Build a small content-based recommender, exclude already-seen items and evaluate a documented reranking rule.
A fictional learner prefers the topic vector [2,1,0] for data, project and design content. Four items have binary vectors: A=[1,0,0], B=[1,1,0], C=[0,0,1], D=[0,1,1]. Item A is already seen. Rank by dot product, break ties by item ID and return two unseen items.
| Item | Data | Project | Design | Already seen |
|---|---|---|---|---|
| A | 1 | 0 | 0 | yes |
| B | 1 | 1 | 0 | no |
| C | 0 | 0 | 1 | no |
| D | 0 | 1 | 1 | no |
Candidate generation, scoring and reranking solve different problems. A small catalog can score every eligible item, while a large one often narrows candidates first. State eligibility separately from preference. The case uses one fictional profile and does not infer a real person’s interests from browsing behavior.
Draw the eligible-items → score → rank → top-two pipeline.
Pipeline specification
Record your result and evidence here or in a separate file.
Seen-item exclusion is a rule, not a negative preference score.
Move eligibility checks before the final selection.
A dot product rewards overlap weighted by the profile. It is easy to inspect but sensitive to representation and magnitude. Do not call it cosine similarity: that requires normalization. Keep the vector order fixed and explain the meaning of each position so the numbers remain reproducible.
Calculate all four scores and implement the scoring function.
Score table and function
Record your result and evidence here or in a separate file.
Scores are A=2, B=3, C=0 and D=1.
Check the feature order and distinguish the chosen score from other similarities.
A deterministic tie rule makes tests and explanations stable. Filter seen items before taking the top results; otherwise the list can be too short or contain repeats. Consider what happens when fewer eligible items remain than requested. Returning fewer is more honest than inserting an ineligible item.
Produce the top two unseen items and test a nearly exhausted catalog.
Ranking function and edge cases
Record your result and evidence here or in a separate file.
The case returns B then D; no seen item is returned.
Apply the eligibility predicate before slicing the ranked list.
A reranker can impose diversity, freshness or other constraints, but every rule has a trade-off. Explain what it changes and why. The case can test mechanics, not real satisfaction. A policy that promotes a low-scoring item should be visible rather than disguised as the original model score.
Propose a rule requiring a design-tagged item in the top two and show its effect.
Reranking note
Record your result and evidence here or in a separate file.
D already satisfies the rule in the base result; no unnecessary change is made.
Check whether the constraint is already satisfied before altering the ranking.
Offline relevance checks need labeled outcomes or a defensible proxy. This case has neither real engagement nor satisfaction data, so do not invent accuracy or click-through improvements. Test correctness of exclusions and ordering, then outline how a voluntary future evaluation could examine usefulness and unwanted effects.
Write an evaluation plan and a model card for the toy scorer.
Recommendation handoff
Record your result and evidence here or in a separate file.
No real-user performance metric is claimed.
Separate code correctness from recommendation quality.
Deliver the vectors, scorer, exclusion tests, reranking policy and evaluation plan. Add a tied candidate and demonstrate the documented ID ordering.
Eligibility is enforced before selection and the score is not mislabeled as observed satisfaction.
| Criterion | Points | Evidence |
|---|---|---|
| Evidence and correctness | 30 | Calculations, source use and results match the supplied case; limitations are honest. |
| Required artifacts | 30 | All five stage outputs and the capstone handoff are present and inspectable. |
| Reasoning and decisions | 20 | Choices, assumptions, alternatives and the case-specific critical condition are explained. |
| Reproducibility | 10 | A reviewer can follow the stated steps and distinguish expected from observed results. |
| Clear communication | 10 | Labels, units, structure and evidence references make the work easy to review. |
Score at least 80/100, supply every required artifact, and satisfy the path-specific critical condition. Rework missing evidence before marking complete.
With profile [2,1,0], B scores 3 and D scores 1. A scores 2 but is excluded because it is seen; C scores 0. The final order is B, D. The design-diversity rule makes no change because D already carries that tag.
This is a content-based toy recommender, not a personalized production service or an engagement experiment.