Each project arrives with its purpose, milestones and first tasks written out. Here is how the first three read.
Recommendation surface inventory and slot goals
Before choosing an algorithm, list every place the product shows suggestions: the home feed, the product page carousel, the basket add-on row, the email digest and the empty search result. Each slot has a different job, such as discovery, completing a basket or bringing a lapsed user back, and one model tuned for clicks will serve some of them badly.
First tasks
- Screenshot every place the product currently suggests items to users
- Pull last month's impression counts for each recommendation slot
- Write one goal and one guardrail metric per surface with its owner
- Rank the surfaces by traffic and by the gap between goal and current logic
Impression and interaction logging for recommendations
Most teams log clicks and purchases but not what was shown, in which position and by which model version, and without impressions you cannot tell an ignored item from one never seen. Fixing the event schema now is far cheaper than discovering a year from now that none of the history supports training, position bias correction or off-policy evaluation.
First tasks
- List the fields your current click events carry and which are missing
- Add request ID, position and model version to the impression event
- Join a day of clicks to impressions and measure the join rate
- Document the event schema in the team's repository
Item catalogue and metadata readiness check
Content-based features, cold start fixes and business filters all depend on the item catalogue, and catalogues are rarely as clean as product teams believe. Measuring how many items have a category, description, image, price and live availability flag shows which approaches are possible now and which need catalogue work first.
First tasks
- Export the item catalogue with every metadata field to a working table
- Calculate fill rates for each field across live items
- Decide how product variants group into one recommendable item
- Send the ranked list of catalogue gaps to the catalogue owner