Recommender systems
Strava | 11C: Present properties of system outputs
Pinterest | 11A: Local explanations
Apple Music | 10B: Avoid cold starts by eliciting user preferences
Microsoft News | 10B: Avoid cold starts by eliciting user preferences
Instagram | 9D: Do G9 through G15
Google Maps | 9B: Rich and detailed edits
Google Maps | 2D: Provide low performance alerts
Kayak | 2C: Report system performance information
Pattern 15C: Reporting inappropriate content
Problem User feedback is needed to identify problematic or inappropriate system outputs. Solution Implement a user-feedback mechanism at each item or instance of system output, enabling the user to flag output that is problematic, wrong, offensive, biased, or otherwise inappropriate. Leverage user feedback to identify biased, offensive, or otherwise inappropriate system outputs. Use when How […]
Pattern 15B: Request explicit feedback on selected system outputs
Problem User feedback is needed to assess the system and help it improve over time. Solution Implement a user-feedback mechanism that occasionally asks the user to provide explicit feedback for selected items or instances of system outputs. The system initiates the feedback interaction. Leverage user feedback for: Use When How Decide what type of feedback […]
Pattern 15A: Encourage explicit feedback on individual system outputs
Problem User feedback is needed to assess the system and help it improve over time. Solution Implement a user-feedback mechanism that enables the user to provide explicit feedback at each item or instance of system output. The user initiates the feedback interaction. Leverage user feedback for: Use when How Decide what type of feedback to […]
Pattern 14B: Immediate, partial, non-disruptive updates
Problem The system adapts in response to user interaction and is at risk of disrupting or disorienting the user. Solution The system makes an immediate, but local update that maintains, to a large extent, the previous state. Use when How Collaborate with an AI/ML practitioner to: When making the update, consider: User benefits Common pitfalls […]