Chapter 1 推荐系统概论 | Introduction to Recommendation Systems
> 1. 推荐系统(Recommendation System):通过算法预测用户对物品的偏好,主动为用户提供个性化内容、商品或服务的系统,是解决信息过载的核心工具。 > 2. 协同过滤(Collaborative Filtering, CF):推荐系统最经典的算法范式,核心逻辑是“物以类聚,人以群分”,
直接开始第一段正文内容,阐述本章要讨论的核心问题。不需要任何标题或开场白。
推荐系统(Recommendation System)是通过算法预测用户对物品的偏好,主动为用户提供个性化内容、商品或服务的智能系统,是当前解决信息过载(Information Overload)问题的核心工具。据2024年Statista统计,全球推荐系统市场规模已达215亿美元,预计2028年将增长至680亿美元,年复合增长率超过33%,是增长最快的AI应用领域之一。从你每天刷到的抖音短视频、网易云音乐的每日推荐,到淘宝的“猜你喜欢”、LinkedIn的人脉推荐,推荐系统已经深度融入现代人的数字生活,成为连接用户与信息的核心枢纽。As an intelligent system that predicts user preferences for items and proactively provides personalized content, goods or services, the recommendation system is the core tool to solve the problem of information overload. According to 2024 Statista statistics, the global recommendation system market has reached 21.5 billion US dollars, and is expected to grow to 68 billion US dollars by 2028, with a compound annual growth rate of over 33%, making it one of the fastest-growing AI application fields. From the Douyin short videos you watch every day, the daily recommendations of NetEase Cloud Music, to Taobao's "Guess You Like" and LinkedIn's people recommendation, recommendation systems have been deeply integrated into the digital life of modern people, becoming the core hub connecting users and information.
1.1 推荐系统的定义与核心价值 | Definition and Core Value of Recommendation Systems
1.1.1 什么是推荐系统?| What is a Recommendation System?
从技术本质来看,推荐系统是一个“信息匹配引擎”,其核心目标是最大化用户获取有用信息的效率。我们可以用一个简单的公式来量化这一目标:$$\eta = \frac{R_{relevant}}{T_{user}}$$其中$\eta$代表信息匹配效率,$R_{relevant}$是用户在一定时间内找到的有用信息的数量,$T_{user}$是用户花费的时间。推荐系统的核心作用就是通过算法提升$\eta$,让用户在更短的时间内找到更多符合自己需求的内容。 From a technical perspective, a recommendation system is an "information matching engine", and its core goal is to maximize the efficiency of users obtaining useful information. We can use a simple formula to quantify this goal: $$\eta = \frac{R_{relevant}}{T_{user}}$$where $\eta$ represents the information matching efficiency, $R_{relevant}$ is the number of useful information users find in a certain period of time, and $T_{user}$ is the time spent by users. The core function of the recommendation system is to improve $\eta$ through algorithms, so that users can find more content that meets their needs in a shorter time.
推荐系统的核心输入包括三类数据:第一类是用户特征数据,包括用户的年龄、性别、地域等静态属性,以及浏览、点击、购买、收藏等动态行为数据;第二类是物品特征数据,包括商品的品类、价格、参数,内容的主题、时长、作者等属性;第三类是上下文特征数据,包括用户使用产品的时间、地点、设备,当前的季节、热点事件等。这三类数据共同构成了推荐系统的决策基础。 The core inputs of a recommendation system include three types of data: the first is user feature data, including static attributes such as user's age, gender, region, and dynamic behavior data such as browsing, clicking, purchasing, and collecting; the second is item feature data, including attributes such as product category, price, parameters, and content theme, duration, author, etc.; the third is context feature data, including the time, location, and device when the user uses the product, as well as the current season, hot events, etc. These three types of data together form the decision-making basis of the recommendation system.
> [!TIP] 电子版侧边栏扩展 > 你平时刷抖音时,推荐系统不仅会记录你点赞、评论的行为,还会记录你停留的时长、是否快速划过、是否重复观看,甚至你滑动屏幕的速度,这些隐式反馈(Implicit Feedback)比显式的点赞、收藏更能反映你的真实偏好。
1.1.2 推荐系统的核心价值 | Core Value of Recommendation Systems
推荐系统的价值可以从用户、平台、社会三个维度来理解: The value of recommendation systems can be understood from three dimensions: users, platforms, and society.
对用户的价值:降低信息获取成本,提升体验 | Value to Users: Reduce information acquisition costs and improve experience 在推荐系统普及之前,用户获取信息主要依赖主动搜索和被动浏览:比如想找一本喜欢的书,需要逛书店几个小时,或者翻几十页搜索结果;想找一部符合口味的电影,需要看几十条影评才能决定。推荐系统出现后,用户只需要提供少量的初始反馈(比如给几部电影打分,或者浏览几个商品),系统就可以主动推送符合用户偏好的内容,将信息获取的效率提升数倍甚至数十倍。以Netflix为例,其官方数据显示,80%的用户观看内容来自推荐系统的推送,用户每年因为推荐节省的找内容时间超过100小时。 Before the popularization of recommendation systems, users mainly relied on active search and passive browsing to obtain information: for example, if you want to find a favorite book, you need to spend a few hours in a bookstore, or turn through dozens of pages of search results; if you want to find a movie that suits your taste, you need to read dozens of movie reviews before making a decision. After the emergence of recommendation systems, users only need to provide a small amount of initial feedback (such as rating a few movies, or browsing a few products), and the system can actively push content that matches the user's preferences, improving the efficiency of information acquisition by several times or even dozens of times. Taking Netflix as an example, its official data shows that 80% of users' viewing content comes from the push of the recommendation system, and users save more than 100 hours a year in finding content thanks to recommendations.
对平台的价值:提升留存与营收,降低运营成本 | Value to Platforms: Improve retention and revenue, reduce operating costs 对于互联网平台而言,推荐系统是提升用户留存、增加营收的核心工具。以电商平台为例,亚马逊官方数据显示,其35%的营收来自推荐系统的推送,推荐系统的投入产出比超过1:30,即每投入1美元在推荐系统上,可以带来30美元的营收增长。对于内容平台而言,推荐系统可以大幅提升用户的停留时长和留存率:字节跳动的内部数据显示,抖音