数据分析的世界:你身边的数据魔法 / The World of Data Analysis: Data Magic Around You
The World of Data Analysis: Data Magic Around You
理解数据:类型、来源和数据生态系统
What Exactly Is Data? / 数据究竟是什么?
When your teacher hands back a test with a big red "92" circled at the top, that's data. When you check how many "likes" your latest Instagram post received, that's data too. When your parents decide which route to take to avoid traffic based on a navigation app's recommendation, they're using data. Data is not some mysterious substance that only scientists and programmers can understand—it's the raw material of information, and it's everywhere in your daily life.
数据究竟是什么?当你看到试卷上老师用红笔圈出的"92"分时,那是数据;当你查看 Instagram 帖子的点赞数量时,那是数据;当你父母根据导航软件的建议选择避开拥堵的路线时,他们也在使用数据。数据并非只有科学家和程序员才能理解的神秘物质——它是信息的基本原料,就存在于你日常生活的每一个角落。
At its most fundamental level, data is simply a recorded measurement or observation. Think of it as a snapshot of reality that can be stored, analyzed, and used to make decisions. The word "data" comes from the Latin word *datum*, meaning "something given." In the context of data analysis, this etymology reminds us that data represents facts that have been collected or "given" to us through observation and measurement.
从最根本的层面来看,数据就是一条被记录的测量结果或观察结果。把它想象成现实的快照——可以被存储、分析,并用来做决策。"数据"这个词源自拉丁语 *datum*,意为"被给予的东西"。在数据分析的语境中,这个词源提醒我们:数据代表的是通过观察和测量收集来的事实。
Types of Data: Qualitative vs. Quantitative / 数据类型:定性数据与定量数据
Data comes in two fundamental flavors, and understanding the difference will help you see the analytical possibilities in every situation you encounter.
数据有两种基本类型,理解它们之间的区别将帮助你发现日常生活中无处不在的分析可能性。
Quantitative data / 定量数据 is numerical information that can be measured and expressed with numbers. When you record your height as 165 centimeters, your monthly phone bill as $45.50, or the number of students in your class as 32—these are all quantitative data points. Quantitative data is further divided into two categories:
定量数据是可以用数字测量和表达的数值信息。当你记录身高为165厘米、月手机账单为45.50美元、或班级学生数为32人时,这些都是定量数据点。定量数据进一步分为两类:
- **Discrete data / 离散数据** represents values that can only take specific, separate values. The number of students in a classroom (you can't have half a student) or the number of apps on your phone are discrete data points. These values are typically counted in whole numbers.
- **离散数据**只能取特定的、独立的值。教室里的学生人数(不可能有半个学生)或手机上的应用数量都是离散数据点。这些值通常以整数计数。
- **Continuous data / 连续数据** can take any value within a range. Your height could be 165.234 centimeters, your weight could be 52.789 kilograms, or the temperature could be 23.5 degrees. These measurements can be infinitely precise, limited only by the precision of our measuring instruments.
- **连续数据**可以在一个范围内取任意值。你的身高可以是165.234厘米,体重可以是52.789公斤,温度可以是23.5度。这些测量值可以无限精确,仅受测量工具精度的限制。
Qualitative data / 定性数据 describes characteristics or qualities that cannot be expressed with numbers. When you describe your favorite color as blue, your personality as "extroverted," or your favorite music genre as "indie rock"—these are qualitative observations. Qualitative data helps us understand the "why" behind the numbers, adding context and meaning to our quantitative findings. In business analytics, qualitative data often comes from customer interviews, open-ended survey responses, or social media comments.
定性数据描述的是无法用数字表达的特征或性质。当你把最喜欢的颜色描述为蓝色、性格描述为"外向"、或最爱的音乐类型描述为"独立摇滚"时,这些都是定性观察。定性数据帮助我们理解数字背后的"原因",为定量发现增添背景和意义。在商业分析中,定性数据通常来自客户访谈、开放式问卷调查或社交媒体评论。
The Data Ecosystem: Where Does All This Data Come From? / 数据生态系统:所有这些数据从何而来?
Every day, humanity generates an astonishing amount of data—approximately 328 million terabytes of new data every single day. But where does it all come from? Understanding the sources of data helps you appreciate the vast ecosystem that surrounds modern data analysis.
每天,人类产生令人震惊的数据量——大约每天3.28亿 TB 的新数据。但这一切都从何而来?了解数据的来源能帮助你理解围绕现代数据分析的庞大生态系统。
Structured data / 结构化数据 is organized in a predefined format, typically in rows and columns. Think of a spreadsheet where each column represents a specific attribute (like name, age, grade level) and each row represents a single record (a specific student). Excel spreadsheets, database tables, and CSV (Comma-Separated Values) files are all examples of structured data. This organization makes structured data relatively easy to analyze because the format is consistent and predictable.
结构化数据以预定义的格式组织,通常是行和列的形式。想象一个电子表格,每一列代表一个特定属性(如姓名、年龄、年级),每一行代表一条单独记录(一个特定学生)。Excel 电子表格、数据库表和 CSV(逗号分隔值)文件都是结构化数据的例子。这种组织方式使结构化数据相对容易分析,因为格式一致且可预测。
Unstructured data / 非结构化数据 has no predefined organization—it doesn't fit neatly into rows and columns. This category includes text documents, emails, social media posts, images, audio recordings, and video files. While unstructured data makes up approximately 80% of all data generated worldwide, it requires more sophisticated techniques (like natural language processing or computer vision) to analyze. For now, you'll be working primarily with structured data, but it's important to know that the data world is much larger than just spreadsheets.
非结构化数据没有预定义的组织方式——它不能整齐地放入行和列中。这类数据包括文本文档、电子邮件、社交媒体帖子、图片、音频录音和视频文件。尽管非结构化数据约占全球生成数据的80%,但分析它需要更复杂的技术(如自然语言处理或计算机视觉)。目前,你将主要处理结构化数据,但重要的是要知道数据世界远不止电子表格那么大。
The data ecosystem / 数据生态系统 encompasses all the systems, technologies, and processes that work together to collect, store, process, and analyze data. Just as a natural ecosystem includes organisms, their habitats, and the interactions between them, a data ecosystem includes data sources (where data originates), data storage systems (databases, data warehouses, data lakes), data processing tools (Excel, Python, SQL), and the people who use these tools to extract insights.
数据生态系统包含了收集、存储、处理和分析数据的所有系统、技术和过程。就像自然生态系统包含生物、它们的栖息地以及它们之间的相互作用一样,数据生态系统包括数据源(数据产生的地方)、数据存储系统(数据库、数据仓库、数据湖)、数据处理工具(Excel、Python、SQL),以及使用这些工具提取洞察的人。
For a teenager, this ecosystem is already part of your daily life. Your school probably uses a student information system that tracks your grades, attendance, and class schedule. Online platforms like YouTube or Spotify use algorithms to recommend content based on your viewing or listening history. Your phone's health app tracks your steps, sleep patterns, and heart rate. All these systems are part of the vast data ecosystem that surrounds you—and understanding how they work is the first step toward becoming a data-savvy individual.
对于青少年来说,这个生态系统已经是你日常生活的一部分。你的学校可能使用学生信息系统来追踪你的成绩、出勤率和课程表。像 YouTube 或 Spotify 这样的在线平台使用算法根据你的观看或收听历史来推荐内容。你手机上的健康应用追踪你的步数、睡眠模式和心率。所有这些系统都是围绕你的庞大数据生态系统的一部分——理解它们如何工作是成为数据素养个体的第一步。
数据分析流程:从问题定义到洞察发现
What Is Data Analysis, Really? / 数据分析到底是什么?
Now that you understand what data is, let's address the central question of this chapter: What is data analysis, and why should you care about it?
现在你已经理解了什么是数据,让我们来回答本章的核心问题:什么是数据分析,为什么你应该关心它?
Data analysis / 数据分析 is the systematic application of statistical, computational, or analytical techniques to describe, interpret, and derive meaningful insights from data. But this definition, while accurate, doesn't capture the excitement of what data analysis really enables you to do. At its core, data analysis is about transformation—turning raw, seemingly meaningless numbers into actionable knowledge that can guide decisions and solve real problems.
数据分析是对统计、计算或分析技术的系统应用,用于描述、解释和从数据中获取有意义的洞察。但这个定义虽然准确,却没有捕捉到数据分析真正让你做到的事情的兴奋感。从本质上讲,数据分析是关于转化的——将原始的、看似无意义的数字转化为可操作的知識,能够指导决策并解决实际问题。
Think of a data analyst as a detective. A detective examines evidence, looks for patterns, asks questions, and ultimately tries to solve a mystery or answer a question. A data analyst does the same thing with data—they examine datasets, look for patterns and trends, ask questions of the data, and ultimately try to answer business questions or solve organizational problems. The "alchemy" in this book's title refers to this magical transformation: turning the "lead" of raw data into the "gold" of valuable insights.
把数据分析师想象成侦探。侦探检查证据、寻找模式、提出问题,最终试图解开谜团或回答问题。数据分析师用数据做同样的事情——他们检查数据集、寻找模式和趋势、向数据提出问题,最终试图回答业