The New Frontier: When Code Meets Law
第一章:新前沿:当代码遇上法律
The New Frontier: When Code Meets Law
---
2021年3月的一个深夜,位于美国东海岸的斯坎恩医疗系统(Scane Health System)总部大楼几乎空无一人。 只有急诊室的灯光依然明亮,监护仪的蜂鸣声在走廊里此起彼伏。凌晨2点17分,位于数据中心值班的IT工程师马库斯·陈(Marcus Chen)正准备去休息室泡一杯咖啡,却突然注意到监控屏幕上闪过一连串异常警报。他揉了揉眼睛,以为是自己太疲惫产生了幻觉。但警报声越来越密集,屏幕上开始弹出一个又一个红色窗口。
"这不可能,"马库斯喃喃自语,手指飞快地在键盘上敲击,试图登录系统核心数据库。然而,每次输入凭证后,等待他的只有那个令人窒息的黑色屏幕,以及一行不断闪烁的绿色文字:
> *"Your files are encrypted. Your business is at stake. You have 48 hours to decide. After that, the price goes up. After 7 days, all your data will be destroyed. Payment accepted in Bitcoin only."* > > *"您的文件已被加密。您的业务危在旦夕。您有48小时做出决定。逾期之后,价格将会上涨。七天之后,您的所有数据将被彻底销毁。只接受比特币支付。"*
就在马库斯试图理解发生了什么的同时,整栋大楼的电子门禁系统突然失灵。护士站的电脑屏幕变成了同样的勒索界面。手术室的预约系统完全瘫痪。药房调配系统拒绝响应任何指令。更糟糕的是,放射科的影像存档与传输系统(PACS)——存储着数十万份患者CT扫描、MRI影像和X光片——全部被锁定。医生们无法调取患者的历史影像记录,无法进行手术排期,甚至无法确认哪位患者对某种药物过敏。
斯坎恩医疗系统并不是孤例。在接下来的72小时内,这场名为"暗影医疗"(DarkMed)的勒索软件攻击席卷了美国境内至少六家大型医院网络,超过1500万患者的医疗记录被锁定或外泄。其中一家医院不得不将救护车转向50英里外的其他医疗机构,另一家医院的癌症患者因为无法调取化疗方案而被迫中断治疗。宾夕法尼亚州的一位急诊医生后来在国会作证时说:"那一刻,我突然意识到,我们对数字系统的依赖程度已经超出了任何人的想象。当系统崩溃时,我们就像被蒙住双眼的外科医生,手里握着手术刀,却不知道该往哪里切。"
这场攻击最终造成超过2.3亿美元的直接经济损失,但真正的代价恐怕永远无法用金钱衡量:至少有17名患者因为延误治疗而病情恶化,其中3人不幸离世。联邦调查局后来追踪到攻击源头是一群位于东欧的网络犯罪分子,但追责之路漫长而艰难。当国会议员们试图制定应对方案时,他们发现自己面对的是一个前所未有的困境:应该如何定义这种攻击的性质?它是一场网络恐怖主义行为,还是普通的敲诈勒索?谁应该为医院的网络安全漏洞负责——医院管理层、软件开发公司、还是政府监管部门?
这个故事并非孤例。从2017年的"想哭"(WannaCry)勒索软件攻击导致英国国民健康服务体系(NHS)数万台电脑瘫痪,到2021年Colonial Pipeline输油管道被攻击后美国东海岸燃油供应一度中断;从Facebook算法放大仇恨言论导致缅甸罗兴亚人危机,到亚马逊仓库算法对工人实施"压榨式"管理;从Zoom因隐私漏洞被多国学校停用,到TikTok算法被指影响青少年心理健康——我们正在见证一个深刻变革的到来:代码不再只是运行在实验室里的抽象逻辑,它已经成为塑造现实世界的权力工具;而法律,这套人类社会数千年来的规则体系,正艰难地试图追赶上这个新的现实。
This scene from March 2021 captures something profound about our present moment. When Marcus Chen watched those red alerts cascade across his screen, he wasn't just witnessing a technical failure. He was watching the moment when the abstract world of code became terrifyingly, undeniably real. Every encrypted file represented a patient whose surgery might be delayed. Every locked database meant a doctor working blind. The digital and the physical—once thought to be separate realms—had collided with devastating force.
This book is about that collision. It is about what happens when the invisible infrastructure of ones and zeros that now governs our banks, our hospitals, our elections, our relationships, and our daily lives suddenly becomes visible, consequential, and contested. It is about the struggle to apply rules written for a world of atoms to a world increasingly governed by algorithms. And it is about the profound question facing every society on Earth: how do we govern the digital age without sacrificing the values that define us?
当代码获得力量:从工具到权力
For three centuries, Western legal systems operated on a fundamental assumption: responsibility flows through hierarchy. The manufacturer is responsible for a defective product. The employer is responsible for an employee's actions within the scope of employment. The government is responsible for its agents' conduct. This chain of accountability was designed for a world where humans made decisions, institutions organized human activity, and physical goods dominated economic life.
But what happens when the decision-maker is not a person but a pattern recognition system trained on petabytes of data? What happens when the organization coordinating millions of transactions is not a corporation with a board of directors but an algorithm that learns and evolves without human intervention? What happens when the "product" is not a physical object with clear boundaries but an information flow that copies itself infinitely and adapts to every user differently?
These are not hypothetical questions. They are the daily reality of the 2020s. Consider the following scenarios that our legal systems are currently struggling to address:
The Autonomous Vehicle Dilemma: In 2018, a self-driving car operated by Uber struck and killed Elaine Herzberg in Tempe, Arizona. The car's sensors detected the pedestrian, but the software classified her as a "false positive"—a static object that posed no threat—and continued forward. The safety driver, Rafaela Vasquez, was watching videos on her phone. The victim was jaywalking with a bicycle. Who bears moral and legal responsibility? The engineer who trained the model? The company that deployed it commercially? The safety driver who failed to intervene? The regulatory body that approved the vehicle for public roads? Or should we blame the algorithmic decision itself—a decision that was neither intended nor foreseen by any human being?
The Social Media Amplification Problem: Internal documents from Facebook (now Meta) reveal that the platform's algorithm prioritizes "engagement"—and that inflammatory, divisive content generates more engagement than nuanced, accurate information. The algorithm doesn't "want" to spread misinformation or incite violence. It simply optimizes for its objective function. Yet research has linked Facebook's recommendation systems to ethnic violence in Myanmar, the January 6th Capitol attack, and declining mental health among teenage girls. When does an algorithm's optimization become a crime? And who is the criminal?
The Predictive Policing Paradox: Cities across America have deployed algorithmic systems to predict where crimes are likely to occur and allocate police patrols accordingly. These systems achieve their stated goal—they do predict crime hotspots. But critics argue they merely reinforce existing patterns of over-policing in minority neighborhoods, creating a self-fulfilling prophecy. If an algorithm tells police to flood a Black neighborhood with patrols, they will inevitably find more arrests there—which "proves" the algorithm was right—which justifies more patrols. The algorithm didn't discriminate on the basis of race. It discriminated on the basis of past arrests. But in a society with a documented history of racially biased policing, is there any meaningful difference?
Each of these cases reveals the same uncomfortable truth: the traditional tools of law—intention, causation, duty of care, proportionality—were designed for human actors with human cognition, human intentions, and human accountability. They are struggling to adapt to a world where consequential decisions are increasingly made by systems that process information faster than any human could, adapt their behavior based on data that humans cannot fully comprehend, and operate at a scale that exceeds any human organization's capacity for oversight.
This is not merely a technical problem. It is a governance crisis. For the first time in human history, a small group of private companies—most notably the American giants Google, Apple, Meta (Facebook), Amazon, and Microsoft, along with their Chinese counterparts Baidu, Alibaba, and Tencent—exercise control over technological infrastructure that rivals or exceeds that of nation-states. These companies are not elected. They are not subject to the same legal constraints as governments. And their products—search algorithms, social feeds, recommendation engines, automated decision systems—are embedded in virtually every aspect of modern life.
Meanwhile, the institutions that traditionally regulate powerful actors—legislatures, courts, regulatory agencies—were largely designed in the 18th and 19th centuries, when the primary concerns were territorial sovereignty, trade regulation, and criminal justice. They lack the technical expertise, the jurisdictional reach, and often the political will to effectively govern the digital giants. When Senator Orrin Hatch asked Mark Zuckerberg in 2018 how Facebook sustains a business model offering a free service, he received what was perhaps the most honest answer any tech CEO has ever given: "Senator, we run ads."
The result is a profound accountability gap. Billions of people entrust their personal data, their social connections, their information diets, and increasingly their financial lives to platforms w