Theoretical Foundations of Short-Form Video Semiotics

The semiotic system of short-form video represents a paradigm shift in visual communication, emerging not as a mere truncation of cinematic language but as a distinct symbolic ecology adapted to the cognitive constraints and platform affordances of the mobile-first era. This chapter establishes the theoretical foundation for analyzing短视频 as an autonomous semiotic structure, tracing its evolution from film grammar through digital-native syntax, and proposing a unified analytical framework that integrates cognitive load theory, attention economics, and platform-specific design parameters. At its core, short-form video operates under fundamentally different semiotic conditions than traditional film or television: average viewing durations of 1.7 seconds per shot on TikTok compared to 2.5-3 seconds in classical Hollywood cinema, vertical aspect ratios that reconfigure spatial composition, and algorithmic curation that transforms passive viewership into interactive decision-making processes. These are not superficial variations but constitute a new grammar where meaning is constructed through rapid syntactic combinations rather than prolonged semantic development.

The historical trajectory from cinematic language to digital-native grammar reveals three pivotal transformations. First, the democratization of production tools shifted authorship from specialized technicians to mass participants, fragmenting established conventions. Second, the migration from theatrical and broadcast screens to handheld devices altered viewing contexts from sustained attention to fragmented micro-engagements. Third, platform architectures introduced algorithmic mediation as a co-creator of meaning, where recommendation systems actively shape narrative comprehension through sequencing. Consider the evolution of the "shot-reverse-shot" convention: in classical cinema, this dialogue pattern establishes spatial relationships and emotional rhythms over extended sequences. In short-form video, the same convention manifests as a 0.8-second cut pattern where the reverse shot often contains a reaction meme or a textual overlay, transforming spatial continuity into emotional punctuation. This adaptation exemplifies what media scholar Henry Jenkins termed "convergence culture" taken to its logical extreme—where cinematic syntax is not just consumed but actively remediated by users within platform constraints.

Core terminology must be precisely defined to establish analytical rigor. Shot language refers to the combinatorial system of visual elements (duration, angle, motion, composition) that function as morphemes in the video's syntactic structure. Unlike film shot language that emphasizes continuity and development, short-form shot language prioritizes instant recognizability and emotional resonance. A "hook shot" (first 0.5 seconds) employs high-contrast colors, abrupt motion, or facial close-ups to trigger orienting responses, while a "payoff shot" delivers the narrative or comedic resolution within 1-2 seconds. Narrative hook extends beyond traditional storytelling concepts to encompass any mechanism that interrupts scrolling behavior and initiates watch-time commitment. This includes not only story openings but also curiosity gaps ("You won't believe what happened next"), social validation cues ("This trick saved me 10 hours"), and sensory triggers (ASMR sounds, sudden visual changes). Temporal compression describes the ratio of narrative time to screen time, where complex events are condensed through ellipsis, montage, or symbolic substitution. A 15-second recipe video might compress hours of cooking into 8 key shots, each representing categorical actions rather than literal continuity. Additional essential terms include: scroll velocity (the rate at which users skip content, typically 0.3-0.5 seconds per swipe), retention curve (the percentage of viewers remaining at each timestamp, with critical drop-off points at 0.3s, 1s, and 3s), platform affordance (technical and cultural features enabling specific expressions, such as TikTok's duet function or Instagram's sticker array), and algorithmic resonance (the degree to which content matches platform-specific engagement patterns that trigger distribution).

The unified analytical model proposed here integrates three theoretical streams. Cognitive load theory provides the foundation for understanding why short-form video structures differ from long-form content. Sweller's distinction between intrinsic load (inherent complexity of content), extraneous load (presentation-induced complexity), and germane load (processing for schema construction) becomes operationalized through metrics like information density per second and schema activation latency. A typical TikTok video maintains intrinsic load through familiar formats (dance, comedy, tutorial) while minimizing extraneous load via consistent framing and predictable editing patterns. The germane load—where viewers actually learn or are persuaded—is maximized through "aha moments" placed at 2-3 second intervals, aligning with the average attention restoration cycle. Consider a DIY craft video: the first shot shows finished product (schema activation), subsequent shots use repetitive motions (reducing extraneous load), and the final reveal creates germane load through surprise transformation. This structure reflects an optimized cognitive pipeline where each shot serves a specific load-management function.

Attention economics refines this model by quantifying the scarcity of viewer attention as a transactional resource. The attention marketplace operates on principles of supply (infinite content) and demand (finite daily attention minutes, averaging 52 minutes across platforms for US adults). Short-form videos compete in micro-auctions where initial 0.3 seconds determine whether attention is "purchased." Key economic concepts include attention debt (when creators borrow attention through hooks but fail to deliver value, causing future content to be deprioritized), attention arbitrage (exploiting platform-specific attention curves, such as posting during low-competition hours), and attention compounding (when early engagement triggers algorithmic amplification, creating exponential reach). Platform-specific affordances introduce the third dimension: each platform's technical constraints and cultural norms shape the semiotic possibilities. TikTok's full-screen vertical format with overlay UI elements creates a layered semiotic space where primary content (video), secondary content (text overlays), and tertiary content (UI buttons) compete for attention but also create meaning through juxtaposition. Instagram Reels' emphasis on aesthetic curation favors higher production values, while YouTube Shorts' integration with long-form content creates hybrid narrative strategies where shorts serve as trailers or supplementary material.

The micro-narrative analysis framework operationalizes these theories through a four-layer model. Layer 1: Temporal Architecture maps the video's timeline onto critical engagement thresholds: the 0.3-second orienting response window, the 1-second commitment point (where 40% of viewers drop off), the 3-second retention checkpoint (where successful videos retain 60-70% of initial viewers), and the completion milestone. Each layer contains specific semiotic functions: the first shot must trigger an orienting response through novelty or familiarity, the first three shots must establish a question or promise, the middle section develops the promise through pattern recognition, and the final shot delivers resolution while encouraging engagement (like, share, follow). Layer 2: Spatial Composition analyzes vertical framing conventions: the "safe zone" (central 60% where key action occurs despite UI obstructions), the "thumb-zone" (upper portion visible when scrolling), and the "interaction zone" (areas wher