# Cross-entropy in bars and language trees > A mathematical explainer connects compression and language prediction to cross-entropy, using color-coded probability bars, branching trees, equations, loss surfaces, and paired distribution diagrams. - Kind: Video - Page: https://meetreference.com/v/video-cross-entropy-in-bars-and-language-trees-94bec7/ - Ready-to-use agent handoff: https://meetreference.com/v/video-cross-entropy-in-bars-and-language-trees-94bec7/agent.txt - Authorship: Not stated - Made with: Not stated - Model: not stated - Built with: Manim - Style: Math & science; diagrammatic, minimalist, color-coded, typographic, educational - Length and format: 2 min, 16:9 (1280x720 source) - Playback: a muted visual reference. The original soundtrack is available only at the source. - Shared by 3Blue1Brown in YouTube, Jul 16, 2026: https://www.youtube.com/watch?v=GlYgs6v2YfU - Prompt fidelity: Unavailable in this entry. The recreation brief is written by Reference. ## Before you start Guidance from Reference, separate from the creator's instructions. 1. Read the reference and inspect the project, installed libraries, and available agent skills before writing code. Reuse suitable tools already present. 2. Prefer the creator-reported libraries and skills when they fit the task. Explain what useful additions help with, and install missing project dependencies or relevant skills from official sources when the environment and the user's existing permissions allow it. Respect the project's package manager and setup rules; do not ask again for routine setup already authorized. 3. Distinguish tools used by the creator from your own recommendations. A listed tool is not automatically required, and an empty tools or requirements list means the setup is unknown, not that nothing is needed. 4. Ask concise questions when missing inputs or choices materially affect the result: paid services, credentials, the user's assets, or a different production approach. Use existing answers and permissions; continue independent work while waiting. 5. If a useful library, skill, or service cannot be installed or used, explain an available alternative and its expected effect on quality, features, or effort. Get the user's choice before a material compromise; otherwise state the fallback and continue. Never silently simplify the result or claim to have used a tool you did not use. ## Recreating this video This is a visual reference. No original creator prompt is available. The following brief was written by Reference after inspecting the work. Adapt the color-linked equation-and-diagram approach to another abstract topic, such as risk or resource allocation. Assign each variable a stable accent color and reuse it in labels, bars, and formulas. Pair a concrete worked example with a side-by-side comparison before introducing the general expression. 1. Open the live work or source and inspect the frame images below. 2. Adapt its layout, hierarchy, palette, and interaction patterns to the user's own content and brand. 3. Compare the result against the reference. Use your own assets and credit the original creator. ## What it looks like Written by Reference from the video frames, not by the creator. A dark, technical explainer visualizes loss as a red surface over a gridded landscape, alongside formulas, neural-network diagrams, and training-data examples. - Color: Black backgrounds with coral red and orange surfaces, teal grid lines and accents, and white or pale-gray text. - Type: Serif headings and body text paired with italic mathematical notation and symbols. - Framing: The red loss surface and its vertical loss marker sit above perspective grids; formulas and small diagrams appear beside or near the visualizations, with text examples presented in separate sections. - Structure: Connected educational graphics progress from loss-surface illustrations and notation to gradient descent, backpropagation, training data, and the statement “Loss = Information.” Storyboard, nine frames spread across the video: https://meetreference.com/media/video-cross-entropy-in-bars-and-language-trees-94bec7/storyboard.webp - Frame 1 at 5.0s: https://meetreference.com/media/video-cross-entropy-in-bars-and-language-trees-94bec7/f1.webp - Frame 2 at 15.0s: https://meetreference.com/media/video-cross-entropy-in-bars-and-language-trees-94bec7/f2.webp - Frame 3 at 25.0s: https://meetreference.com/media/video-cross-entropy-in-bars-and-language-trees-94bec7/f3.webp - Frame 4 at 35.0s: https://meetreference.com/media/video-cross-entropy-in-bars-and-language-trees-94bec7/f4.webp - Frame 5 at 45.0s: https://meetreference.com/media/video-cross-entropy-in-bars-and-language-trees-94bec7/f5.webp - Frame 6 at 55.0s: https://meetreference.com/media/video-cross-entropy-in-bars-and-language-trees-94bec7/f6.webp - Frame 7 at 65.0s: https://meetreference.com/media/video-cross-entropy-in-bars-and-language-trees-94bec7/f7.webp - Frame 8 at 75.0s: https://meetreference.com/media/video-cross-entropy-in-bars-and-language-trees-94bec7/f8.webp - Frame 9 at 85.0s: https://meetreference.com/media/video-cross-entropy-in-bars-and-language-trees-94bec7/f9.webp ## How it was made, per the creator - Notes: Reference shows a muted excerpt from 16:10 to 17:40. Watch the complete video at the original source. ## Links - Watch: https://www.youtube.com/watch?v=GlYgs6v2YfU - Original post: https://www.youtube.com/watch?v=GlYgs6v2YfU - Discovery collection: https://www.youtube.com/@3blue1brown/videos