斜杠中年斜杠中年AI × 沟通 × 商业 × 人生
AI Research

FLUX 3 — Real World Models: Black Forest Labs' Unified Foundation for Images, Video, Audio, and Action

Black Forest Labs announces FLUX 3 — a single multimodal foundation model jointly trained on images, video, and audio from scratch. Uses the Self-Flow training method, supports video up to 20 seconds with native audio, and extends into physical AI via action prediction. Early access now live.

2026-07-24Updated: 2026-07-248 min readWesley Chong
#FLUX 3#Black Forest Labs#multimodal models#Self-Flow#video generation#Physical AI
FLUX 3 — Real World Models: Black Forest Labs' Unified Foundation for Images, Video, Audio, and Action|AI Research 封面图

Summary

FLUX 3 is the first model built entirely from scratch as a unified multimodal architecture — not a patched-together combination of separate image and video models. Jointly trained across images, video, and audio, it generates all three modalities simultaneously and even predicts robot actions. Early access is now available.

One-Sentence Answer

FLUX 3 is Black Forest Labs' answer to the idea that images, video, audio, and robot actions aren't separate problems at all — they're different projections of the same underlying physical reality, and a model that learns them all together naturally develops a world understanding no single-modality model can match.

A Model Built Jointly, Not Patched Together

The biggest conceptual shift in FLUX 3 isn't about resolution or speed — it's the training philosophy.

Previous models learned modality by modality: train an image model, then add video on top, then bolt on audio. Each new capability required architectural changes and retraining from scratch or heavy fine-tuning. The result was competent but fundamentally fragmented — the model didn't learn that sound must match impact, or that motion must obey physics, because it never saw those constraints expressed simultaneously.

FLUX 3 changes the starting assumption: no single modality provides a complete description of reality.

Images capture spatial structures and relationships at a frozen moment. Videos restore time and reveal physical laws. Audio reveals causal relationships between mechanical phenomena and acoustics that vision alone can't detect. Language links these perceptions to goals and instructions. When a model learns all of them at once, their mutual constraints tell you something none could alone: the future has to follow from the past, the sound has to match the impact, the motion has to obey the mass. The modalities stop being separate and start being evidence about one underlying reality.

That's the core insight behind FLUX 3 — and it's powered by Self-Flow, BFL's approach for aligning multimodal generation and understanding within the same architecture.

What FLUX 3 Actually Does

FLUX 3 mixes modalities natively. It generates images, video-with-audio, and edits both — all from the same backbone. Key capabilities include:

Video (with Native Audio)

  • Text-to-video up to 20 seconds with synchronized audio
  • Image-to-video animation from still frames
  • Video-to-video style/content transfer from reference clips
  • Generative continuation — extend existing video+audio clips
  • Keyframe-to-video for controlled transitions
  • Multilingual dialogue — characters speak in multiple languages
  • Style diversity ranging from candid camcorder footage to animation to cinematics
  • Strong typography generation and animated text designs
  • Agentic chaining — stitch individual clips into longer multi-shot sequences spanning several minutes

For preliminary evaluation, BFL generated 10-second text-to-video clips at 720p with audio. The early access phase includes a dedicated video generation portal.

Image Synthesis and Editing

  • Wide variety of styles, aspect ratios, and resolutions
  • Significantly improved handling of complex prompts over previous FLUX versions
  • High-accuracy text rendering in multiple languages
  • Early access for image capabilities expected in the coming weeks

Action Prediction (Physical AI)

This is where things get interesting. FLUX 3's world understanding doesn't just generate pixels — it predicts actions too. BFL shows two paths:

  1. Native integration — action prediction baked directly into FLUX 3 through scaled-up Self-Flow training
  2. Foundation fine-tuning — specialized action models fine-tuned from the pretrained video backbone using limited task-specific data

mimic robotics is the flagship example here: they built FLUX-mimic by combining FLUX 3's backbone with their dexterous manipulation expertise. The result? Robots running on Audi's production floor solving tasks conventional automation can't touch (soft-body manipulation, flexible materials like seals and cables). Read our dedicated article on FLUX-mimic for the full breakdown.

Self-Flow: The Training Method That Makes It All Work

FLUX 3 is built on Self-Flow, which addresses a fundamental tension in generative AI: generative models produce high-quality world models but typically have entangled, hard-to-decode feature representations. Meanwhile, specialized representation learning approaches produce clean, disentangled features but lack the generative power needed for realistic simulation.

Self-Flow unifies both objectives. Better generation → better world model → better features → easier to decode for downstream tasks → better action prediction. The improvements are reciprocal:

| Metric | Self-Flow | Flow Matching (baseline) | |---|---|---| | Generation error (Fréchet distance) | Lower across all modalities | Normalized to 100 | | Robot manipulation success rate | Higher after fine-tuning | Baseline |

Video generation accounts for over 95% of total compute costs, making it the dominant driver of both training expense and the quality of the world representation the model ultimately develops.

How FLUX 3 Compares on Video

BFL's early evaluations (preliminary, mid-development) show strong preference rates across human judgment tests:

| Competitor | FLUX 3 preferred | |---|---| | Luma Ray 3.2 | 93% | | Runway Gen-4.5 | 77% | | Grok Imagine Video | 69% | | Kling v3 Pro | 60% | | Happy Horse v1 | 59% | | Happy Horse 1.1 | 57% | | Seedance 2.0 | 52% | | Gemini Omni Flash | 52% |

These are still early results with a model that's actively being developed. BFL explicitly notes they expect further improvements throughout the early access phase — but the competitive landscape suggests a significant leap in quality.

Flux 3 Video particularly excels at human facial expressions, sound-event association, and multilingual capabilities. These strengths are noteworthy because facial expression fidelity requires genuine temporal modeling (not just good-looking static frames), and multilingual support means the model has learned cross-modal language mapping — it knows what different languages sound like when paired with visual cues.

The Launch Plan

Over the coming weeks and months, BFL is rolling out FLUX 3 in phases:

  1. FLUX 3 Video — API + private weight access for video+audio generation and editing (now in early access)
  2. FLUX 3 Action — selected research/commercial partners only, beginning with mimic robotics (in progress)
  3. FLUX 3 Image — API + private weight access for image synthesis and editing (coming soon)
  4. FLUX 3 Dev — open-weight release covering the full multimodal backbone (planned)

All capabilities share the same underlying architecture. Unlike current approaches where each modality gets its own checkpoint, FLUX 3 is one model with many faces.

What's Next for BFL

The company's ambition extends beyond joint generation. Their stated goal is to unify perceptual, action, and language prediction in a single model — essentially a general-purpose intelligence backbone capable of seeing, acting, and reasoning. Interactive image and video editing, simulation environments, computer use, and Physical AI are all explicitly called out as application vectors.

They're also hiring in Germany and the US while working on next-generation models.

Why This Matters Beyond the Hype

FLUX 3 represents a structural shift in how foundation models are conceived. The industry spent years building modality-by-modality architectures — image generator, video generator, speech synthesizer, action predictor — each with its own training pipeline and evaluation metric. FLUX 3's approach says: stop treating modalities as separate problems and treat them as signals about the same underlying reality.

The proof isn't just in generation quality — though the early results are strong. It's in what the shared representation enables: a model that can generate photorealistic video and predict robot actions isn't doing two separate things. It's demonstrating a unified understanding of cause, effect, and physical causality that no fragmented architecture achieves.

For developers and creators watching this space, the implication is straightforward: the models you use for content creation are increasingly becoming models of the physical world. The line between "generative AI" and "understanding AI" is dissolving — and FLUX 3 is one of the clearest milestones along that path.

Extending the Reading

FAQs

What makes FLUX 3 different from previous FLUX models?

Previous FLUX versions were single-modality (images only). FLUX 3 was built from day one as a unified multimodal model trained jointly on images, video, and audio — not layered on top of an existing model later. This means its world understanding emerges from the mutual constraints between modalities rather than being retrofit.

How long are the video outputs?

FLUX 3 generates videos up to 20 seconds in length in a single pass, with native audio generation. Videos can be chained together agentic-style into longer multi-shot sequences lasting several minutes, using visual references to maintain character consistency across scenes.

Is FLUX 3 open source?

An open-weight 'FLUX 3 Dev' version will be released for content creation (image, video, audio) and action prediction. Current early access is through APIs and private weight access for select partners like mimic robotics.

What's Self-Flow and why does it matter?

Self-Flow is BFL's training framework that unifies multimodal generation with representation learning. Unlike traditional Flow Matching which optimizes generation quality in isolation, Self-Flow simultaneously improves how well the model's internal features can be decoded for downstream tasks — resulting in both better generation quality AND more useful representations for applications like robot control.

分享这篇文章 / Share Article
Wesley Chong

Author

Wesley Chong

Software developer, digital consultant, and Toastmasters speaker from Kluang, Malaysia.

Focusing on helping ordinary people upgrade communication, expression, business, and life with AI.

Related Reading