SSyncDev

Cosmos3-Nano-Sim-Bimanual

SyncDev model directory · Profile updated Nov 19, 2026

Compare with another model

Cosmos3-Nano-Sim-Bimanual is NVIDIA's open 16B world model that simulates video of a two-armed AgiBot robot as it moves its camera and manipulates.

Key specifications

Specification score
14.8
License
OpenMDW-1.1

The specification score summarizes recorded features and limits. It is not a benchmark result.

Pricing conditions: Open weights; no hosted API price. GPU time is the cost, so confirm throughput on your own hardware.

Inputs and outputs

Recorded modality support shows what this model can accept and produce. An undocumented modality is shown as unknown rather than assumed to be unsupported.

Accepts

  • Image input
  • Text input

Produces

  • Video output

Capabilities

VisionOpen weights

What is Cosmos3-Nano-Sim-Bimanual?

Most robot world models handle either the arm or the camera. Cosmos3-Nano-Sim-Bimanual handles both in one rollout. Starting from a single image, it generates what happens as a two-armed robot moves its gripper, changes its arm state and repositions its camera, all within the same action sequence.

That makes it a practical stand-in for teleoperation when you need demonstrations or want to evaluate a policy before it touches hardware.

The setup

Released on 20 October 2026 as one of the Cosmos3 examples, it starts from Cosmos3-Nano and is post-trained on a mix of manipulation videos paired with robot actions and navigation videos paired with camera trajectories. Causal distillation then turns it into a chunked, few-step generator that conditions on cached history and incoming controls.

Controls can come from anywhere. A vision-language-action policy, a world-action model or a person on a joystick can supply them at any point during a rollout.

Inputs and outputs

Field Format
Initial frame JPG, PNG, JPEG or WebP
Robot actions JSON of shape (T, D), embodiment-specific
Camera trajectories Pose sequence, e.g. 9-D camera motion
Text Prompt string
Output MP4 or streamed frames, 480p at 30 fps
Supported robot AgiBot
Size 16B trainable parameters
Licence OpenMDW-1.1

Open-loop and closed-loop operation are both supported.

What people use it for

  • Scoring candidate policies against many simulated episodes before a real trial.
  • Generating synthetic demonstrations without a human operator.
  • Reinforcement-learning training where the environment is the model itself.

The single-embodiment restriction is the biggest caveat. If you do not run AgiBot hardware, expect to post-train before the actions mean anything.

How to sanity-check rollouts

Replay a recorded AgiBot episode's actions from its first frame and compare generated frames against the real video every second. Look for gripper state errors first; they are the failure that silently ruins policy evaluation. Then try a scripted camera pan mid-grasp and confirm the object stays where the arm left it.

For simulator-driven photorealism instead of action-driven simulation, Cosmos3-Nano-Sim-Transfer is the sibling to use. Other generators that start from a still frame are in the image-to-video directory, and NVIDIA's robotics models are collected on the provider page.

How to evaluate Cosmos3-Nano-Sim-Bimanual

Compare the model on the work you need to complete.

Tasks and inputs

Cosmos3-Nano-Sim-Bimanual is listed for Image-to-video, Video-to-video. It accepts image, text and produces video. Use the publisher’s input format and preprocessing for your chosen deployment.

Capacity and cost

Choose duration, resolution and frame rate together. Compare the cost of an accepted clip, including repeat generations.

Choosing a deployment

The weights are downloadable under OpenMDW-1.1. Check runtime support and size the complete model and working context for your expected concurrency.

Frequently asked questions

AgiBot, a bimanual embodiment; other robots would need further post-training.

These records share a directory category. Check the source card, output type and deployment requirements before treating a model as a replacement.

tbc

TBC mischief 1

TBC mischief 1 is an image-to-video model built on Wan 2.2, sold on fal and OpenRouter at about half a cent per second for 3-5 s clips at up to 720p.

— context

NVIDIA

Cosmos3-H-Dreams

Cosmos3-H-Dreams is NVIDIA's open real-time surgical world model: it streams Versius robot video from one endoscope frame and two-arm commands.

— context

NVIDIA

Cosmos3-H-Embodied-Nano

Cosmos3-H-Embodied-Nano is NVIDIA's open 16B surgical world model that does forward dynamics, inverse dynamics and policy from one checkpoint.

— context

noiz-ai

Helix World

Helix World (preview) is an open real-time world model from Noiz AI and HKUST that streams explorable 768x512 video with stereo sound that follows the camera.

— context

Alibaba

Wan-Animate-2

Wan-Animate-2 is Alibaba Wan's open 14B character-animation model that drives a character from video directly, with text-controlled camera angle.

— context

Z.ai / Zhipu AI

SCAIL-2

SCAIL-2 is Zhipu's open character-animation model that drives a reference character from any video, with no pose skeletons or masks. MIT licence.

— context