---
pretty_name: GenieSim 3.0 Dataset
size_categories:
- n>1T
task_categories:
- robotics
- manipulation
language:
- en
- zh
tags:
- Embodied-AI
- Robotic manipulation
- Simulation dataset
- Isaac Sim
extra_gated_prompt: >-
  ### GenieSim 3.0 Dataset COMMUNITY LICENSE AGREEMENT
  GenieSim 3.0 Dataset Release Date: [Release Date]. All the data and code within this
  repo are under [CC BY-NC-SA
  4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).
extra_gated_fields:
  First Name: text
  Last Name: text
  Email: text
  Country: country
  Affiliation: text
  Phone: text
  Job title:
    type: select
    options:
    - Student
    - Research Graduate
    - AI researcher
    - AI developer/engineer
    - Reporter
    - Other
  Research interest: text
  geo: ip_location
  By clicking Submit below I accept the terms of the license and acknowledge that the information I provide will be collected stored processed and shared in accordance with the GenieSim Privacy Policy: checkbox
extra_gated_description: >-
  The information you provide will be collected, stored, processed and shared in
  accordance with the GenieSim Privacy Policy.
extra_gated_button_content: Submit
---
# GenieSim 3.0 Dataset

<div style="display: flex; justify-content: center; align-items: center; margin: 20px 0;">
    <video controls autoplay loop muted width="100%" style="max-width: 100%; border-radius: 10px; box-shadow: 0 4px 8px rgba(0, 0, 0, 0.1);">
        <source src="dataset.mp4" type="video/mp4">
        Your browser does not support the video tag.
    </video>
</div>

<div align="center" style="margin: 24px 0;">
  <a href="https://arxiv.org/abs/2601.02078" style="text-decoration:none;">
    <img src="https://img.shields.io/badge/arXiv-2601.02078-red.svg?logo=arxiv&logoColor=white" alt="arXiv Paper: 2601.02078" style="vertical-align: middle; margin-right: 24px; height: 25px;">
  </a>
  <a href="https://agibot-world.com/genie-sim" style="text-decoration:none;">
    <img src="https://img.shields.io/badge/Project%20Page-genie--sim-1976d2?logo=githubpages&logoColor=white" alt="Project Homepage" style="vertical-align: middle; margin-right: 24px; height: 25px;">
  </a>
  <a href="https://github.com/AgibotTech/genie_sim" style="text-decoration:none;">
    <img src="https://img.shields.io/badge/Code-GitHub-181717?logo=github&logoColor=white" alt="Code Repository" style="vertical-align: middle; margin-right: 24px; height: 25px;">
  </a>
  <a href="https://modelscope.cn/datasets/agibot_world/GenieSim3.0-Dataset" style="text-decoration:none;">
    <img src="https://img.shields.io/badge/Dataset-ModelScope-FF6B35?logo=model&logoColor=white" alt="ModelScope Dataset" style="vertical-align: middle; height: 25px;">
  </a>
</div>

<strong>GenieSim 3.0 Dataset</strong> is a large-scale robotic manipulation simulation dataset built on Isaac Sim, covering diverse manipulation task scenarios and providing high-quality training data for embodied intelligence research.

## 📖 Dataset Introduction

**GenieSim 3.0 Dataset** represents the largest open-source simulation dataset in embodied AI. GenieSim open-sources over **10,000 hours** of simulation data across **200+ tasks**, featuring multi-sensor streams including RGB-D, stereo vision, and whole-body kinematics, alongside multi-dimensional variations in layout, noise, and lighting.

The complexity of tasks is hierarchically organized, facilitating a structured progression from simple to complex scenarios. A key design principle is **composability**: long-horizon tasks can be decomposed into sequences of fundamental sub-tasks contained within the dataset. To this end, we structure the task taxonomy along three primary axes: **manipulation skill**, **cognitive comprehension**, and **task complexity**.

Addressing the critical concern of sim-to-real gap in the field, we conducted comprehensive sim-to-real validation. Training with synthetic data exhibits **zero-shot sim-to-real transfer** with superior task success rates compared to real data, demonstrating the practical utility of our simulation dataset for real-world robotic applications.

## 🔑 Key Features

- **Large-scale simulation data**: Over 10,000 hours of high-quality simulation demonstrations across 200+ manipulation tasks
- **Multi-sensor streams**: RGB-D cameras, stereo vision, and whole-body kinematics data
- **Rich variations**: Multi-dimensional variations in scene layout, sensor noise, and lighting conditions
- **Hierarchical task organization**: Tasks organized from simple to complex, enabling progressive learning
- **Composable task structure**: Long-horizon tasks decomposable into fundamental sub-tasks
- **Three-dimensional task taxonomy**: Structured along manipulation skill, cognitive comprehension, and task complexity axes
- **Proven sim-to-real transfer**: Zero-shot transfer capability with superior performance compared to real data training

## 📁 Dataset Structure

## Folder Hierarchy

The dataset repository contains three main directories at the top level:

```
GenieSim3.0-Dataset/
├── dataset/                                 # Main dataset directory
│   ├── heat_food_microwave/                # Task name
│   │   ├── g2/                              # Robot type
│   │   │   ├── data/                       # Episode data files
│   │   │   │   ├── chunk-000/              # Data chunk 0
│   │   │   │   │   ├── episode_000000.parquet
│   │   │   │   │   ├── episode_000001.parquet
│   │   │   │   │   ├── episode_000002.parquet
│   │   │   │   │   └── ...
│   │   │   │   ├── chunk-001/              # Data chunk 1
│   │   │   │   │   ├── episode_001000.parquet
│   │   │   │   │   ├── episode_001001.parquet
│   │   │   │   │   └── ...
│   │   │   │   └── ...
│   │   │   ├── meta/                       # Metadata files
│   │   │   │   ├── info.json               # Dataset information and feature definitions
│   │   │   │   ├── episodes.jsonl          # Episode metadata (task, length, etc.)
│   │   │   │   ├── episodes_stats.jsonl   # Per-episode statistics
│   │   │   │   └── tasks.jsonl             # Task definitions
│   │   │   └── videos/                     # Video recordings
│   │   │       ├── chunk-000/              # Video chunk 0
│   │   │       │   ├── observation.images.top_head/    # Top head camera videos
│   │   │       │   │   ├── episode_000000.mp4
│   │   │       │   │   ├── episode_000001.mp4
│   │   │       │   │   └── ...
│   │   │       │   ├── observation.images.hand_left/   # Left hand camera videos
│   │   │       │   │   └── ...
│   │   │       │   ├── observation.images.hand_right/  # Right hand camera videos
│   │   │       │   │   └── ...
│   │   │       │   ├── observation.images.head_depth/  # Head depth camera videos
│   │   │       │   │   └── ...
│   │   │       │   ├── observation.images.hand_left_depth/  # Left hand depth videos
│   │   │       │   │   └── ...
│   │   │       │   └── observation.images.hand_right_depth/ # Right hand depth videos
│   │   │       │       └── ...
│   │   │       ├── chunk-001/              # Video chunk 1
│   │   │       │   ├── observation.images.top_head/
│   │   │       │   │   └── ...
│   │   │       │   └── ...
│   │   │       └── ...
│   │   └── ...                             # Other robot types
│   ├── organize_kitchen_utensils/          # Another task name
│   │   ├── g2/                             # Robot type
│   │   │   ├── data/
│   │   │   ├── meta/
│   │   │   └── videos/
│   │   └── ...
│   └── ...                                 # Other tasks
├── checkpoints/                            # Trained model checkpoints
│   └── ...                                 # PI 0.5 models trained on simulation data
└── reconstruction_source_data/            # 3DGS reconstruction source data
    └── ...                                 # Original data for 3D Gaussian Splatting reconstruction
```

The dataset follows the [LeRobot](https://github.com/huggingface/lerobot) v0.3.3 format, which provides a standardized structure for robotic manipulation datasets. Within the `dataset/` directory, data is organized by task name and robot type, with each task-robot combination containing episode data in Parquet format, metadata files (info.json, episodes.jsonl, episodes_stats.jsonl, tasks.jsonl), and video recordings organized by chunk and camera view.

The repository also includes:
- **checkpoints/**: Pre-trained PI 0.5 models trained on the simulation data. These models are the ones referenced in the paper that demonstrate **zero-shot sim-to-real transfer with superior task success rates compared to real data**. The large-scale, systematically randomized synthetic data pipeline implemented in GenieSim 3.0 offers a pragmatic and scalable alternative to real-robot data collection, enabling the training of robust models capable of high zero-shot performance in physical environments.
- **reconstruction_source_data/**: Original data used for 3D Gaussian Splatting (3DGS) reconstruction

## 📄 License and Citation

All the data and code within this repo are under [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/). Please consider citing our project if it helps your research:

```BibTeX
@misc{yin2026geniesim30,
  title={Genie Sim 3.0 : A High-Fidelity Comprehensive Simulation Platform for Humanoid Robot},
  author={Chenghao Yin and Da Huang and Di Yang and Jichao Wang and Nanshu Zhao and Chen Xu and Wenjun Sun and Linjie Hou and Zhijun Li and Junhui Wu and Zhaobo Liu and Zhen Xiao and Sheng Zhang and Lei Bao and Rui Feng and Zhenquan Pang and Jiayu Li and Qian Wang and Maoqing Yao},
  year={2026},
  eprint={2601.02078},
  archivePrefix={arXiv},
  primaryClass={cs.RO},
  url={https://arxiv.org/abs/2601.02078},
}
```

