Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aloha_hd5 to LerobotDataset v2 #586

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

Raziel90
Copy link
Contributor

What this does

Adds Script for the conversion of aloha_hd5 dataset format to LerobotDataset (v2)

  • The scripts decouples the components dependant on the Original dataset format to those that create the dataset.
  • The script is easy to generalise to other datasets as long as an equivalent of the AlohaHD5Extractor (check code) is provided

NB: Automated testing will be provided in a separate PR.

How it was tested

Launched the script to upload the dataset in multiple ways (e.g. images as images or as videos, different episode descriptions)

These datasets are uploaded with this
https://huggingface.co/datasets/ccop/aloha-hd5-conversion-test
https://huggingface.co/datasets/ccop/test-again

Examples:

  • Added examples/port_datasets/aloha_hd5.py

How to checkout & try? (for the reviewer)

You can try on an hd5 dataset using the following. (change the arguments to fit your dataset).

python examples/port_datasets/aloha_hd5.py --fps=50 --raw-path=/home/ccop/code/aloha_data/aloha_stationary_pick_place_bottle/  --dataset-repo-id=ccop/test-again --video-encoding=false --push=True --description="Aloha HD5 dataset - Bottle Pick and Place"

@Michael-Equi
Copy link

Hi Raziel. Thanks for writing this! I think there is a bug in the implementation you are submitting that results in saving only one frame per episode. The fix should just be to tab in this line https://github.com/huggingface/lerobot/pull/586/files#diff-8a6e4cf809bbdbbde9c6d8d6887e9c3d1537f3dda6179c2bf819a04984bb9fd4R131

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants