Question: Do reconstructed objects behave like the real ones during manipulation?
Open-loop trajectory replay runs the recorded joint and gripper commands without feedback from object states, so each grasp, lift, and release succeeds only if the simulated object responds to contact as the real one does. Below is one demonstration per task; in all five, the simulated objects end where the real ones do.
In each row, the real robot and the SceneRig reconstruction execute the same recorded robot commands, so the two videos are synchronized and play at real speed. The slider under a row moves both videos.
Example 1: Cup-to-bowl
The arm picks up the orange cup and places it in the bowl.
Example 2: Everything-to-bin
The arms move three objects into the blue bin, one at a time.
Example 3: Marker-to-cup
The arm picks up the thin marker and drops it into the red cup, a placement that needs high accuracy.
Example 4: Mustard-to-bin
The arm grasps the mustard bottle and places it in the red bin.
Example 5: Fruits-to-bowl
The arm moves both fruits from the red plate to the small blue bowl.