Question: How does SceneRig handle scenes beyond tabletops?

SceneRig is designed for tabletop scenes for robot manipulation. Below, we run it on seven images: two dining scenes from the internet, our own photo of a living room, and four images from related papers, including a bedroom. Furniture and objects are recovered, but in rooms, textiles such as blankets are segmented as separate objects and reconstructed as rigid meshes, so they can look unnatural.

Each 3D viewer opens at the input camera; drag to orbit, scroll to zoom, and right-drag to pan. The viewer uses neutral lighting, so shading differs from the photo; walls between the camera and the scene are hidden while orbiting.

Example 1: Round dining table · internet image

The table, four upholstered chairs, vase, open book, and cup are recovered; the chairs' fabric appears darker than in the photo.

Input image
Input image of a round wooden dining table with four upholstered chairs.
SceneRig (ours) · interactive 3D

Example 2: Pedestal table · internet image

The pedestal table, three leather chairs, and the vase of flowers are recovered.

Input image
Input image of a round pedestal table with three leather chairs and a vase of pink flowers.
SceneRig (ours) · interactive 3D

Example 3: Living room · our own photo

The sofa, cabinet, rug, suitcases, bags, chairs, and floor lamp are recovered. The throws on the sofa become rigid meshes, and the paintings on the wall are not reconstructed.

Input image
Input photo of a living room with a striped sofa, suitcases, and a rug.
SceneRig (ours) · interactive 3D

Example 4: Bedroom · input from REST3D

The bed, pillows, side tables, lamp, plants, and rug are recovered. The folded blankets at the foot of the bed are segmented as separate objects; reconstructed as rigid meshes, one sticks up as a stiff slab instead of lying flat on the bed.

Input image
Input photo of a bedroom with a bed, plants, and a rug.
SceneRig (ours) · interactive 3D

Example 5: Garden stool · input from φ-Scene

An outdoor scene: the potted plant and watering can on the stool, and the bucket and trowel below it, are recovered.

Input image
Input image of a wooden stool holding a potted plant and a watering can.
SceneRig (ours) · interactive 3D

Example 6: Glove and ball on a bench · input from SimFoundry

A real outdoor photo: the glove and ball are recovered on the bench.

Input image
Input photo of a baseball glove and ball on a concrete bench.
SceneRig (ours) · interactive 3D

Example 7: Desk · input from SimuScene

The monitor, laptop, stacked books, mug, and notebook are recovered on the desk.

Input image
Input image of a desk with a monitor, a laptop, and stacked books.
SceneRig (ours) · interactive 3D