SceneRig.← Project page

Question: How does SceneRig compare with TabletopGen and PAT3D?

Each row is a method; each column is one of five samples. Switch all 15 reconstructions between the source view and a nearby view at +30° azimuth. Input images are linked below the column headings; select any reconstruction for a larger version.

Source view

Scroll horizontally to compare all five samples. Method labels stay visible.

MethodBreakfast tableInput image ↗Clutter fruitInput image ↗IMG_8334Input image ↗bridge_7Input image ↗bridge_2Input image ↗
TabletopGenBreakfast table — TabletopGen, source viewClutter fruit — TabletopGen, source viewIMG_8334 — TabletopGen, source viewbridge_7 — TabletopGen, source viewbridge_2 — TabletopGen, source view
PAT3DBreakfast table — PAT3D, source viewClutter fruit — PAT3D, source viewIMG_8334 — PAT3D, source viewbridge_7 — PAT3D, source viewbridge_2 — PAT3D, source view
SceneRig (ours)Breakfast table — SceneRig (ours), source viewClutter fruit — SceneRig (ours), source viewIMG_8334 — SceneRig (ours), source viewbridge_7 — SceneRig (ours), source viewbridge_2 — SceneRig (ours), source view

Download the source-view appendix figure (PDF)

Quantitative results on separate matched cohorts

TabletopGen completed 59 of 80 attempted scenes; PAT3D completed 67 of 80, with 13 failures and no jobs remaining. Each baseline is compared with SceneRig on its own completed scenes, so SceneRig has two separate rows. Failed runs are excluded, not zero-filled; no completed scenes were excluded based on appearance.

All applicable completed scenes contribute to these averages; the five examples above are qualitative illustrations. Object and layout scores use the synthetic subsets: 38 scenes for TabletopGen and 35 for PAT3D.

Source-view reconstruction

Cohort · scenesMethodPSNR ↑SSIM ↑LPIPS ↓
TabletopGen cohort · 59TabletopGen7.9270.5160.752
SceneRig13.3880.5360.517
PAT3D cohort · 67PAT3D9.7950.5380.743
SceneRig13.2720.5340.517

Object recovery

PSNR*/SSIM* score ground-truth object pixels, excluding the table and background. LPIPS* averages object crops with non-object pixels set to white. ARI/FG-IoU use the rendered instance masks.

Cohort · synthetic scenesMethodARI ↑FG-IoU ↑PSNR* ↑SSIM* ↑LPIPS* ↓
TabletopGen cohort · 38TabletopGen0.5060.4189.4990.3580.301
SceneRig0.8770.81813.6810.4410.166
PAT3D cohort · 35PAT3D0.1240.1259.5070.3780.315
SceneRig0.8750.81513.5480.4280.170

3D layout

The shared evaluator uses camera-oriented support-plane coordinates and global scale alignment. The OSPA cutoff is 10 cm, and reported OSPA distances are also in centimeters.

Cohort · synthetic scenesMethodOSPA@10 cm ↓F1@10 cm ↑
TabletopGen cohort · 38TabletopGen7.280.567
SceneRig3.190.926
PAT3D cohort · 35PAT3D9.270.212
SceneRig3.010.948

Pairwise VLM evaluation

GPT-5.6 Terra and Qwen 3.8 Max judge anonymous source/+30° panels with the GRASE v4 rubric. Both presentation orders are evaluated; order-inconsistent judgments are discarded and ties receive half credit. Each cohort has a separate mean-centered, two-method Bradley–Terry fit: scores across the two fits should not be used to rank the baselines against each other.

Cohort · scenesMethodCompleteness ↑Layout ↑Appearance ↑
TabletopGen cohort · 59TabletopGen-1.273-1.744-2.172
SceneRig1.2731.7442.172
PAT3D cohort · 67PAT3D-1.572-2.794-2.794
SceneRig1.5722.7942.794
Reproduction and evaluation details

PAT3D starts from the supplied benchmark image and uses Hunyuan3D 2.1, GPT-Image-2, and Claude Opus 5. Its original layout, mesh processing, and physics pipeline are retained with the approved segmentation-mask loading fix. Reproduction encountered API rejections, asset/physics failures, and camera-export failures; the completion counts describe this reproduction, not the authors’ reported success rate.

PAT3D’s source camera uses DepthPro intrinsics and the estimated global gravity/support alignment, then follows only the reference support’s vertical displacement during physics. It does not follow individual object pose edits, and the support is not frozen. This is approximate source-camera recovery, with no ground-truth camera fitting or image-score optimization.

PAT3D source scores and panels use the saved Cycles 32-sample render. TabletopGen source scores use its saved pyrender output, whereas its qualitative panels use archived Cycles 96-sample VLM renders. SceneRig uses its existing Cycles evaluation images. Renderer versions, samples, lighting and backgrounds are not normalized across methods. TabletopGen uses supplied synthetic calibration and estimated real-image intrinsics; PAT3D estimates both from its reconstruction.

Nearby views apply the same +30° orbit rule while preserving each method’s orbital radius and elevation; they do not imply identical extrinsics. Images are resized and WebP-encoded for display, with no brightness adjustment. Metrics use the original images.

TabletopGen’s 21 incomplete runs comprise 17 top-view quality-check failures, three Seedream input rejections, and one missing support surface. Additional TabletopGen calibrated/novel-view metrics remain available; those extra pixel metrics are outside the PAT3D comparison reported here.

Download aggregate scores and cohort lists