Iterative VLM transient mask bootstrapping · v0

0.684proposal GT coverage
0.594SAM oracle IoU
0.438final mask IoU
0.495final mask recall
33.3%clean-frame FPR
88 → 43raw → routed proposals

Safety cap applied: True; raw VLM-masked frames: 30/30. The cap retains at most 50% of frames, ranked without reference data.

Clean test reconstruction

10k unmasked control: PSNR 28.1257, SSIM 0.8524, LPIPS 0.2475
10k predicted-mask Round 1: PSNR 28.7262, SSIM 0.8542, LPIPS 0.2397

Clean-test side-by-side

clean test 0031 · PSNR 27.868 → 27.949 (+0.081 dB)

control
masked
target

clean test 0032 · PSNR 29.805 → 29.832 (+0.027 dB)

control
masked
target

clean test 0033 · PSNR 27.131 → 27.049 (-0.082 dB)

control
masked
target

clean test 0034 · PSNR 24.217 → 27.314 (+3.096 dB)

control
masked
target

clean test 0035 · PSNR 31.607 → 31.486 (-0.120 dB)

control
masked
target

Locked reference mask audit

Reference-derived pseudo-GT appears only below this point.

0001 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0001__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0001",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0001__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0001",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0001__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red umbrella is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0001",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0002 · dynamic

IoU 0.931 · precision 0.999 · recall 0.932 · proposal coverage 0.637 · SAM oracle 0.914

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0002__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "The red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella does not appear in the static reconstruction or the nearby training observations.",
    "needs_more_evidence": false,
    "frame_id": "0002",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"The red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella does not appear in the static reconstruction or the nearby training observations.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0002__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a partially visible fan",
    "evidence_for": "The fan appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The fan's presence in the target frame suggests it is a transient object, as it does not persist across multiple views.",
    "needs_more_evidence": false,
    "frame_id": "0002",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a partially visible fan\",\n  \"evidence_for\": \"The fan appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The fan's presence in the target frame suggests it is a transient object, as it does not persist across multiple views.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0002__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a partially visible umbrella",
    "evidence_for": "The umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The umbrella's presence in the target frame suggests it is a transient object, as it does not appear in the surrounding context frames.",
    "needs_more_evidence": false,
    "frame_id": "0002",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a partially visible umbrella\",\n  \"evidence_for\": \"The umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The umbrella's presence in the target frame suggests it is a transient object, as it does not appear in the surrounding context frames.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0003 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0003__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "umbrella",
    "evidence_for": "The umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0003",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"umbrella\",\n  \"evidence_for\": \"The umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0003__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "The red umbrella on the floor.",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames or the static reconstruction.",
    "evidence_against": "The umbrella's presence is consistent across multiple frames, indicating it is part of the scene.",
    "needs_more_evidence": false,
    "frame_id": "0003",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"The red umbrella on the floor.\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The umbrella's presence is consistent across multiple frames, indicating it is part of the scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0003__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a small decorative item on the cabinet",
    "evidence_for": "The object appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The object is not persistent across different views or frames.",
    "needs_more_evidence": false,
    "frame_id": "0003",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a small decorative item on the cabinet\",\n  \"evidence_for\": \"The object appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The object is not persistent across different views or frames.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0004 · dynamic

IoU 0.493 · precision 0.793 · recall 0.566 · proposal coverage 0.547 · SAM oracle 0.464

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0004__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "umbrella",
    "evidence_for": "The umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0004",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"umbrella\",\n  \"evidence_for\": \"The umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0004__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "umbrella",
    "evidence_for": "The umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0004",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"umbrella\",\n  \"evidence_for\": \"The umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0004__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "umbrella",
    "evidence_for": "The umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0004",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"umbrella\",\n  \"evidence_for\": \"The umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0005 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0005__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "the red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella does not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0005",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"the red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella does not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0005__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "C",
    "object_description": "the red carpet on the floor",
    "evidence_for": "The red carpet appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The red carpet does not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0005",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"C\",\n  \"object_description\": \"the red carpet on the floor\",\n  \"evidence_for\": \"The red carpet appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The red carpet does not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0005__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "The red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0005",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"The red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0006 · dynamic

IoU 0.615 · precision 0.999 · recall 0.615 · proposal coverage 0.373 · SAM oracle 0.548

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0006__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "B",
    "object_description": "a red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the other frames or the static reconstruction.",
    "evidence_against": "The red umbrella does not appear in the static reconstruction or the nearby training observations.",
    "needs_more_evidence": false,
    "frame_id": "0006",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"B\",\n  \"object_description\": \"a red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the other frames or the static reconstruction.\",\n  \"evidence_against\": \"The red umbrella does not appear in the static reconstruction or the nearby training observations.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0006__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a screen partition",
    "evidence_for": "The screen partition appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The screen partition is visible in the context frames, indicating it is part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0006",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a screen partition\",\n  \"evidence_for\": \"The screen partition appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The screen partition is visible in the context frames, indicating it is part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0006__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a small, colorful umbrella",
    "evidence_for": "The umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The umbrella's appearance in the target frame does not align with the persistent scene content across different views.",
    "needs_more_evidence": false,
    "frame_id": "0006",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a small, colorful umbrella\",\n  \"evidence_for\": \"The umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The umbrella's appearance in the target frame does not align with the persistent scene content across different views.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0007 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0007__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "flowers in a vase",
    "evidence_for": "The flowers appear only in the target frame and are not present in the context frames.",
    "evidence_against": "The flowers are not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0007",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"flowers in a vase\",\n  \"evidence_for\": \"The flowers appear only in the target frame and are not present in the context frames.\",\n  \"evidence_against\": \"The flowers are not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0007__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a red umbrella",
    "evidence_for": "The umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The umbrella's appearance in the target frame does not align with the context frames, suggesting it is not part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0007",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a red umbrella\",\n  \"evidence_for\": \"The umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The umbrella's appearance in the target frame does not align with the context frames, suggesting it is not part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0007__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "The red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0007",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"The red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0008 · dynamic

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.913 · SAM oracle 0.731

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0008__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0008",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0008__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0008",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0008__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0008",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0009 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0009__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the nearby training observations.",
    "needs_more_evidence": false,
    "frame_id": "0009",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the nearby training observations.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0009__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0009",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0009__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "The red umbrella on the floor",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0009",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"The red umbrella on the floor\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0010 · dynamic

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.781 · SAM oracle 0.300

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0010__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a small, round object on the floor near the center of the room",
    "evidence_for": "The small, round object appears only in the target frame and is not present in any of the context frames or the static reconstruction.",
    "evidence_against": "The object does not appear in the static reconstruction or the context frames, suggesting it is not part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0010",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a small, round object on the floor near the center of the room\",\n  \"evidence_for\": \"The small, round object appears only in the target frame and is not present in any of the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The object does not appear in the static reconstruction or the context frames, suggesting it is not part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0010__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "pillow on the floor",
    "evidence_for": "The pillow appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The pillow is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0010",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"pillow on the floor\",\n  \"evidence_for\": \"The pillow appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The pillow is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0010__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "pillow on the floor",
    "evidence_for": "The pillow appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The pillow is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0010",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"pillow on the floor\",\n  \"evidence_for\": \"The pillow appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The pillow is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0011 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0011__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "floral arrangement",
    "evidence_for": "The floral arrangement appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The floral arrangement is not present in the context frames, indicating it is likely transient.",
    "needs_more_evidence": false,
    "frame_id": "0011",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"floral arrangement\",\n  \"evidence_for\": \"The floral arrangement appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The floral arrangement is not present in the context frames, indicating it is likely transient.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0011__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red umbrella is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0011",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0011__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a small, light-colored object resembling a cat statue",
    "evidence_for": "The object appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The object does not appear in the imperfect static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0011",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a small, light-colored object resembling a cat statue\",\n  \"evidence_for\": \"The object appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The object does not appear in the imperfect static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0012 · dynamic

IoU 0.492 · precision 0.728 · recall 0.603 · proposal coverage 0.757 · SAM oracle 0.578

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0012__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "The large, flowing curtain",
    "evidence_for": "The curtain appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The curtain's appearance in the target frame does not align with the context frames, suggesting it is not part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0012",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"The large, flowing curtain\",\n  \"evidence_for\": \"The curtain appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The curtain's appearance in the target frame does not align with the context frames, suggesting it is not part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0012__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "curtain",
    "evidence_for": "The curtain appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The curtain is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0012",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"curtain\",\n  \"evidence_for\": \"The curtain appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The curtain is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0012__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a green curtain",
    "evidence_for": "The green curtain appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The green curtain does not appear in the static reconstruction or the nearby training observations.",
    "needs_more_evidence": false,
    "frame_id": "0012",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a green curtain\",\n  \"evidence_for\": \"The green curtain appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The green curtain does not appear in the static reconstruction or the nearby training observations.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0013 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0013__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "The red umbrella on the right side of the room.",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames or the static reconstruction.",
    "evidence_against": "The red umbrella is not present in the static reconstruction, which suggests it is not part of the persistent scene content.",
    "needs_more_evidence": false,
    "frame_id": "0013",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"The red umbrella on the right side of the room.\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction, which suggests it is not part of the persistent scene content.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0013__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a green curtain",
    "evidence_for": "The green curtain appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The green curtain does not appear in any of the context frames or the static reconstruction, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0013",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a green curtain\",\n  \"evidence_for\": \"The green curtain appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The green curtain does not appear in any of the context frames or the static reconstruction, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0013__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "The red umbrella on the right side of the room.",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The red umbrella is not present in the context frames, indicating it is not part of the persistent scene content.",
    "needs_more_evidence": false,
    "frame_id": "0013",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"The red umbrella on the right side of the room.\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The red umbrella is not present in the context frames, indicating it is not part of the persistent scene content.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0014 · dynamic

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.535 · SAM oracle 0.403

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0014__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0014",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0014__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "The person in the foreground",
    "evidence_for": "The person appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The person's presence is consistent across multiple context frames, indicating they are part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0014",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"The person in the foreground\",\n  \"evidence_for\": \"The person appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The person's presence is consistent across multiple context frames, indicating they are part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0014__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "C",
    "object_description": "mannequin wearing a hat",
    "evidence_for": "The mannequin appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The mannequin does not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0014",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"C\",\n  \"object_description\": \"mannequin wearing a hat\",\n  \"evidence_for\": \"The mannequin appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The mannequin does not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0015 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0015__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "C",
    "object_description": "mannequin wearing a blue shirt",
    "evidence_for": "The mannequin appears only in the target frame and is not present in any of the other frames.",
    "evidence_against": "The mannequin does not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0015",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"C\",\n  \"object_description\": \"mannequin wearing a blue shirt\",\n  \"evidence_for\": \"The mannequin appears only in the target frame and is not present in any of the other frames.\",\n  \"evidence_against\": \"The mannequin does not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0015__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "C",
    "object_description": "mannequin wearing a blue shirt",
    "evidence_for": "The mannequin appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The mannequin does not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0015",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"C\",\n  \"object_description\": \"mannequin wearing a blue shirt\",\n  \"evidence_for\": \"The mannequin appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The mannequin does not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0015__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a person wearing a blue shirt",
    "evidence_for": "The person appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The person's presence is consistent across multiple frames, indicating it is part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0015",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a person wearing a blue shirt\",\n  \"evidence_for\": \"The person appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The person's presence is consistent across multiple frames, indicating it is part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0016 · dynamic

IoU 0.832 · precision 0.999 · recall 0.833 · proposal coverage 0.592 · SAM oracle 0.747

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0016__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella is not visible in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0016",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella is not visible in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0016__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a blue shirt",
    "evidence_for": "The blue shirt appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The blue shirt does not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0016",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a blue shirt\",\n  \"evidence_for\": \"The blue shirt appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The blue shirt does not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0017 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0017__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "the red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the other frames.",
    "evidence_against": "The red umbrella is not present in the context frames or the static reconstruction render.",
    "needs_more_evidence": false,
    "frame_id": "0017",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"the red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the other frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the context frames or the static reconstruction render.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0017__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a red patterned cushion on the floor",
    "evidence_for": "The red patterned cushion appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The cushion's appearance in the target frame does not align with the context frames, suggesting it is not part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0017",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a red patterned cushion on the floor\",\n  \"evidence_for\": \"The red patterned cushion appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The cushion's appearance in the target frame does not align with the context frames, suggesting it is not part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0017__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "the red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella does not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0017",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"the red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella does not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0018 · dynamic

IoU 0.589 · precision 0.694 · recall 0.796 · proposal coverage 0.823 · SAM oracle 0.718

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0018__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "mirror",
    "evidence_for": "The mirror appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The mirror is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0018",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"mirror\",\n  \"evidence_for\": \"The mirror appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The mirror is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0018__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the other frames or the static reconstruction.",
    "evidence_against": "The red umbrella does not appear in any of the context frames or the static reconstruction.",
    "needs_more_evidence": false,
    "frame_id": "0018",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the other frames or the static reconstruction.\",\n  \"evidence_against\": \"The red umbrella does not appear in any of the context frames or the static reconstruction.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0018__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red umbrella is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0018",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0019 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0019__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "person holding a mirror",
    "evidence_for": "The person holding the mirror appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The person is not visible in the context frames, suggesting they are not part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0019",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"person holding a mirror\",\n  \"evidence_for\": \"The person holding the mirror appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The person is not visible in the context frames, suggesting they are not part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0019__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "person holding a mirror",
    "evidence_for": "The person holding the mirror appears only in the target frame and is not present in the other frames.",
    "evidence_against": "The person is not visible in any of the other frames, indicating they are likely transient.",
    "needs_more_evidence": false,
    "frame_id": "0019",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"person holding a mirror\",\n  \"evidence_for\": \"The person holding the mirror appears only in the target frame and is not present in the other frames.\",\n  \"evidence_against\": \"The person is not visible in any of the other frames, indicating they are likely transient.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0019__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "person holding a mirror",
    "evidence_for": "The person holding the mirror appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The person is not visible in the static reconstruction or the context frames, suggesting it is a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0019",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"person holding a mirror\",\n  \"evidence_for\": \"The person holding the mirror appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The person is not visible in the static reconstruction or the context frames, suggesting it is a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0020 · dynamic

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.632 · SAM oracle 0.148

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0020__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "person holding a mirror",
    "evidence_for": "The person holding the mirror appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The person is not visible in the context frames, indicating they are likely transient.",
    "needs_more_evidence": false,
    "frame_id": "0020",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"person holding a mirror\",\n  \"evidence_for\": \"The person holding the mirror appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The person is not visible in the context frames, indicating they are likely transient.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0020__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "mirror",
    "evidence_for": "The mirror appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The mirror is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0020",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"mirror\",\n  \"evidence_for\": \"The mirror appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The mirror is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0020__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "mirror",
    "evidence_for": "The mirror appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The mirror's presence is consistent across multiple frames, indicating it is part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0020",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"mirror\",\n  \"evidence_for\": \"The mirror appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The mirror's presence is consistent across multiple frames, indicating it is part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0021 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0021__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "C",
    "object_description": "mirror held by person",
    "evidence_for": "The mirror appears only in the target frame and is not present in the other frames or the static reconstruction.",
    "evidence_against": "The mirror does not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0021",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"C\",\n  \"object_description\": \"mirror held by person\",\n  \"evidence_for\": \"The mirror appears only in the target frame and is not present in the other frames or the static reconstruction.\",\n  \"evidence_against\": \"The mirror does not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0021__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red umbrella is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0021",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0021__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "mirror held by person",
    "evidence_for": "The mirror appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The mirror does not appear in the static reconstruction or the RGB residual proposal.",
    "needs_more_evidence": false,
    "frame_id": "0021",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"mirror held by person\",\n  \"evidence_for\": \"The mirror appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The mirror does not appear in the static reconstruction or the RGB residual proposal.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0022 · dynamic

IoU 0.772 · precision 0.906 · recall 0.839 · proposal coverage 0.808 · SAM oracle 0.809

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0022__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red cage",
    "evidence_for": "The red cage appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red cage is not visible in the context frames, suggesting it is a new object introduced in the target frame.",
    "needs_more_evidence": false,
    "frame_id": "0022",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red cage\",\n  \"evidence_for\": \"The red cage appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red cage is not visible in the context frames, suggesting it is a new object introduced in the target frame.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0022__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "color chart",
    "evidence_for": "The color chart appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The color chart is not persistent across different views or frames.",
    "needs_more_evidence": false,
    "frame_id": "0022",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"color chart\",\n  \"evidence_for\": \"The color chart appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The color chart is not persistent across different views or frames.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0022__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The red umbrella does not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0022",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The red umbrella does not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0023 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0023__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a large teddy bear",
    "evidence_for": "The teddy bear appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The teddy bear is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0023",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a large teddy bear\",\n  \"evidence_for\": \"The teddy bear appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The teddy bear is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0023__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0023",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0023__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a large teddy bear",
    "evidence_for": "The teddy bear appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The teddy bear is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0023",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a large teddy bear\",\n  \"evidence_for\": \"The teddy bear appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The teddy bear is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0024 · dynamic

IoU 0.553 · precision 0.770 · recall 0.662 · proposal coverage 0.711 · SAM oracle 0.685

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0024__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red fabric hanging from the ceiling",
    "evidence_for": "The red fabric is only visible in the target frame and not in the context frames or the static reconstruction.",
    "evidence_against": "The red fabric does not appear in the context frames, suggesting it is not part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0024",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red fabric hanging from the ceiling\",\n  \"evidence_for\": \"The red fabric is only visible in the target frame and not in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The red fabric does not appear in the context frames, suggesting it is not part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0024__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red flag",
    "evidence_for": "The red flag appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The red flag does not appear in any of the context frames, indicating it is not part of the persistent scene content.",
    "needs_more_evidence": false,
    "frame_id": "0024",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red flag\",\n  \"evidence_for\": \"The red flag appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The red flag does not appear in any of the context frames, indicating it is not part of the persistent scene content.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0025 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0025__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "mirror",
    "evidence_for": "The mirror appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The mirror does not appear in the context frames, suggesting it is a new object introduced in the target frame.",
    "needs_more_evidence": false,
    "frame_id": "0025",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"mirror\",\n  \"evidence_for\": \"The mirror appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The mirror does not appear in the context frames, suggesting it is a new object introduced in the target frame.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0025__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "mirror",
    "evidence_for": "The mirror appears only in the target frame and is not present in the other frames.",
    "evidence_against": "The mirror does not appear in the other frames, indicating it is not part of the persistent scene content.",
    "needs_more_evidence": false,
    "frame_id": "0025",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"mirror\",\n  \"evidence_for\": \"The mirror appears only in the target frame and is not present in the other frames.\",\n  \"evidence_against\": \"The mirror does not appear in the other frames, indicating it is not part of the persistent scene content.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0025__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "mirror",
    "evidence_for": "The mirror appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The mirror does not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0025",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"mirror\",\n  \"evidence_for\": \"The mirror appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The mirror does not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0026 · dynamic

IoU 0.770 · precision 0.940 · recall 0.810 · proposal coverage 0.705 · SAM oracle 0.782

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0026__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "mannequin shirt",
    "evidence_for": "The mannequin shirt appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The mannequin shirt is not visible in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0026",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"mannequin shirt\",\n  \"evidence_for\": \"The mannequin shirt appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The mannequin shirt is not visible in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0026__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "mannequin torso",
    "evidence_for": "The mannequin torso appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The mannequin torso does not appear in any of the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0026",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"mannequin torso\",\n  \"evidence_for\": \"The mannequin torso appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The mannequin torso does not appear in any of the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0026__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "mannequin torso",
    "evidence_for": "The mannequin torso appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The mannequin torso does not appear in any of the context frames or the static reconstruction, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0026",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"mannequin torso\",\n  \"evidence_for\": \"The mannequin torso appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The mannequin torso does not appear in any of the context frames or the static reconstruction, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0027 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0027__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a green object on the floor",
    "evidence_for": "The green object appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The green object does not appear in any of the context frames or the static reconstruction, suggesting it is not part of the persistent scene content.",
    "needs_more_evidence": false,
    "frame_id": "0027",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a green object on the floor\",\n  \"evidence_for\": \"The green object appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The green object does not appear in any of the context frames or the static reconstruction, suggesting it is not part of the persistent scene content.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0027__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red umbrella is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0027",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0027__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a small red object on the floor",
    "evidence_for": "The small red object appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The object does not appear in the context frames, suggesting it is not part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0027",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a small red object on the floor\",\n  \"evidence_for\": \"The small red object appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The object does not appear in the context frames, suggesting it is not part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0028 · dynamic

IoU 0.525 · precision 0.618 · recall 0.777 · proposal coverage 0.820 · SAM oracle 0.613

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0028__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red umbrella is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0028",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0028__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a small green object on the floor",
    "evidence_for": "The small green object appears only in the target frame and is not present in the context frames or the static reconstruction.",
    "evidence_against": "The object does not appear in the context frames, suggesting it is not part of the persistent scene.",
    "needs_more_evidence": false,
    "frame_id": "0028",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a small green object on the floor\",\n  \"evidence_for\": \"The small green object appears only in the target frame and is not present in the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The object does not appear in the context frames, suggesting it is not part of the persistent scene.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0028__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a small blue object on the floor",
    "evidence_for": "The small blue object appears only in the target frame and is not present in any of the context frames or the static reconstruction.",
    "evidence_against": "The object does not appear in the RGB residual visualization, suggesting it is not a significant residual error.",
    "needs_more_evidence": false,
    "frame_id": "0028",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a small blue object on the floor\",\n  \"evidence_for\": \"The small blue object appears only in the target frame and is not present in any of the context frames or the static reconstruction.\",\n  \"evidence_against\": \"The object does not appear in the RGB residual visualization, suggesting it is not a significant residual error.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0029 · clean

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.000 · SAM oracle 0.000

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0029__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red umbrella is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0029",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0029__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0029",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0029__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in the context frames.",
    "evidence_against": "The red umbrella is not present in the context frames, indicating it is likely a transient object.",
    "needs_more_evidence": false,
    "frame_id": "0029",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the context frames, indicating it is likely a transient object.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]

0030 · dynamic

IoU 0.000 · precision 0.000 · recall 0.000 · proposal coverage 0.629 · SAM oracle 0.469

obs
render
residual
proposal
pred
gt
VLM decisions
[
  {
    "proposal_id": "round_00__view_0030__proposal_01",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red flowers in a vase",
    "evidence_for": "The red flowers appear only in the target frame and are not present in any of the context frames.",
    "evidence_against": "The red flowers do not appear in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0030",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red flowers in a vase\",\n  \"evidence_for\": \"The red flowers appear only in the target frame and are not present in any of the context frames.\",\n  \"evidence_against\": \"The red flowers do not appear in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0030__proposal_02",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "a red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.",
    "needs_more_evidence": false,
    "frame_id": "0030",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"a red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the RGB residual proposal visualization.\",\n  \"needs_more_evidence\": false\n}\n```"
  },
  {
    "proposal_id": "round_00__view_0030__proposal_03",
    "decision": "transient",
    "confidence": 0.9,
    "selected_sam_candidate": "A",
    "object_description": "red umbrella",
    "evidence_for": "The red umbrella appears only in the target frame and is not present in any of the context frames.",
    "evidence_against": "The red umbrella is not present in the static reconstruction or the nearby training observations.",
    "needs_more_evidence": false,
    "frame_id": "0030",
    "raw_response": "```json\n{\n  \"decision\": \"transient\",\n  \"confidence\": 0.9,\n  \"selected_sam_candidate\": \"A\",\n  \"object_description\": \"red umbrella\",\n  \"evidence_for\": \"The red umbrella appears only in the target frame and is not present in any of the context frames.\",\n  \"evidence_against\": \"The red umbrella is not present in the static reconstruction or the nearby training observations.\",\n  \"needs_more_evidence\": false\n}\n```"
  }
]