V5 — 4x Tensor Super-Resolution

Date: 2026-07-13. Source video: /local/scratch-2/fy277/temp/vdp_screening/input/cycle_view.mp4. Clip: 3.0s at 8 fps, resized to 384×256. Optimization iterations: L1/L2/CVVDP-heatmap L1 = 260; raw CVVDP = 70. Task: optimize the 4x downsampled RGB tensor directly, then bicubic-upsample to reference resolution. Losses: L1, L2, detached CVVDP raw-heatmap weighted L1, and direct raw CVVDP scalar.

1 · Full Metric Table

NameLossJODΔJODPSNRΔPSNRSSIML1L2LPIPSΔLPIPSSeconds
raw_cvvdp-CVVDP JOD + 0.01 L17.885+1.56022.220-0.2150.5950.051430.0059980.6096+0.047115.5
l2L27.588+1.26324.186+1.7510.6740.038710.0038140.5172-0.04530.3
vdp_heat_l1CVVDP raw heatmap × L17.392+1.06723.797+1.3630.6630.037800.0041710.5235-0.03890.3
l1L17.331+1.00623.765+1.3300.6700.036910.0042020.5284-0.03410.4
bicubicnone6.325+0.00022.435+0.0000.6270.045380.0057090.5625+0.00000.0

2 · Videos

Reference clip
4x downsampled input
Bicubic baseline
Optimized tensor · L1
Optimized tensor · L2
Optimized tensor · CVVDP heatmap L1
Optimized tensor · raw CVVDP scalar
Bicubic CVVDP raw heatmap

3 · Diagnostics

Frame comparison grid
Frame comparison grid
Optimization curves
Optimization curves
PSNR per frame
PSNR per frame

4 · Verdict

This run optimizes the 4x low-resolution tensor directly on a different 3-second video clip. Compared with bicubic, L1 changes JOD by +1.006, L2 by +1.263, CVVDP-heatmap L1 by +1.067, and raw CVVDP by +1.560. The raw CVVDP column is a direct differentiable scalar-loss probe; the heatmap-weighted variant keeps CVVDP detached and uses it only as spatial perceptual weighting.

5 · Config

{
  "source_video": "/local/scratch-2/fy277/temp/vdp_screening/input/cycle_view.mp4",
  "work_dir": "/local/scratch-2/fy277/temp/vdp_screening/work/v5_cycle_view_superres_tensor_opt_20260713",
  "seconds": 3.0,
  "start": 0.0,
  "fps": 8,
  "frames": 24,
  "width": 384,
  "height": 256,
  "downsample_factor": 4,
  "low_width": 96,
  "low_height": 64,
  "steps": 260,
  "raw_steps": 70,
  "lr": 0.08,
  "raw_lr": 0.025,
  "device": "cuda",
  "cuda_visible_devices": "0"
}