Ablation: contrast representation



Metric/Variant RMSE PLCC SROCC
FovDots UPIQ DeepFovea LIVE-FBT-FCVR Average(1) FovDots UPIQ DeepFovea LIVE-FBT-FCVR Average(2) FovDots UPIQ DeepFovea LIVE-FBT-FCVR Average(3)
Weber contrast 0.8938 0.7696 0.9376 0.6481 0.8123 0.7873 0.8599 0.8322 0.728 0.8554 0.8148 0.83 0.8413 0.7254 0.8287
Logarithmic contrast 1.088 0.9228 0.972 0.6455 0.907 0.7157 0.7901 0.8407 0.7578 0.7869 0.7216 0.7599 0.843 0.7579 0.7597

(1)Average RMSE is computed as an average of RMSEs of individual datasets so that each dataset has the same influence on the average RMSE regardless of the number of conditions it contains.

(2-3)Average correlation coeffcients are computed for the consolidated dataset consisting of all four individual datasets. It means that the average correlation coefficients are dominated by the performance of UPIQ, which contains over 4000 conditions. For that reason, RMSE is more indicative of metric performance.


Weber contrast

RMSE = 0.8123 PLCC = 0.8554 SROCC = 0.8287

JOD regression: Q = 10 -0.0129523 * M^0.596953

Logarithmic contrast

RMSE = 0.907 PLCC = 0.7869 SROCC = 0.7597

JOD regression: Q = 10 -0.0909765 * M^0.406821