BDRF-space metric performance on the subjective BRDF quality dataset

The report shows the results for the following performance indices:

You can click on the BRDF-Quality links below to see the detailed scatter plots showing the relation between metric predictions and the BRDF subjective quality.



Metric/Variant SROCC RMSE KROCC PLCC
BRDF-Quality BRDF-Quality BRDF-Quality BRDF-Quality
MA-LogWE (ε=1e-5) → 0.5391 1.64 0.3755 0.519
MA-LogWE (ε=1e-6) → 0.5184 1.653 0.3589 0.5071
MA-LogWE (ε=0.0001) → 0.5533 1.659 0.385 0.502
RMS-LogE (ε=0.0001) → 0.5101 1.673 0.3485 0.4888
MA-LogE (ε=0.0001) → 0.5101 1.673 0.3485 0.4888
RMS-LogWE (ε=1e-5) → 0.4887 1.682 0.3341 0.4811
RMS-LogE (ε=1e-5) → 0.4841 1.684 0.3336 0.4788
MA-LogE (ε=1e-5) → 0.4841 1.684 0.3336 0.4788
RMS-LogWE (ε=0.0001) → 0.5185 1.686 0.3557 0.4767
RMS-LogWE (ε=1e-6) → 0.4669 1.701 0.3232 0.4623
RMS-LogE (ε=1e-6) → 0.4559 1.707 0.3155 0.456
MA-LogE (ε=1e-6) → 0.4559 1.707 0.3155 0.456
RMS-LogE (ε=0.001) → 0.5009 1.73 0.3372 0.432
MA-LogE (ε=0.001) → 0.5009 1.73 0.3372 0.432
MA-LogWE (ε=0.001) → 0.4965 1.746 0.3383 0.4137
RMS-LogWE (ε=0.001) → 0.4797 1.763 0.3207 0.3936
MA-LogWE (ε=0.01) → 0.3833 1.841 0.2638 0.2802
RMS-LogE (ε=0.01) → 0.3694 1.842 0.2457 0.2793
MA-LogE (ε=0.01) → 0.3694 1.842 0.2457 0.2793
RMS-LogWE (ε=0.01) → 0.3624 1.855 0.2412 0.2537
MA-CRWE → 0.4063 1.856 0.2687 0.2523
MA-LogWE (ε=0.1) → 0.3432 1.87 0.2297 0.2219
RMS-CRWE → 0.3997 1.873 0.2658 0.2145
RMS-LogWE (ε=0.1) → 0.3258 1.883 0.216 0.1902
MA-LogWE (ε=1) → 0.3789 1.884 0.2475 0.1869
RMS-LogE (ε=0.1) → 0.295 1.887 0.1965 0.1799
MA-LogE (ε=0.1) → 0.295 1.887 0.1965 0.1799
RMS-LogWE (ε=1) → 0.3678 1.894 0.2418 0.1597
RMS-LogE (ε=1) → 0.3211 1.894 0.2144 0.1566
MA-LogE (ε=1) → 0.3211 1.894 0.2144 0.1566
MA-E → 0.3826 1.911 0.254 0.0839
RMS-E → 0.3806 1.913 0.2525 0.07374

MA-LogWE (ε=1e-5)

Test: SROCC = 0.5391 RMSE = 1.64 KROCC = 0.3755 PLCC = 0.519

Detailed report for:BRDF-Quality



MA-LogWE (ε=1e-6)

Test: SROCC = 0.5184 RMSE = 1.653 KROCC = 0.3589 PLCC = 0.5071

Detailed report for:BRDF-Quality



MA-LogWE (ε=0.0001)

Test: SROCC = 0.5533 RMSE = 1.659 KROCC = 0.385 PLCC = 0.502

Detailed report for:BRDF-Quality



RMS-LogE (ε=0.0001)

Test: SROCC = 0.5101 RMSE = 1.673 KROCC = 0.3485 PLCC = 0.4888

Detailed report for:BRDF-Quality



MA-LogE (ε=0.0001)

Test: SROCC = 0.5101 RMSE = 1.673 KROCC = 0.3485 PLCC = 0.4888

Detailed report for:BRDF-Quality



RMS-LogWE (ε=1e-5)

Test: SROCC = 0.4887 RMSE = 1.682 KROCC = 0.3341 PLCC = 0.4811

Detailed report for:BRDF-Quality



RMS-LogE (ε=1e-5)

Test: SROCC = 0.4841 RMSE = 1.684 KROCC = 0.3336 PLCC = 0.4788

Detailed report for:BRDF-Quality



MA-LogE (ε=1e-5)

Test: SROCC = 0.4841 RMSE = 1.684 KROCC = 0.3336 PLCC = 0.4788

Detailed report for:BRDF-Quality



RMS-LogWE (ε=0.0001)

Test: SROCC = 0.5185 RMSE = 1.686 KROCC = 0.3557 PLCC = 0.4767

Detailed report for:BRDF-Quality



RMS-LogWE (ε=1e-6)

Test: SROCC = 0.4669 RMSE = 1.701 KROCC = 0.3232 PLCC = 0.4623

Detailed report for:BRDF-Quality



RMS-LogE (ε=1e-6)

Test: SROCC = 0.4559 RMSE = 1.707 KROCC = 0.3155 PLCC = 0.456

Detailed report for:BRDF-Quality



MA-LogE (ε=1e-6)

Test: SROCC = 0.4559 RMSE = 1.707 KROCC = 0.3155 PLCC = 0.456

Detailed report for:BRDF-Quality



RMS-LogE (ε=0.001)

Test: SROCC = 0.5009 RMSE = 1.73 KROCC = 0.3372 PLCC = 0.432

Detailed report for:BRDF-Quality



MA-LogE (ε=0.001)

Test: SROCC = 0.5009 RMSE = 1.73 KROCC = 0.3372 PLCC = 0.432

Detailed report for:BRDF-Quality



MA-LogWE (ε=0.001)

Test: SROCC = 0.4965 RMSE = 1.746 KROCC = 0.3383 PLCC = 0.4137

Detailed report for:BRDF-Quality



RMS-LogWE (ε=0.001)

Test: SROCC = 0.4797 RMSE = 1.763 KROCC = 0.3207 PLCC = 0.3936

Detailed report for:BRDF-Quality



MA-LogWE (ε=0.01)

Test: SROCC = 0.3833 RMSE = 1.841 KROCC = 0.2638 PLCC = 0.2802

Detailed report for:BRDF-Quality



RMS-LogE (ε=0.01)

Test: SROCC = 0.3694 RMSE = 1.842 KROCC = 0.2457 PLCC = 0.2793

Detailed report for:BRDF-Quality



MA-LogE (ε=0.01)

Test: SROCC = 0.3694 RMSE = 1.842 KROCC = 0.2457 PLCC = 0.2793

Detailed report for:BRDF-Quality



RMS-LogWE (ε=0.01)

Test: SROCC = 0.3624 RMSE = 1.855 KROCC = 0.2412 PLCC = 0.2537

Detailed report for:BRDF-Quality



MA-CRWE

Test: SROCC = 0.4063 RMSE = 1.856 KROCC = 0.2687 PLCC = 0.2523

Detailed report for:BRDF-Quality



MA-LogWE (ε=0.1)

Test: SROCC = 0.3432 RMSE = 1.87 KROCC = 0.2297 PLCC = 0.2219

Detailed report for:BRDF-Quality



RMS-CRWE

Test: SROCC = 0.3997 RMSE = 1.873 KROCC = 0.2658 PLCC = 0.2145

Detailed report for:BRDF-Quality



RMS-LogWE (ε=0.1)

Test: SROCC = 0.3258 RMSE = 1.883 KROCC = 0.216 PLCC = 0.1902

Detailed report for:BRDF-Quality



MA-LogWE (ε=1)

Test: SROCC = 0.3789 RMSE = 1.884 KROCC = 0.2475 PLCC = 0.1869

Detailed report for:BRDF-Quality



RMS-LogE (ε=0.1)

Test: SROCC = 0.295 RMSE = 1.887 KROCC = 0.1965 PLCC = 0.1799

Detailed report for:BRDF-Quality



MA-LogE (ε=0.1)

Test: SROCC = 0.295 RMSE = 1.887 KROCC = 0.1965 PLCC = 0.1799

Detailed report for:BRDF-Quality



RMS-LogWE (ε=1)

Test: SROCC = 0.3678 RMSE = 1.894 KROCC = 0.2418 PLCC = 0.1597

Detailed report for:BRDF-Quality



RMS-LogE (ε=1)

Test: SROCC = 0.3211 RMSE = 1.894 KROCC = 0.2144 PLCC = 0.1566

Detailed report for:BRDF-Quality



MA-LogE (ε=1)

Test: SROCC = 0.3211 RMSE = 1.894 KROCC = 0.2144 PLCC = 0.1566

Detailed report for:BRDF-Quality



MA-E

Test: SROCC = 0.3826 RMSE = 1.911 KROCC = 0.254 PLCC = 0.0839

Detailed report for:BRDF-Quality



RMS-E

Test: SROCC = 0.3806 RMSE = 1.913 KROCC = 0.2525 PLCC = 0.07374

Detailed report for:BRDF-Quality