I have looked at the previous version of tests_results.txt and it's a little more than I first thought.
Reproducibility test for task 1 checks the element wise absolute error of dist_all.npy vs the reference (a (8,14) dimension array)
Reproducibility test for task 2 checks the contents of IDloc.npy, IDSel.npy and IDx.npy vs the reference.
Reproducibility test for task 3 checks the contents of SRF_FGSPIN.10Y.ORC22v8034_19101231_sechiba_rest.nc vs the reference. (dimensions and variables)
Reproducibility test for task 4 checks all *.png files,
and contents of SBG_FGSPIN.340Y.ORC22v8034_22501231_stomate_rest.nc
Regarding the new implementation:
task 1 checks everything as before - but we don't output absolute error.
task 2 checks everything as before
task 4 checks the output to 2 s.f. vs reference of the [R2,slope,NRME].txt error. We do not check *.pngs or the stomate_rest.nc file. The latter seems easy to check.
It would be useful to put this in a tests_results.txt report as before, providing absolute errors and the contents as it was originally summarised.
I have looked at the previous version of tests_results.txt and it's a little more than I first thought.
Reproducibility test for task 1 checks the element wise absolute error of dist_all.npy vs the reference (a (8,14) dimension array)
Reproducibility test for task 2 checks the contents of IDloc.npy, IDSel.npy and IDx.npy vs the reference.
Reproducibility test for task 3 checks the contents of SRF_FGSPIN.10Y.ORC22v8034_19101231_sechiba_rest.nc vs the reference. (dimensions and variables)
Reproducibility test for task 4 checks all *.png files,
and contents of SBG_FGSPIN.340Y.ORC22v8034_22501231_stomate_rest.nc
Regarding the new implementation:
task 1 checks everything as before - but we don't output absolute error.
task 2 checks everything as before
task 4 checks the output to 2 s.f. vs reference of the [R2,slope,NRME].txt error. We do not check *.pngs or the stomate_rest.nc file. The latter seems easy to check.
It would be useful to put this in a tests_results.txt report as before, providing absolute errors and the contents as it was originally summarised.