Hash for test 'subtests.subtest.test_functions.test_hmissing_imissing' not found in /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json. Generated hash is 2d15274f0e9b44f1c16e6b237710cd36a3de5c5b7596ef0e65e7a33ce4624cf4. Image comparison test --------------------- Image file not found for comparison test in: /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/baseline (This is expected for new tests.) Generated Image: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmissing_imissing/result.png
None
2d15274f0e9b44f1c16e6b237710cd36a3de5c5b7596ef0e65e7a33ce4624cf4
Hash for test 'subtests.subtest.test_functions.test_hmissing_idiff' not found in /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json. Generated hash is 9e98dbd2027525c776212daa061180b4fc40ad12dfc2cdfe4b86694ede14e0c3. Image comparison test --------------------- Error: Image files did not match. RMS Value: 24.6217358806762 Expected: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmissing_idiff/baseline.png Actual: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmissing_idiff/result.png Difference: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmissing_idiff/result-failed-diff.png Tolerance: 2
24.6217358806762
2
None
9e98dbd2027525c776212daa061180b4fc40ad12dfc2cdfe4b86694ede14e0c3
Hash for test 'subtests.subtest.test_functions.test_hmissing_idiffshape' not found in /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json. Generated hash is 5534324f9da5c1c104c3ef3435dc6fa9792c0d0d8b762fad5d7f81abd91fbb89. Image comparison test --------------------- Error: Image dimensions did not match. Expected shape: (300, 400) /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmissing_idiffshape/baseline.png Actual shape: (600, 800) /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmissing_idiffshape/result.png
None
None
None
5534324f9da5c1c104c3ef3435dc6fa9792c0d0d8b762fad5d7f81abd91fbb89
Hash e37bd5868d14547557653c051d23d3fd48d198d3f59006dc5ba390433d6670ff doesn't match hash d1ffd5868d14547557653c051d23d3fd48d198d3f59006dc5ba390433d6670ff in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_functions.test_hdiff_imissing. Image comparison test --------------------- Image file not found for comparison test in: /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/baseline (This is expected for new tests.) Generated Image: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hdiff_imissing/result.png
d1ffd5868d14547557653c051d23d3fd48d198d3f59006dc5ba390433d6670ff
e37bd5868d14547557653c051d23d3fd48d198d3f59006dc5ba390433d6670ff
Hash for test 'subtests.subtest.test_functions.test_hmissing_imatch' not found in /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json. Generated hash is 592d12cc2d5749a6607bbf98d715b95c06a2af6572a7e298bcae349648b9997e. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
None
592d12cc2d5749a6607bbf98d715b95c06a2af6572a7e298bcae349648b9997e
Hash 2bb430367cdf04b7b5f3af8c50652964ff27def9fc0a75a68b4775ba1eb8e827 doesn't match hash d1ff30367cdf04b7b5f3af8c50652964ff27def9fc0a75a68b4775ba1eb8e827 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_classes.TestClass.test_hdiff_idiff_testclass. Image comparison test --------------------- Error: Image files did not match. RMS Value: 24.536840442259244 Expected: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_classes.TestClass.test_hdiff_idiff_testclass/baseline.png Actual: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_classes.TestClass.test_hdiff_idiff_testclass/result.png Difference: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_classes.TestClass.test_hdiff_idiff_testclass/result-failed-diff.png Tolerance: 2
24.536840442259244
2
d1ff30367cdf04b7b5f3af8c50652964ff27def9fc0a75a68b4775ba1eb8e827
2bb430367cdf04b7b5f3af8c50652964ff27def9fc0a75a68b4775ba1eb8e827
Hash 56d00363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252 doesn't match hash d1ff0363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_classes.TestClassWithSetupMethod.test_hdiff_idiff_testclasswithsetupmethod. Image comparison test --------------------- Error: Image files did not match. RMS Value: 24.537034749650488 Expected: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_classes.TestClassWithSetupMethod.test_hdiff_idiff_testclasswithsetupmethod/baseline.png Actual: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_classes.TestClassWithSetupMethod.test_hdiff_idiff_testclasswithsetupmethod/result.png Difference: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_classes.TestClassWithSetupMethod.test_hdiff_idiff_testclasswithsetupmethod/result-failed-diff.png Tolerance: 2
24.537034749650488
2
d1ff0363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252
56d00363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252
Hash 8c4fa5f95b2a2b424ad9e441b6aeeced9d51a52fe7f19870eedcdfdcf6d39818 doesn't match hash d1ffa5f95b2a2b424ad9e441b6aeeced9d51a52fe7f19870eedcdfdcf6d39818 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_classes.TestClassWithSetupClass.test_hdiff_idiff_testclasswithsetupclass. Image comparison test --------------------- Error: Image files did not match. RMS Value: 24.563779228775037 Expected: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_classes.TestClassWithSetupClass.test_hdiff_idiff_testclasswithsetupclass/baseline.png Actual: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_classes.TestClassWithSetupClass.test_hdiff_idiff_testclasswithsetupclass/result.png Difference: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_classes.TestClassWithSetupClass.test_hdiff_idiff_testclasswithsetupclass/result-failed-diff.png Tolerance: 2
24.563779228775037
2
d1ffa5f95b2a2b424ad9e441b6aeeced9d51a52fe7f19870eedcdfdcf6d39818
8c4fa5f95b2a2b424ad9e441b6aeeced9d51a52fe7f19870eedcdfdcf6d39818
Hash 567f014f73cdfea555e46a29aaac43c4394c3c4c21998e54971edb773eee6c95 doesn't match hash d1ff014f73cdfea555e46a29aaac43c4394c3c4c21998e54971edb773eee6c95 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_functions.test_hdiff_idiff. Image comparison test --------------------- Error: Image files did not match. RMS Value: 24.620185259705547 Expected: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hdiff_idiff/baseline.png Actual: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hdiff_idiff/result.png Difference: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hdiff_idiff/result-failed-diff.png Tolerance: 2
24.620185259705547
2
d1ff014f73cdfea555e46a29aaac43c4394c3c4c21998e54971edb773eee6c95
567f014f73cdfea555e46a29aaac43c4394c3c4c21998e54971edb773eee6c95
Hash b6673bafdcc8350c612bc925269fc4332dd9062a6399701067863b178568b219 doesn't match hash d1ff3bafdcc8350c612bc925269fc4332dd9062a6399701067863b178568b219 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_functions.test_hdiff_idiffshape. Image comparison test --------------------- Error: Image dimensions did not match. Expected shape: (300, 400) /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hdiff_idiffshape/baseline.png Actual shape: (600, 800) /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hdiff_idiffshape/result.png
None
None
d1ff3bafdcc8350c612bc925269fc4332dd9062a6399701067863b178568b219
b6673bafdcc8350c612bc925269fc4332dd9062a6399701067863b178568b219
Hash f26ca66a7c02ae64c8b2512021e0450cbe64c084c9d5f7e2600a7342a559c0b1 doesn't match hash d1ffa66a7c02ae64c8b2512021e0450cbe64c084c9d5f7e2600a7342a559c0b1 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_special.test_hdiff_idiff_tolerance. Image comparison test --------------------- Error: Image files did not match. RMS Value: 24.576566752362574 Expected: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_special.test_hdiff_idiff_tolerance/baseline.png Actual: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_special.test_hdiff_idiff_tolerance/result.png Difference: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_special.test_hdiff_idiff_tolerance/result-failed-diff.png Tolerance: 3
24.576566752362574
3
d1ffa66a7c02ae64c8b2512021e0450cbe64c084c9d5f7e2600a7342a559c0b1
f26ca66a7c02ae64c8b2512021e0450cbe64c084c9d5f7e2600a7342a559c0b1
Hash 2bb430367cdf04b7b5f3af8c50652964ff27def9fc0a75a68b4775ba1eb8e827 doesn't match hash d1ff30367cdf04b7b5f3af8c50652964ff27def9fc0a75a68b4775ba1eb8e827 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_unittest.TestCase.test_hdiff_idiff_testclass. Image comparison test --------------------- Error: Image files did not match. RMS Value: 24.536840442259244 Expected: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_unittest.TestCase.test_hdiff_idiff_testclass/baseline.png Actual: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_unittest.TestCase.test_hdiff_idiff_testclass/result.png Difference: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_unittest.TestCase.test_hdiff_idiff_testclass/result-failed-diff.png Tolerance: 2
24.536840442259244
2
d1ff30367cdf04b7b5f3af8c50652964ff27def9fc0a75a68b4775ba1eb8e827
2bb430367cdf04b7b5f3af8c50652964ff27def9fc0a75a68b4775ba1eb8e827
Hash 56d00363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252 doesn't match hash d1ff0363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_unittest.TestCaseWithSetUp.test_hdiff_idiff_testcasewithsetup. Image comparison test --------------------- Error: Image files did not match. RMS Value: 24.537034749650488 Expected: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_unittest.TestCaseWithSetUp.test_hdiff_idiff_testcasewithsetup/baseline.png Actual: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_unittest.TestCaseWithSetUp.test_hdiff_idiff_testcasewithsetup/result.png Difference: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_unittest.TestCaseWithSetUp.test_hdiff_idiff_testcasewithsetup/result-failed-diff.png Tolerance: 2
24.537034749650488
2
d1ff0363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252
56d00363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252
Hash 5f1e6e2b775a1b1d1e9e20a4d929586a9accb08b2fddaec8a24fb4acfc83c602 doesn't match hash d1ff6e2b775a1b1d1e9e20a4d929586a9accb08b2fddaec8a24fb4acfc83c602 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_unittest.TestCaseWithSetUpClass.test_hdiff_idiff_testcasewithsetupclass. Image comparison test --------------------- Error: Image files did not match. RMS Value: 24.520257314106637 Expected: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_unittest.TestCaseWithSetUpClass.test_hdiff_idiff_testcasewithsetupclass/baseline.png Actual: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_unittest.TestCaseWithSetUpClass.test_hdiff_idiff_testcasewithsetupclass/result.png Difference: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_unittest.TestCaseWithSetUpClass.test_hdiff_idiff_testcasewithsetupclass/result-failed-diff.png Tolerance: 2
24.520257314106637
2
d1ff6e2b775a1b1d1e9e20a4d929586a9accb08b2fddaec8a24fb4acfc83c602
5f1e6e2b775a1b1d1e9e20a4d929586a9accb08b2fddaec8a24fb4acfc83c602
Hash b92c5c6bc631fbdaffa23d3d57fc027768fcded889f3b269941da859110ce282 doesn't match hash d1ff5c6bc631fbdaffa23d3d57fc027768fcded889f3b269941da859110ce282 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_functions.test_hdiff_imatch. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
d1ff5c6bc631fbdaffa23d3d57fc027768fcded889f3b269941da859110ce282
b92c5c6bc631fbdaffa23d3d57fc027768fcded889f3b269941da859110ce282
Hash f26ca66a7c02ae64c8b2512021e0450cbe64c084c9d5f7e2600a7342a559c0b1 doesn't match hash d1ffa66a7c02ae64c8b2512021e0450cbe64c084c9d5f7e2600a7342a559c0b1 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_special.test_hdiff_imatch_tolerance. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
200
d1ffa66a7c02ae64c8b2512021e0450cbe64c084c9d5f7e2600a7342a559c0b1
f26ca66a7c02ae64c8b2512021e0450cbe64c084c9d5f7e2600a7342a559c0b1
Hash 0a0514c35f1da18de3f4ceb1901501e5a8a5a0d18eb8a7b4db5cfde170b57423 doesn't match hash d1ff14c35f1da18de3f4ceb1901501e5a8a5a0d18eb8a7b4db5cfde170b57423 in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_special.test_hdiff_imatch_savefig. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
d1ff14c35f1da18de3f4ceb1901501e5a8a5a0d18eb8a7b4db5cfde170b57423
0a0514c35f1da18de3f4ceb1901501e5a8a5a0d18eb8a7b4db5cfde170b57423
Hash 588ad00c4b99c6087d04f84ca071a5997b4ecf76cf859ce3548634e67841a79b doesn't match hash d1ffd00c4b99c6087d04f84ca071a5997b4ecf76cf859ce3548634e67841a79b in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_special.test_hdiff_imatch_style. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
d1ffd00c4b99c6087d04f84ca071a5997b4ecf76cf859ce3548634e67841a79b
588ad00c4b99c6087d04f84ca071a5997b4ecf76cf859ce3548634e67841a79b
Hash a78ad7512c6d886262b1bcb4501374bfc61ef8569d24930b0258dab08e6eca9a doesn't match hash d1ffd7512c6d886262b1bcb4501374bfc61ef8569d24930b0258dab08e6eca9a in library /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/hashes/mpl35_ft261.json for test subtests.subtest.test_special.test_hdiff_imatch_removetext. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
d1ffd7512c6d886262b1bcb4501374bfc61ef8569d24930b0258dab08e6eca9a
a78ad7512c6d886262b1bcb4501374bfc61ef8569d24930b0258dab08e6eca9a
Test hash matches baseline hash. Image comparison test --------------------- Image file not found for comparison test in: /home/runner/work/pytest-mpl/pytest-mpl/tests/subtests/subtest/baseline (This is expected for new tests.) Generated Image: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmatch_imissing/result.png
f06e910b6c80db28e1eb08fdb8e1ab9211434498c134d00820900a13a4f2568c
f06e910b6c80db28e1eb08fdb8e1ab9211434498c134d00820900a13a4f2568c
Test hash matches baseline hash. Image comparison test --------------------- Error: Image files did not match. RMS Value: 24.618234716477044 Expected: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmatch_idiff/baseline.png Actual: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmatch_idiff/result.png Difference: /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmatch_idiff/result-failed-diff.png Tolerance: 2
24.618234716477044
2
085fcb22e9d6cfbb2bb6e0efbf749fa598be27e837c348130adc21a6dc2fc5fe
085fcb22e9d6cfbb2bb6e0efbf749fa598be27e837c348130adc21a6dc2fc5fe
Test hash matches baseline hash. Image comparison test --------------------- Error: Image dimensions did not match. Expected shape: (300, 400) /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmatch_idiffshape/baseline.png Actual shape: (600, 800) /tmp/tmp2iaapcsb/test_html0/results/subtests.subtest.test_functions.test_hmatch_idiffshape/result.png
None
None
a8f866c3b765e274c217d49ba72c9ce3bd4b316491ffd34a124ef03643ce45b8
a8f866c3b765e274c217d49ba72c9ce3bd4b316491ffd34a124ef03643ce45b8
Test hash matches baseline hash. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
af966da7f2e57908211d559ff0a24a52c363c3fabca9e810138ad60e3fd2bcc9
af966da7f2e57908211d559ff0a24a52c363c3fabca9e810138ad60e3fd2bcc9
Test hash matches baseline hash. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
56d00363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252
56d00363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252
Test hash matches baseline hash. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
8c4fa5f95b2a2b424ad9e441b6aeeced9d51a52fe7f19870eedcdfdcf6d39818
8c4fa5f95b2a2b424ad9e441b6aeeced9d51a52fe7f19870eedcdfdcf6d39818
Test hash matches baseline hash. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
ee0c290d66d17e4e40991c31eee0c55bd724922a3ecb66f7300b2ce8abf3d204
ee0c290d66d17e4e40991c31eee0c55bd724922a3ecb66f7300b2ce8abf3d204
Test hash matches baseline hash. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
3f8d2c1facdf6e34e43b4343abd888bd5ee9d2d451ce285e62bf0c65d6cdcdce
3f8d2c1facdf6e34e43b4343abd888bd5ee9d2d451ce285e62bf0c65d6cdcdce
Test hash matches baseline hash. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
9a6b008431f0b47a8866d87a9f1e9352fd73407a3ee2dd756a8ccbfa5a835a08
9a6b008431f0b47a8866d87a9f1e9352fd73407a3ee2dd756a8ccbfa5a835a08
Test hash matches baseline hash. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
d21af7f9a2c1cbaf3c9bca3598f1b32b36891ac9d5db47e81a7bcaa342f7d4fc
d21af7f9a2c1cbaf3c9bca3598f1b32b36891ac9d5db47e81a7bcaa342f7d4fc
Test hash matches baseline hash. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
af966da7f2e57908211d559ff0a24a52c363c3fabca9e810138ad60e3fd2bcc9
af966da7f2e57908211d559ff0a24a52c363c3fabca9e810138ad60e3fd2bcc9
Test hash matches baseline hash. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
56d00363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252
56d00363330cb7d959d6cfdc1335901716e841f54014cb6e657d1c4721384252
Test hash matches baseline hash. Image comparison test --------------------- The comparison to the baseline image succeeded.
< tolerance
2
5f1e6e2b775a1b1d1e9e20a4d929586a9accb08b2fddaec8a24fb4acfc83c602
5f1e6e2b775a1b1d1e9e20a4d929586a9accb08b2fddaec8a24fb4acfc83c602