info

algorithm local_revision global_revision revision_summary build_options driver_options component_options
issue731-base-blind-release32 issue731-base 4c4a20cebfcd 4c4a20cebfcd (issue731) issue731-base [u'-j20', u'release32'] [u'--validate', u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--build', u'release32'] [u'--search', u'astar(blind())']
issue731-base-cegar-release32 issue731-base 4c4a20cebfcd 4c4a20cebfcd (issue731) issue731-base [u'-j20', u'release32'] [u'--validate', u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--build', u'release32'] [u'--search', u'astar(cegar())']
issue731-base-divpot-release32 issue731-base 4c4a20cebfcd 4c4a20cebfcd (issue731) issue731-base [u'-j20', u'release32'] [u'--validate', u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--build', u'release32'] [u'--search', u'astar(diverse_potentials())']
issue731-base-ipdb-release32 issue731-base 4c4a20cebfcd 4c4a20cebfcd (issue731) issue731-base [u'-j20', u'release32'] [u'--validate', u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--build', u'release32'] [u'--search', u'astar(ipdb())']
issue731-base-systematic2-release32 issue731-base 4c4a20cebfcd 4c4a20cebfcd (issue731) issue731-base [u'-j20', u'release32'] [u'--validate', u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--build', u'release32'] [u'--search', u'astar(cpdbs(systematic(2)))']
issue731-v4-blind-release32 issue731-v4 d532fb910142 d532fb910142 (issue731) issue731-v4 [u'-j20', u'release32'] [u'--validate', u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--build', u'release32'] [u'--search', u'astar(blind())']
issue731-v4-cegar-release32 issue731-v4 d532fb910142 d532fb910142 (issue731) issue731-v4 [u'-j20', u'release32'] [u'--validate', u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--build', u'release32'] [u'--search', u'astar(cegar())']
issue731-v4-divpot-release32 issue731-v4 d532fb910142 d532fb910142 (issue731) issue731-v4 [u'-j20', u'release32'] [u'--validate', u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--build', u'release32'] [u'--search', u'astar(diverse_potentials())']
issue731-v4-ipdb-release32 issue731-v4 d532fb910142 d532fb910142 (issue731) issue731-v4 [u'-j20', u'release32'] [u'--validate', u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--build', u'release32'] [u'--search', u'astar(ipdb())']
issue731-v4-systematic2-release32 issue731-v4 d532fb910142 d532fb910142 (issue731) issue731-v4 [u'-j20', u'release32'] [u'--validate', u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--build', u'release32'] [u'--search', u'astar(cpdbs(systematic(2)))']

summary

Summary issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
cost - Sum 6396115.00 6396115.00 0.0 6396115.00 6396115.00 0.0 6396115.00 6396115.00 0.0 6396115.00 6396115.00 0.0 6396115.00 6396115.00 0.0
coverage - Sum 616 616 0.0 807 809 2.0 798 798 0.0 656 654 -2.0 777 776 -1.0
evaluations - Geometric mean 78128.21 78128.21 0.0 9154.81 9171.58 16.77 9275.60 9275.60 0.0 8620.80 8620.80 0.0 4406.48 4406.48 0.0
expansions - Geometric mean 0.00 0.00 0.0 3746.42 3754.68 8.25 0.00 0.00 0.0 0.00 0.00 0.0 0.00 0.00 0.0
expansions_until_last_jump - Sum 956087338 956087338 0.0 404979115 404863412 -115703.0 311001863 311001863 0.0 218062004 218062004 0.0 143871268 143871268 0.0
generated - Geometric mean 0.00 0.00 0.0 0.00 0.00 0.0 0.00 0.00 0.0 0.00 0.00 0.0 0.00 0.00 0.0
memory - Sum 92422836 92424676 1840.0 47984964 47980132 -4832.0 72623524 72623812 288.0 30600188 30601388 1200.0 31742360 31742360 0.0
quality - Sum 616.00 616.00 0.0 807.00 809.00 2.0 798.00 798.00 0.0 656.00 654.00 -2.0 777.00 776.00 -1.0
score_evaluations - Sum 229.76 229.76 0.0 372.38 372.51 0.13 364.90 364.90 0.0 321.54 321.49 -0.05 382.98 382.98 0.0
score_expansions - Sum 244.30 244.30 0.0 423.24 423.61 0.37 417.28 417.28 0.0 361.31 361.05 -0.26 434.70 434.70 0.0
score_generated - Sum 175.96 175.96 0.0 327.28 327.30 0.02 320.20 320.20 0.0 278.02 278.02 0.0 337.05 337.05 0.0
score_memory - Sum 310.51 310.51 -0.0 415.58 416.06 0.47 307.55 307.55 0.0 364.91 364.01 -0.91 403.23 403.23 -0.0
score_search_time - Sum 512.13 510.76 -1.37 690.35 689.56 -0.79 685.90 684.39 -1.51 565.53 565.01 -0.53 689.81 689.07 -0.74
score_total_time - Sum 512.01 510.65 -1.37 653.90 652.91 -1.0 652.95 651.05 -1.9 556.14 552.73 -3.41 592.51 592.14 -0.37
search_time - Geometric mean 0.69 0.72 0.02 0.13 0.14 0.0 0.16 0.16 0.0 0.23 0.24 0.0 0.08 0.08 0.0
total_time - Geometric mean 0.73 0.76 0.02 0.48 0.49 0.01 0.38 0.40 0.01 0.43 0.48 0.05 1.04 1.04 0.01

cost

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
airport (17) 873.00 873.00 0.0 873.00 873.00 0.0 873.00 873.00 0.0 873.00 873.00 0.0 873.00 873.00 0.0
barman-opt11-strips (4) 360.00 360.00 0.0 360.00 360.00 0.0 360.00 360.00 0.0 360.00 360.00 0.0 360.00 360.00 0.0
blocks (18) 302.00 302.00 0.0 302.00 302.00 0.0 302.00 302.00 0.0 302.00 302.00 0.0 302.00 302.00 0.0
depot (4) 73.00 73.00 0.0 73.00 73.00 0.0 73.00 73.00 0.0 73.00 73.00 0.0 73.00 73.00 0.0
driverlog (7) 96.00 96.00 0.0 96.00 96.00 0.0 96.00 96.00 0.0 96.00 96.00 0.0 96.00 96.00 0.0
elevators-opt08-strips (11) 552.00 552.00 0.0 552.00 552.00 0.0 552.00 552.00 0.0 552.00 552.00 0.0 552.00 552.00 0.0
elevators-opt11-strips (9) 484.00 484.00 0.0 484.00 484.00 0.0 484.00 484.00 0.0 484.00 484.00 0.0 484.00 484.00 0.0
floortile-opt11-strips (2) 71.00 71.00 0.0 71.00 71.00 0.0 71.00 71.00 0.0 71.00 71.00 0.0 71.00 71.00 0.0
freecell (15) 202.00 202.00 0.0 202.00 202.00 0.0 202.00 202.00 0.0 202.00 202.00 0.0 202.00 202.00 0.0
ged-opt14-strips (15) 47.00 47.00 0.0 47.00 47.00 0.0 47.00 47.00 0.0 47.00 47.00 0.0 47.00 47.00 0.0
grid (1) 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
gripper (7) 203.00 203.00 0.0 203.00 203.00 0.0 203.00 203.00 0.0 203.00 203.00 0.0 203.00 203.00 0.0
hiking-opt14-strips (11) 228.00 228.00 0.0 228.00 228.00 0.0 228.00 228.00 0.0 228.00 228.00 0.0 228.00 228.00 0.0
logistics00 (10) 194.00 194.00 0.0 194.00 194.00 0.0 194.00 194.00 0.0 194.00 194.00 0.0 194.00 194.00 0.0
logistics98 (2) 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0
miconic (50) 926.00 926.00 0.0 926.00 926.00 0.0 926.00 926.00 0.0 926.00 926.00 0.0 926.00 926.00 0.0
movie (30) 210.00 210.00 0.0 210.00 210.00 0.0 210.00 210.00 0.0 210.00 210.00 0.0 210.00 210.00 0.0
mprime (19) 105.00 105.00 0.0 105.00 105.00 0.0 105.00 105.00 0.0 105.00 105.00 0.0 105.00 105.00 0.0
mystery (15) 89.00 89.00 0.0 89.00 89.00 0.0 89.00 89.00 0.0 89.00 89.00 0.0 89.00 89.00 0.0
nomystery-opt11-strips (8) 119.00 119.00 0.0 119.00 119.00 0.0 119.00 119.00 0.0 119.00 119.00 0.0 119.00 119.00 0.0
openstacks-opt08-strips (13) 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0
openstacks-opt11-strips (8) 29.00 29.00 0.0 29.00 29.00 0.0 29.00 29.00 0.0 29.00 29.00 0.0 29.00 29.00 0.0
openstacks-strips (7) 206.00 206.00 0.0 206.00 206.00 0.0 206.00 206.00 0.0 206.00 206.00 0.0 206.00 206.00 0.0
parcprinter-08-strips (9) 3838762.00 3838762.00 0.0 3838762.00 3838762.00 0.0 3838762.00 3838762.00 0.0 3838762.00 3838762.00 0.0 3838762.00 3838762.00 0.0
parcprinter-opt11-strips (5) 2536420.00 2536420.00 0.0 2536420.00 2536420.00 0.0 2536420.00 2536420.00 0.0 2536420.00 2536420.00 0.0 2536420.00 2536420.00 0.0
pathways-noneg (4) 53.00 53.00 0.0 53.00 53.00 0.0 53.00 53.00 0.0 53.00 53.00 0.0 53.00 53.00 0.0
pegsol-08-strips (2) 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
pipesworld-notankage (13) 159.00 159.00 0.0 159.00 159.00 0.0 159.00 159.00 0.0 159.00 159.00 0.0 159.00 159.00 0.0
pipesworld-tankage (11) 167.00 167.00 0.0 167.00 167.00 0.0 167.00 167.00 0.0 167.00 167.00 0.0 167.00 167.00 0.0
psr-small (48) 810.00 810.00 0.0 810.00 810.00 0.0 810.00 810.00 0.0 810.00 810.00 0.0 810.00 810.00 0.0
rovers (5) 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0
satellite (4) 50.00 50.00 0.0 50.00 50.00 0.0 50.00 50.00 0.0 50.00 50.00 0.0 50.00 50.00 0.0
scanalyzer-08-strips (11) 251.00 251.00 0.0 251.00 251.00 0.0 251.00 251.00 0.0 251.00 251.00 0.0 251.00 251.00 0.0
scanalyzer-opt11-strips (9) 241.00 241.00 0.0 241.00 241.00 0.0 241.00 241.00 0.0 241.00 241.00 0.0 241.00 241.00 0.0
sokoban-opt08-strips (20) 564.00 564.00 0.0 564.00 564.00 0.0 564.00 564.00 0.0 564.00 564.00 0.0 564.00 564.00 0.0
sokoban-opt11-strips (18) 549.00 549.00 0.0 549.00 549.00 0.0 549.00 549.00 0.0 549.00 549.00 0.0 549.00 549.00 0.0
storage (14) 158.00 158.00 0.0 158.00 158.00 0.0 158.00 158.00 0.0 158.00 158.00 0.0 158.00 158.00 0.0
tetris-opt14-strips (1) 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
tidybot-opt11-strips (13) 349.00 349.00 0.0 349.00 349.00 0.0 349.00 349.00 0.0 349.00 349.00 0.0 349.00 349.00 0.0
tidybot-opt14-strips (6) 163.00 163.00 0.0 163.00 163.00 0.0 163.00 163.00 0.0 163.00 163.00 0.0 163.00 163.00 0.0
tpp (6) 82.00 82.00 0.0 82.00 82.00 0.0 82.00 82.00 0.0 82.00 82.00 0.0 82.00 82.00 0.0
transport-opt08-strips (11) 4707.00 4707.00 0.0 4707.00 4707.00 0.0 4707.00 4707.00 0.0 4707.00 4707.00 0.0 4707.00 4707.00 0.0
transport-opt11-strips (6) 2956.00 2956.00 0.0 2956.00 2956.00 0.0 2956.00 2956.00 0.0 2956.00 2956.00 0.0 2956.00 2956.00 0.0
transport-opt14-strips (6) 2726.00 2726.00 0.0 2726.00 2726.00 0.0 2726.00 2726.00 0.0 2726.00 2726.00 0.0 2726.00 2726.00 0.0
trucks-strips (6) 121.00 121.00 0.0 121.00 121.00 0.0 121.00 121.00 0.0 121.00 121.00 0.0 121.00 121.00 0.0
visitall-opt11-strips (9) 109.00 109.00 0.0 109.00 109.00 0.0 109.00 109.00 0.0 109.00 109.00 0.0 109.00 109.00 0.0
visitall-opt14-strips (3) 70.00 70.00 0.0 70.00 70.00 0.0 70.00 70.00 0.0 70.00 70.00 0.0 70.00 70.00 0.0
woodworking-opt08-strips (5) 820.00 820.00 0.0 820.00 820.00 0.0 820.00 820.00 0.0 820.00 820.00 0.0 820.00 820.00 0.0
woodworking-opt11-strips (1) 225.00 225.00 0.0 225.00 225.00 0.0 225.00 225.00 0.0 225.00 225.00 0.0 225.00 225.00 0.0
zenotravel (8) 69.00 69.00 0.0 69.00 69.00 0.0 69.00 69.00 0.0 69.00 69.00 0.0 69.00 69.00 0.0
Sum (537) 6396115.00 6396115.00 6396115.00 6396115.00 6396115.00 6396115.00 6396115.00 6396115.00 6396115.00 6396115.00
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

Only instances where all algorithms have a value for "cost" are considered. Each table entry gives the sum of "cost" for that domain. The last row reports the sum across all domains.

airport

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
p01-airport1-p1.pddl 8.00 8.00 0.0 None 8.00 - 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
p02-airport1-p1.pddl 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0
p03-airport1-p2.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
p04-airport2-p1.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
p05-airport2-p1.pddl 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0
p06-airport2-p2.pddl 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0
p07-airport2-p2.pddl 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0
p08-airport2-p3.pddl 62.00 62.00 0.0 62.00 62.00 0.0 62.00 62.00 0.0 62.00 62.00 0.0 62.00 62.00 0.0
p09-airport2-p4.pddl 71.00 71.00 0.0 71.00 71.00 0.0 71.00 71.00 0.0 71.00 71.00 0.0 71.00 71.00 0.0
p10-airport3-p1.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p11-airport3-p1.pddl 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0
p12-airport3-p2.pddl 39.00 39.00 0.0 39.00 39.00 0.0 39.00 39.00 0.0 39.00 39.00 0.0 39.00 39.00 0.0
p13-airport3-p2.pddl 37.00 37.00 0.0 37.00 37.00 0.0 37.00 37.00 0.0 37.00 37.00 0.0 37.00 37.00 0.0
p14-airport3-p3.pddl 60.00 60.00 0.0 60.00 60.00 0.0 60.00 60.00 0.0 60.00 60.00 0.0 60.00 60.00 0.0
p15-airport3-p3.pddl 58.00 58.00 0.0 58.00 58.00 0.0 58.00 58.00 0.0 58.00 58.00 0.0 58.00 58.00 0.0
p16-airport3-p4.pddl 79.00 79.00 0.0 79.00 79.00 0.0 79.00 79.00 0.0 None None - 79.00 79.00 0.0
p17-airport3-p5.pddl 88.00 88.00 0.0 88.00 88.00 0.0 88.00 88.00 0.0 None None - 88.00 88.00 0.0
p18-airport3-p6.pddl None None - None None - 107.00 107.00 0.0 None None - None None -
p19-airport3-p6.pddl 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0 None None - 90.00 90.00 0.0
p20-airport3-p7.pddl None None - None None - None None - None None - None None -
p21-airport4halfMUC-p2.pddl 101.00 101.00 0.0 101.00 101.00 0.0 101.00 101.00 0.0 101.00 101.00 0.0 101.00 101.00 0.0
p22-airport4halfMUC-p3.pddl 148.00 148.00 0.0 148.00 148.00 0.0 148.00 148.00 0.0 148.00 148.00 0.0 148.00 148.00 0.0
p23-airport4halfMUC-p4.pddl None None - None None - None None - 168.00 168.00 0.0 168.00 168.00 0.0
p24-airport4halfMUC-p4.pddl None None - None None - None None - None None - None None -
p25-airport4halfMUC-p5.pddl None None - None None - None None - None None - None None -
p26-airport4halfMUC-p6.pddl None None - None None - None None - None None - None None -
p27-airport4halfMUC-p6.pddl None None - None None - None None - None None - None None -
p28-airport4halfMUC-p7.pddl None None - None None - None None - None None - None None -
p29-airport4halfMUC-p8.pddl None None - None None - None None - None None - None None -
p30-airport4halfMUC-p8.pddl None None - None None - None None - None None - None None -
p31-airport4halfMUC-p9.pddl None None - None None - None None - None None - None None -
p32-airport4halfMUC-p10.pddl None None - None None - None None - None None - None None -
p33-airport4halfMUC-p10.pddl None None - None None - None None - None None - None None -
p34-airport4halfMUC-p11.pddl None None - None None - None None - None None - None None -
p35-airport4halfMUC-p12.pddl None None - None None - None None - None None - None None -
p36-airport5MUC-p2.pddl 109.00 109.00 0.0 109.00 109.00 0.0 109.00 109.00 0.0 109.00 109.00 0.0 109.00 109.00 0.0
p37-airport5MUC-p3.pddl None None - 142.00 142.00 0.0 142.00 142.00 0.0 None None - None None -
p38-airport5MUC-p3.pddl None None - 155.00 155.00 0.0 155.00 155.00 0.0 None None - 155.00 155.00 0.0
p39-airport5MUC-p4.pddl None None - None None - None None - None None - None None -
p40-airport5MUC-p4.pddl None None - None None - None None - None None - None None -
p41-airport5MUC-p4.pddl None None - None None - None None - None None - None None -
p42-airport5MUC-p5.pddl None None - None None - None None - None None - None None -
p43-airport5MUC-p5.pddl None None - None None - None None - None None - None None -
p44-airport5MUC-p5.pddl None None - None None - None None - None None - None None -
p45-airport5MUC-p6.pddl None None - None None - None None - None None - None None -
p46-airport5MUC-p6.pddl None None - None None - None None - None None - None None -
p47-airport5MUC-p8.pddl None None - None None - None None - None None - None None -
p48-airport5MUC-p9.pddl None None - None None - None None - None None - None None -
p49-airport5MUC-p10.pddl None None - None None - None None - None None - None None -
p50-airport5MUC-p15.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

barman-opt11-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
pfile01-001.pddl 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0
pfile01-002.pddl 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0
pfile01-003.pddl 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0
pfile01-004.pddl 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0
pfile02-005.pddl None None - None None - None None - None None - None None -
pfile02-006.pddl None None - None None - None None - None None - None None -
pfile02-007.pddl None None - None None - None None - None None - None None -
pfile02-008.pddl None None - None None - None None - None None - None None -
pfile03-009.pddl None None - None None - None None - None None - None None -
pfile03-010.pddl None None - None None - None None - None None - None None -
pfile03-011.pddl None None - None None - None None - None None - None None -
pfile03-012.pddl None None - None None - None None - None None - None None -
pfile04-013.pddl None None - None None - None None - None None - None None -
pfile04-014.pddl None None - None None - None None - None None - None None -
pfile04-015.pddl None None - None None - None None - None None - None None -
pfile04-016.pddl None None - None None - None None - None None - None None -
pfile05-017.pddl None None - None None - None None - None None - None None -
pfile05-018.pddl None None - None None - None None - None None - None None -
pfile05-019.pddl None None - None None - None None - None None - None None -
pfile05-020.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

barman-opt14-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
p435-1.pddl None None - None None - None None - None None - None None -
p435-2.pddl None None - None None - None None - None None - None None -
p435-3.pddl None None - None None - None None - None None - None None -
p536-1.pddl None None - None None - None None - None None - None None -
p536-2.pddl None None - None None - None None - None None - None None -
p536-3.pddl None None - None None - None None - None None - None None -
p638-1.pddl None None - None None - None None - None None - None None -
p638-2.pddl None None - None None - None None - None None - None None -
p638-3.pddl None None - None None - None None - None None - None None -
p739-1.pddl None None - None None - None None - None None - None None -
p739-2.pddl None None - None None - None None - None None - None None -
p739-3.pddl None None - None None - None None - None None - None None -
p839-1.pddl None None - None None - None None - None None - None None -
p839-2.pddl None None - None None - None None - None None - None None -
Sum of diffs None None None None None
Arithmetic mean of diffs None None None None None

blocks

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
probBLOCKS-4-0.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
probBLOCKS-4-1.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
probBLOCKS-4-2.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
probBLOCKS-5-0.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
probBLOCKS-5-1.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
probBLOCKS-5-2.pddl 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0
probBLOCKS-6-0.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
probBLOCKS-6-1.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
probBLOCKS-6-2.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probBLOCKS-7-0.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probBLOCKS-7-1.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
probBLOCKS-7-2.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probBLOCKS-8-0.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
probBLOCKS-8-1.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probBLOCKS-8-2.pddl 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0
probBLOCKS-9-0.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
probBLOCKS-9-1.pddl 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0
probBLOCKS-9-2.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
probBLOCKS-10-0.pddl None None - 34.00 34.00 0.0 None None - 34.00 34.00 0.0 34.00 34.00 0.0
probBLOCKS-10-1.pddl None None - 32.00 32.00 0.0 None None - 32.00 32.00 0.0 32.00 32.00 0.0
probBLOCKS-10-2.pddl None None - 34.00 34.00 0.0 None None - 34.00 34.00 0.0 34.00 34.00 0.0
probBLOCKS-11-0.pddl None None - 32.00 32.00 0.0 None None - 32.00 32.00 0.0 32.00 32.00 0.0
probBLOCKS-11-1.pddl None None - 30.00 30.00 0.0 None None - 30.00 30.00 0.0 30.00 30.00 0.0
probBLOCKS-11-2.pddl None None - 34.00 34.00 0.0 None None - 34.00 34.00 0.0 34.00 34.00 0.0
probBLOCKS-12-0.pddl None None - 34.00 34.00 0.0 None None - 34.00 34.00 0.0 34.00 34.00 0.0
probBLOCKS-12-1.pddl None None - 34.00 34.00 0.0 None None - 34.00 34.00 0.0 34.00 34.00 0.0
probBLOCKS-13-0.pddl None None - None None - None None - None None - None None -
probBLOCKS-13-1.pddl None None - None None - None None - None None - None None -
probBLOCKS-14-0.pddl None None - 38.00 38.00 0.0 None None - 38.00 38.00 0.0 38.00 38.00 0.0
probBLOCKS-14-1.pddl None None - 36.00 36.00 0.0 None None - 36.00 36.00 0.0 36.00 36.00 0.0
probBLOCKS-15-0.pddl None None - None None - None None - None None - None None -
probBLOCKS-15-1.pddl None None - None None - None None - None None - None None -
probBLOCKS-16-1.pddl None None - None None - None None - None None - None None -
probBLOCKS-16-2.pddl None None - None None - None None - None None - None None -
probBLOCKS-17-0.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

childsnack-opt14-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
child-snack_pfile01-2.pddl None None - None None - None None - None None - None None -
child-snack_pfile01.pddl None None - None None - None None - None None - None None -
child-snack_pfile02-2.pddl None None - None None - None None - None None - None None -
child-snack_pfile02.pddl None None - None None - None None - None None - None None -
child-snack_pfile03-2.pddl None None - None None - None None - None None - None None -
child-snack_pfile03.pddl None None - None None - None None - None None - None None -
child-snack_pfile04-2.pddl None None - None None - None None - None None - None None -
child-snack_pfile04.pddl None None - None None - None None - None None - None None -
child-snack_pfile05-2.pddl None None - None None - None None - None None - None None -
child-snack_pfile05.pddl None None - None None - None None - None None - None None -
child-snack_pfile06-2.pddl None None - None None - None None - None None - None None -
child-snack_pfile06.pddl None None - None None - None None - None None - None None -
child-snack_pfile07-2.pddl None None - None None - None None - None None - None None -
child-snack_pfile07.pddl None None - None None - None None - None None - None None -
child-snack_pfile08-2.pddl None None - None None - None None - None None - None None -
child-snack_pfile08.pddl None None - None None - None None - None None - None None -
child-snack_pfile09-2.pddl None None - None None - None None - None None - None None -
child-snack_pfile09.pddl None None - None None - None None - None None - None None -
child-snack_pfile10-2.pddl None None - None None - None None - None None - None None -
child-snack_pfile10.pddl None None - None None - None None - None None - None None -
Sum of diffs None None None None None
Arithmetic mean of diffs None None None None None

depot

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
p01.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
p02.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
p03.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
p04.pddl None None - 30.00 30.00 0.0 None None - 30.00 30.00 0.0 30.00 30.00 0.0
p05.pddl None None - None None - None None - None None - None None -
p06.pddl None None - None None - None None - None None - None None -
p07.pddl 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0
p08.pddl None None - None None - None None - None None - None None -
p09.pddl None None - None None - None None - None None - None None -
p10.pddl None None - 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0
p11.pddl None None - None None - None None - None None - None None -
p12.pddl None None - None None - None None - None None - None None -
p13.pddl None None - 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
p14.pddl None None - None None - None None - None None - None None -
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - 22.00 22.00 0.0 None None - 22.00 22.00 0.0
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
p21.pddl None None - None None - None None - None None - None None -
p22.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

driverlog

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
p01.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
p02.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
p03.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
p04.pddl 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0
p05.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p06.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
p07.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
p08.pddl None None - 22.00 22.00 0.0 None None - 22.00 22.00 0.0 22.00 22.00 0.0
p09.pddl None None - 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
p10.pddl None None - 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
p11.pddl None None - 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
p12.pddl None None - None None - None None - None None - None None -
p13.pddl None None - 26.00 26.00 0.0 None None - 26.00 26.00 0.0 26.00 26.00 0.0
p14.pddl None None - None None - None None - 28.00 28.00 0.0 28.00 28.00 0.0
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

elevators-opt08-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
p01.pddl 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0
p02.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
p03.pddl 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0
p04.pddl 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0
p05.pddl 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0
p06.pddl None None - None None - 53.00 53.00 0.0 53.00 53.00 0.0 53.00 53.00 0.0
p07.pddl None None - None None - None None - 62.00 62.00 0.0 62.00 62.00 0.0
p08.pddl None None - None None - 53.00 53.00 0.0 None None - None None -
p09.pddl None None - None None - None None - None None - None None -
p10.pddl None None - None None - None None - None None - None None -
p11.pddl 56.00 56.00 0.0 56.00 56.00 0.0 56.00 56.00 0.0 56.00 56.00 0.0 56.00 56.00 0.0
p12.pddl 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0
p13.pddl 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0
p14.pddl 63.00 63.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0
p15.pddl None None - None None - 66.00 66.00 0.0 66.00 66.00 0.0 66.00 66.00 0.0
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - 61.00 61.00 0.0 61.00 61.00 0.0 61.00 61.00 0.0
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
p21.pddl 48.00 48.00 0.0 48.00 48.00 0.0 48.00 48.00 0.0 48.00 48.00 0.0 48.00 48.00 0.0
p22.pddl 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0
p23.pddl None None - None None - 69.00 69.00 0.0 69.00 69.00 0.0 69.00 69.00 0.0
p24.pddl None None - None None - None None - 56.00 56.00 0.0 56.00 56.00 0.0
p25.pddl None None - None None - 63.00 63.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0
p26.pddl None None - None None - None None - 48.00 48.00 0.0 48.00 48.00 0.0
p27.pddl None None - None None - None None - None None - 82.00 82.00 0.0
p28.pddl None None - None None - None None - None None - None None -
p29.pddl None None - None None - None None - None None - None None -
p30.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

elevators-opt11-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
p01.pddl 56.00 56.00 0.0 56.00 56.00 0.0 56.00 56.00 0.0 56.00 56.00 0.0 56.00 56.00 0.0
p02.pddl 48.00 48.00 0.0 48.00 48.00 0.0 48.00 48.00 0.0 48.00 48.00 0.0 48.00 48.00 0.0
p03.pddl 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0
p04.pddl 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0
p05.pddl 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0
p06.pddl 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0
p07.pddl None None - None None - None None - 48.00 48.00 0.0 48.00 48.00 0.0
p08.pddl 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0
p09.pddl 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0
p10.pddl 63.00 63.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0
p11.pddl None None - None None - None None - None None - None None -
p12.pddl None None - None None - 53.00 53.00 0.0 53.00 53.00 0.0 53.00 53.00 0.0
p13.pddl None None - None None - None None - 62.00 62.00 0.0 62.00 62.00 0.0
p14.pddl None None - None None - 53.00 53.00 0.0 None None - None None -
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - 66.00 66.00 0.0 66.00 66.00 0.0 66.00 66.00 0.0
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - 61.00 61.00 0.0 61.00 61.00 0.0 61.00 61.00 0.0
p19.pddl None None - None None - 69.00 69.00 0.0 69.00 69.00 0.0 69.00 69.00 0.0
p20.pddl None None - None None - None None - 56.00 56.00 0.0 56.00 56.00 0.0
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

floortile-opt11-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
opt-p01-001.pddl 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
opt-p01-002.pddl 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0
opt-p02-003.pddl None None - 62.00 62.00 0.0 None None - None None - None None -
opt-p02-004.pddl None None - 53.00 53.00 0.0 None None - None None - None None -
opt-p03-005.pddl None None - None None - None None - None None - None None -
opt-p03-006.pddl None None - None None - None None - None None - None None -
opt-p04-007.pddl None None - None None - None None - None None - None None -
opt-p04-008.pddl None None - None None - None None - None None - None None -
opt-p05-009.pddl None None - None None - None None - None None - None None -
opt-p05-010.pddl None None - None None - None None - None None - None None -
opt-p06-011.pddl None None - None None - None None - None None - None None -
opt-p06-012.pddl None None - None None - None None - None None - None None -
opt-p07-013.pddl None None - None None - None None - None None - None None -
opt-p07-014.pddl None None - None None - None None - None None - None None -
opt-p08-015.pddl None None - None None - None None - None None - None None -
opt-p08-016.pddl None None - None None - None None - None None - None None -
opt-p09-017.pddl None None - None None - None None - None None - None None -
opt-p09-018.pddl None None - None None - None None - None None - None None -
opt-p10-019.pddl None None - None None - None None - None None - None None -
opt-p10-020.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

floortile-opt14-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
p01-4-3-2.pddl None None - 56.00 56.00 0.0 None None - None None - None None -
p01-4-4-2.pddl None None - None None - None None - None None - None None -
p01-5-3-2.pddl None None - None None - None None - None None - None None -
p01-5-4-2.pddl None None - None None - None None - None None - None None -
p01-5-5-2.pddl None None - None None - None None - None None - None None -
p01-6-4-2.pddl None None - None None - None None - None None - None None -
p01-6-5-2.pddl None None - None None - None None - None None - None None -
p02-4-4-2.pddl None None - None None - None None - None None - None None -
p02-5-3-2.pddl None None - None None - None None - None None - None None -
p02-5-4-2.pddl None None - None None - None None - None None - None None -
p02-5-5-2.pddl None None - None None - None None - None None - None None -
p02-6-4-2.pddl None None - None None - None None - None None - None None -
p02-6-5-2.pddl None None - None None - None None - None None - None None -
p03-4-3-2.pddl None None - 56.00 56.00 0.0 None None - None None - None None -
p03-4-4-2.pddl None None - None None - None None - None None - None None -
p03-5-3-2.pddl None None - None None - None None - None None - None None -
p03-5-4-2.pddl None None - None None - None None - None None - None None -
p03-5-5-2.pddl None None - None None - None None - None None - None None -
p03-6-4-2.pddl None None - None None - None None - None None - None None -
p03-6-5-2.pddl None None - None None - None None - None None - None None -
Sum of diffs None 0.00 None None None
Arithmetic mean of diffs None 0.00 None None None

freecell

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
p01.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
p02.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
p03.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p04.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
p05.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
p06.pddl None None - 34.00 34.00 0.0 34.00 34.00 0.0 None None - None None -
p07.pddl None None - 41.00 41.00 0.0 41.00 41.00 0.0 None None - None None -
p08.pddl None None - 47.00 47.00 0.0 47.00 47.00 0.0 None None - None None -
p09.pddl None None - 43.00 43.00 0.0 43.00 43.00 0.0 None None - None None -
p10.pddl None None - 48.00 48.00 0.0 48.00 48.00 0.0 None None - None None -
p11.pddl None None - 56.00 56.00 0.0 56.00 56.00 0.0 None None - None None -
p12.pddl None None - 47.00 47.00 0.0 47.00 47.00 0.0 None None - None None -
p13.pddl None None - None None - 58.00 58.00 0.0 None None - None None -
p14.pddl None None - None None - 54.00 54.00 0.0 None None - None None -
p15.pddl None None - None None - 62.00 62.00 0.0 None None - None None -
p16.pddl None None - None None - 60.00 60.00 0.0 None None - None None -
p17.pddl None None - None None - 62.00 62.00 0.0 None None - None None -
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
probfreecell-2-1.pddl 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0
probfreecell-2-2.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-3.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-4.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-5.pddl 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0
probfreecell-3-1.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
probfreecell-3-2.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
probfreecell-3-3.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
probfreecell-3-4.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
probfreecell-3-5.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
probfreecell-4-1.pddl None None - 19.00 19.00 0.0 19.00 19.00 0.0 None None - 19.00 19.00 0.0
probfreecell-4-2.pddl None None - 17.00 17.00 0.0 17.00 17.00 0.0 None None - 17.00 17.00 0.0
probfreecell-4-3.pddl None None - 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
probfreecell-4-4.pddl None None - 18.00 18.00 0.0 18.00 18.00 0.0 None None - 18.00 18.00 0.0
probfreecell-4-5.pddl None None - 18.00 18.00 0.0 18.00 18.00 0.0 None None - 18.00 18.00 0.0
probfreecell-5-1.pddl None None - 24.00 24.00 0.0 24.00 24.00 0.0 None None - None None -
probfreecell-5-2.pddl None None - 23.00 23.00 0.0 23.00 23.00 0.0 None None - None None -
probfreecell-5-3.pddl None None - 24.00 24.00 0.0 24.00 24.00 0.0 None None - None None -
probfreecell-5-4.pddl None None - 23.00 23.00 0.0 23.00 23.00 0.0 None None - None None -
probfreecell-5-5.pddl None None - 25.00 25.00 0.0 25.00 25.00 0.0 None None - None None -
probfreecell-6-1.pddl None None - 30.00 30.00 0.0 30.00 30.00 0.0 None None - None None -
probfreecell-6-2.pddl None None - 28.00 28.00 0.0 28.00 28.00 0.0 None None - None None -
probfreecell-6-3.pddl None None - 28.00 28.00 0.0 28.00 28.00 0.0 None None - None None -
probfreecell-6-4.pddl None None - 28.00 28.00 0.0 28.00 28.00 0.0 None None - None None -
probfreecell-6-5.pddl None None - 32.00 32.00 0.0 None None - None None - None None -
probfreecell-7-1.pddl None None - 35.00 35.00 0.0 35.00 35.00 0.0 None None - None None -
probfreecell-7-2.pddl None None - 34.00 34.00 0.0 34.00 34.00 0.0 None None - None None -
probfreecell-7-3.pddl None None - 32.00 32.00 0.0 32.00 32.00 0.0 None None - None None -
probfreecell-7-4.pddl None None - 35.00 35.00 0.0 35.00 35.00 0.0 None None - None None -
probfreecell-7-5.pddl None None - None None - None None - None None - None None -
probfreecell-8-1.pddl None None - 42.00 42.00 0.0 42.00 42.00 0.0 None None - None None -
probfreecell-8-2.pddl None None - 39.00 39.00 0.0 39.00 39.00 0.0 None None - None None -
probfreecell-8-3.pddl None None - 38.00 38.00 0.0 38.00 38.00 0.0 None None - None None -
probfreecell-8-4.pddl None None - 42.00 42.00 0.0 42.00 42.00 0.0 None None - None None -
probfreecell-8-5.pddl None None - None None - None None - None None - None None -
probfreecell-9-1.pddl None None - 47.00 47.00 0.0 47.00 47.00 0.0 None None - None None -
probfreecell-9-2.pddl None None - 45.00 45.00 0.0 45.00 45.00 0.0 None None - None None -
probfreecell-9-3.pddl None None - 44.00 44.00 0.0 44.00 44.00 0.0 None None - None None -
probfreecell-9-4.pddl None None - None None - 49.00 49.00 0.0 None None - None None -
probfreecell-9-5.pddl None None - None None - None None - None None - None None -
probfreecell-10-1.pddl None None - None None - 57.00 57.00 0.0 None None - None None -
probfreecell-10-2.pddl None None - 53.00 53.00 0.0 53.00 53.00 0.0 None None - None None -
probfreecell-10-3.pddl None None - 50.00 50.00 0.0 50.00 50.00 0.0 None None - None None -
probfreecell-10-4.pddl None None - None None - None None - None None - None None -
probfreecell-10-5.pddl None None - None None - None None - None None - None None -
probfreecell-11-1.pddl None None - None None - 65.00 65.00 0.0 None None - None None -
probfreecell-11-2.pddl None None - 58.00 58.00 0.0 58.00 58.00 0.0 None None - None None -
probfreecell-11-3.pddl None None - 57.00 57.00 0.0 57.00 57.00 0.0 None None - None None -
probfreecell-11-4.pddl None None - None None - None None - None None - None None -
probfreecell-11-5.pddl None None - None None - None None - None None - None None -
probfreecell-12-1.pddl None None - None None - None None - None None - None None -
probfreecell-12-2.pddl None None - 63.00 63.00 0.0 63.00 63.00 0.0 None None - None None -
probfreecell-12-3.pddl None None - None None - 65.00 65.00 0.0 None None - None None -
probfreecell-12-4.pddl None None - None None - None None - None None - None None -
probfreecell-12-5.pddl None None - None None - None None - None None - None None -
probfreecell-13-1.pddl None None - None None - None None - None None - None None -
probfreecell-13-2.pddl None None - None None - 75.00 75.00 0.0 None None - None None -
probfreecell-13-3.pddl None None - None None - None None - None None - None None -
probfreecell-13-4.pddl None None - None None - None None - None None - None None -
probfreecell-13-5.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

ged-opt14-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
d-1-2.pddl 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0
d-1-3.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-1-4.pddl 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0
d-1-8.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-2-1.pddl 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0
d-2-3.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
d-2-4.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
d-2-8.pddl None None - None None - None None - None None - 5.00 5.00 0.0
d-3-1.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-3-2.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
d-3-4.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
d-4-2.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
d-4-3.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
d-4-8.pddl None None - None None - None None - None None - 5.00 5.00 0.0
d-7-5.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-7-6.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-8-1.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-8-2.pddl None None - None None - None None - None None - 5.00 5.00 0.0
d-8-4.pddl None None - None None - None None - None None - 5.00 5.00 0.0
d-8-9.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

grid

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
prob01.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
prob02.pddl None None - 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
prob03.pddl None None - None None - None None - None None - None None -
prob04.pddl None None - None None - None None - None None - 36.00 36.00 0.0
prob05.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

gripper

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
prob01.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
prob02.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
prob03.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
prob04.pddl 29.00 29.00 0.0 29.00 29.00 0.0 29.00 29.00 0.0 29.00 29.00 0.0 29.00 29.00 0.0
prob05.pddl 35.00 35.00 0.0 35.00 35.00 0.0 35.00 35.00 0.0 35.00 35.00 0.0 35.00 35.00 0.0
prob06.pddl 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0
prob07.pddl 47.00 47.00 0.0 47.00 47.00 0.0 47.00 47.00 0.0 47.00 47.00 0.0 47.00 47.00 0.0
prob08.pddl None None - None None - None None - None None - None None -
prob09.pddl None None - None None - None None - None None - None None -
prob10.pddl None None - None None - None None - None None - None None -
prob11.pddl None None - None None - None None - None None - None None -
prob12.pddl None None - None None - None None - None None - None None -
prob13.pddl None None - None None - None None - None None - None None -
prob14.pddl None None - None None - None None - None None - None None -
prob15.pddl None None - None None - None None - None None - None None -
prob16.pddl None None - None None - None None - None None - None None -
prob17.pddl None None - None None - None None - None None - None None -
prob18.pddl None None - None None - None None - None None - None None -
prob19.pddl None None - None None - None None - None None - None None -
prob20.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

hiking-opt14-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
ptesting-1-2-3.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
ptesting-1-2-4.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
ptesting-1-2-5.pddl 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
ptesting-1-2-7.pddl 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
ptesting-1-2-8.pddl 45.00 45.00 0.0 45.00 45.00 0.0 45.00 45.00 0.0 45.00 45.00 0.0 45.00 45.00 0.0
ptesting-2-2-3.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
ptesting-2-2-4.pddl 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0
ptesting-2-2-5.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
ptesting-2-2-6.pddl None None - None None - 30.00 30.00 0.0 None None - None None -
ptesting-2-2-7.pddl None None - None None - None None - None None - None None -
ptesting-2-2-8.pddl None None - None None - None None - None None - None None -
ptesting-2-3-4.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
ptesting-2-3-5.pddl None None - None None - 24.00 24.00 0.0 None None - None None -
ptesting-2-3-6.pddl None None - None None - None None - None None - None None -
ptesting-2-3-7.pddl None None - None None - None None - None None - None None -
ptesting-2-4-3.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
ptesting-2-4-4.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
ptesting-2-4-5.pddl None None - None None - None None - None None - None None -
ptesting-2-4-6.pddl None None - None None - None None - None None - None None -
ptesting-2-4-7.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

logistics00

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
probLOGISTICS-4-0.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probLOGISTICS-4-1.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
probLOGISTICS-4-2.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
probLOGISTICS-5-0.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
probLOGISTICS-5-1.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
probLOGISTICS-5-2.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probLOGISTICS-6-0.pddl 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
probLOGISTICS-6-1.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
probLOGISTICS-6-2.pddl 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
probLOGISTICS-6-9.pddl 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0
probLOGISTICS-7-0.pddl None None - 36.00 36.00 0.0 36.00 36.00 0.0 36.00 36.00 0.0 36.00 36.00 0.0
probLOGISTICS-7-1.pddl None None - 44.00 44.00 0.0 44.00 44.00 0.0 44.00 44.00 0.0 44.00 44.00 0.0
probLOGISTICS-8-0.pddl None None - 31.00 31.00 0.0 31.00 31.00 0.0 31.00 31.00 0.0 31.00 31.00 0.0
probLOGISTICS-8-1.pddl None None - 44.00 44.00 0.0 44.00 44.00 0.0 44.00 44.00 0.0 44.00 44.00 0.0
probLOGISTICS-9-0.pddl None None - 36.00 36.00 0.0 36.00 36.00 0.0 36.00 36.00 0.0 36.00 36.00 0.0
probLOGISTICS-9-1.pddl None None - 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
probLOGISTICS-10-0.pddl None None - None None - 45.00 45.00 0.0 45.00 45.00 0.0 45.00 45.00 0.0
probLOGISTICS-10-1.pddl None None - None None - 42.00 42.00 0.0 42.00 None - 42.00 42.00 0.0
probLOGISTICS-11-0.pddl None None - None None - 48.00 48.00 0.0 None None - 48.00 48.00 0.0
probLOGISTICS-11-1.pddl None None - None None - None None - None None - 60.00 60.00 0.0
probLOGISTICS-12-0.pddl None None - None None - 42.00 42.00 0.0 None None - 42.00 42.00 0.0
probLOGISTICS-12-1.pddl None None - None None - None None - None None - None None -
probLOGISTICS-13-0.pddl None None - None None - None None - None None - None None -
probLOGISTICS-13-1.pddl None None - None None - None None - None None - None None -
probLOGISTICS-14-0.pddl None None - None None - None None - None None - None None -
probLOGISTICS-14-1.pddl None None - None None - None None - None None - None None -
probLOGISTICS-15-0.pddl None None - None None - None None - None None - None None -
probLOGISTICS-15-1.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

logistics98

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
prob01.pddl None None - 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
prob02.pddl None None - None None - 32.00 32.00 0.0 None None - None None -
prob03.pddl None None - None None - None None - None None - None None -
prob04.pddl None None - None None - None None - None None - None None -
prob05.pddl None None - 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
prob06.pddl None None - None None - None None - None None - None None -
prob07.pddl None None - None None - None None - None None - None None -
prob08.pddl None None - None None - None None - None None - None None -
prob09.pddl None None - None None - None None - None None - None None -
prob10.pddl None None - None None - None None - None None - None None -
prob11.pddl None None - None None - None None - None None - None None -
prob12.pddl None None - None None - None None - None None - None None -
prob13.pddl None None - None None - None None - None None - None None -
prob14.pddl None None - None None - None None - None None - None None -
prob15.pddl None None - None None - None None - None None - None None -
prob16.pddl None None - None None - None None - None None - None None -
prob17.pddl None None - None None - None None - None None - None None -
prob18.pddl None None - None None - None None - None None - None None -
prob19.pddl None None - None None - None None - None None - None None -
prob20.pddl None None - None None - None None - None None - None None -
prob21.pddl None None - None None - None None - None None - None None -
prob22.pddl None None - None None - None None - None None - None None -
prob23.pddl None None - None None - None None - None None - None None -
prob24.pddl None None - None None - None None - None None - None None -
prob25.pddl None None - None None - None None - None None - None None -
prob26.pddl None None - None None - None None - None None - None None -
prob27.pddl None None - None None - None None - None None - None None -
prob28.pddl None None - None None - None None - None None - None None -
prob29.pddl None None - None None - None None - None None - None None -
prob30.pddl None None - None None - None None - None None - None None -
prob31.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
prob32.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
prob33.pddl None None - None None - 27.00 27.00 0.0 None None - 27.00 27.00 0.0
prob34.pddl None None - None None - 45.00 45.00 0.0 None None - None None -
prob35.pddl None None - None None - 30.00 30.00 0.0 None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

miconic

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
s1-0.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-1.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
s1-2.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-3.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-4.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s2-0.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s2-1.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s2-2.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s2-3.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s2-4.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s3-0.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
s3-1.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
s3-2.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
s3-3.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
s3-4.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
s4-0.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
s4-1.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
s4-2.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
s4-3.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
s4-4.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
s5-0.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
s5-1.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
s5-2.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
s5-3.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
s5-4.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
s6-0.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
s6-1.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
s6-2.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
s6-3.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
s6-4.pddl 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0
s7-0.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
s7-1.pddl 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0
s7-2.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
s7-3.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
s7-4.pddl 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
s8-0.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
s8-1.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
s8-2.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
s8-3.pddl 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0
s8-4.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
s9-0.pddl 31.00 31.00 0.0 31.00 31.00 0.0 31.00 31.00 0.0 31.00 31.00 0.0 31.00 31.00 0.0
s9-1.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
s9-2.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
s9-3.pddl 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0
s9-4.pddl 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0
s10-0.pddl 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0
s10-1.pddl 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0
s10-2.pddl 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0
s10-3.pddl 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
s10-4.pddl 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0
s11-0.pddl None None - None None - 37.00 37.00 0.0 37.00 37.00 0.0 37.00 37.00 0.0
s11-1.pddl None None - 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
s11-2.pddl None None - None None - 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
s11-3.pddl None None - None None - 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
s11-4.pddl None None - 35.00 35.00 0.0 35.00 35.00 0.0 35.00 35.00 0.0 35.00 35.00 0.0
s12-0.pddl None None - None None - 40.00 40.00 0.0 None None - None None -
s12-1.pddl None None - None None - 40.00 40.00 0.0 None None - None None -
s12-2.pddl None None - None None - 40.00 40.00 0.0 None None - None None -
s12-3.pddl None None - None None - 39.00 39.00 0.0 None None - None None -
s12-4.pddl None None - None None - 41.00 41.00 0.0 None None - None None -
s13-0.pddl None None - None None - 44.00 44.00 0.0 None None - None None -
s13-1.pddl None None - None None - 42.00 42.00 0.0 None None - None None -
s13-2.pddl None None - None None - 46.00 46.00 0.0 None None - None None -
s13-3.pddl None None - None None - 43.00 43.00 0.0 None None - None None -
s13-4.pddl None None - None None - 41.00 41.00 0.0 None None - None None -
s14-0.pddl None None - None None - 45.00 45.00 0.0 None None - None None -
s14-1.pddl None None - None None - None None - None None - None None -
s14-2.pddl None None - None None - 49.00 49.00 0.0 None None - None None -
s14-3.pddl None None - None None - None None - None None - None None -
s14-4.pddl None None - None None - None None - None None - None None -
s15-0.pddl None None - None None - 46.00 46.00 0.0 None None - None None -
s15-1.pddl None None - None None - None None - None None - None None -
s15-2.pddl None None - None None - None None - None None - None None -
s15-3.pddl None None - None None - None None - None None - None None -
s15-4.pddl None None - None None - None None - None None - None None -
s16-0.pddl None None - None None - None None - None None - None None -
s16-1.pddl None None - None None - 52.00 52.00 0.0 None None - None None -
s16-2.pddl None None - None None - None None - None None - None None -
s16-3.pddl None None - None None - None None - None None - None None -
s16-4.pddl None None - None None - None None - None None - None None -
s17-0.pddl None None - None None - None None - None None - None None -
s17-1.pddl None None - None None - None None - None None - None None -
s17-2.pddl None None - None None - None None - None None - None None -
s17-3.pddl None None - None None - 60.00 60.00 0.0 None None - None None -
s17-4.pddl None None - None None - None None - None None - None None -
s18-0.pddl None None - None None - None None - None None - None None -
s18-1.pddl None None - None None - None None - None None - None None -
s18-2.pddl None None - None None - None None - None None - None None -
s18-3.pddl None None - None None - None None - None None - None None -
s18-4.pddl None None - None None - None None - None None - None None -
s19-0.pddl None None - None None - None None - None None - None None -
s19-1.pddl None None - None None - None None - None None - None None -
s19-2.pddl None None - None None - None None - None None - None None -
s19-3.pddl None None - None None - None None - None None - None None -
s19-4.pddl None None - None None - None None - None None - None None -
s20-0.pddl None None - None None - None None - None None - None None -
s20-1.pddl None None - None None - None None - None None - None None -
s20-2.pddl None None - None None - None None - None None - None None -
s20-3.pddl None None - None None - None None - None None - None None -
s20-4.pddl None None - None None - None None - None None - None None -
s21-0.pddl None None - None None - None None - None None - None None -
s21-1.pddl None None - None None - None None - None None - None None -
s21-2.pddl None None - None None - None None - None None - None None -
s21-3.pddl None None - None None - None None - None None - None None -
s21-4.pddl None None - None None - None None - None None - None None -
s22-0.pddl None None - None None - None None - None None - None None -
s22-1.pddl None None - None None - None None - None None - None None -
s22-2.pddl None None - None None - None None - None None - None None -
s22-3.pddl None None - None None - None None - None None - None None -
s22-4.pddl None None - None None - None None - None None - None None -
s23-0.pddl None None - None None - None None - None None - None None -
s23-1.pddl None None - None None - None None - None None - None None -
s23-2.pddl None None - None None - None None - None None - None None -
s23-3.pddl None None - None None - None None - None None - None None -
s23-4.pddl None None - None None - None None - None None - None None -
s24-0.pddl None None - None None - None None - None None - None None -
s24-1.pddl None None - None None - None None - None None - None None -
s24-2.pddl None None - None None - None None - None None - None None -
s24-3.pddl None None - None None - None None - None None - None None -
s24-4.pddl None None - None None - None None - None None - None None -
s25-0.pddl None None - None None - None None - None None - None None -
s25-1.pddl None None - None None - None None - None None - None None -
s25-2.pddl None None - None None - None None - None None - None None -
s25-3.pddl None None - None None - None None - None None - None None -
s25-4.pddl None None - None None - None None - None None - None None -
s26-0.pddl None None - None None - None None - None None - None None -
s26-1.pddl None None - None None - None None - None None - None None -
s26-2.pddl None None - None None - None None - None None - None None -
s26-3.pddl None None - None None - None None - None None - None None -
s26-4.pddl None None - None None - None None - None None - None None -
s27-0.pddl None None - None None - None None - None None - None None -
s27-1.pddl None None - None None - None None - None None - None None -
s27-2.pddl None None - None None - None None - None None - None None -
s27-3.pddl None None - None None - None None - None None - None None -
s27-4.pddl None None - None None - None None - None None - None None -
s28-0.pddl None None - None None - None None - None None - None None -
s28-1.pddl None None - None None - None None - None None - None None -
s28-2.pddl None None - None None - None None - None None - None None -
s28-3.pddl None None - None None - None None - None None - None None -
s28-4.pddl None None - None None - None None - None None - None None -
s29-0.pddl None None - None None - None None - None None - None None -
s29-1.pddl None None - None None - None None - None None - None None -
s29-2.pddl None None - None None - None None - None None - None None -
s29-3.pddl None None - None None - None None - None None - None None -
s29-4.pddl None None - None None - None None - None None - None None -
s30-0.pddl None None - None None - None None - None None - None None -
s30-1.pddl None None - None None - None None - None None - None None -
s30-2.pddl None None - None None - None None - None None - None None -
s30-3.pddl None None - None None - None None - None None - None None -
s30-4.pddl None None - None None - None None - None None - None None -
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

movie

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
prob01.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob02.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob03.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob04.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob05.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob06.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob07.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob08.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob09.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob10.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob11.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob12.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob13.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob14.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob15.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob16.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob17.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob18.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob19.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob20.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob21.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob22.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob23.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob24.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob25.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob26.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob27.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob28.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob29.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob30.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

mprime

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
prob01.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob02.pddl None None - 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob03.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob04.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
prob05.pddl None None - 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
prob06.pddl None None - None None - None None - None None - None None -
prob07.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob08.pddl None None - 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob09.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
prob10.pddl None None - None None - None None - None None - None None -
prob11.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob12.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob13.pddl None None - None None - None None - None None - None None -
prob14.pddl None None - None None - None None - None None - None None -
prob15.pddl None None - None None - 6.00 6.00 0.0 None None - None None -
prob16.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob17.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob18.pddl None None - None None - None None - None None - None None -
prob19.pddl None None - 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob20.pddl None None - None None - None None - None None - None None -
prob21.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob22.pddl None None - None None - None None - None None - None None -
prob23.pddl None None - None None - None None - None None - None None -
prob24.pddl None None - None None - 8.00 8.00 0.0 None None - None None -
prob25.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob26.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob27.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob28.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob29.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob30.pddl None None - None None - 9.00 9.00 0.0 None None - None None -
prob31.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob32.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob33.pddl None None - None None - None None - None None - None None -
prob34.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob35.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

mystery

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
prob01.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob02.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob03.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob04.pddl None None - None None - None None - None None - None None -
prob05.pddl None None - None None - None None - None None - None None -
prob06.pddl None None - None None - 11.00 11.00 0.0 None None - None None -
prob07.pddl None None - None None - None None - None None - None None -
prob08.pddl None None - None None - None None - None None - None None -
prob09.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
prob10.pddl None None - 8.00 8.00 0.0 8.00 8.00 0.0 None None - 8.00 8.00 0.0
prob11.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob12.pddl None None - None None - None None - None None - None None -
prob13.pddl None None - None None - None None - None None - None None -
prob14.pddl None None - None None - None None - None None - None None -
prob15.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob16.pddl None None - None None - None None - None None - None None -
prob17.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob18.pddl None None - None None - None None - None None - None None -
prob19.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob20.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob21.pddl None None - None None - None None - None None - None None -
prob22.pddl None None - None None - None None - None None - None None -
prob23.pddl None None - None None - None None - None None - None None -
prob24.pddl None None - None None - None None - None None - None None -
prob25.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob26.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob27.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob28.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob29.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob30.pddl 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

nomystery-opt11-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
p01.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
p02.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
p03.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
p04.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
p05.pddl None None - 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
p06.pddl None None - 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
p07.pddl None None - None None - 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
p08.pddl None None - None None - None None - 34.00 34.00 0.0 34.00 34.00 0.0
p09.pddl None None - None None - None None - 38.00 38.00 0.0 None None -
p10.pddl None None - None None - None None - None None - None None -
p11.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
p12.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
p13.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
p14.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
p15.pddl None None - 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
p16.pddl None None - 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
p17.pddl None None - None None - 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
p18.pddl None None - None None - None None - 34.00 34.00 0.0 34.00 34.00 0.0
p19.pddl None None - None None - None None - 38.00 38.00 0.0 38.00 38.00 0.0
p20.pddl None None - None None - None None - None None - 38.00 38.00 0.0
Sum of diffs 0.00 0.00 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00 0.00 0.00

openstacks-opt08-strips

cost issue731-base-blind-release32 issue731-v4-blind-release32 Diff (blind-release32) issue731-base-divpot-release32 issue731-v4-divpot-release32 Diff (divpot-release32) issue731-base-cegar-release32 issue731-v4-cegar-release32 Diff (cegar-release32) issue731-base-systematic2-release32 issue731-v4-systematic2-release32 Diff (systematic2-release32) issue731-base-ipdb-release32 issue731-v4-ipdb-release32 Diff (ipdb-release32)
p01.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p02.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p03.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p04.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p05.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p06.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p07.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
p08.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
p09.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p10.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p11.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p12.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p13.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p14.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 None None - 4.00 4.00 0.0
p15.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 None None - 4.00 4.00 0.0
p16.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 None None - 4.00 4.00 0.0
p17.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 None None - 4.00 4.00 0.0
p18.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0 None None - 3.00 3.00 0.0
p19.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 None None - 4.00 4.00 0.0
p20.pddl None None - None None - None None - None None - None None -
p21.pddl None None - None None - None None - None None - None None -
p22.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0 None None - 4.00 4.00 0.0
p23.pddl None None - None None - None None - None None - None None -
p24.pddl None None - None None - None None - None None - None None -
p25.pddl None None - None None - None None - None None - None None -
p26.pddl None None - None None - None None - None None - None None -
p27.pddl None None - None None - None None - None None - None None -
p28.pddl None None - None None - None None - None None - None None -
p29.pddl None <