unexplained-errors

Unexplained errors domain problem config error search_wall_clock_time memory
runs-05901-06000/05951 psr-large p41-s201-n60-l2-f30.pddl issue416-base-seq_sat_lama_2011 unexplained-critical-error 1631.69 2096444
runs-12601-12700/12617 psr-large p41-s201-n60-l2-f30.pddl issue416-v1-seq_sat_lama_2011 unexplained-critical-error 1762.79 2096876

info

algorithm local_revision global_revision revision_summary build_options driver_options component_options
issue416-base-ehc_lm_zhu issue416-base 0ef313f79ac5 0ef313f79ac5 (issue416) issue416-base [u'-j16'] [u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G'] [u'--search', u'ehc(lmcount(lm_zg()))']
issue416-base-lama_first issue416-base 0ef313f79ac5 0ef313f79ac5 (issue416) issue416-base [u'-j16'] [u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--alias', u'lama-first'] None
issue416-base-seq_sat_lama_2011 issue416-base 0ef313f79ac5 0ef313f79ac5 (issue416) issue416-base [u'-j16'] [u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--alias', u'seq-sat-lama-2011'] None
issue416-v1-ehc_lm_zhu issue416-v1 735f780233dd 735f780233dd (issue416) issue416-v1 [u'-j16'] [u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G'] [u'--search', u'ehc(lmcount(lm_zg()))']
issue416-v1-lama_first issue416-v1 735f780233dd 735f780233dd (issue416) issue416-v1 [u'-j16'] [u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--alias', u'lama-first'] None
issue416-v1-seq_sat_lama_2011 issue416-v1 735f780233dd 735f780233dd (issue416) issue416-v1 [u'-j16'] [u'--search-time-limit', u'30m', u'--search-memory-limit', u'2G', u'--alias', u'seq-sat-lama-2011'] None

summary

summary issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
cost - Sum 30806823.00 30806825.00 2.0 30905167.00 30905167.00 0.0 30102452.00 30101995.00 -457.0
coverage - Sum 1080 1079 -1.0 2019 2020 1.0 2019 2019 0.0
evaluations - Geometric mean 1410.70 1410.13 -0.57 673.24 673.24 0.0 8100.99 9231.11 1130.12
expansions - Geometric mean 1395.79 1395.22 -0.57 0.00 0.00 0.0 0.00 0.00 0.0
generated - Geometric mean 0.00 0.00 0.0 0.00 0.00 0.0 0.00 0.00 0.0
memory - Sum 96696436 96652232 -44204.0 28353580 28367244 13664.0 1039161116 1042586004 3424888.0
quality - Sum 888.48 887.38 -1.1 1665.62 1666.67 1.05 1992.76 2003.47 10.71
score_evaluations - Average 49.84 49.84 0.0 65.00 65.08 0.08 51.66 51.00 -0.66
score_evaluations - Sum 2840.64 2840.79 0.15 3704.88 3709.28 4.4 2944.76 2907.02 -37.74
score_expansions - Average 49.85 49.85 0.0 70.82 70.91 0.08 57.27 57.36 0.09
score_expansions - Sum 2841.38 2841.54 0.15 4036.90 4041.70 4.79 3264.24 3269.33 5.1
score_generated - Average 45.36 45.36 0.0 47.62 47.69 0.07 33.69 33.75 0.06
score_generated - Sum 2585.29 2585.50 0.21 2714.48 2718.21 3.74 1920.48 1923.97 3.49
score_memory - Average 25.50 25.48 -0.03 53.57 53.62 0.05 19.87 19.44 -0.43
score_memory - Sum 1453.59 1452.15 -1.44 3053.24 3056.08 2.84 1132.61 1107.98 -24.63
score_search_time - Average 66.01 66.01 0.0 81.44 81.50 0.05 60.34 61.44 1.1
score_search_time - Sum 3762.67 3762.73 0.07 4642.24 4645.24 3.0 3439.28 3502.17 62.89
score_total_time - Average 64.66 64.67 0.0 80.35 80.40 0.05 19.41 19.23 -0.18
score_total_time - Sum 3685.70 3685.92 0.23 4579.85 4582.95 3.11 1106.23 1096.07 -10.16
search_time - Geometric mean 0.08 0.08 -0.0 0.09 0.09 0.0 3.54 3.43 -0.11
total_time - Geometric mean 0.02 0.02 0.0 0.03 0.03 0.0 3.19 3.53 0.34

cost

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
airport (4) 208.00 208.00 0.0 208.00 208.00 0.0 208.00 208.00 0.0
assembly (17) 1097.00 1097.00 0.0 965.00 965.00 0.0 936.00 934.00 -2.0
blocks (2) 36.00 36.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0
depot (14) 537.00 537.00 0.0 707.00 707.00 0.0 425.00 420.00 -5.0
driverlog (14) 428.00 428.00 0.0 390.00 390.00 0.0 296.00 283.00 -13.0
elevators-sat08-strips (10) 1310.00 1310.00 0.0 1577.00 1577.00 0.0 979.00 1054.00 75.0
freecell (53) 2008.00 2008.00 0.0 2022.00 2022.00 0.0 1870.00 1837.00 -33.0
grid (5) 382.00 382.00 0.0 338.00 338.00 0.0 255.00 262.00 7.0
logistics00 (28) 1432.00 1432.00 0.0 1192.00 1192.00 0.0 1160.00 1173.00 13.0
logistics98 (12) 513.00 513.00 0.0 448.00 448.00 0.0 441.00 439.00 -2.0
miconic (150) 9338.00 9338.00 0.0 10521.00 10521.00 0.0 8104.00 8100.00 -4.0
miconic-fulladl (34) 695.00 695.00 0.0 727.00 727.00 0.0 559.00 554.00 -5.0
miconic-simpleadl (140) 7449.00 7449.00 0.0 7918.00 7918.00 0.0 5771.00 5629.00 -142.0
movie (30) 240.00 240.00 0.0 240.00 240.00 0.0 210.00 210.00 0.0
mprime (18) 124.00 124.00 0.0 124.00 124.00 0.0 109.00 107.00 -2.0
mystery (14) 94.00 94.00 0.0 87.00 87.00 0.0 82.00 82.00 0.0
nomystery-sat11-strips (1) 21.00 21.00 0.0 20.00 20.00 0.0 18.00 18.00 0.0
openstacks (30) 4764.00 4764.00 0.0 4764.00 4764.00 0.0 4747.00 4747.00 0.0
openstacks-sat08-adl (30) 664.00 664.00 0.0 664.00 664.00 0.0 286.00 276.00 -10.0
openstacks-sat08-strips (30) 760.00 760.00 0.0 760.00 760.00 0.0 286.00 286.00 0.0
openstacks-sat11-strips (20) 2116.00 2116.00 0.0 2116.00 2116.00 0.0 1560.00 1566.00 6.0
openstacks-strips (30) 4769.00 4769.00 0.0 4776.00 4776.00 0.0 4754.00 4757.00 3.0
parcprinter-08-strips (11) 14316195.00 14316195.00 0.0 14405692.00 14405692.00 0.0 13615992.00 13615992.00 0.0
parcprinter-sat11-strips (6) 16411318.00 16411318.00 0.0 16411318.00 16411318.00 0.0 16411318.00 16411318.00 0.0
pathways-noneg (7) 211.00 211.00 0.0 208.00 208.00 0.0 208.00 208.00 0.0
philosophers (18) 1701.00 1701.00 0.0 2837.00 2837.00 0.0 1701.00 1701.00 0.0
pipesworld-notankage (34) 1148.00 1148.00 0.0 2004.00 2004.00 0.0 753.00 749.00 -4.0
pipesworld-tankage (20) 705.00 705.00 0.0 881.00 881.00 0.0 430.00 419.00 -11.0
psr-large (6) 59.00 59.00 0.0 62.00 62.00 0.0 42.00 42.00 0.0
psr-middle (16) 143.00 145.00 2.0 126.00 126.00 0.0 98.00 98.00 0.0
psr-small (50) 904.00 904.00 0.0 910.00 910.00 0.0 894.00 894.00 0.0
rovers (18) 530.00 530.00 0.0 532.00 532.00 0.0 504.00 500.00 -4.0
satellite (9) 200.00 200.00 0.0 193.00 193.00 0.0 173.00 164.00 -9.0
scanalyzer-08-strips (18) 914.00 914.00 0.0 912.00 912.00 0.0 666.00 672.00 6.0
scanalyzer-sat11-strips (11) 648.00 648.00 0.0 662.00 662.00 0.0 462.00 468.00 6.0
schedule (48) 797.00 797.00 0.0 775.00 775.00 0.0 732.00 713.00 -19.0
sokoban-sat08-strips (2) 13.00 13.00 0.0 17.00 17.00 0.0 11.00 11.00 0.0
sokoban-sat11-strips (1) 2.00 2.00 0.0 4.00 4.00 0.0 2.00 2.00 0.0
storage (18) 335.00 335.00 0.0 379.00 379.00 0.0 254.00 254.00 0.0
tidybot-sat11-strips (15) 957.00 957.00 0.0 976.00 976.00 0.0 698.00 669.00 -29.0
tpp (24) 2779.00 2779.00 0.0 2151.00 2151.00 0.0 1946.00 1927.00 -19.0
transport-sat08-strips (6) 4058.00 4058.00 0.0 3276.00 3276.00 0.0 2698.00 2698.00 0.0
trucks (2) 66.00 66.00 0.0 57.00 57.00 0.0 55.00 55.00 0.0
trucks-strips (2) 66.00 66.00 0.0 67.00 67.00 0.0 55.00 55.00 0.0
visitall-sat11-strips (20) 22268.00 22268.00 0.0 28853.00 28853.00 0.0 28084.00 27838.00 -246.0
woodworking-sat08-strips (5) 1010.00 1010.00 0.0 930.00 930.00 0.0 880.00 880.00 0.0
woodworking-sat11-strips (1) 50.00 50.00 0.0 55.00 55.00 0.0 50.00 50.00 0.0
zenotravel (20) 761.00 761.00 0.0 710.00 710.00 0.0 674.00 660.00 -14.0
Sum (1074) 30806823.00 30806825.00 30905167.00 30905167.00 30102452.00 30101995.00
Sum 2.00 0.00 -457.00
Average 0.04 0.00 -9.52

Only instances where all configurations have a value for "cost" are considered. Each table entry gives the sum of "cost" for that domain. The last row reports the sum across all domains.

airport

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01-airport1-p1.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
p02-airport1-p1.pddl None None - 9.00 9.00 0.0 9.00 9.00 0.0
p03-airport1-p2.pddl None None - 17.00 17.00 0.0 17.00 17.00 0.0
p04-airport2-p1.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
p05-airport2-p1.pddl None None - 21.00 21.00 0.0 21.00 21.00 0.0
p06-airport2-p2.pddl None None - 41.00 41.00 0.0 41.00 41.00 0.0
p07-airport2-p2.pddl None None - 43.00 43.00 0.0 41.00 41.00 0.0
p08-airport2-p3.pddl None None - 64.00 64.00 0.0 62.00 62.00 0.0
p09-airport2-p4.pddl None None - 75.00 75.00 0.0 71.00 71.00 0.0
p10-airport3-p1.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p11-airport3-p1.pddl None None - 21.00 21.00 0.0 21.00 21.00 0.0
p12-airport3-p2.pddl None None - 39.00 39.00 0.0 39.00 39.00 0.0
p13-airport3-p2.pddl None None - 37.00 37.00 0.0 37.00 37.00 0.0
p14-airport3-p3.pddl None None - 62.00 62.00 0.0 60.00 60.00 0.0
p15-airport3-p3.pddl None None - 60.00 60.00 0.0 58.00 58.00 0.0
p16-airport3-p4.pddl None None - 83.00 83.00 0.0 79.00 79.00 0.0
p17-airport3-p5.pddl None None - 92.00 92.00 0.0 88.00 88.00 0.0
p18-airport3-p6.pddl None None - 111.00 111.00 0.0 111.00 111.00 0.0
p19-airport3-p6.pddl None None - 92.00 92.00 0.0 90.00 90.00 0.0
p20-airport3-p7.pddl None None - 121.00 121.00 0.0 119.00 119.00 0.0
p21-airport4halfMUC-p2.pddl None None - 101.00 101.00 0.0 101.00 101.00 0.0
p22-airport4halfMUC-p3.pddl None None - 148.00 148.00 0.0 148.00 148.00 0.0
p23-airport4halfMUC-p4.pddl None None - 168.00 168.00 0.0 168.00 168.00 0.0
p24-airport4halfMUC-p4.pddl 162.00 162.00 0.0 162.00 162.00 0.0 162.00 162.00 0.0
p25-airport4halfMUC-p5.pddl None None - 214.00 214.00 0.0 212.00 214.00 2.0
p26-airport4halfMUC-p6.pddl None None - None None - None None -
p27-airport4halfMUC-p6.pddl None None - None None - None None -
p28-airport4halfMUC-p7.pddl None None - None None - None None -
p29-airport4halfMUC-p8.pddl None None - None None - None None -
p30-airport4halfMUC-p8.pddl None None - None None - None None -
p31-airport4halfMUC-p9.pddl None None - None None - None None -
p32-airport4halfMUC-p10.pddl None None - None None - None None -
p33-airport4halfMUC-p10.pddl None None - None None - None None -
p34-airport4halfMUC-p11.pddl None None - None None - None None -
p35-airport4halfMUC-p12.pddl None None - None None - None None -
p36-airport5MUC-p2.pddl None None - 109.00 109.00 0.0 109.00 109.00 0.0
p37-airport5MUC-p3.pddl None None - 144.00 144.00 0.0 144.00 144.00 0.0
p38-airport5MUC-p3.pddl None None - 155.00 155.00 0.0 155.00 155.00 0.0
p39-airport5MUC-p4.pddl None None - None None - None None -
p40-airport5MUC-p4.pddl None None - 193.00 193.00 0.0 193.00 193.00 0.0
p41-airport5MUC-p4.pddl None None - 365.00 365.00 0.0 179.00 179.00 0.0
p42-airport5MUC-p5.pddl None None - None None - None None -
p43-airport5MUC-p5.pddl None None - 303.00 303.00 0.0 303.00 303.00 0.0
p44-airport5MUC-p5.pddl None None - 231.00 231.00 0.0 231.00 231.00 0.0
p45-airport5MUC-p6.pddl None None - None None - None None -
p46-airport5MUC-p6.pddl None None - None None - None None -
p47-airport5MUC-p8.pddl None None - None None - None None -
p48-airport5MUC-p9.pddl None None - None None - None None -
p49-airport5MUC-p10.pddl None None - None None - None None -
p50-airport5MUC-p15.pddl None None - None None - None None -
Sum 0.00 0.00 2.00
Average 0.00 0.00 0.06

assembly

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
prob01.pddl 32.00 32.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0
prob02.pddl 31.00 31.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
prob03.pddl 34.00 34.00 0.0 34.00 34.00 0.0 32.00 32.00 0.0
prob04.pddl 35.00 35.00 0.0 35.00 35.00 0.0 33.00 33.00 0.0
prob05.pddl 44.00 44.00 0.0 38.00 38.00 0.0 37.00 37.00 0.0
prob06.pddl 44.00 44.00 0.0 36.00 36.00 0.0 36.00 36.00 0.0
prob07.pddl 56.00 56.00 0.0 51.00 51.00 0.0 51.00 49.00 -2.0
prob08.pddl 56.00 56.00 0.0 50.00 50.00 0.0 44.00 44.00 0.0
prob09.pddl 54.00 54.00 0.0 49.00 49.00 0.0 48.00 48.00 0.0
prob10.pddl 57.00 57.00 0.0 47.00 47.00 0.0 47.00 47.00 0.0
prob11.pddl 63.00 63.00 0.0 59.00 59.00 0.0 57.00 57.00 0.0
prob12.pddl None None - 58.00 58.00 0.0 57.00 57.00 0.0
prob13.pddl 74.00 74.00 0.0 68.00 68.00 0.0 60.00 60.00 0.0
prob14.pddl 75.00 75.00 0.0 66.00 66.00 0.0 62.00 62.00 0.0
prob15.pddl 79.00 79.00 0.0 68.00 68.00 0.0 68.00 68.00 0.0
prob16.pddl None None - 76.00 76.00 0.0 75.00 75.00 0.0
prob17.pddl None None - 76.00 76.00 0.0 74.00 74.00 0.0
prob18.pddl None None - 79.00 79.00 0.0 77.00 77.00 0.0
prob19.pddl None None - 85.00 85.00 0.0 76.00 74.00 -2.0
prob20.pddl None None - 82.00 82.00 0.0 82.00 82.00 0.0
prob21.pddl None None - 75.00 75.00 0.0 75.00 75.00 0.0
prob22.pddl None None - 78.00 78.00 0.0 78.00 78.00 0.0
prob23.pddl 121.00 121.00 0.0 101.00 101.00 0.0 98.00 98.00 0.0
prob24.pddl 114.00 114.00 0.0 99.00 99.00 0.0 99.00 99.00 0.0
prob25.pddl None None - 101.00 101.00 0.0 99.00 99.00 0.0
prob26.pddl None None - 99.00 99.00 0.0 99.00 99.00 0.0
prob27.pddl None None - 113.00 113.00 0.0 113.00 113.00 0.0
prob28.pddl None None - 95.00 95.00 0.0 95.00 95.00 0.0
prob29.pddl None None - 96.00 96.00 0.0 96.00 96.00 0.0
prob30.pddl 128.00 128.00 0.0 109.00 109.00 0.0 109.00 109.00 0.0
Sum 0.00 0.00 -4.00
Average 0.00 0.00 -0.13

barman-sat11-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
pfile06-021.pddl None None - 310.00 310.00 0.0 310.00 310.00 0.0
pfile06-022.pddl None None - 300.00 300.00 0.0 300.00 300.00 0.0
pfile06-023.pddl None None - 330.00 330.00 0.0 329.00 329.00 0.0
pfile06-024.pddl None None - 307.00 307.00 0.0 307.00 307.00 0.0
pfile07-025.pddl None None - 342.00 342.00 0.0 342.00 342.00 0.0
pfile07-026.pddl None None - 447.00 447.00 0.0 447.00 447.00 0.0
pfile07-027.pddl None None - 317.00 317.00 0.0 317.00 317.00 0.0
pfile07-028.pddl None None - 331.00 331.00 0.0 331.00 331.00 0.0
pfile08-029.pddl None None - 395.00 395.00 0.0 395.00 395.00 0.0
pfile08-030.pddl None None - 354.00 354.00 0.0 354.00 354.00 0.0
pfile08-031.pddl None None - 465.00 465.00 0.0 465.00 465.00 0.0
pfile08-032.pddl None None - 433.00 433.00 0.0 433.00 433.00 0.0
pfile09-033.pddl None None - 504.00 504.00 0.0 504.00 504.00 0.0
pfile09-034.pddl None None - 465.00 465.00 0.0 465.00 465.00 0.0
pfile09-035.pddl None None - 451.00 451.00 0.0 447.00 447.00 0.0
pfile09-036.pddl None None - 429.00 429.00 0.0 429.00 429.00 0.0
pfile10-037.pddl None None - 441.00 441.00 0.0 441.00 441.00 0.0
pfile10-038.pddl None None - 516.00 516.00 0.0 516.00 516.00 0.0
pfile10-039.pddl None None - 441.00 441.00 0.0 441.00 441.00 0.0
pfile10-040.pddl None None - 407.00 407.00 0.0 407.00 407.00 0.0
Sum 0 0.00 0.00
Average None 0.00 0.00

blocks

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
probBLOCKS-4-0.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
probBLOCKS-4-1.pddl None None - 10.00 10.00 0.0 10.00 10.00 0.0
probBLOCKS-4-2.pddl None None - 6.00 6.00 0.0 6.00 6.00 0.0
probBLOCKS-5-0.pddl None None - 12.00 12.00 0.0 12.00 12.00 0.0
probBLOCKS-5-1.pddl None None - 10.00 10.00 0.0 10.00 10.00 0.0
probBLOCKS-5-2.pddl None None - 20.00 20.00 0.0 16.00 16.00 0.0
probBLOCKS-6-0.pddl None None - 12.00 12.00 0.0 12.00 12.00 0.0
probBLOCKS-6-1.pddl 30.00 30.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
probBLOCKS-6-2.pddl None None - 28.00 28.00 0.0 20.00 20.00 0.0
probBLOCKS-7-0.pddl None None - 26.00 26.00 0.0 20.00 20.00 0.0
probBLOCKS-7-1.pddl None None - 28.00 28.00 0.0 22.00 22.00 0.0
probBLOCKS-7-2.pddl None None - 28.00 28.00 0.0 20.00 20.00 0.0
probBLOCKS-8-0.pddl None None - 30.00 30.00 0.0 18.00 18.00 0.0
probBLOCKS-8-1.pddl None None - 24.00 24.00 0.0 20.00 20.00 0.0
probBLOCKS-8-2.pddl None None - 22.00 22.00 0.0 16.00 16.00 0.0
probBLOCKS-9-0.pddl None None - 72.00 72.00 0.0 30.00 30.00 0.0
probBLOCKS-9-1.pddl None None - 76.00 76.00 0.0 28.00 28.00 0.0
probBLOCKS-9-2.pddl None None - 30.00 30.00 0.0 26.00 26.00 0.0
probBLOCKS-10-0.pddl None None - 44.00 44.00 0.0 34.00 34.00 0.0
probBLOCKS-10-1.pddl None None - 44.00 44.00 0.0 32.00 32.00 0.0
probBLOCKS-10-2.pddl None None - 38.00 38.00 0.0 34.00 34.00 0.0
probBLOCKS-11-0.pddl None None - 46.00 46.00 0.0 32.00 32.00 0.0
probBLOCKS-11-1.pddl None None - 38.00 38.00 0.0 30.00 30.00 0.0
probBLOCKS-11-2.pddl None None - 64.00 64.00 0.0 34.00 34.00 0.0
probBLOCKS-12-0.pddl None None - 74.00 74.00 0.0 34.00 34.00 0.0
probBLOCKS-12-1.pddl None None - 52.00 52.00 0.0 34.00 34.00 0.0
probBLOCKS-13-0.pddl None None - 82.00 82.00 0.0 46.00 44.00 -2.0
probBLOCKS-13-1.pddl None None - 104.00 104.00 0.0 46.00 48.00 2.0
probBLOCKS-14-0.pddl None None - 76.00 76.00 0.0 38.00 38.00 0.0
probBLOCKS-14-1.pddl None None - 42.00 42.00 0.0 36.00 36.00 0.0
probBLOCKS-15-0.pddl None None - 142.00 142.00 0.0 46.00 54.00 8.0
probBLOCKS-15-1.pddl None None - 112.00 112.00 0.0 64.00 66.00 2.0
probBLOCKS-16-1.pddl None None - 58.00 58.00 0.0 58.00 54.00 -4.0
probBLOCKS-16-2.pddl None None - 236.00 236.00 0.0 64.00 60.00 -4.0
probBLOCKS-17-0.pddl None None - 192.00 192.00 0.0 46.00 46.00 0.0
Sum 0.00 0.00 2.00
Average 0.00 0.00 0.06

depot

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
pfile1 12.00 12.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
pfile2 16.00 16.00 0.0 16.00 16.00 0.0 15.00 15.00 0.0
pfile3 52.00 52.00 0.0 33.00 33.00 0.0 27.00 27.00 0.0
pfile4 32.00 32.00 0.0 48.00 48.00 0.0 30.00 30.00 0.0
pfile5 58.00 58.00 0.0 218.00 218.00 0.0 45.00 45.00 0.0
pfile6 60.00 60.00 0.0 None None - None None -
pfile7 40.00 40.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0
pfile8 45.00 45.00 0.0 59.00 59.00 0.0 33.00 33.00 0.0
pfile9 None None - 99.00 99.00 0.0 67.00 68.00 1.0
pfile10 26.00 26.00 0.0 34.00 34.00 0.0 24.00 24.00 0.0
pfile11 53.00 53.00 0.0 76.00 76.00 0.0 48.00 48.00 0.0
pfile12 None None - 91.00 91.00 0.0 70.00 67.00 -3.0
pfile13 27.00 27.00 0.0 29.00 29.00 0.0 26.00 25.00 -1.0
pfile14 47.00 47.00 0.0 42.00 42.00 0.0 30.00 30.00 0.0
pfile15 None None - 139.00 139.00 0.0 101.00 116.00 15.0
pfile16 33.00 33.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
pfile17 26.00 26.00 0.0 26.00 26.00 0.0 26.00 25.00 -1.0
pfile18 70.00 70.00 0.0 68.00 68.00 0.0 63.00 60.00 -3.0
pfile19 None None - 43.00 43.00 0.0 42.00 39.00 -3.0
pfile20 None None - 149.00 149.00 0.0 149.00 149.00 0.0
pfile21 None None - 34.00 34.00 0.0 34.00 34.00 0.0
pfile22 None None - None None - None None -
Sum 0.00 0.00 5.00
Average 0.00 0.00 0.25

driverlog

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
pfile1 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
pfile2 27.00 27.00 0.0 25.00 25.00 0.0 19.00 19.00 0.0
pfile3 15.00 15.00 0.0 13.00 13.00 0.0 12.00 12.00 0.0
pfile4 28.00 28.00 0.0 19.00 19.00 0.0 16.00 16.00 0.0
pfile5 26.00 26.00 0.0 23.00 23.00 0.0 18.00 18.00 0.0
pfile6 13.00 13.00 0.0 13.00 13.00 0.0 11.00 11.00 0.0
pfile7 18.00 18.00 0.0 17.00 17.00 0.0 13.00 13.00 0.0
pfile8 29.00 29.00 0.0 27.00 27.00 0.0 25.00 24.00 -1.0
pfile9 36.00 36.00 0.0 59.00 59.00 0.0 22.00 22.00 0.0
pfile10 None None - 20.00 20.00 0.0 17.00 17.00 0.0
pfile11 31.00 31.00 0.0 26.00 26.00 0.0 19.00 19.00 0.0
pfile12 56.00 56.00 0.0 40.00 40.00 0.0 35.00 36.00 1.0
pfile13 40.00 40.00 0.0 30.00 30.00 0.0 27.00 26.00 -1.0
pfile14 47.00 47.00 0.0 46.00 46.00 0.0 28.00 28.00 0.0
pfile15 55.00 55.00 0.0 45.00 45.00 0.0 44.00 32.00 -12.0
pfile16 None None - 158.00 158.00 0.0 112.00 100.00 -12.0
pfile17 None None - 134.00 134.00 0.0 87.00 93.00 6.0
pfile18 None None - 124.00 124.00 0.0 108.00 107.00 -1.0
pfile19 None None - 212.00 212.00 0.0 137.00 153.00 16.0
pfile20 None None - 210.00 210.00 0.0 132.00 124.00 -8.0
Sum 0.00 0.00 -12.00
Average 0.00 0.00 -0.60

elevators-sat08-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl 72.00 72.00 0.0 66.00 66.00 0.0 52.00 52.00 0.0
p02.pddl 93.00 93.00 0.0 78.00 78.00 0.0 53.00 53.00 0.0
p03.pddl 103.00 103.00 0.0 129.00 129.00 0.0 70.00 70.00 0.0
p04.pddl 130.00 130.00 0.0 180.00 180.00 0.0 90.00 90.00 0.0
p05.pddl 114.00 114.00 0.0 166.00 166.00 0.0 73.00 73.00 0.0
p06.pddl 133.00 133.00 0.0 138.00 138.00 0.0 138.00 138.00 0.0
p07.pddl 144.00 144.00 0.0 165.00 165.00 0.0 165.00 165.00 0.0
p08.pddl None None - 192.00 192.00 0.0 192.00 192.00 0.0
p09.pddl 164.00 164.00 0.0 195.00 195.00 0.0 102.00 99.00 -3.0
p10.pddl None None - 314.00 314.00 0.0 314.00 314.00 0.0
p11.pddl 119.00 119.00 0.0 162.00 162.00 0.0 91.00 115.00 24.0
p12.pddl None None - 334.00 334.00 0.0 135.00 130.00 -5.0
p13.pddl 238.00 238.00 0.0 298.00 298.00 0.0 145.00 199.00 54.0
p14.pddl None None - 346.00 346.00 0.0 346.00 346.00 0.0
p15.pddl None None - 677.00 677.00 0.0 293.00 287.00 -6.0
p16.pddl None None - 397.00 397.00 0.0 244.00 278.00 34.0
p17.pddl None None - 543.00 543.00 0.0 543.00 531.00 -12.0
p18.pddl None None - 503.00 503.00 0.0 503.00 503.00 0.0
p19.pddl None None - 564.00 564.00 0.0 564.00 564.00 0.0
p20.pddl None None - 619.00 619.00 0.0 619.00 619.00 0.0
p21.pddl None None - 259.00 259.00 0.0 259.00 259.00 0.0
p22.pddl None None - 411.00 411.00 0.0 411.00 411.00 0.0
p23.pddl None None - 502.00 502.00 0.0 502.00 502.00 0.0
p24.pddl None None - 1025.00 1025.00 0.0 1025.00 1025.00 0.0
p25.pddl None None - 902.00 902.00 0.0 902.00 902.00 0.0
p26.pddl None None - 741.00 741.00 0.0 741.00 741.00 0.0
p27.pddl None None - 1071.00 1071.00 0.0 1071.00 1071.00 0.0
p28.pddl None None - 1015.00 994.00 -21.0 1015.00 994.00 -21.0
p29.pddl None None - 896.00 896.00 0.0 896.00 896.00 0.0
p30.pddl None None - 1012.00 1012.00 0.0 1012.00 1012.00 0.0
Sum 0.00 -21.00 65.00
Average 0.00 -0.70 2.17

elevators-sat11-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl None None - 346.00 346.00 0.0 346.00 346.00 0.0
p02.pddl None None - 1025.00 1025.00 0.0 1025.00 1025.00 0.0
p03.pddl None None - 741.00 741.00 0.0 741.00 741.00 0.0
p04.pddl None None - 619.00 619.00 0.0 619.00 619.00 0.0
p05.pddl None None - 503.00 503.00 0.0 503.00 503.00 0.0
p06.pddl None None - 1071.00 1071.00 0.0 1071.00 1071.00 0.0
p07.pddl None None - 902.00 902.00 0.0 902.00 902.00 0.0
p08.pddl None None - 1015.00 994.00 -21.0 1015.00 994.00 -21.0
p09.pddl None None - 896.00 896.00 0.0 896.00 896.00 0.0
p10.pddl None None - 1012.00 1012.00 0.0 1012.00 1012.00 0.0
p11.pddl None None - 1366.00 1366.00 0.0 1366.00 1366.00 0.0
p12.pddl None None - 1110.00 1110.00 0.0 1110.00 1110.00 0.0
p13.pddl None None - 1308.00 1308.00 0.0 1308.00 1308.00 0.0
p14.pddl None None - 1608.00 1608.00 0.0 1608.00 1608.00 0.0
p15.pddl None None - 1227.00 1227.00 0.0 1227.00 1227.00 0.0
p16.pddl None None - 1302.00 1302.00 0.0 1302.00 1325.00 23.0
p17.pddl None None - 1758.00 1758.00 0.0 1758.00 1758.00 0.0
p18.pddl None None - 1749.00 1749.00 0.0 1749.00 1749.00 0.0
p19.pddl None None - 2507.00 2507.00 0.0 2507.00 2507.00 0.0
p20.pddl None None - 1828.00 1828.00 0.0 1828.00 1828.00 0.0
Sum 0 -21.00 2.00
Average None -1.05 0.10

floortile-sat11-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
seq-p01-001.pddl None None - 118.00 118.00 0.0 49.00 49.00 0.0
seq-p01-002.pddl None None - 103.00 103.00 0.0 52.00 52.00 0.0
seq-p02-003.pddl None None - 136.00 136.00 0.0 136.00 129.00 -7.0
seq-p02-004.pddl None None - 150.00 150.00 0.0 150.00 150.00 0.0
seq-p03-005.pddl None None - 127.00 127.00 0.0 127.00 127.00 0.0
seq-p03-006.pddl None None - 128.00 128.00 0.0 128.00 128.00 0.0
seq-p04-007.pddl None None - None None - None None -
seq-p04-008.pddl None None - None None - None None -
seq-p05-009.pddl None None - None None - None None -
seq-p05-010.pddl None None - None None - None None -
seq-p06-011.pddl None None - None None - None None -
seq-p06-012.pddl None None - None None - None None -
seq-p07-013.pddl None None - None None - None None -
seq-p07-014.pddl None None - None None - None None -
seq-p08-015.pddl None None - None None - None None -
seq-p08-016.pddl None None - None None - None None -
seq-p09-017.pddl None None - None None - None None -
seq-p09-018.pddl None None - None None - None None -
seq-p10-019.pddl None None - None None - None None -
seq-p10-020.pddl None None - None None - None None -
Sum 0 0.00 -7.00
Average None 0.00 -1.17

freecell

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
pfile1 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
pfile2 15.00 15.00 0.0 15.00 15.00 0.0 14.00 14.00 0.0
pfile3 22.00 22.00 0.0 19.00 19.00 0.0 18.00 18.00 0.0
pfile4 None None - 29.00 29.00 0.0 26.00 26.00 0.0
pfile5 34.00 34.00 0.0 35.00 35.00 0.0 30.00 30.00 0.0
pfile6 41.00 41.00 0.0 45.00 45.00 0.0 42.00 44.00 2.0
pfile7 None None - 60.00 60.00 0.0 41.00 41.00 0.0
pfile8 57.00 57.00 0.0 51.00 51.00 0.0 50.00 50.00 0.0
pfile9 None None - 50.00 50.00 0.0 50.00 50.00 0.0
pfile10 67.00 67.00 0.0 69.00 69.00 0.0 51.00 68.00 17.0
pfile11 None None - 95.00 95.00 0.0 56.00 56.00 0.0
pfile12 52.00 52.00 0.0 58.00 58.00 0.0 50.00 50.00 0.0
pfile13 None None - 73.00 73.00 0.0 73.00 72.00 -1.0
pfile14 75.00 75.00 0.0 75.00 75.00 0.0 64.00 55.00 -9.0
pfile15 76.00 76.00 0.0 85.00 85.00 0.0 84.00 84.00 0.0
pfile16 84.00 84.00 0.0 75.00 75.00 0.0 75.00 73.00 -2.0
pfile17 83.00 83.00 0.0 102.00 102.00 0.0 81.00 66.00 -15.0
pfile18 None None - 111.00 111.00 0.0 109.00 80.00 -29.0
pfile19 None None - 162.00 162.00 0.0 142.00 116.00 -26.0
pfile20 None None - 101.00 101.00 0.0 101.00 89.00 -12.0
probfreecell-2-1.pddl 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0
probfreecell-2-2.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-3.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-4.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-5.pddl 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0
probfreecell-3-1.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
probfreecell-3-2.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
probfreecell-3-3.pddl 13.00 13.00 0.0 13.00 13.00 0.0 12.00 12.00 0.0
probfreecell-3-4.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
probfreecell-3-5.pddl 14.00 14.00 0.0 14.00 14.00 0.0 13.00 13.00 0.0
probfreecell-4-1.pddl 21.00 21.00 0.0 21.00 21.00 0.0 19.00 19.00 0.0
probfreecell-4-2.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
probfreecell-4-3.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
probfreecell-4-4.pddl 19.00 19.00 0.0 19.00 19.00 0.0 18.00 18.00 0.0
probfreecell-4-5.pddl 19.00 19.00 0.0 19.00 19.00 0.0 18.00 18.00 0.0
probfreecell-5-1.pddl 27.00 27.00 0.0 29.00 29.00 0.0 28.00 24.00 -4.0
probfreecell-5-2.pddl 24.00 24.00 0.0 24.00 24.00 0.0 23.00 23.00 0.0
probfreecell-5-3.pddl 26.00 26.00 0.0 27.00 27.00 0.0 24.00 24.00 0.0
probfreecell-5-4.pddl 26.00 26.00 0.0 27.00 27.00 0.0 23.00 23.00 0.0
probfreecell-5-5.pddl 26.00 26.00 0.0 26.00 26.00 0.0 25.00 25.00 0.0
probfreecell-6-1.pddl 34.00 34.00 0.0 39.00 39.00 0.0 32.00 39.00 7.0
probfreecell-6-2.pddl 30.00 30.00 0.0 30.00 30.00 0.0 28.00 28.00 0.0
probfreecell-6-3.pddl 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0
probfreecell-6-4.pddl 33.00 33.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0
probfreecell-6-5.pddl 36.00 36.00 0.0 35.00 35.00 0.0 34.00 34.00 0.0
probfreecell-7-1.pddl 41.00 41.00 0.0 45.00 45.00 0.0 43.00 44.00 1.0
probfreecell-7-2.pddl 37.00 37.00 0.0 38.00 38.00 0.0 35.00 37.00 2.0
probfreecell-7-3.pddl 39.00 39.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
probfreecell-7-4.pddl 51.00 51.00 0.0 52.00 52.00 0.0 37.00 37.00 0.0
probfreecell-7-5.pddl 48.00 48.00 0.0 48.00 48.00 0.0 43.00 43.00 0.0
probfreecell-8-1.pddl None None - 55.00 55.00 0.0 54.00 54.00 0.0
probfreecell-8-2.pddl 45.00 45.00 0.0 45.00 45.00 0.0 44.00 44.00 0.0
probfreecell-8-3.pddl 45.00 45.00 0.0 44.00 44.00 0.0 44.00 42.00 -2.0
probfreecell-8-4.pddl 49.00 49.00 0.0 57.00 57.00 0.0 44.00 45.00 1.0
probfreecell-8-5.pddl 56.00 56.00 0.0 53.00 53.00 0.0 53.00 52.00 -1.0
probfreecell-9-1.pddl None None - 63.00 63.00 0.0 63.00 61.00 -2.0
probfreecell-9-2.pddl 60.00 60.00 0.0 54.00 54.00 0.0 54.00 47.00 -7.0
probfreecell-9-3.pddl 54.00 54.00 0.0 55.00 55.00 0.0 53.00 53.00 0.0
probfreecell-9-4.pddl 58.00 58.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0
probfreecell-9-5.pddl 61.00 61.00 0.0 71.00 71.00 0.0 56.00 56.00 0.0
probfreecell-10-1.pddl None None - 109.00 109.00 0.0 75.00 85.00 10.0
probfreecell-10-2.pddl 73.00 73.00 0.0 64.00 64.00 0.0 64.00 64.00 0.0
probfreecell-10-3.pddl None None - 61.00 61.00 0.0 61.00 60.00 -1.0
probfreecell-10-4.pddl None None - 77.00 77.00 0.0 71.00 75.00 4.0
probfreecell-10-5.pddl None None - 80.00 80.00 0.0 67.00 76.00 9.0
probfreecell-11-1.pddl None None - 92.00 92.00 0.0 92.00 92.00 0.0
probfreecell-11-2.pddl 91.00 91.00 0.0 81.00 81.00 0.0 81.00 59.00 -22.0
probfreecell-11-3.pddl 90.00 90.00 0.0 74.00 74.00 0.0 74.00 73.00 -1.0
probfreecell-11-4.pddl None None - 90.00 90.00 0.0 84.00 87.00 3.0
probfreecell-11-5.pddl None None - 128.00 128.00 0.0 82.00 76.00 -6.0
probfreecell-12-1.pddl None None - None None - None None -
probfreecell-12-2.pddl None None - 89.00 89.00 0.0 63.00 64.00 1.0
probfreecell-12-3.pddl None None - 81.00 81.00 0.0 77.00 80.00 3.0
probfreecell-12-4.pddl None None - 113.00 113.00 0.0 78.00 104.00 26.0
probfreecell-12-5.pddl None None - 117.00 117.00 0.0 106.00 112.00 6.0
probfreecell-13-1.pddl None None - 152.00 152.00 0.0 92.00 92.00 0.0
probfreecell-13-2.pddl None None - 153.00 153.00 0.0 85.00 110.00 25.0
probfreecell-13-3.pddl None None - 112.00 112.00 0.0 103.00 78.00 -25.0
probfreecell-13-4.pddl None None - 147.00 147.00 0.0 105.00 145.00 40.0
probfreecell-13-5.pddl None None - 165.00 165.00 0.0 165.00 99.00 -66.0
Sum 0.00 0.00 -74.00
Average 0.00 0.00 -0.94

grid

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
prob01.pddl 17.00 17.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
prob02.pddl 40.00 40.00 0.0 32.00 32.00 0.0 26.00 26.00 0.0
prob03.pddl 104.00 104.00 0.0 76.00 76.00 0.0 54.00 54.00 0.0
prob04.pddl 49.00 49.00 0.0 49.00 49.00 0.0 36.00 36.00 0.0
prob05.pddl 172.00 172.00 0.0 167.00 167.00 0.0 125.00 132.00 7.0
Sum 0.00 0.00 7.00
Average 0.00 0.00 1.40

gripper

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
prob01.pddl None None - 11.00 11.00 0.0 11.00 11.00 0.0
prob02.pddl None None - 17.00 17.00 0.0 17.00 17.00 0.0
prob03.pddl None None - 23.00 23.00 0.0 23.00 23.00 0.0
prob04.pddl None None - 29.00 29.00 0.0 29.00 29.00 0.0
prob05.pddl None None - 35.00 35.00 0.0 35.00 35.00 0.0
prob06.pddl None None - 41.00 41.00 0.0 41.00 41.00 0.0
prob07.pddl None None - 47.00 47.00 0.0 47.00 47.00 0.0
prob08.pddl None None - 53.00 53.00 0.0 53.00 53.00 0.0
prob09.pddl None None - 59.00 59.00 0.0 59.00 59.00 0.0
prob10.pddl None None - 65.00 65.00 0.0 65.00 65.00 0.0
prob11.pddl None None - 71.00 71.00 0.0 71.00 71.00 0.0
prob12.pddl None None - 77.00 77.00 0.0 77.00 77.00 0.0
prob13.pddl None None - 83.00 83.00 0.0 83.00 83.00 0.0
prob14.pddl None None - 89.00 89.00 0.0 89.00 89.00 0.0
prob15.pddl None None - 95.00 95.00 0.0 95.00 95.00 0.0
prob16.pddl None None - 101.00 101.00 0.0 101.00 101.00 0.0
prob17.pddl None None - 107.00 107.00 0.0 107.00 107.00 0.0
prob18.pddl None None - 113.00 113.00 0.0 113.00 113.00 0.0
prob19.pddl None None - 119.00 119.00 0.0 119.00 119.00 0.0
prob20.pddl None None - 125.00 125.00 0.0 125.00 125.00 0.0
Sum 0 0.00 0.00
Average None 0.00 0.00

logistics00

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
probLOGISTICS-4-0.pddl 26.00 26.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probLOGISTICS-4-1.pddl 23.00 23.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
probLOGISTICS-4-2.pddl 20.00 20.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
probLOGISTICS-5-0.pddl 32.00 32.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
probLOGISTICS-5-1.pddl 21.00 21.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
probLOGISTICS-5-2.pddl 12.00 12.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probLOGISTICS-6-0.pddl 30.00 30.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
probLOGISTICS-6-1.pddl 20.00 20.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
probLOGISTICS-6-2.pddl 30.00 30.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
probLOGISTICS-6-9.pddl 29.00 29.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0
probLOGISTICS-7-0.pddl 45.00 45.00 0.0 38.00 38.00 0.0 36.00 36.00 0.0
probLOGISTICS-7-1.pddl 52.00 52.00 0.0 44.00 44.00 0.0 44.00 44.00 0.0
probLOGISTICS-8-0.pddl 39.00 39.00 0.0 32.00 32.00 0.0 31.00 31.00 0.0
probLOGISTICS-8-1.pddl 54.00 54.00 0.0 44.00 44.00 0.0 44.00 44.00 0.0
probLOGISTICS-9-0.pddl 47.00 47.00 0.0 38.00 38.00 0.0 37.00 36.00 -1.0
probLOGISTICS-9-1.pddl 39.00 39.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
probLOGISTICS-10-0.pddl 57.00 57.00 0.0 48.00 48.00 0.0 47.00 47.00 0.0
probLOGISTICS-10-1.pddl 54.00 54.00 0.0 44.00 44.00 0.0 42.00 42.00 0.0
probLOGISTICS-11-0.pddl 63.00 63.00 0.0 52.00 52.00 0.0 51.00 49.00 -2.0
probLOGISTICS-11-1.pddl 73.00 73.00 0.0 64.00 64.00 0.0 61.00 63.00 2.0
probLOGISTICS-12-0.pddl 54.00 54.00 0.0 45.00 45.00 0.0 43.00 42.00 -1.0
probLOGISTICS-12-1.pddl 84.00 84.00 0.0 74.00 74.00 0.0 68.00 72.00 4.0
probLOGISTICS-13-0.pddl 93.00 93.00 0.0 81.00 81.00 0.0 81.00 80.00 -1.0
probLOGISTICS-13-1.pddl 79.00 79.00 0.0 66.00 66.00 0.0 66.00 66.00 0.0
probLOGISTICS-14-0.pddl 77.00 77.00 0.0 62.00 62.00 0.0 60.00 62.00 2.0
probLOGISTICS-14-1.pddl 95.00 95.00 0.0 83.00 83.00 0.0 72.00 82.00 10.0
probLOGISTICS-15-0.pddl 97.00 97.00 0.0 84.00 84.00 0.0 84.00 84.00 0.0
probLOGISTICS-15-1.pddl 87.00 87.00 0.0 69.00 69.00 0.0 69.00 69.00 0.0
Sum 0.00 0.00 13.00
Average 0.00 0.00 0.46

logistics98

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
prob01.pddl 33.00 33.00 0.0 27.00 27.00 0.0 26.00 26.00 0.0
prob02.pddl 34.00 34.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0
prob03.pddl 67.00 67.00 0.0 57.00 57.00 0.0 56.00 55.00 -1.0
prob04.pddl None None - 65.00 65.00 0.0 62.00 61.00 -1.0
prob05.pddl 31.00 31.00 0.0 23.00 23.00 0.0 23.00 22.00 -1.0
prob06.pddl None None - 76.00 76.00 0.0 76.00 76.00 0.0
prob07.pddl 38.00 38.00 0.0 35.00 35.00 0.0 34.00 34.00 0.0
prob08.pddl None None - 47.00 47.00 0.0 43.00 44.00 1.0
prob09.pddl None None - 98.00 98.00 0.0 90.00 88.00 -2.0
prob10.pddl None None - 113.00 113.00 0.0 108.00 113.00 5.0
prob11.pddl 31.00 31.00 0.0 31.00 31.00 0.0 31.00 30.00 -1.0
prob12.pddl None None - 41.00 41.00 0.0 41.00 41.00 0.0
prob13.pddl None None - 77.00 76.00 -1.0 73.00 72.00 -1.0
prob14.pddl None None - 99.00 99.00 0.0 97.00 96.00 -1.0
prob15.pddl 115.00 115.00 0.0 98.00 98.00 0.0 96.00 98.00 2.0
prob16.pddl None None - 56.00 56.00 0.0 56.00 56.00 0.0
prob17.pddl None None - 44.00 44.00 0.0 44.00 44.00 0.0
prob18.pddl None None - 181.00 181.00 0.0 180.00 173.00 -7.0
prob19.pddl None None - 165.00 165.00 0.0 161.00 157.00 -4.0
prob20.pddl None None - 164.00 164.00 0.0 163.00 164.00 1.0
prob21.pddl None None - 111.00 111.00 0.0 110.00 109.00 -1.0
prob22.pddl None None - 322.00 322.00 0.0 295.00 319.00 24.0
prob23.pddl None None - 125.00 125.00 0.0 125.00 117.00 -8.0
prob24.pddl None None - 42.00 42.00 0.0 42.00 41.00 -1.0
prob25.pddl None None - 208.00 208.00 0.0 208.00 208.00 0.0
prob26.pddl None None - 218.00 218.00 0.0 218.00 217.00 -1.0
prob27.pddl None None - 161.00 161.00 0.0 160.00 157.00 -3.0
prob28.pddl None None - 314.00 314.00 0.0 314.00 314.00 0.0
prob29.pddl None None - 341.00 341.00 0.0 341.00 341.00 0.0
prob30.pddl None None - 148.00 148.00 0.0 148.00 148.00 0.0
prob31.pddl 16.00 16.00 0.0 14.00 14.00 0.0 13.00 13.00 0.0
prob32.pddl 25.00 25.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
prob33.pddl 32.00 32.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
prob34.pddl 48.00 48.00 0.0 52.00 52.00 0.0 52.00 51.00 -1.0
prob35.pddl 43.00 43.00 0.0 31.00 31.00 0.0 30.00 30.00 0.0
Sum 0.00 -1.00 -1.00
Average 0.00 -0.03 -0.03

miconic

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
s1-0.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-1.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
s1-2.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-3.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-4.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s2-0.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
s2-1.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
s2-2.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
s2-3.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s2-4.pddl 8.00 8.00 0.0 9.00 9.00 0.0 7.00 7.00 0.0
s3-0.pddl 12.00 12.00 0.0 13.00 13.00 0.0 10.00 10.00 0.0
s3-1.pddl 12.00 12.00 0.0 13.00 13.00 0.0 11.00 11.00 0.0
s3-2.pddl 10.00 10.00 0.0 12.00 12.00 0.0 10.00 10.00 0.0
s3-3.pddl 11.00 11.00 0.0 12.00 12.00 0.0 10.00 10.00 0.0
s3-4.pddl 10.00 10.00 0.0 11.00 11.00 0.0 10.00 10.00 0.0
s4-0.pddl 17.00 17.00 0.0 15.00 15.00 0.0 14.00 14.00 0.0
s4-1.pddl 16.00 16.00 0.0 16.00 16.00 0.0 13.00 13.00 0.0
s4-2.pddl 17.00 17.00 0.0 17.00 17.00 0.0 15.00 15.00 0.0
s4-3.pddl 17.00 17.00 0.0 19.00 19.00 0.0 15.00 15.00 0.0
s4-4.pddl 19.00 19.00 0.0 21.00 21.00 0.0 15.00 15.00 0.0
s5-0.pddl 21.00 21.00 0.0 24.00 24.00 0.0 17.00 17.00 0.0
s5-1.pddl 20.00 20.00 0.0 20.00 20.00 0.0 17.00 17.00 0.0
s5-2.pddl 17.00 17.00 0.0 18.00 18.00 0.0 15.00 15.00 0.0
s5-3.pddl 20.00 20.00 0.0 18.00 18.00 0.0 17.00 17.00 0.0
s5-4.pddl 22.00 22.00 0.0 24.00 24.00 0.0 18.00 18.00 0.0
s6-0.pddl 22.00 22.00 0.0 25.00 25.00 0.0 19.00 19.00 0.0
s6-1.pddl 23.00 23.00 0.0 21.00 21.00 0.0 19.00 19.00 0.0
s6-2.pddl 23.00 23.00 0.0 27.00 27.00 0.0 20.00 20.00 0.0
s6-3.pddl 22.00 22.00 0.0 21.00 21.00 0.0 20.00 20.00 0.0
s6-4.pddl 25.00 25.00 0.0 25.00 25.00 0.0 21.00 21.00 0.0
s7-0.pddl 28.00 28.00 0.0 29.00 29.00 0.0 23.00 23.00 0.0
s7-1.pddl 30.00 30.00 0.0 33.00 33.00 0.0 24.00 24.00 0.0
s7-2.pddl 27.00 27.00 0.0 23.00 23.00 0.0 22.00 22.00 0.0
s7-3.pddl 28.00 28.00 0.0 29.00 29.00 0.0 22.00 22.00 0.0
s7-4.pddl 31.00 31.00 0.0 34.00 34.00 0.0 25.00 25.00 0.0
s8-0.pddl 33.00 33.00 0.0 33.00 33.00 0.0 27.00 27.00 0.0
s8-1.pddl 34.00 34.00 0.0 37.00 37.00 0.0 27.00 27.00 0.0
s8-2.pddl 31.00 31.00 0.0 36.00 36.00 0.0 26.00 26.00 0.0
s8-3.pddl 34.00 34.00 0.0 36.00 36.00 0.0 28.00 28.00 0.0
s8-4.pddl 31.00 31.00 0.0 31.00 31.00 0.0 27.00 27.00 0.0
s9-0.pddl 36.00 36.00 0.0 42.00 42.00 0.0 31.00 31.00 0.0
s9-1.pddl 36.00 36.00 0.0 41.00 41.00 0.0 30.00 30.00 0.0
s9-2.pddl 35.00 35.00 0.0 40.00 40.00 0.0 30.00 30.00 0.0
s9-3.pddl 38.00 38.00 0.0 35.00 35.00 0.0 32.00 32.00 0.0
s9-4.pddl 33.00 33.00 0.0 35.00 35.00 0.0 28.00 28.00 0.0
s10-0.pddl 39.00 39.00 0.0 47.00 47.00 0.0 33.00 33.00 0.0
s10-1.pddl 40.00 40.00 0.0 41.00 41.00 0.0 32.00 32.00 0.0
s10-2.pddl 39.00 39.00 0.0 40.00 40.00 0.0 32.00 32.00 0.0
s10-3.pddl 41.00 41.00 0.0 45.00 45.00 0.0 34.00 34.00 0.0
s10-4.pddl 39.00 39.00 0.0 42.00 42.00 0.0 33.00 33.00 0.0
s11-0.pddl 46.00 46.00 0.0 51.00 51.00 0.0 37.00 37.00 0.0
s11-1.pddl 42.00 42.00 0.0 43.00 43.00 0.0 34.00 34.00 0.0
s11-2.pddl 46.00 46.00 0.0 53.00 53.00 0.0 38.00 38.00 0.0
s11-3.pddl 45.00 45.00 0.0 48.00 48.00 0.0 38.00 38.00 0.0
s11-4.pddl 41.00 41.00 0.0 48.00 48.00 0.0 35.00 35.00 0.0
s12-0.pddl 48.00 48.00 0.0 46.00 46.00 0.0 40.00 40.00 0.0
s12-1.pddl 50.00 50.00 0.0 56.00 56.00 0.0 40.00 40.00 0.0
s12-2.pddl 48.00 48.00 0.0 56.00 56.00 0.0 40.00 40.00 0.0
s12-3.pddl 46.00 46.00 0.0 53.00 53.00 0.0 39.00 39.00 0.0
s12-4.pddl 48.00 48.00 0.0 59.00 59.00 0.0 41.00 41.00 0.0
s13-0.pddl 53.00 53.00 0.0 60.00 60.00 0.0 44.00 44.00 0.0
s13-1.pddl 49.00 49.00 0.0 53.00 53.00 0.0 42.00 42.00 0.0
s13-2.pddl 57.00 57.00 0.0 64.00 64.00 0.0 46.00 46.00 0.0
s13-3.pddl 53.00 53.00 0.0 53.00 53.00 0.0 43.00 43.00 0.0
s13-4.pddl 50.00 50.00 0.0 53.00 53.00 0.0 41.00 41.00 0.0
s14-0.pddl 54.00 54.00 0.0 59.00 59.00 0.0 45.00 45.00 0.0
s14-1.pddl 57.00 57.00 0.0 66.00 66.00 0.0 47.00 47.00 0.0
s14-2.pddl 62.00 62.00 0.0 66.00 66.00 0.0 51.00 51.00 0.0
s14-3.pddl 52.00 52.00 0.0 61.00 61.00 0.0 42.00 42.00 0.0
s14-4.pddl 53.00 53.00 0.0 63.00 63.00 0.0 45.00 45.00 0.0
s15-0.pddl 57.00 57.00 0.0 66.00 66.00 0.0 46.00 46.00 0.0
s15-1.pddl 60.00 60.00 0.0 75.00 75.00 0.0 50.00 50.00 0.0
s15-2.pddl 60.00 60.00 0.0 70.00 70.00 0.0 54.00 54.00 0.0
s15-3.pddl 61.00 61.00 0.0 70.00 70.00 0.0 50.00 50.00 0.0
s15-4.pddl 57.00 57.00 0.0 66.00 66.00 0.0 47.00 47.00 0.0
s16-0.pddl 64.00 64.00 0.0 73.00 73.00 0.0 57.00 56.00 -1.0
s16-1.pddl 65.00 65.00 0.0 71.00 71.00 0.0 54.00 54.00 0.0
s16-2.pddl 65.00 65.00 0.0 80.00 80.00 0.0 59.00 59.00 0.0
s16-3.pddl 65.00 65.00 0.0 73.00 73.00 0.0 56.00 56.00 0.0
s16-4.pddl 66.00 66.00 0.0 72.00 72.00 0.0 56.00 56.00 0.0
s17-0.pddl 67.00 67.00 0.0 77.00 77.00 0.0 56.00 56.00 0.0
s17-1.pddl 66.00 66.00 0.0 73.00 73.00 0.0 59.00 59.00 0.0
s17-2.pddl 68.00 68.00 0.0 79.00 79.00 0.0 54.00 54.00 0.0
s17-3.pddl 74.00 74.00 0.0 82.00 82.00 0.0 62.00 62.00 0.0
s17-4.pddl 67.00 67.00 0.0 75.00 75.00 0.0 58.00 58.00 0.0
s18-0.pddl 73.00 73.00 0.0 79.00 79.00 0.0 64.00 64.00 0.0
s18-1.pddl 72.00 72.00 0.0 77.00 77.00 0.0 61.00 61.00 0.0
s18-2.pddl 71.00 71.00 0.0 80.00 80.00 0.0 64.00 64.00 0.0
s18-3.pddl 74.00 74.00 0.0 84.00 84.00 0.0 65.00 64.00 -1.0
s18-4.pddl 66.00 66.00 0.0 80.00 80.00 0.0 64.00 64.00 0.0
s19-0.pddl 77.00 77.00 0.0 87.00 87.00 0.0 69.00 69.00 0.0
s19-1.pddl 81.00 81.00 0.0 91.00 91.00 0.0 70.00 69.00 -1.0
s19-2.pddl 75.00 75.00 0.0 88.00 88.00 0.0 68.00 68.00 0.0
s19-3.pddl 78.00 78.00 0.0 89.00 89.00 0.0 69.00 70.00 1.0
s19-4.pddl 76.00 76.00 0.0 86.00 86.00 0.0 67.00 68.00 1.0
s20-0.pddl 78.00 78.00 0.0 86.00 86.00 0.0 72.00 71.00 -1.0
s20-1.pddl 81.00 81.00 0.0 89.00 89.00 0.0 70.00 70.00 0.0
s20-2.pddl 77.00 77.00 0.0 87.00 87.00 0.0 69.00 69.00 0.0
s20-3.pddl 79.00 79.00 0.0 88.00 88.00 0.0 70.00 70.00 0.0
s20-4.pddl 79.00 79.00 0.0 89.00 89.00 0.0 69.00 69.00 0.0
s21-0.pddl 86.00 86.00 0.0 97.00 97.00 0.0 74.00 74.00 0.0
s21-1.pddl 88.00 88.00 0.0 96.00 96.00 0.0 72.00 72.00 0.0
s21-2.pddl 85.00 85.00 0.0 90.00 90.00 0.0 72.00 72.00 0.0
s21-3.pddl 80.00 80.00 0.0 91.00 91.00 0.0 72.00 72.00 0.0
s21-4.pddl 87.00 87.00 0.0 93.00 93.00 0.0 73.00 73.00 0.0
s22-0.pddl 89.00 89.00 0.0 104.00 104.00 0.0 80.00 81.00 1.0
s22-1.pddl 86.00 86.00 0.0 98.00 98.00 0.0 78.00 78.00 0.0
s22-2.pddl 89.00 89.00 0.0 103.00 103.00 0.0 79.00 79.00 0.0
s22-3.pddl 93.00 93.00 0.0 105.00 105.00 0.0 79.00 79.00 0.0
s22-4.pddl 86.00 86.00 0.0 102.00 102.00 0.0 77.00 78.00 1.0
s23-0.pddl 94.00 94.00 0.0 108.00 108.00 0.0 83.00 84.00 1.0
s23-1.pddl 90.00 90.00 0.0 100.00 100.00 0.0 80.00 81.00 1.0
s23-2.pddl 91.00 91.00 0.0 101.00 101.00 0.0 77.00 77.00 0.0
s23-3.pddl 86.00 86.00 0.0 96.00 96.00 0.0 80.00 81.00 1.0
s23-4.pddl 89.00 89.00 0.0 104.00 104.00 0.0 84.00 82.00 -2.0
s24-0.pddl 95.00 95.00 0.0 100.00 100.00 0.0 82.00 82.00 0.0
s24-1.pddl 96.00 96.00 0.0 108.00 108.00 0.0 83.00 83.00 0.0
s24-2.pddl 92.00 92.00 0.0 111.00 111.00 0.0 86.00 85.00 -1.0
s24-3.pddl 98.00 98.00 0.0 113.00 113.00 0.0 85.00 85.00 0.0
s24-4.pddl 95.00 95.00 0.0 110.00 110.00 0.0 87.00 87.00 0.0
s25-0.pddl 101.00 101.00 0.0 115.00 115.00 0.0 89.00 88.00 -1.0
s25-1.pddl 105.00 105.00 0.0 123.00 123.00 0.0 91.00 91.00 0.0
s25-2.pddl 96.00 96.00 0.0 113.00 113.00 0.0 87.00 87.00 0.0
s25-3.pddl 105.00 105.00 0.0 118.00 118.00 0.0 90.00 90.00 0.0
s25-4.pddl 102.00 102.00 0.0 118.00 118.00 0.0 90.00 91.00 1.0
s26-0.pddl 102.00 102.00 0.0 118.00 118.00 0.0 89.00 89.00 0.0
s26-1.pddl 101.00 101.00 0.0 116.00 116.00 0.0 89.00 89.00 0.0
s26-2.pddl 113.00 113.00 0.0 121.00 121.00 0.0 94.00 93.00 -1.0
s26-3.pddl 110.00 110.00 0.0 123.00 123.00 0.0 93.00 94.00 1.0
s26-4.pddl 103.00 103.00 0.0 117.00 117.00 0.0 90.00 90.00 0.0
s27-0.pddl 106.00 106.00 0.0 128.00 128.00 0.0 98.00 98.00 0.0
s27-1.pddl 113.00 113.00 0.0 126.00 126.00 0.0 96.00 96.00 0.0
s27-2.pddl 105.00 105.00 0.0 127.00 127.00 0.0 100.00 100.00 0.0
s27-3.pddl 111.00 111.00 0.0 128.00 128.00 0.0 96.00 95.00 -1.0
s27-4.pddl 110.00 110.00 0.0 126.00 126.00 0.0 97.00 98.00 1.0
s28-0.pddl 116.00 116.00 0.0 133.00 133.00 0.0 102.00 102.00 0.0
s28-1.pddl 116.00 116.00 0.0 130.00 130.00 0.0 99.00 98.00 -1.0
s28-2.pddl 117.00 117.00 0.0 136.00 136.00 0.0 102.00 102.00 0.0
s28-3.pddl 108.00 108.00 0.0 121.00 121.00 0.0 95.00 95.00 0.0
s28-4.pddl 114.00 114.00 0.0 130.00 130.00 0.0 100.00 99.00 -1.0
s29-0.pddl 117.00 117.00 0.0 131.00 131.00 0.0 98.00 98.00 0.0
s29-1.pddl 111.00 111.00 0.0 131.00 131.00 0.0 99.00 99.00 0.0
s29-2.pddl 120.00 120.00 0.0 134.00 134.00 0.0 107.00 106.00 -1.0
s29-3.pddl 119.00 119.00 0.0 140.00 140.00 0.0 106.00 106.00 0.0
s29-4.pddl 123.00 123.00 0.0 146.00 146.00 0.0 110.00 110.00 0.0
s30-0.pddl 116.00 116.00 0.0 133.00 133.00 0.0 102.00 102.00 0.0
s30-1.pddl 122.00 122.00 0.0 138.00 138.00 0.0 108.00 108.00 0.0
s30-2.pddl 121.00 121.00 0.0 133.00 133.00 0.0 104.00 103.00 -1.0
s30-3.pddl 123.00 123.00 0.0 144.00 144.00 0.0 109.00 108.00 -1.0
s30-4.pddl 121.00 121.00 0.0 141.00 141.00 0.0 108.00 109.00 1.0
Sum 0.00 0.00 -4.00
Average 0.00 0.00 -0.03

miconic-fulladl

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
f1-0.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
f1-1.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
f1-2.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
f1-3.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
f1-4.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
f2-0.pddl 7.00 7.00 0.0 7.00 7.00 0.0 6.00 6.00 0.0
f2-1.pddl 7.00 7.00 0.0 8.00 8.00 0.0 6.00 6.00 0.0
f2-2.pddl 7.00 7.00 0.0 8.00 8.00 0.0 6.00 6.00 0.0
f2-3.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
f2-4.pddl 8.00 8.00 0.0 7.00 7.00 0.0 6.00 6.00 0.0
f3-0.pddl 10.00 10.00 0.0 12.00 12.00 0.0 8.00 8.00 0.0
f3-1.pddl 11.00 11.00 0.0 12.00 12.00 0.0 10.00 10.00 0.0
f3-2.pddl 8.00 8.00 0.0 12.00 12.00 0.0 8.00 8.00 0.0
f3-3.pddl 9.00 9.00 0.0 11.00 11.00 0.0 9.00 9.00 0.0
f3-4.pddl 9.00 9.00 0.0 11.00 11.00 0.0 8.00 8.00 0.0
f4-0.pddl 13.00 13.00 0.0 13.00 13.00 0.0 12.00 12.00 0.0
f4-1.pddl 13.00 13.00 0.0 14.00 14.00 0.0 11.00 11.00 0.0
f4-2.pddl 16.00 16.00 0.0 18.00 18.00 0.0 14.00 14.00 0.0
f4-3.pddl None None - 16.00 16.00 0.0 14.00 14.00 0.0
f4-4.pddl 19.00 19.00 0.0 20.00 20.00 0.0 14.00 14.00 0.0
f5-0.pddl 21.00 21.00 0.0 20.00 20.00 0.0 16.00 16.00 0.0
f5-1.pddl 21.00 21.00 0.0 21.00 21.00 0.0 18.00 18.00 0.0
f5-2.pddl None None - 16.00 16.00 0.0 13.00 13.00 0.0
f5-3.pddl None None - 18.00 18.00 0.0 15.00 15.00 0.0
f5-4.pddl 17.00 17.00 0.0 14.00 14.00 0.0 12.00 12.00 0.0
f6-0.pddl None None - 22.00 22.00 0.0 17.00 17.00 0.0
f6-1.pddl None None - 20.00 20.00 0.0 14.00 14.00 0.0
f6-2.pddl None None - 21.00 21.00 0.0 18.00 18.00 0.0
f6-3.pddl 24.00 24.00 0.0 21.00 21.00 0.0 16.00 16.00 0.0
f6-4.pddl 20.00 20.00 0.0 21.00 21.00 0.0 14.00 14.00 0.0
f7-0.pddl None None - 23.00 23.00 0.0 19.00 19.00 0.0
f7-1.pddl 28.00 28.00 0.0 31.00 31.00 0.0 22.00 22.00 0.0
f7-2.pddl None None - 27.00 27.00 0.0 20.00 20.00 0.0
f7-3.pddl None None - 25.00 25.00 0.0 19.00 19.00 0.0
f7-4.pddl None None - 25.00 25.00 0.0 19.00 19.00 0.0
f8-0.pddl 26.00 26.00 0.0 25.00 25.00 0.0 20.00 20.00 0.0
f8-1.pddl None None - 31.00 31.00 0.0 22.00 22.00 0.0
f8-2.pddl None None - 27.00 27.00 0.0 20.00 20.00 0.0
f8-3.pddl None None - 34.00 34.00 0.0 26.00 26.00 0.0
f8-4.pddl 28.00 28.00 0.0 27.00 27.00 0.0 21.00 21.00 0.0
f9-0.pddl None None - 29.00 29.00 0.0 23.00 23.00 0.0
f9-1.pddl None None - 30.00 30.00 0.0 25.00 25.00 0.0
f9-2.pddl None None - 33.00 33.00 0.0 24.00 24.00 0.0
f9-3.pddl 36.00 36.00 0.0 33.00 33.00 0.0 25.00 25.00 0.0
f9-4.pddl None None - 31.00 31.00 0.0 22.00 22.00 0.0
f10-0.pddl None None - 44.00 44.00 0.0 31.00 31.00 0.0
f10-1.pddl 35.00 35.00 0.0 38.00 38.00 0.0 28.00 28.00 0.0
f10-2.pddl None None - None None - None None -
f10-3.pddl None None - 42.00 42.00 0.0 30.00 30.00 0.0
f10-4.pddl None None - 40.00 40.00 0.0 28.00 28.00 0.0
f11-0.pddl None None - 43.00 43.00 0.0 29.00 29.00 0.0
f11-1.pddl 42.00 42.00 0.0 41.00 41.00 0.0 32.00 32.00 0.0
f11-2.pddl None None - 42.00 42.00 0.0 31.00 31.00 0.0
f11-3.pddl None None - 44.00 44.00 0.0 32.00 32.00 0.0
f11-4.pddl None None - 37.00 37.00 0.0 29.00 29.00 0.0
f12-0.pddl None None - 52.00 52.00 0.0 34.00 34.00 0.0
f12-1.pddl None None - 55.00 55.00 0.0 38.00 38.00 0.0
f12-2.pddl None None - 50.00 50.00 0.0 34.00 34.00 0.0
f12-3.pddl None None - 50.00 50.00 0.0 38.00 38.00 0.0
f12-4.pddl None None - 44.00 44.00 0.0 32.00 32.00 0.0
f13-0.pddl None None - 47.00 47.00 0.0 36.00 36.00 0.0
f13-1.pddl 48.00 48.00 0.0 55.00 55.00 0.0 38.00 38.00 0.0
f13-2.pddl None None - 50.00 50.00 0.0 38.00 38.00 0.0
f13-3.pddl None None - 53.00 53.00 0.0 38.00 38.00 0.0
f13-4.pddl None None - 45.00 45.00 0.0 34.00 34.00 0.0
f14-0.pddl None None - 58.00 58.00 0.0 42.00 42.00 0.0
f14-1.pddl None None - 49.00 49.00 0.0 39.00 39.00 0.0
f14-2.pddl None None - 55.00 55.00 0.0 43.00 43.00 0.0
f14-3.pddl None None - 51.00 51.00 0.0 37.00 37.00 0.0
f14-4.pddl None None - 57.00 57.00 0.0 42.00 42.00 0.0
f15-0.pddl None None - 67.00 67.00 0.0 46.00 46.00 0.0
f15-1.pddl None None - 60.00 60.00 0.0 44.00 44.00 0.0
f15-2.pddl None None - 55.00 55.00 0.0 36.00 36.00 0.0
f15-3.pddl None None - 52.00 52.00 0.0 36.00 36.00 0.0
f15-4.pddl None None - 52.00 52.00 0.0 38.00 38.00 0.0
f16-0.pddl None None - 69.00 69.00 0.0 52.00 52.00 0.0
f16-1.pddl 58.00 58.00 0.0 57.00 57.00 0.0 43.00 43.00 0.0
f16-2.pddl 59.00 59.00 0.0 68.00 68.00 0.0 51.00 50.00 -1.0
f16-3.pddl None None - 72.00 72.00 0.0 46.00 46.00 0.0
f16-4.pddl None None - None None - None None -
f17-0.pddl None None - 71.00 71.00 0.0 54.00 52.00 -2.0
f17-1.pddl None None - None None - None None -
f17-2.pddl None None - 60.00 60.00 0.0 45.00 45.00 0.0
f17-3.pddl None None - 67.00 67.00 0.0 53.00 51.00 -2.0
f17-4.pddl None None - 61.00 61.00 0.0 48.00 48.00 0.0
f18-0.pddl None None - 72.00 72.00 0.0 52.00 52.00 0.0
f18-1.pddl None None - 72.00 72.00 0.0 57.00 55.00 -2.0
f18-2.pddl None None - 73.00 73.00 0.0 56.00 52.00 -4.0
f18-3.pddl None None - 73.00 73.00 0.0 49.00 49.00 0.0
f18-4.pddl None None - 71.00 71.00 0.0 47.00 47.00 0.0
f19-0.pddl None None - 73.00 73.00 0.0 51.00 51.00 0.0
f19-1.pddl None None - 76.00 76.00 0.0 58.00 54.00 -4.0
f19-2.pddl None None - 73.00 73.00 0.0 58.00 58.00 0.0
f19-3.pddl None None - 67.00 67.00 0.0 51.00 48.00 -3.0
f19-4.pddl 70.00 70.00 0.0 77.00 77.00 0.0 60.00 56.00 -4.0
f20-0.pddl None None - 82.00 82.00 0.0 65.00 62.00 -3.0
f20-1.pddl None None - 75.00 75.00 0.0 54.00 54.00 0.0
f20-2.pddl None None - 86.00 86.00 0.0 66.00 64.00 -2.0
f20-3.pddl None None - None None - None None -
f20-4.pddl None None - 74.00 74.00 0.0 56.00 56.00 0.0
f21-0.pddl None None - 84.00 84.00 0.0 66.00 66.00 0.0
f21-1.pddl None None - 75.00 75.00 0.0 62.00 60.00 -2.0
f21-2.pddl None None - 81.00 81.00 0.0 62.00 62.00 0.0
f21-3.pddl None None - None None - None None -
f21-4.pddl None None - None None - None None -
f22-0.pddl None None - 92.00 92.00 0.0 68.00 64.00 -4.0
f22-1.pddl None None - 87.00 87.00 0.0 72.00 70.00 -2.0
f22-2.pddl None None - 91.00 91.00 0.0 62.00 62.00 0.0
f22-3.pddl None None - 82.00 82.00 0.0 68.00 66.00 -2.0
f22-4.pddl None None - 80.00 80.00 0.0 66.00 66.00 0.0
f23-0.pddl None None - 95.00 95.00 0.0 74.00 74.00 0.0
f23-1.pddl None None - 94.00 94.00 0.0 72.00 72.00 0.0
f23-2.pddl None None - 86.00 86.00 0.0 68.00 64.00 -4.0
f23-3.pddl None None - 95.00 95.00 0.0 74.00 76.00 2.0
f23-4.pddl None None - 103.00 103.00 0.0 70.00 70.00 0.0
f24-0.pddl None None - 97.00 97.00 0.0 74.00 72.00 -2.0
f24-1.pddl None None - None None - None None -
f24-2.pddl None None - 85.00 85.00 0.0 70.00 64.00 -6.0
f24-3.pddl None None - 99.00 99.00 0.0 82.00 78.00 -4.0
f24-4.pddl None None - 89.00 89.00 0.0 68.00 66.00 -2.0
f25-0.pddl None None - 106.00 106.00 0.0 78.00 76.00 -2.0
f25-1.pddl None None - 101.00 101.00 0.0 82.00 76.00 -6.0
f25-2.pddl None None - None None - None None -
f25-3.pddl None None - 117.00 117.00 0.0 84.00 80.00 -4.0
f25-4.pddl None None - 97.00 97.00 0.0 76.00 74.00 -2.0
f26-0.pddl None None - 89.00 89.00 0.0 73.00 75.00 2.0
f26-1.pddl None None - 110.00 110.00 0.0 83.00 80.00 -3.0
f26-2.pddl None None - 100.00 100.00 0.0 72.00 74.00 2.0
f26-3.pddl None None - 110.00 110.00 0.0 84.00 80.00 -4.0
f26-4.pddl None None - 106.00 106.00 0.0 79.00 76.00 -3.0
f27-0.pddl None None - 103.00 103.00 0.0 82.00 80.00 -2.0
f27-1.pddl None None - 102.00 102.00 0.0 77.00 74.00 -3.0
f27-2.pddl None None - None None - None None -
f27-3.pddl None None - 108.00 108.00 0.0 80.00 76.00 -4.0
f27-4.pddl None None - 95.00 95.00 0.0 79.00 76.00 -3.0
f28-0.pddl None None - 105.00 105.00 0.0 86.00 84.00 -2.0
f28-1.pddl None None - 122.00 122.00 0.0 83.00 78.00 -5.0
f28-2.pddl None None - 101.00 101.00 0.0 78.00 74.00 -4.0
f28-3.pddl None None - 103.00 103.00 0.0 78.00 76.00 -2.0
f28-4.pddl None None - None None - None None -
f29-0.pddl None None - 129.00 129.00 0.0 98.00 92.00 -6.0
f29-1.pddl None None - 119.00 119.00 0.0 108.00 116.00 8.0
f29-2.pddl None None - 114.00 114.00 0.0 88.00 86.00 -2.0
f29-3.pddl None None - 129.00 129.00 0.0 97.00 92.00 -5.0
f29-4.pddl None None - 112.00 112.00 0.0 84.00 84.00 0.0
f30-0.pddl None None - 124.00 124.00 0.0 92.00 92.00 0.0
f30-1.pddl None None - 128.00 128.00 0.0 101.00 95.00 -6.0
f30-2.pddl None None - None None - None None -
f30-3.pddl None None - 125.00 125.00 0.0 90.00 86.00 -4.0
f30-4.pddl None None - 114.00 114.00 0.0 90.00 88.00 -2.0
Sum 0.00 0.00 -115.00
Average 0.00 0.00 -0.83

miconic-simpleadl

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
s1-0.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-1.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
s1-2.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-3.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-4.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s2-0.pddl 7.00 7.00 0.0 7.00 7.00 0.0 6.00 6.00 0.0
s2-1.pddl 7.00 7.00 0.0 8.00 8.00 0.0 6.00 6.00 0.0
s2-2.pddl 7.00 7.00 0.0 8.00 8.00 0.0 6.00 6.00 0.0
s2-3.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
s2-4.pddl 8.00 8.00 0.0 7.00 7.00 0.0 6.00 6.00 0.0
s3-0.pddl 10.00 10.00 0.0 12.00 12.00 0.0 8.00 8.00 0.0
s3-1.pddl 11.00 11.00 0.0 12.00 12.00 0.0 10.00 10.00 0.0
s3-2.pddl 8.00 8.00 0.0 12.00 12.00 0.0 8.00 8.00 0.0
s3-3.pddl 9.00 9.00 0.0 11.00 11.00 0.0 9.00 9.00 0.0
s3-4.pddl 9.00 9.00 0.0 11.00 11.00 0.0 8.00 8.00 0.0
s4-0.pddl 13.00 13.00 0.0 13.00 13.00 0.0 12.00 12.00 0.0
s4-1.pddl 12.00 12.00 0.0 14.00 14.00 0.0 11.00 11.00 0.0
s4-2.pddl 15.00 15.00 0.0 16.00 16.00 0.0 14.00 14.00 0.0
s4-3.pddl 16.00 16.00 0.0 16.00 16.00 0.0 14.00 14.00 0.0
s4-4.pddl 18.00 18.00 0.0 20.00 20.00 0.0 14.00 14.00 0.0
s5-0.pddl 18.00 18.00 0.0 20.00 20.00 0.0 14.00 14.00 0.0
s5-1.pddl 17.00 17.00 0.0 19.00 19.00 0.0 15.00 15.00 0.0
s5-2.pddl 12.00 12.00 0.0 14.00 14.00 0.0 10.00 10.00 0.0
s5-3.pddl 16.00 16.00 0.0 16.00 16.00 0.0 14.00 14.00 0.0
s5-4.pddl 20.00 20.00 0.0 20.00 20.00 0.0 16.00 16.00 0.0
s6-0.pddl 18.00 18.00 0.0 19.00 19.00 0.0 14.00 14.00 0.0
s6-1.pddl 20.00 20.00 0.0 17.00 17.00 0.0 15.00 15.00 0.0
s6-2.pddl 23.00 23.00 0.0 22.00 22.00 0.0 16.00 16.00 0.0
s6-3.pddl 17.00 17.00 0.0 20.00 20.00 0.0 16.00 16.00 0.0
s6-4.pddl 24.00 24.00 0.0 22.00 22.00 0.0 18.00 18.00 0.0
s7-0.pddl 24.00 24.00 0.0 24.00 24.00 0.0 18.00 18.00 0.0
s7-1.pddl 29.00 29.00 0.0 29.00 29.00 0.0 20.00 20.00 0.0
s7-2.pddl 22.00 22.00 0.0 18.00 18.00 0.0 17.00 17.00 0.0
s7-3.pddl 25.00 25.00 0.0 22.00 22.00 0.0 17.00 17.00 0.0
s7-4.pddl 28.00 28.00 0.0 33.00 33.00 0.0 23.00 23.00 0.0
s8-0.pddl 31.00 31.00 0.0 26.00 26.00 0.0 22.00 22.00 0.0
s8-1.pddl 30.00 30.00 0.0 29.00 29.00 0.0 23.00 23.00 0.0
s8-2.pddl 27.00 27.00 0.0 27.00 27.00 0.0 20.00 20.00 0.0
s8-3.pddl 33.00 33.00 0.0 31.00 31.00 0.0 24.00 24.00 0.0
s8-4.pddl None None - 26.00 26.00 0.0 22.00 22.00 0.0
s9-0.pddl 38.00 38.00 0.0 37.00 37.00 0.0 26.00 26.00 0.0
s9-1.pddl 36.00 36.00 0.0 32.00 32.00 0.0 24.00 24.00 0.0
s9-2.pddl 36.00 36.00 0.0 30.00 30.00 0.0 24.00 24.00 0.0
s9-3.pddl 38.00 38.00 0.0 32.00 32.00 0.0 28.00 28.00 0.0
s9-4.pddl 29.00 29.00 0.0 29.00 29.00 0.0 21.00 21.00 0.0
s10-0.pddl None None - 39.00 39.00 0.0 27.00 27.00 0.0
s10-1.pddl 37.00 37.00 0.0 34.00 34.00 0.0 25.00 25.00 0.0
s10-2.pddl 36.00 36.00 0.0 30.00 30.00 0.0 24.00 24.00 0.0
s10-3.pddl 40.00 40.00 0.0 38.00 38.00 0.0 28.00 28.00 0.0
s10-4.pddl 39.00 39.00 0.0 35.00 35.00 0.0 26.00 26.00 0.0
s11-0.pddl 48.00 48.00 0.0 42.00 42.00 0.0 30.00 30.00 0.0
s11-1.pddl 37.00 37.00 0.0 35.00 35.00 0.0 25.00 25.00 0.0
s11-2.pddl 45.00 45.00 0.0 46.00 46.00 0.0 32.00 32.00 0.0
s11-3.pddl 38.00 38.00 0.0 44.00 44.00 0.0 32.00 32.00 0.0
s11-4.pddl 36.00 36.00 0.0 34.00 34.00 0.0 26.00 26.00 0.0
s12-0.pddl 44.00 44.00 0.0 38.00 38.00 0.0 32.00 32.00 0.0
s12-1.pddl 44.00 44.00 0.0 45.00 45.00 0.0 32.00 32.00 0.0
s12-2.pddl 46.00 46.00 0.0 46.00 46.00 0.0 32.00 32.00 0.0
s12-3.pddl 48.00 48.00 0.0 41.00 41.00 0.0 30.00 30.00 0.0
s12-4.pddl 50.00 50.00 0.0 50.00 50.00 0.0 34.00 34.00 0.0
s13-0.pddl 48.00 48.00 0.0 49.00 49.00 0.0 36.00 36.00 0.0
s13-1.pddl 46.00 46.00 0.0 45.00 45.00 0.0 32.00 32.00 0.0
s13-2.pddl 60.00 60.00 0.0 58.00 58.00 0.0 40.00 40.00 0.0
s13-3.pddl 47.00 47.00 0.0 46.00 46.00 0.0 34.00 34.00 0.0
s13-4.pddl 45.00 45.00 0.0 41.00 41.00 0.0 31.00 31.00 0.0
s14-0.pddl 49.00 49.00 0.0 48.00 48.00 0.0 35.00 35.00 0.0
s14-1.pddl None None - 55.00 55.00 0.0 38.00 38.00 0.0
s14-2.pddl 56.00 56.00 0.0 59.00 59.00 0.0 43.00 43.00 0.0
s14-3.pddl 40.00 40.00 0.0 42.00 42.00 0.0 29.00 29.00 0.0
s14-4.pddl 48.00 48.00 0.0 51.00 51.00 0.0 35.00 35.00 0.0
s15-0.pddl 44.00 44.00 0.0 48.00 48.00 0.0 33.00 33.00 0.0
s15-1.pddl 50.00 50.00 0.0 63.00 63.00 0.0 40.00 40.00 0.0
s15-2.pddl 56.00 56.00 0.0 60.00 60.00 0.0 40.00 40.00 0.0
s15-3.pddl None None - 57.00 57.00 0.0 40.00 40.00 0.0
s15-4.pddl 49.00 49.00 0.0 49.00 49.00 0.0 34.00 34.00 0.0
s16-0.pddl 56.00 56.00 0.0 58.00 58.00 0.0 42.00 42.00 0.0
s16-1.pddl 56.00 56.00 0.0 59.00 59.00 0.0 41.00 41.00 0.0
s16-2.pddl 58.00 58.00 0.0 66.00 66.00 0.0 49.00 46.00 -3.0
s16-3.pddl 58.00 58.00 0.0 56.00 56.00 0.0 40.00 40.00 0.0
s16-4.pddl 54.00 54.00 0.0 61.00 61.00 0.0 43.00 43.00 0.0
s17-0.pddl 57.00 57.00 0.0 63.00 63.00 0.0 44.00 44.00 0.0
s17-1.pddl 57.00 57.00 0.0 59.00 59.00 0.0 41.00 41.00 0.0
s17-2.pddl 60.00 60.00 0.0 62.00 62.00 0.0 41.00 41.00 0.0
s17-3.pddl 65.00 65.00 0.0 75.00 75.00 0.0 55.00 52.00 -3.0
s17-4.pddl 57.00 57.00 0.0 64.00 64.00 0.0 49.00 45.00 -4.0
s18-0.pddl 67.00 67.00 0.0 65.00 65.00 0.0 46.00 46.00 0.0
s18-1.pddl 64.00 64.00 0.0 61.00 61.00 0.0 45.00 45.00 0.0
s18-2.pddl 62.00 62.00 0.0 58.00 58.00 0.0 44.00 44.00 0.0
s18-3.pddl 68.00 68.00 0.0 70.00 70.00 0.0 50.00 48.00 -2.0
s18-4.pddl None None - 64.00 64.00 0.0 42.00 42.00 0.0
s19-0.pddl 66.00 66.00 0.0 70.00 70.00 0.0 48.00 48.00 0.0
s19-1.pddl 70.00 70.00 0.0 76.00 76.00 0.0 54.00 54.00 0.0
s19-2.pddl 63.00 63.00 0.0 72.00 72.00 0.0 57.00 50.00 -7.0
s19-3.pddl 70.00 70.00 0.0 74.00 74.00 0.0 52.00 54.00 2.0
s19-4.pddl 64.00 64.00 0.0 72.00 72.00 0.0 54.00 50.00 -4.0
s20-0.pddl None None - 72.00 72.00 0.0 54.00 48.00 -6.0
s20-1.pddl 71.00 71.00 0.0 74.00 74.00 0.0 59.00 53.00 -6.0
s20-2.pddl 66.00 66.00 0.0 69.00 69.00 0.0 46.00 46.00 0.0
s20-3.pddl 64.00 64.00 0.0 72.00 72.00 0.0 46.00 46.00 0.0
s20-4.pddl 69.00 69.00 0.0 71.00 71.00 0.0 54.00 52.00 -2.0
s21-0.pddl 71.00 71.00 0.0 82.00 82.00 0.0 60.00 56.00 -4.0
s21-1.pddl 75.00 75.00 0.0 83.00 83.00 0.0 61.00 59.00 -2.0
s21-2.pddl 73.00 73.00 0.0 76.00 76.00 0.0 55.00 55.00 0.0
s21-3.pddl 66.00 66.00 0.0 71.00 71.00 0.0 52.00 50.00 -2.0
s21-4.pddl 73.00 73.00 0.0 79.00 79.00 0.0 61.00 59.00 -2.0
s22-0.pddl 76.00 76.00 0.0 86.00 86.00 0.0 62.00 60.00 -2.0
s22-1.pddl 73.00 73.00 0.0 75.00 75.00 0.0 59.00 55.00 -4.0
s22-2.pddl 72.00 72.00 0.0 81.00 81.00 0.0 58.00 54.00 -4.0
s22-3.pddl 80.00 80.00 0.0 92.00 92.00 0.0 66.00 64.00 -2.0
s22-4.pddl 72.00 72.00 0.0 81.00 81.00 0.0 63.00 60.00 -3.0
s23-0.pddl 87.00 87.00 0.0 89.00 89.00 0.0 62.00 60.00 -2.0
s23-1.pddl 77.00 77.00 0.0 81.00 81.00 0.0 62.00 62.00 0.0
s23-2.pddl 74.00 74.00 0.0 80.00 80.00 0.0 58.00 56.00 -2.0
s23-3.pddl 69.00 69.00 0.0 71.00 71.00 0.0 59.00 52.00 -7.0
s23-4.pddl 77.00 77.00 0.0 87.00 87.00 0.0 58.00 56.00 -2.0
s24-0.pddl 81.00 81.00 0.0 83.00 83.00 0.0 66.00 62.00 -4.0
s24-1.pddl 84.00 84.00 0.0 85.00 85.00 0.0 71.00 60.00 -11.0
s24-2.pddl None None - 91.00 91.00 0.0 64.00 64.00 0.0
s24-3.pddl 86.00 86.00 0.0 95.00 95.00 0.0 66.00 64.00 -2.0
s24-4.pddl 86.00 86.00 0.0 84.00 84.00 0.0 64.00 62.00 -2.0
s25-0.pddl 88.00 88.00 0.0 87.00 87.00 0.0 66.00 62.00 -4.0
s25-1.pddl 89.00 89.00 0.0 105.00 105.00 0.0 76.00 74.00 -2.0
s25-2.pddl 78.00 78.00 0.0 85.00 85.00 0.0 63.00 63.00 0.0
s25-3.pddl 88.00 88.00 0.0 101.00 101.00 0.0 72.00 70.00 -2.0
s25-4.pddl 84.00 84.00 0.0 97.00 97.00 0.0 71.00 66.00 -5.0
s26-0.pddl 78.00 78.00 0.0 91.00 91.00 0.0 69.00 64.00 -5.0
s26-1.pddl None None - 93.00 93.00 0.0 71.00 64.00 -7.0
s26-2.pddl None None - 105.00 105.00 0.0 76.00 76.00 0.0
s26-3.pddl 92.00 92.00 0.0 104.00 104.00 0.0 75.00 72.00 -3.0
s26-4.pddl 86.00 86.00 0.0 93.00 93.00 0.0 64.00 62.00 -2.0
s27-0.pddl 97.00 97.00 0.0 101.00 101.00 0.0 78.00 70.00 -8.0
s27-1.pddl 97.00 97.00 0.0 108.00 108.00 0.0 77.00 75.00 -2.0
s27-2.pddl None None - 106.00 106.00 0.0 69.00 67.00 -2.0
s27-3.pddl 94.00 94.00 0.0 105.00 105.00 0.0 72.00 72.00 0.0
s27-4.pddl 95.00 95.00 0.0 103.00 103.00 0.0 74.00 72.00 -2.0
s28-0.pddl 97.00 97.00 0.0 115.00 115.00 0.0 80.00 80.00 0.0
s28-1.pddl 95.00 95.00 0.0 110.00 110.00 0.0 76.00 76.00 0.0
s28-2.pddl 101.00 101.00 0.0 113.00 113.00 0.0 78.00 76.00 -2.0
s28-3.pddl 89.00 89.00 0.0 94.00 94.00 0.0 67.00 69.00 2.0
s28-4.pddl 92.00 92.00 0.0 105.00 105.00 0.0 72.00 72.00 0.0
s29-0.pddl 90.00 90.00 0.0 106.00 106.00 0.0 75.00 73.00 -2.0
s29-1.pddl 93.00 93.00 0.0 95.00 95.00 0.0 75.00 77.00 2.0
s29-2.pddl 101.00 101.00 0.0 104.00 104.00 0.0 74.00 74.00 0.0
s29-3.pddl 106.00 106.00 0.0 118.00 118.00 0.0 80.00 78.00 -2.0
s29-4.pddl 112.00 112.00 0.0 124.00 124.00 0.0 86.00 82.00 -4.0
s30-0.pddl 95.00 95.00 0.0 107.00 107.00 0.0 75.00 73.00 -2.0
s30-1.pddl 104.00 104.00 0.0 118.00 118.00 0.0 82.00 77.00 -5.0
s30-2.pddl 102.00 102.00 0.0 106.00 106.00 0.0 78.00 76.00 -2.0
s30-3.pddl 104.00 104.00 0.0 121.00 121.00 0.0 90.00 86.00 -4.0
s30-4.pddl 96.00 96.00 0.0 117.00 117.00 0.0 81.00 79.00 -2.0
Sum 0.00 0.00 -157.00
Average 0.00 0.00 -1.05

movie

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
prob01.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob02.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob03.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob04.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob05.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob06.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob07.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob08.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob09.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob10.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob11.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob12.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob13.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob14.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob15.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob16.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob17.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob18.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob19.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob20.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob21.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob22.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob23.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob24.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob25.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob26.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob27.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob28.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob29.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob30.pddl 8.00 8.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
Sum 0.00 0.00 0.00
Average 0.00 0.00 0.00

mprime

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
prob01.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob02.pddl 9.00 9.00 0.0 8.00 8.00 0.0 8.00 7.00 -1.0
prob03.pddl 4.00 4.00 0.0 6.00 6.00 0.0 4.00 4.00 0.0
prob04.pddl 11.00 11.00 0.0 9.00 9.00 0.0 8.00 8.00 0.0
prob05.pddl 11.00 11.00 0.0 12.00 12.00 0.0 12.00 11.00 -1.0
prob06.pddl None None - 22.00 22.00 0.0 12.00 12.00 0.0
prob07.pddl 5.00 5.00 0.0 6.00 6.00 0.0 5.00 5.00 0.0
prob08.pddl None None - 7.00 7.00 0.0 6.00 6.00 0.0
prob09.pddl 8.00 8.00 0.0 12.00 12.00 0.0 8.00 8.00 0.0
prob10.pddl None None - 8.00 8.00 0.0 8.00 8.00 0.0
prob11.pddl 9.00 9.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob12.pddl 6.00 6.00 0.0 7.00 7.00 0.0 6.00 6.00 0.0
prob13.pddl None None - 17.00 17.00 0.0 15.00 15.00 0.0
prob14.pddl None None - 11.00 11.00 0.0 11.00 11.00 0.0
prob15.pddl None None - 6.00 6.00 0.0 6.00 6.00 0.0
prob16.pddl 9.00 9.00 0.0 7.00 7.00 0.0 6.00 6.00 0.0
prob17.pddl None None - 4.00 4.00 0.0 4.00 4.00 0.0
prob18.pddl None None - 20.00 20.00 0.0 17.00 17.00 0.0
prob19.pddl None None - 8.00 8.00 0.0 6.00 6.00 0.0
prob20.pddl None None - 7.00 7.00 0.0 7.00 7.00 0.0
prob21.pddl None None - 7.00 7.00 0.0 6.00 6.00 0.0
prob22.pddl None None - 13.00 13.00 0.0 9.00 9.00 0.0
prob23.pddl None None - 11.00 11.00 0.0 10.00 10.00 0.0
prob24.pddl None None - 8.00 8.00 0.0 8.00 8.00 0.0
prob25.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob26.pddl None None - 6.00 6.00 0.0 6.00 6.00 0.0
prob27.pddl 7.00 7.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob28.pddl 12.00 12.00 0.0 9.00 9.00 0.0 7.00 7.00 0.0
prob29.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob30.pddl None None - 9.00 9.00 0.0 9.00 9.00 0.0
prob31.pddl 4.00 4.00 0.0 5.00 5.00 0.0 4.00 4.00 0.0
prob32.pddl 7.00 7.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob33.pddl None None - 14.00 14.00 0.0 14.00 13.00 -1.0
prob34.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob35.pddl 5.00 5.00 0.0 6.00 6.00 0.0 5.00 5.00 0.0
Sum 0.00 0.00 -3.00
Average 0.00 0.00 -0.09

mystery

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
prob01.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob02.pddl 9.00 9.00 0.0 8.00 8.00 0.0 7.00 7.00 0.0
prob03.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob04.pddl None None - None None - None None -
prob05.pddl None None - None None - None None -
prob06.pddl None None - 16.00 16.00 0.0 11.00 11.00 0.0
prob07.pddl None None - None None - None None -
prob08.pddl None None - None None - None None -
prob09.pddl 8.00 8.00 0.0 9.00 9.00 0.0 8.00 8.00 0.0
prob10.pddl None None - 8.00 8.00 0.0 8.00 8.00 0.0
prob11.pddl 9.00 9.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob12.pddl None None - None None - None None -
prob13.pddl None None - 21.00 21.00 0.0 16.00 15.00 -1.0
prob14.pddl None None - 11.00 11.00 0.0 11.00 11.00 0.0
prob15.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob16.pddl None None - None None - None None -
prob17.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob18.pddl None None - None None - None None -
prob19.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob20.pddl None None - 8.00 8.00 0.0 7.00 7.00 0.0
prob21.pddl None None - None None - None None -
prob22.pddl None None - None None - None None -
prob23.pddl None None - None None - None None -
prob24.pddl None None - None None - None None -
prob25.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob26.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob27.pddl 7.00 7.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob28.pddl 12.00 12.00 0.0 9.00 9.00 0.0 7.00 7.00 0.0
prob29.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob30.pddl 10.00 10.00 0.0 10.00 10.00 0.0 9.00 9.00 0.0
Sum 0.00 0.00 -1.00
Average 0.00 0.00 -0.05

nomystery-sat11-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl 21.00 21.00 0.0 20.00 20.00 0.0 18.00 18.00 0.0
p02.pddl None None - 23.00 23.00 0.0 21.00 21.00 0.0
p03.pddl None None - 28.00 28.00 0.0 25.00 26.00 1.0
p04.pddl None None - 33.00 33.00 0.0 28.00 28.00 0.0
p05.pddl None None - 37.00 37.00 0.0 35.00 36.00 1.0
p06.pddl None None - None 39.00 - None None -
p07.pddl None None - 48.00 48.00 0.0 44.00 44.00 0.0
p08.pddl None None - 43.00 43.00 0.0 43.00 42.00 -1.0
p09.pddl None None - None None - None None -
p10.pddl None None - None None - None None -
p11.pddl None None - 20.00 20.00 0.0 18.00 18.00 0.0
p12.pddl None None - 21.00 21.00 0.0 21.00 21.00 0.0
p13.pddl None None - 26.00 26.00 0.0 25.00 26.00 1.0
p14.pddl None None - None None - None None -
p15.pddl None None - None None - None None -
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
Sum 0.00 0.00 2.00
Average 0.00 0.00 0.20

openstacks

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl 25.00 25.00 0.0 25.00 25.00 0.0 23.00 23.00 0.0
p02.pddl 24.00 24.00 0.0 24.00 24.00 0.0 23.00 23.00 0.0
p03.pddl 25.00 25.00 0.0 25.00 25.00 0.0 23.00 23.00 0.0
p04.pddl 25.00 25.00 0.0 25.00 25.00 0.0 23.00 23.00 0.0
p05.pddl 25.00 25.00 0.0 25.00 25.00 0.0 23.00 23.00 0.0
p06.pddl 49.00 49.00 0.0 49.00 49.00 0.0 45.00 45.00 0.0
p07.pddl 50.00 50.00 0.0 50.00 50.00 0.0 46.00 46.00 0.0
p08.pddl 95.00 95.00 0.0 95.00 95.00 0.0 95.00 95.00 0.0
p09.pddl 95.00 95.00 0.0 95.00 95.00 0.0 95.00 95.00 0.0
p10.pddl 99.00 99.00 0.0 99.00 99.00 0.0 99.00 99.00 0.0
p11.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p12.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p13.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p14.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p15.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p16.pddl 99.00 99.00 0.0 99.00 99.00 0.0 99.00 99.00 0.0
p17.pddl 120.00 120.00 0.0 120.00 120.00 0.0 120.00 120.00 0.0
p18.pddl 193.00 193.00 0.0 193.00 193.00 0.0 193.00 193.00 0.0
p19.pddl 124.00 124.00 0.0 124.00 124.00 0.0 124.00 124.00 0.0
p20.pddl 147.00 147.00 0.0 147.00 147.00 0.0 147.00 147.00 0.0
p21.pddl 146.00 146.00 0.0 146.00 146.00 0.0 146.00 146.00 0.0
p22.pddl 150.00 150.00 0.0 150.00 150.00 0.0 150.00 150.00 0.0
p23.pddl 150.00 150.00 0.0 150.00 150.00 0.0 150.00 150.00 0.0
p24.pddl 250.00 250.00 0.0 250.00 250.00 0.0 250.00 250.00 0.0
p25.pddl 250.00 250.00 0.0 250.00 250.00 0.0 250.00 250.00 0.0
p26.pddl 248.00 248.00 0.0 248.00 248.00 0.0 248.00 248.00 0.0
p27.pddl 375.00 375.00 0.0 375.00 375.00 0.0 375.00 375.00 0.0
p28.pddl 500.00 500.00 0.0 500.00 500.00 0.0 500.00 500.00 0.0
p29.pddl 500.00 500.00 0.0 500.00 500.00 0.0 500.00 500.00 0.0
p30.pddl 500.00 500.00 0.0 500.00 500.00 0.0 500.00 500.00 0.0
Sum 0.00 0.00 0.00
Average 0.00 0.00 0.00

openstacks-sat08-adl

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p02.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p03.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p04.pddl 4.00 4.00 0.0 4.00 4.00 0.0 2.00 2.00 0.0
p05.pddl 3.00 3.00 0.0 3.00 3.00 0.0 2.00 2.00 0.0
p06.pddl 6.00 6.00 0.0 6.00 6.00 0.0 4.00 4.00 0.0
p07.pddl 7.00 7.00 0.0 7.00 7.00 0.0 4.00 4.00 0.0
p08.pddl 7.00 7.00 0.0 7.00 7.00 0.0 4.00 4.00 0.0
p09.pddl 6.00 6.00 0.0 6.00 6.00 0.0 4.00 4.00 0.0
p10.pddl 7.00 7.00 0.0 7.00 7.00 0.0 4.00 4.00 0.0
p11.pddl 10.00 10.00 0.0 10.00 10.00 0.0 5.00 5.00 0.0
p12.pddl 8.00 8.00 0.0 8.00 8.00 0.0 3.00 3.00 0.0
p13.pddl 11.00 11.00 0.0 11.00 11.00 0.0 5.00 5.00 0.0
p14.pddl 14.00 14.00 0.0 14.00 14.00 0.0 4.00 4.00 0.0
p15.pddl 12.00 12.00 0.0 12.00 12.00 0.0 4.00 4.00 0.0
p16.pddl 20.00 20.00 0.0 20.00 20.00 0.0 7.00 6.00 -1.0
p17.pddl 20.00 20.00 0.0 20.00 20.00 0.0 7.00 7.00 0.0
p18.pddl 19.00 19.00 0.0 19.00 19.00 0.0 4.00 4.00 0.0
p19.pddl 20.00 20.00 0.0 20.00 20.00 0.0 10.00 10.00 0.0
p20.pddl 29.00 29.00 0.0 29.00 29.00 0.0 13.00 13.00 0.0
p21.pddl 26.00 26.00 0.0 26.00 26.00 0.0 7.00 7.00 0.0
p22.pddl 34.00 34.00 0.0 34.00 34.00 0.0 14.00 14.00 0.0
p23.pddl 33.00 33.00 0.0 33.00 33.00 0.0 9.00 9.00 0.0
p24.pddl 34.00 34.00 0.0 34.00 34.00 0.0 9.00 9.00 0.0
p25.pddl 42.00 42.00 0.0 42.00 42.00 0.0 22.00 19.00 -3.0
p26.pddl 49.00 49.00 0.0 49.00 49.00 0.0 17.00 15.00 -2.0
p27.pddl 48.00 48.00 0.0 48.00 48.00 0.0 23.00 20.00 -3.0
p28.pddl 63.00 63.00 0.0 63.00 63.00 0.0 31.00 32.00 1.0
p29.pddl 58.00 58.00 0.0 58.00 58.00 0.0 31.00 30.00 -1.0
p30.pddl 67.00 67.00 0.0 67.00 67.00 0.0 30.00 29.00 -1.0
Sum 0.00 0.00 -10.00
Average 0.00 0.00 -0.33

openstacks-sat08-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl 3.00 3.00 0.0 3.00 3.00 0.0 2.00 2.00 0.0
p02.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p03.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p04.pddl 4.00 4.00 0.0 4.00 4.00 0.0 2.00 2.00 0.0
p05.pddl 4.00 4.00 0.0 4.00 4.00 0.0 2.00 2.00 0.0
p06.pddl 6.00 6.00 0.0 6.00 6.00 0.0 4.00 4.00 0.0
p07.pddl 8.00 8.00 0.0 8.00 8.00 0.0 4.00 4.00 0.0
p08.pddl 5.00 5.00 0.0 5.00 5.00 0.0 4.00 4.00 0.0
p09.pddl 7.00 7.00 0.0 7.00 7.00 0.0 4.00 4.00 0.0
p10.pddl 11.00 11.00 0.0 11.00 11.00 0.0 4.00 4.00 0.0
p11.pddl 11.00 11.00 0.0 11.00 11.00 0.0 5.00 5.00 0.0
p12.pddl 8.00 8.00 0.0 8.00 8.00 0.0 3.00 3.00 0.0
p13.pddl 16.00 16.00 0.0 16.00 16.00 0.0 5.00 5.00 0.0
p14.pddl 15.00 15.00 0.0 15.00 15.00 0.0 4.00 4.00 0.0
p15.pddl 14.00 14.00 0.0 14.00 14.00 0.0 4.00 4.00 0.0
p16.pddl 22.00 22.00 0.0 22.00 22.00 0.0 6.00 6.00 0.0
p17.pddl 22.00 22.00 0.0 22.00 22.00 0.0 6.00 6.00 0.0
p18.pddl 23.00 23.00 0.0 23.00 23.00 0.0 4.00 4.00 0.0
p19.pddl 25.00 25.00 0.0 25.00 25.00 0.0 10.00 10.00 0.0
p20.pddl 36.00 36.00 0.0 36.00 36.00 0.0 13.00 13.00 0.0
p21.pddl 28.00 28.00 0.0 28.00 28.00 0.0 6.00 6.00 0.0
p22.pddl 39.00 39.00 0.0 39.00 39.00 0.0 15.00 15.00 0.0
p23.pddl 37.00 37.00 0.0 37.00 37.00 0.0 8.00 8.00 0.0
p24.pddl 38.00 38.00 0.0 38.00 38.00 0.0 11.00 11.00 0.0
p25.pddl 58.00 58.00 0.0 58.00 58.00 0.0 20.00 20.00 0.0
p26.pddl 46.00 46.00 0.0 46.00 46.00 0.0 17.00 17.00 0.0
p27.pddl 48.00 48.00 0.0 48.00 48.00 0.0 20.00 20.00 0.0
p28.pddl 71.00 71.00 0.0 71.00 71.00 0.0 31.00 31.00 0.0
p29.pddl 70.00 70.00 0.0 70.00 70.00 0.0 33.00 33.00 0.0
p30.pddl 80.00 80.00 0.0 80.00 80.00 0.0 34.00 34.00 0.0
Sum 0.00 0.00 0.00
Average 0.00 0.00 0.00

openstacks-sat11-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl 28.00 28.00 0.0 28.00 28.00 0.0 6.00 6.00 0.0
p02.pddl 39.00 39.00 0.0 39.00 39.00 0.0 15.00 15.00 0.0
p03.pddl 38.00 38.00 0.0 38.00 38.00 0.0 11.00 11.00 0.0
p04.pddl 58.00 58.00 0.0 58.00 58.00 0.0 20.00 20.00 0.0
p05.pddl 46.00 46.00 0.0 46.00 46.00 0.0 17.00 17.00 0.0
p06.pddl 48.00 48.00 0.0 48.00 48.00 0.0 20.00 20.00 0.0
p07.pddl 36.00 36.00 0.0 36.00 36.00 0.0 13.00 13.00 0.0
p08.pddl 71.00 71.00 0.0 71.00 71.00 0.0 31.00 31.00 0.0
p09.pddl 70.00 70.00 0.0 70.00 70.00 0.0 33.00 33.00 0.0
p10.pddl 80.00 80.00 0.0 80.00 80.00 0.0 34.00 34.00 0.0
p11.pddl 82.00 82.00 0.0 82.00 82.00 0.0 33.00 33.00 0.0
p12.pddl 122.00 122.00 0.0 122.00 122.00 0.0 114.00 114.00 0.0
p13.pddl 103.00 103.00 0.0 103.00 103.00 0.0 46.00 46.00 0.0
p14.pddl 154.00 154.00 0.0 154.00 154.00 0.0 150.00 150.00 0.0
p15.pddl 134.00 134.00 0.0 134.00 134.00 0.0 78.00 83.00 5.0
p16.pddl 177.00 177.00 0.0 177.00 177.00 0.0 173.00 173.00 0.0
p17.pddl 169.00 169.00 0.0 169.00 169.00 0.0 117.00 118.00 1.0
p18.pddl 212.00 212.00 0.0 212.00 212.00 0.0 208.00 208.00 0.0
p19.pddl 206.00 206.00 0.0 206.00 206.00 0.0 202.00 202.00 0.0
p20.pddl 243.00 243.00 0.0 243.00 243.00 0.0 239.00 239.00 0.0
Sum 0.00 0.00 6.00
Average 0.00 0.00 0.30

openstacks-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl 24.00 24.00 0.0 25.00 25.00 0.0 23.00 23.00 0.0
p02.pddl 24.00 24.00 0.0 25.00 25.00 0.0 23.00 23.00 0.0
p03.pddl 24.00 24.00 0.0 25.00 25.00 0.0 23.00 23.00 0.0
p04.pddl 24.00 24.00 0.0 25.00 25.00 0.0 23.00 23.00 0.0
p05.pddl 25.00 25.00 0.0 25.00 25.00 0.0 23.00 23.00 0.0
p06.pddl 49.00 49.00 0.0 49.00 49.00 0.0 45.00 45.00 0.0
p07.pddl 49.00 49.00 0.0 50.00 50.00 0.0 46.00 46.00 0.0
p08.pddl 95.00 95.00 0.0 95.00 95.00 0.0 91.00 94.00 3.0
p09.pddl 95.00 95.00 0.0 95.00 95.00 0.0 95.00 95.00 0.0
p10.pddl 99.00 99.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p11.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p12.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p13.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p14.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p15.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p16.pddl 99.00 99.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p17.pddl 120.00 120.00 0.0 120.00 120.00 0.0 120.00 120.00 0.0
p18.pddl 193.00 193.00 0.0 193.00 193.00 0.0 193.00 193.00 0.0
p19.pddl 125.00 125.00 0.0 125.00 125.00 0.0 125.00 125.00 0.0
p20.pddl 150.00 150.00 0.0 150.00 150.00 0.0 150.00 150.00 0.0
p21.pddl 150.00 150.00 0.0 150.00 150.00 0.0 150.00 150.00 0.0
p22.pddl 150.00 150.00 0.0 150.00 150.00 0.0 150.00 150.00 0.0
p23.pddl 150.00 150.00 0.0 150.00 150.00 0.0 150.00 150.00 0.0
p24.pddl 250.00 250.00 0.0 250.00 250.00 0.0 250.00 250.00 0.0
p25.pddl 250.00 250.00 0.0 250.00 250.00 0.0 250.00 250.00 0.0
p26.pddl 249.00 249.00 0.0 249.00 249.00 0.0 249.00 249.00 0.0
p27.pddl 375.00 375.00 0.0 375.00 375.00 0.0 375.00 375.00 0.0
p28.pddl 500.00 500.00 0.0 500.00 500.00 0.0 500.00 500.00 0.0
p29.pddl 500.00 500.00 0.0 500.00 500.00 0.0 500.00 500.00 0.0
p30.pddl 500.00 500.00 0.0 500.00 500.00 0.0 500.00 500.00 0.0
Sum 0.00 0.00 3.00
Average 0.00 0.00 0.10

optical-telegraphs

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01-opt2.pddl None None - 28.00 28.00 0.0 28.00 28.00 0.0
p02-opt3.pddl None None - 42.00 42.00 0.0 42.00 42.00 0.0
p03-opt4.pddl None None - 56.00 56.00 0.0 56.00 56.00 0.0
p04-opt5.pddl None None - 70.00 70.00 0.0 70.00 70.00 0.0
p05-opt6.pddl None None - None None - None None -
p06-opt7.pddl None None - None None - None None -
p07-opt8.pddl None None - None None - None None -
p08-opt9.pddl None None - None None - None None -
p09-opt10.pddl None None - None None - None None -
p10-opt11.pddl None None - None None - None None -
p11-opt12.pddl None None - None None - None None -
p12-opt13.pddl None None - None None - None None -
p13-opt14.pddl None None - None None - None None -
p14-opt15.pddl None None - None None - None None -
p15-opt16.pddl None None - None None - None None -
p16-opt17.pddl None None - None None - None None -
p17-opt18.pddl None None - None None - None None -
p18-opt19.pddl None None - None None - None None -
p19-opt20.pddl None None - None None - None None -
p20-opt21.pddl None None - None None - None None -
p21-opt22.pddl None None - None None - None None -
p22-opt23.pddl None None - None None - None None -
p23-opt24.pddl None None - None None - None None -
p24-opt25.pddl None None - None None - None None -
p25-opt26.pddl None None - None None - None None -
p26-opt27.pddl None None - None None - None None -
p27-opt28.pddl None None - None None - None None -
p28-opt29.pddl None None - None None - None None -
p29-opt30.pddl None None - None None - None None -
p30-opt31.pddl None None - None None - None None -
p31-opt32.pddl None None - None None - None None -
p32-opt33.pddl None None - None None - None None -
p33-opt34.pddl None None - None None - None None -
p34-opt35.pddl None None - None None - None None -
p35-opt36.pddl None None - None None - None None -
p36-opt37.pddl None None - None None - None None -
p37-opt38.pddl None None - None None - None None -
p38-opt39.pddl None None - None None - None None -
p39-opt40.pddl None None - None None - None None -
p40-opt41.pddl None None - None None - None None -
p41-opt42.pddl None None - None None - None None -
p42-opt43.pddl None None - None None - None None -
p43-opt44.pddl None None - None None - None None -
p44-opt45.pddl None None - None None - None None -
p45-opt46.pddl None None - None None - None None -
p46-opt47.pddl None None - None None - None None -
p47-opt48.pddl None None - None None - None None -
p48-opt49.pddl None None - None None - None None -
Sum 0 0.00 0.00
Average None 0.00 0.00

parcprinter-08-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl 269038.00 269038.00 0.0 269038.00 269038.00 0.0 169009.00 169009.00 0.0
p02.pddl 538076.00 538076.00 0.0 538076.00 538076.00 0.0 438047.00 438047.00 0.0
p03.pddl None None - 807114.00 807114.00 0.0 807114.00 807114.00 0.0
p04.pddl 1076152.00 1076152.00 0.0 1076152.00 1076152.00 0.0 876094.00 876094.00 0.0
p05.pddl 1345190.00 1345190.00 0.0 1345190.00 1345190.00 0.0 1145132.00 1145132.00 0.0
p06.pddl 1614228.00 1614228.00 0.0 1614228.00 1614228.00 0.0 1514199.00 1514199.00 0.0
p07.pddl 1883266.00 1883266.00 0.0 1883266.00 1883266.00 0.0 1883266.00 1883266.00 0.0
p08.pddl 2152304.00 2152304.00 0.0 2152304.00 2152304.00 0.0 2152304.00 2152304.00 0.0
p09.pddl 2421342.00 2421342.00 0.0 2421342.00 2421342.00 0.0 2421342.00 2421342.00 0.0
p10.pddl 2690380.00 2690380.00 0.0 2690380.00 2690380.00 0.0 2690380.00 2690380.00 0.0
p11.pddl 182808.00 182808.00 0.0 183207.00 183207.00 0.0 182808.00 182808.00 0.0
p12.pddl None None - 520923.00 520923.00 0.0 510256.00 510256.00 0.0
p13.pddl None None - 704130.00 704130.00 0.0 693064.00 693064.00 0.0
p14.pddl None None - 1031977.00 1031977.00 0.0 1020512.00 1020512.00 0.0
p15.pddl None None - 1736917.00 1736917.00 0.0 1697502.00 1697502.00 0.0
p16.pddl None None - 1717278.00 1717278.00 0.0 1717278.00 1717278.00 0.0
p17.pddl None None - 1736107.00 1736107.00 0.0 1736107.00 1736107.00 0.0
p18.pddl None None - 2382841.00 2382841.00 0.0 2382841.00 2382841.00 0.0
p19.pddl None None - None None - None None -
p20.pddl None None - 2807461.00 2807461.00 0.0 2807461.00 2807461.00 0.0
p21.pddl 143411.00 143411.00 0.0 232509.00 232509.00 0.0 143411.00 143411.00 0.0
p22.pddl None None - 465018.00 465018.00 0.0 375821.00 375821.00 0.0
p23.pddl None None - 697527.00 697527.00 0.0 519232.00 519232.00 0.0
p24.pddl None None - 930036.00 930036.00 0.0 751642.00 751642.00 0.0
p25.pddl None None - 1404332.00 1404332.00 0.0 1225839.00 1215839.00 -10000.0
p26.pddl None None - 1395054.00 1395054.00 0.0 1216462.00 1216462.00 0.0
p27.pddl None None - 1627563.00 1627563.00 0.0 1270874.00 1270874.00 0.0
p28.pddl None None - 1860072.00 1860072.00 0.0 1681282.00 1681480.00 198.0
p29.pddl None None - 2576155.00 2576155.00 0.0 2397960.00 2397861.00 -99.0
p30.pddl None None - 2566877.00 2566877.00 0.0 2021893.00 2022091.00 198.0
Sum 0.00 0.00 -9703.00
Average 0.00 0.00 -334.59

parcprinter-sat11-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl 1883266.00 1883266.00 0.0 1883266.00 1883266.00 0.0 1883266.00 1883266.00 0.0
p02.pddl 2152304.00 2152304.00 0.0 2152304.00 2152304.00 0.0 2152304.00 2152304.00 0.0
p03.pddl 2690380.00 2690380.00 0.0 2690380.00 2690380.00 0.0 2690380.00 2690380.00 0.0
p04.pddl None None - 2807461.00 2807461.00 0.0 2807461.00 2807461.00 0.0
p05.pddl None None - 1395054.00 1395054.00 0.0 1216462.00 1216462.00 0.0
p06.pddl None None - 1627563.00 1627563.00 0.0 1270874.00 1270874.00 0.0
p07.pddl 2421342.00 2421342.00 0.0 2421342.00 2421342.00 0.0 2421342.00 2421342.00 0.0
p08.pddl None None - 1860072.00 1860072.00 0.0 1681282.00 1681480.00 198.0
p09.pddl None None - 2576155.00 2576155.00 0.0 2397960.00 2397861.00 -99.0
p10.pddl None None - 2566877.00 2566877.00 0.0 2021893.00 2022091.00 198.0
p11.pddl None None - 2191290.00 2191290.00 0.0 2191290.00 2191290.00 0.0
p12.pddl 3228456.00 3228456.00 0.0 3228456.00 3228456.00 0.0 3228456.00 3228456.00 0.0
p13.pddl 4035570.00 4035570.00 0.0 4035570.00 4035570.00 0.0 4035570.00 4035570.00 0.0
p14.pddl None None - 3173875.00 3173875.00 0.0 3173875.00 3173875.00 0.0
p15.pddl None None - None None - None None -
p16.pddl None None - 3767901.00 3767901.00 0.0 3767901.00 3767901.00 0.0
p17.pddl None None - 2111137.00 2111137.00 0.0 1556448.00 1556448.00 0.0
p18.pddl None None - 2585433.00 2585433.00 0.0 2407237.00 2407237.00 0.0
p19.pddl None None - 3301516.00 3301516.00 0.0 3123420.00 3123519.00 99.0
p20.pddl None None - 3031895.00 3031895.00 0.0 2319705.00 2318913.00 -792.0
Sum 0.00 0.00 -396.00
Average 0.00 0.00 -20.84

parking-sat11-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
pfile08-031.pddl None None - 69.00 69.00 0.0 38.00 37.00 -1.0
pfile08-032.pddl None None - 46.00 46.00 0.0 46.00 41.00 -5.0
pfile09-033.pddl None None - 78.00 78.00 0.0 71.00 68.00 -3.0
pfile09-034.pddl None None - 73.00 73.00 0.0 73.00 73.00 0.0
pfile09-035.pddl None None - 64.00 64.00 0.0 42.00 62.00 20.0
pfile09-036.pddl None None - 59.00 59.00 0.0 59.00 59.00 0.0
pfile10-037.pddl None None - 78.00 78.00 0.0 43.00 42.00 -1.0
pfile10-038.pddl None None - 70.00 70.00 0.0 47.00 44.00 -3.0
pfile10-039.pddl None None - 81.00 81.00 0.0 46.00 58.00 12.0
pfile10-040.pddl None None - 90.00 90.00 0.0 48.00 68.00 20.0
pfile11-041.pddl None None - 84.00 84.00 0.0 47.00 48.00 1.0
pfile11-042.pddl None None - 68.00 68.00 0.0 68.00 68.00 0.0
pfile11-043.pddl None None - 77.00 77.00 0.0 66.00 69.00 3.0
pfile11-044.pddl None None - 78.00 78.00 0.0 45.00 48.00 3.0
pfile12-045.pddl None None - 80.00 80.00 0.0 80.00 74.00 -6.0
pfile12-046.pddl None None - 87.00 87.00 0.0 50.00 87.00 37.0
pfile12-047.pddl None None - 100.00 100.00 0.0 95.00 53.00 -42.0
pfile12-048.pddl None None - 90.00 90.00 0.0 90.00 51.00 -39.0
pfile13-049.pddl None None - 92.00 92.00 0.0 50.00 82.00 32.0
pfile13-050.pddl None None - 96.00 96.00 0.0 95.00 60.00 -35.0
Sum 0 0.00 -7.00
Average None 0.00 -0.35

pathways-noneg

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
p02.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
p03.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p04.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
p05.pddl 31.00 31.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
p06.pddl 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0
p07.pddl None None - 64.00 64.00 0.0 64.00 63.00 -1.0
p08.pddl None None - 98.00 98.00 0.0 98.00 96.00 -2.0
p09.pddl 72.00 72.00 0.0 70.00 70.00 0.0 70.00 70.00 0.0
p10.pddl None None - None None - None None -
p11.pddl None None - 87.00 87.00 0.0 85.00 82.00 -3.0
p12.pddl None None - 113.00 113.00 0.0 113.00 112.00 -1.0
p13.pddl None None - 102.00 102.00 0.0 101.00 100.00 -1.0
p14.pddl None None - 112.00 112.00 0.0 112.00 112.00 0.0
p15.pddl None None - 108.00 108.00 0.0 108.00 108.00 0.0
p16.pddl None None - None None - None None -
p17.pddl None None - 154.00 154.00 0.0 154.00 149.00 -5.0
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
p21.pddl None None - None None - None None -
p22.pddl None None - None None - None None -
p23.pddl None None - 184.00 184.00 0.0 183.00 182.00 -1.0
p24.pddl None None - 226.00 226.00 0.0 226.00 226.00 0.0
p25.pddl None None - 211.00 211.00 0.0 207.00 205.00 -2.0
p26.pddl None None - 240.00 240.00 0.0 240.00 229.00 -11.0
p27.pddl None None - 251.00 251.00 0.0 251.00 249.00 -2.0
p28.pddl None None - 211.00 211.00 0.0 211.00 211.00 0.0
p29.pddl None None - 261.00 261.00 0.0 261.00 261.00 0.0
p30.pddl None None - 292.00 292.00 0.0 292.00 289.00 -3.0
Sum 0.00 0.00 -32.00
Average 0.00 0.00 -1.39

pegsol-08-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl None None - 4.00 4.00 0.0 2.00 2.00 0.0
p02.pddl None None - 5.00 5.00 0.0 5.00 5.00 0.0
p03.pddl None None - 5.00 5.00 0.0 4.00 4.00 0.0
p04.pddl None None - 7.00 7.00 0.0 4.00 4.00 0.0
p05.pddl None None - 6.00 6.00 0.0 4.00 4.00 0.0
p06.pddl None None - 8.00 8.00 0.0 4.00 4.00 0.0
p07.pddl None None - 9.00 9.00 0.0 3.00 3.00 0.0
p08.pddl None None - 11.00 11.00 0.0 6.00 6.00 0.0
p09.pddl None None - 10.00 10.00 0.0 5.00 5.00 0.0
p10.pddl None None - 10.00 10.00 0.0 6.00 6.00 0.0
p11.pddl None None - 10.00 10.00 0.0 7.00 7.00 0.0
p12.pddl None None - 13.00 13.00 0.0 8.00 8.00 0.0
p13.pddl None None - 12.00 12.00 0.0 9.00 9.00 0.0
p14.pddl None None - 10.00 10.00 0.0 7.00 7.00 0.0
p15.pddl None None - 12.00 12.00 0.0 8.00 8.00 0.0
p16.pddl None None - 14.00 14.00 0.0 8.00 8.00 0.0
p17.pddl None None - 15.00 15.00 0.0 10.00 10.00 0.0
p18.pddl None None - 15.00 15.00 0.0 7.00 7.00 0.0
p19.pddl None None - 12.00 12.00 0.0 8.00 8.00 0.0
p20.pddl None None - 16.00 16.00 0.0 7.00 7.00 0.0
p21.pddl None None - 14.00 14.00 0.0 8.00 8.00 0.0
p22.pddl None None - 14.00 14.00 0.0 6.00 6.00 0.0
p23.pddl None None - 16.00 16.00 0.0 8.00 8.00 0.0
p24.pddl None None - 15.00 15.00 0.0 8.00 8.00 0.0
p25.pddl None None - 15.00 15.00 0.0 8.00 8.00 0.0
p26.pddl None None - 18.00 18.00 0.0 9.00 9.00 0.0
p27.pddl None None - 20.00 20.00 0.0 7.00 7.00 0.0
p28.pddl None None - 22.00 22.00 0.0 22.00 22.00 0.0
p29.pddl None None - 26.00 26.00 0.0 11.00 20.00 9.0
p30.pddl None None - 30.00 30.00 0.0 21.00 20.00 -1.0
Sum 0 0.00 8.00
Average None 0.00 0.27

pegsol-sat11-strips

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01.pddl None None - 15.00 15.00 0.0 10.00 10.00 0.0
p02.pddl None None - 15.00 15.00 0.0 7.00 7.00 0.0
p03.pddl None None - 12.00 12.00 0.0 8.00 8.00 0.0
p04.pddl None None - 14.00 14.00 0.0 12.00 12.00 0.0
p05.pddl None None - 14.00 14.00 0.0 9.00 9.00 0.0
p06.pddl None None - 12.00 12.00 0.0 7.00 7.00 0.0
p07.pddl None None - 16.00 16.00 0.0 8.00 8.00 0.0
p08.pddl None None - 15.00 15.00 0.0 11.00 11.00 0.0
p09.pddl None None - 15.00 15.00 0.0 8.00 8.00 0.0
p10.pddl None None - 16.00 16.00 0.0 7.00 7.00 0.0
p11.pddl None None - 14.00 14.00 0.0 8.00 8.00 0.0
p12.pddl None None - 16.00 16.00 0.0 8.00 8.00 0.0
p13.pddl None None - 12.00 12.00 0.0 9.00 9.00 0.0
p14.pddl None None - 15.00 15.00 0.0 8.00 8.00 0.0
p15.pddl None None - 10.00 10.00 0.0 7.00 7.00 0.0
p16.pddl None None - 18.00 18.00 0.0 9.00 9.00 0.0
p17.pddl None None - 20.00 20.00 0.0 7.00 7.00 0.0
p18.pddl None None - 22.00 22.00 0.0 22.00 22.00 0.0
p19.pddl None None - 26.00 26.00 0.0 11.00 20.00 9.0
p20.pddl None None - 30.00 30.00 0.0 21.00 20.00 -1.0
Sum 0 0.00 8.00
Average None 0.00 0.40

philosophers

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01-phil2.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p02-phil3.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
p03-phil4.pddl 36.00 36.00 0.0 36.00 36.00 0.0 36.00 36.00 0.0
p04-phil5.pddl 45.00 45.00 0.0 93.00 93.00 0.0 45.00 45.00 0.0
p05-phil6.pddl 54.00 54.00 0.0 102.00 102.00 0.0 54.00 54.00 0.0
p06-phil7.pddl 63.00 63.00 0.0 143.00 143.00 0.0 63.00 63.00 0.0
p07-phil8.pddl 72.00 72.00 0.0 152.00 152.00 0.0 72.00 72.00 0.0
p08-phil9.pddl 81.00 81.00 0.0 193.00 193.00 0.0 81.00 81.00 0.0
p09-phil10.pddl 90.00 90.00 0.0 202.00 202.00 0.0 90.00 90.00 0.0
p10-phil11.pddl 99.00 99.00 0.0 211.00 211.00 0.0 99.00 99.00 0.0
p11-phil12.pddl 108.00 108.00 0.0 220.00 220.00 0.0 108.00 108.00 0.0
p12-phil13.pddl 117.00 117.00 0.0 149.00 149.00 0.0 117.00 117.00 0.0
p13-phil14.pddl 126.00 126.00 0.0 158.00 158.00 0.0 126.00 126.00 0.0
p14-phil15.pddl 135.00 135.00 0.0 183.00 183.00 0.0 135.00 135.00 0.0
p15-phil16.pddl 144.00 144.00 0.0 192.00 192.00 0.0 144.00 144.00 0.0
p16-phil17.pddl 153.00 153.00 0.0 233.00 233.00 0.0 153.00 153.00 0.0
p17-phil18.pddl 162.00 162.00 0.0 242.00 242.00 0.0 162.00 162.00 0.0
p18-phil19.pddl 171.00 171.00 0.0 283.00 283.00 0.0 171.00 171.00 0.0
p19-phil20.pddl None None - 292.00 292.00 0.0 180.00 180.00 0.0
p20-phil21.pddl None None - 333.00 333.00 0.0 189.00 189.00 0.0
p21-phil22.pddl None None - 342.00 342.00 0.0 198.00 198.00 0.0
p22-phil23.pddl None None - 383.00 383.00 0.0 207.00 207.00 0.0
p23-phil24.pddl None None - 392.00 392.00 0.0 216.00 216.00 0.0
p24-phil25.pddl None None - 433.00 433.00 0.0 225.00 225.00 0.0
p25-phil26.pddl None None - 442.00 442.00 0.0 234.00 234.00 0.0
p26-phil27.pddl None None - 259.00 259.00 0.0 243.00 243.00 0.0
p27-phil28.pddl None None - 268.00 268.00 0.0 252.00 252.00 0.0
p28-phil29.pddl None None - 277.00 277.00 0.0 261.00 261.00 0.0
p29-phil30.pddl None None - 286.00 286.00 0.0 270.00 270.00 0.0
p30-phil31.pddl None None - 295.00 295.00 0.0 279.00 279.00 0.0
p31-phil32.pddl None None - 304.00 304.00 0.0 288.00 288.00 0.0
p32-phil33.pddl None None - 313.00 313.00 0.0 297.00 297.00 0.0
p33-phil34.pddl None None - 322.00 322.00 0.0 306.00 306.00 0.0
p34-phil35.pddl None None - 331.00 331.00 0.0 315.00 315.00 0.0
p35-phil36.pddl None None - 340.00 340.00 0.0 340.00 340.00 0.0
p36-phil37.pddl None None - 349.00 349.00 0.0 349.00 349.00 0.0
p37-phil38.pddl None None - 358.00 358.00 0.0 358.00 358.00 0.0
p38-phil39.pddl None None - 367.00 367.00 0.0 367.00 367.00 0.0
p39-phil40.pddl None None - 376.00 376.00 0.0 376.00 376.00 0.0
p40-phil41.pddl None None - 385.00 385.00 0.0 385.00 385.00 0.0
p41-phil42.pddl None None - None None - None None -
p42-phil43.pddl None None - None None - None None -
p43-phil44.pddl None None - None None - None None -
p44-phil45.pddl None None - None None - None None -
p45-phil46.pddl None None - None None - None None -
p46-phil47.pddl None None - None None - None None -
p47-phil48.pddl None None - None None - None None -
p48-phil49.pddl None None - None None - None None -
Sum 0.00 0.00 0.00
Average 0.00 0.00 0.00

pipesworld-notankage

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01-net1-b6-g2.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
p02-net1-b6-g4.pddl 12.00 12.00 0.0 14.00 14.00 0.0 12.00 12.00 0.0
p03-net1-b8-g3.pddl 9.00 9.00 0.0 9.00 9.00 0.0 8.00 8.00 0.0
p04-net1-b8-g5.pddl 13.00 13.00 0.0 13.00 13.00 0.0 11.00 11.00 0.0
p05-net1-b10-g4.pddl 10.00 10.00 0.0 10.00 10.00 0.0 8.00 8.00 0.0
p06-net1-b10-g6.pddl 14.00 14.00 0.0 12.00 12.00 0.0 10.00 10.00 0.0
p07-net1-b12-g5.pddl 10.00 10.00 0.0 10.00 10.00 0.0 8.00 8.00 0.0
p08-net1-b12-g7.pddl 13.00 13.00 0.0 13.00 13.00 0.0 10.00 10.00 0.0
p09-net1-b14-g6.pddl 16.00 16.00 0.0 19.00 19.00 0.0 13.00 13.00 0.0
p10-net1-b14-g8.pddl 26.00 26.00 0.0 26.00 26.00 0.0 18.00 18.00 0.0
p11-net2-b10-g2.pddl 24.00 24.00 0.0 120.00 120.00 0.0 20.00 20.00 0.0
p12-net2-b10-g4.pddl 48.00 48.00 0.0 148.00 148.00 0.0 24.00 24.00 0.0
p13-net2-b12-g3.pddl 30.00 30.00 0.0 24.00 24.00 0.0 16.00 16.00 0.0
p14-net2-b12-g5.pddl 48.00 48.00 0.0 100.00 100.00 0.0 30.00 30.00 0.0
p15-net2-b14-g4.pddl 42.00 42.00 0.0 72.00 72.00 0.0 26.00 26.00 0.0
p16-net2-b14-g6.pddl 82.00 82.00 0.0 98.00 98.00 0.0 42.00 42.00 0.0
p17-net2-b16-g5.pddl 30.00 30.00 0.0 78.00 78.00 0.0 22.00 22.00 0.0
p18-net2-b16-g7.pddl 56.00 56.00 0.0 98.00 98.00 0.0 30.00 30.00 0.0
p19-net2-b18-g6.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 26.00 -4.0
p20-net2-b18-g8.pddl 48.00 48.00 0.0 81.00 81.00 0.0 28.00 28.00 0.0
p21-net3-b12-g2.pddl 20.00 20.00 0.0 18.00 18.00 0.0 14.00 14.00 0.0
p22-net3-b12-g4.pddl 39.00 39.00 0.0 58.00 58.00 0.0 30.00 30.00 0.0
p23-net3-b14-g3.pddl 24.00 24.00 0.0 21.00 21.00 0.0 18.00 18.00 0.0
p24-net3-b14-g5.pddl 48.00 48.00 0.0 79.00 79.00 0.0 24.00 24.00 0.0
p25-net3-b16-g5.pddl 50.00 50.00 0.0 48.00 48.00 0.0 32.00 32.00 0.0
p26-net3-b16-g7.pddl 57.00 57.00 0.0 150.00 150.00 0.0 36.00 36.00 0.0
p27-net3-b18-g6.pddl 49.00 49.00 0.0 100.00 100.00 0.0 26.00 26.00 0.0
p28-net3-b18-g7.pddl None None - 67.00 67.00 0.0 34.00 34.00 0.0
p29-net3-b20-g6.pddl 52.00 52.00 0.0 57.00 57.00 0.0 33.00 31.00 -2.0
p30-net3-b20-g8.pddl 71.00 71.00 0.0 158.00 158.00 0.0 40.00 40.00 0.0
p31-net4-b14-g3.pddl 27.00 27.00 0.0 29.00 29.00 0.0 24.00 24.00 0.0
p32-net4-b14-g5.pddl 46.00 46.00 0.0 70.00 70.00 0.0 30.00 30.00 0.0
p33-net4-b16-g5.pddl 40.00 40.00 0.0 130.00 130.00 0.0 32.00 32.00 0.0
p34-net4-b16-g6.pddl 47.00 47.00 0.0 78.00 78.00 0.0 31.00 33.00 2.0
p35-net4-b18-g4.pddl None None - 64.00 64.00 0.0 22.00 22.00 0.0
p36-net4-b18-g6.pddl None None - 112.00 112.00 0.0 27.00 27.00 0.0
p37-net4-b20-g5.pddl None None - 80.00 80.00 0.0 29.00 29.00 0.0
p38-net4-b20-g7.pddl None None - 123.00 123.00 0.0 34.00 32.00 -2.0
p39-net4-b22-g7.pddl None None - 36.00 36.00 0.0 32.00 32.00 0.0
p40-net4-b22-g8.pddl None None - 98.00 98.00 0.0 39.00 34.00 -5.0
p41-net5-b22-g2.pddl 12.00 12.00 0.0 28.00 28.00 0.0 12.00 12.00 0.0
p42-net5-b22-g4.pddl None None - None None - None None -
p43-net5-b24-g3.pddl None None - None None - None None -
p44-net5-b24-g5.pddl None None - None None - None None -
p45-net5-b26-g4.pddl None None - None None - None None -
p46-net5-b26-g6.pddl None None - None None - None None -
p47-net5-b28-g5.pddl None None - None None - None None -
p48-net5-b28-g7.pddl None None - None None - None None -
p49-net5-b30-g6.pddl None None - 38.00 38.00 0.0 38.00 38.00 0.0
p50-net5-b30-g8.pddl None None - 64.00 64.00 0.0 60.00 57.00 -3.0
Sum 0.00 0.00 -14.00
Average 0.00 0.00 -0.33

pipesworld-tankage

cost issue416-base-ehc_lm_zhu issue416-v1-ehc_lm_zhu Diff (ehc_lm_zhu) issue416-base-lama_first issue416-v1-lama_first Diff (lama_first) issue416-base-seq_sat_lama_2011 issue416-v1-seq_sat_lama_2011 Diff (seq_sat_lama_2011)
p01-net1-b6-g2-t50.pddl 8.00 8.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
p02-net1-b6-g4-t50.pddl 18.00 18.00 0.0 32.00 32.00 0.0 12.00 12.00 0.0
p03-net1-b8-g3-t80.pddl 9.00 9.00 0.0 10.00 10.00 0.0 8.00 8.00 0.0
p04-net1-b8-g5-t80.pddl 13.00 13.00 0.0 21.00 21.00 0.0 11.00 11.00 0.0
p05-net1-b10-g4-t50.pddl 9.00 9.00 0.0 9.00 9.00 0.0 8.00 8.00 0.0
p06-net1-b10-g6-t50.pddl 14.00 14.00 0.0 11.00 11.00 0.0 10.00 10.00 0.0
p07-net1-b12-g5-t80.pddl 11.00 11.00 0.0 12.00 12.00 0.0 8.00 8.00 0.0
p08-net1-b12-g7-t80.pddl 14.00 14.00 0.0 14.00 14.00 0.0 11.00 13.00 2.0
p09-net1-b14-g6-t50.pddl 26.00 26.00 0.0 33.00 33.00 0.0 25.00 20.00 -5.0
p10-net1-b14-g8-t50.pddl 31.00 31.00 0.0 33.00 33.00 0.0 22.00 22.00 0.0
p11-net2-b10-g2-t30.pddl 42.00 42.00 0.0 42.00 42.00 0.0 22.00 22.00 0.0
p12-net2-b10-g4-t60.pddl 50.00 50.00 0.0 32.00 32.00 0.0 32.00 30.00 -2.0
p13-net2-b12-g3-t70.pddl 24.00 24.00 0.0 26.00 26.00 0.0 16.00 16.00 0.0
p14-net2-b12-g5-t30.pddl 70.00 70.00 0.0 62.00 62.00 0.0 38.00 38.00 0.0
p15-net2-b14-g4-t30.pddl 58.00 58.00 0.0 50.00 50.00 0.0 30.00 30.00 0.0
p16-net2-b14-g6-t80.pddl None None - 66.00 66.00 0.0 48.00 46.00 -2.0
p17-net2-b16-g5-t20.pddl 104.00 104.00 0.0 122.00 122.00 0.0 44.00 44.00 0.0
p18-net2-b16-g7-t60.pddl 60.00 60.00 0.0 70.00 70.00 0.0 36.00 34.00 -2.0
p19-net2-b18-g6-t60.pddl None None - 34.00 34.00 0.0 24.00 24.00 0.0
p20-net2-b18-g8-t90.pddl None None - 68.00 68.00 0.0 32.00 30.00 -2.0
p21-net3-b12-g2-t60.pddl 17.00 17.00