info

algorithm translate_summary preprocess_summary search_summary config_nick commandline_config
issue348-base-astar_blind 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base astar_blind [--search, astar(blind)]
issue348-base-astar_h2 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base astar_h2 [--search, astar(hm(2))]
issue348-base-astar_ipdb 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base astar_ipdb [--search, astar(ipdb)]
issue348-base-astar_lmcount_lm_merged_rhw_hm 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base astar_lmcount_lm_merged_rhw_hm [--search, astar(lmcount(lm_merged([lm_rhw(),lm_hm(m=1)]),admissible=true),mpd=true)]
issue348-base-astar_lmcut 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base astar_lmcut [--search, astar(lmcut)]
issue348-v1-astar_blind 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base 0c9d7156dde6 (issue348) issue348-v1 astar_blind [--search, astar(blind)]
issue348-v1-astar_h2 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base 0c9d7156dde6 (issue348) issue348-v1 astar_h2 [--search, astar(hm(2))]
issue348-v1-astar_ipdb 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base 0c9d7156dde6 (issue348) issue348-v1 astar_ipdb [--search, astar(ipdb)]
issue348-v1-astar_lmcount_lm_merged_rhw_hm 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base 0c9d7156dde6 (issue348) issue348-v1 astar_lmcount_lm_merged_rhw_hm [--search, astar(lmcount(lm_merged([lm_rhw(),lm_hm(m=1)]),admissible=true),mpd=true)]
issue348-v1-astar_lmcut 5d1d7cfa75a2 (issue348) issue348-base 5d1d7cfa75a2 (issue348) issue348-base 0c9d7156dde6 (issue348) issue348-v1 astar_lmcut [--search, astar(lmcut)]

summary

summary issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
cost - Sum 7 7 0.0 7 7 0.0 7 7 0.0 7 7 0.0 7 7 0.0
coverage - Sum 28 29 1.0 2 2 0.0 34 34 0.0 31 31 0.0 32 32 0.0
evaluations - Geometric mean 186.67 186.67 0.0 50.83 50.83 0.0 27.13 27.13 0.0 82.51 82.51 0.0 55.93 55.93 0.0
expansions - Geometric mean 127.00 127.00 0.0 23.37 23.37 0.0 9.22 9.22 0.0 35.07 35.07 0.0 19.87 19.87 0.0
expansions_until_last_jump - Sum 238 238 0.0 13 13 0.0 0 0 0.0 207 207 0.0 50 50 0.0
generated - Geometric mean 361.80 361.80 0.0 75.34 75.34 0.0 26.94 26.94 0.0 95.67 95.67 0.0 64.48 64.48 0.0
memory - Sum 18964 18964 0.0 20944 20944 0.0 198576 198788 212.0 28936 28936 0.0 19352 19352 0.0
score_evaluations - Average 12.16 12.16 0.0 5.00 5.00 0.0 29.46 29.46 0.0 22.31 22.31 0.0 32.79 32.79 0.0
score_evaluations - Sum 24.32 24.32 0.0 10.00 10.00 0.0 58.91 58.91 0.0 44.62 44.62 0.0 65.59 65.59 0.0
score_expansions - Average 13.02 13.02 0.0 5.00 5.00 0.0 33.54 33.54 0.0 24.65 24.65 0.0 37.96 37.96 0.0
score_expansions - Sum 26.03 26.03 0.0 10.00 10.00 0.0 67.08 67.08 0.0 49.29 49.29 0.0 75.92 75.92 0.0
score_memory - Average 37.65 37.98 0.33 3.86 3.86 0.0 36.31 36.28 -0.03 41.96 41.93 -0.03 51.97 51.97 -0.0
score_memory - Sum 75.29 75.95 0.66 7.71 7.71 0.0 72.62 72.55 -0.06 83.91 83.86 -0.05 103.94 103.94 -0.01
score_search_time - Average 48.16 48.56 0.4 2.23 2.24 0.02 60.50 61.39 0.89 57.50 58.26 0.76 54.16 54.28 0.13
score_search_time - Sum 96.32 97.13 0.81 4.45 4.48 0.03 121.00 122.79 1.78 115.00 116.51 1.51 108.31 108.57 0.26
score_total_time - Average 47.90 48.29 0.4 2.22 2.24 0.02 20.17 22.23 2.06 56.53 57.20 0.67 53.69 53.81 0.12
score_total_time - Sum 95.79 96.58 0.79 4.45 4.48 0.03 40.34 44.47 4.13 113.07 114.40 1.33 107.39 107.63 0.24
search_time - Geometric mean 0.10 0.10 0.0 64.07 62.51 -1.57 0.10 0.10 0.0 0.10 0.10 0.0 0.10 0.10 0.0
total_time - Geometric mean 0.19 0.19 0.0 64.14 62.58 -1.56 28.42 25.61 -2.82 0.21 0.20 -0.01 0.19 0.18 -0.0

cost

cost issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (1) 3 3 0.0 3 3 0.0 3 3 0.0 3 3 0.0 3 3 0.0
tidybot-opt11-strips (1) 4 4 0.0 4 4 0.0 4 4 0.0 4 4 0.0 4 4 0.0
Sum (2) 7 7 7 7 7 7 7 7 7 7
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

Only instances where all configurations have a value for "cost" are considered. Each table entry gives the sum of "cost" for that domain. The last row reports the sum across all domains.

pegsol-opt11-strips

cost issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 3 3 0.0 3 3 0.0 3 3 0.0 3 3 0.0 3 3 0.0
p02.pddl 10 10 0.0 None None - 10 10 0.0 10 10 0.0 10 10 0.0
p03.pddl 7 7 0.0 None None - 7 7 0.0 7 7 0.0 7 7 0.0
p04.pddl 8 8 0.0 None None - 8 8 0.0 8 8 0.0 8 8 0.0
p05.pddl 12 12 0.0 None None - 12 12 0.0 12 12 0.0 12 12 0.0
p06.pddl 9 9 0.0 None None - 9 9 0.0 9 9 0.0 9 9 0.0
p07.pddl 7 7 0.0 None None - 7 7 0.0 7 7 0.0 7 7 0.0
p08.pddl 7 7 0.0 None None - 7 7 0.0 7 7 0.0 7 7 0.0
p09.pddl 8 8 0.0 None None - 8 8 0.0 8 8 0.0 8 8 0.0
p10.pddl 8 8 0.0 None None - 8 8 0.0 8 8 0.0 8 8 0.0
p11.pddl 6 6 0.0 None None - 6 6 0.0 6 6 0.0 6 6 0.0
p12.pddl 11 11 0.0 None None - 11 11 0.0 11 11 0.0 11 11 0.0
p13.pddl 8 8 0.0 None None - 8 8 0.0 8 8 0.0 8 8 0.0
p14.pddl 8 8 0.0 None None - 8 8 0.0 8 8 0.0 8 8 0.0
p15.pddl 8 8 0.0 None None - 8 8 0.0 8 8 0.0 8 8 0.0
p16.pddl 9 9 0.0 None None - 9 9 0.0 9 9 0.0 9 9 0.0
p17.pddl 7 7 0.0 None None - 7 7 0.0 7 7 0.0 7 7 0.0
p18.pddl None None - None None - 12 12 0.0 None None - 12 12 0.0
p19.pddl None None - None None - 11 11 0.0 None None - None None -
p20.pddl None None - None None - 18 18 0.0 None None - None None -
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

tidybot-opt11-strips

cost issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 4 4 0.0 4 4 0.0 4 4 0.0 4 4 0.0 4 4 0.0
p02.pddl 33 33 0.0 None None - 33 33 0.0 33 33 0.0 33 33 0.0
p03.pddl 16 16 0.0 None None - 16 16 0.0 16 16 0.0 16 16 0.0
p04.pddl 32 32 0.0 None None - 32 32 0.0 32 32 0.0 32 32 0.0
p05.pddl 38 38 0.0 None None - 38 38 0.0 38 38 0.0 38 38 0.0
p06.pddl 32 32 0.0 None None - 32 32 0.0 32 32 0.0 32 32 0.0
p07.pddl 17 17 0.0 None None - 17 17 0.0 17 17 0.0 17 17 0.0
p08.pddl 37 37 0.0 None None - 37 37 0.0 37 37 0.0 37 37 0.0
p09.pddl 27 27 0.0 None None - 27 27 0.0 27 27 0.0 27 27 0.0
p10.pddl 29 29 0.0 None None - 29 29 0.0 29 29 0.0 29 29 0.0
p11.pddl None 29 - None None - 29 29 0.0 29 29 0.0 29 29 0.0
p12.pddl None None - None None - 35 35 0.0 35 35 0.0 35 35 0.0
p13.pddl None None - None None - 30 30 0.0 30 30 0.0 30 30 0.0
p14.pddl 25 25 0.0 None None - 25 25 0.0 25 25 0.0 25 25 0.0
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

coverage

coverage issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (20) 17 17 0.0 1 1 0.0 20 20 0.0 17 17 0.0 18 18 0.0
tidybot-opt11-strips (20) 11 12 1.0 1 1 0.0 14 14 0.0 14 14 0.0 14 14 0.0
Sum (40) 28 29 2 2 34 34 31 31 32 32
Sum 1.00 0.00 0.00 0.00 0.00
Average 0.50 0.00 0.00 0.00 0.00

The last row reports the sum across all domains.

pegsol-opt11-strips

coverage issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 1 1 0.0 1 1 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p02.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p03.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p04.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p05.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p06.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p07.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p08.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p09.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p10.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p11.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p12.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p13.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p14.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p15.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p16.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p17.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p18.pddl 0 0 0.0 0 0 0.0 1 1 0.0 0 0 0.0 1 1 0.0
p19.pddl 0 0 0.0 0 0 0.0 1 1 0.0 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 1 1 0.0 0 0 0.0 0 0 0.0
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

tidybot-opt11-strips

coverage issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 1 1 0.0 1 1 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p02.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p03.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p04.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p05.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p06.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p07.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p08.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p09.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p10.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p11.pddl 0 1 1.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p12.pddl 0 0 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p13.pddl 0 0 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p14.pddl 1 1 0.0 0 0 0.0 1 1 0.0 1 1 0.0 1 1 0.0
p15.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p16.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p17.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p18.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p19.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
Sum 1.00 0.00 0.00 0.00 0.00
Average 0.05 0.00 0.00 0.00 0.00

evaluations

evaluations issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (1) 303.00 303.00 0.0 38.00 38.00 0.0 32.00 32.00 0.0 296.00 296.00 0.0 136.00 136.00 0.0
tidybot-opt11-strips (1) 115.00 115.00 0.0 68.00 68.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
Geometric mean (2) 186.67 186.67 50.83 50.83 27.13 27.13 82.51 82.51 55.93 55.93
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

Only instances where all configurations have a value for "evaluations" are considered. Each table entry gives the geometric mean of "evaluations" for that domain. The last row reports the geometric mean across all domains.

pegsol-opt11-strips

evaluations issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 303 303 0.0 38 38 0.0 32 32 0.0 296 296 0.0 136 136 0.0
p02.pddl 302149 302149 0.0 None None - 199217 199217 0.0 300041 300041 0.0 222075 222075 0.0
p03.pddl 66154 66154 0.0 None None - 1550 1550 0.0 36695 36695 0.0 6573 6573 0.0
p04.pddl 284247 284247 0.0 None None - 24540 24540 0.0 221216 221216 0.0 96003 96003 0.0
p05.pddl 90058 90058 0.0 None None - 69580 69580 0.0 89930 89930 0.0 29275 29275 0.0
p06.pddl 272444 272444 0.0 None None - 183423 183423 0.0 267518 267518 0.0 152189 152189 0.0
p07.pddl 268440 268440 0.0 None None - 7721 7721 0.0 177701 177701 0.0 48865 48865 0.0
p08.pddl 516337 516337 0.0 None None - 16162 16162 0.0 424143 424143 0.0 137774 137774 0.0
p09.pddl 464427 464427 0.0 None None - 27537 27537 0.0 378282 378282 0.0 128162 128162 0.0
p10.pddl 597643 597643 0.0 None None - 66671 66671 0.0 447771 447771 0.0 219170 219170 0.0
p11.pddl 75410 75410 0.0 None None - 5864 5864 0.0 53138 53138 0.0 26312 26312 0.0
p12.pddl 40041 40041 0.0 None None - 34589 34589 0.0 40007 40007 0.0 13414 13414 0.0
p13.pddl 1342908 1342908 0.0 None None - 76377 76377 0.0 1000693 1000693 0.0 362823 362823 0.0
p14.pddl 1819026 1819026 0.0 None None - 123701 123701 0.0 1138283 1138283 0.0 463172 463172 0.0
p15.pddl 1381622 1381622 0.0 None None - 120069 120069 0.0 1005156 1005156 0.0 308896 308896 0.0
p16.pddl 8260510 8260510 0.0 None None - 1459017 1459017 0.0 8114996 8114996 0.0 3723424 3723424 0.0
p17.pddl 7064301 7064301 0.0 None None - 1109 1109 0.0 1458990 1458990 0.0 358559 358559 0.0
p18.pddl None None - None None - 4949403 4949403 0.0 None None - 30462032 30462032 0.0
p19.pddl None None - None None - 364572 364572 0.0 None None - None None -
p20.pddl None None - None None - 11911524 11911524 0.0 None None - None None -
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

tidybot-opt11-strips

evaluations issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 115 115 0.0 68 68 0.0 23 23 0.0 23 23 0.0 23 23 0.0
p02.pddl 643011 643011 0.0 None None - 28039 28039 0.0 18999 18999 0.0 5769 5769 0.0
p03.pddl 12401 12401 0.0 None None - 1009 1009 0.0 722 722 0.0 317 317 0.0
p04.pddl 444329 444329 0.0 None None - 25494 25494 0.0 7247 7247 0.0 2999 2999 0.0
p05.pddl 10115518 10115518 0.0 None None - 472440 472440 0.0 323910 323910 0.0 34039 34039 0.0
p06.pddl 1143845 1143845 0.0 None None - 18792 18792 0.0 8023 8023 0.0 976 976 0.0
p07.pddl 17572 17572 0.0 None None - 1370 1370 0.0 838 838 0.0 297 297 0.0
p08.pddl 7000883 7000883 0.0 None None - 322311 322311 0.0 220133 220133 0.0 19588 19588 0.0
p09.pddl 1181908 1181908 0.0 None None - 49439 49439 0.0 48487 48487 0.0 11433 11433 0.0
p10.pddl 5794194 5794194 0.0 None None - 76999 76999 0.0 31579 31579 0.0 2570 2570 0.0
p11.pddl None 7695306 - None None - 246505 246505 0.0 101645 101645 0.0 10570 10570 0.0
p12.pddl None None - None None - 1186383 1186383 0.0 546668 546668 0.0 89748 89748 0.0
p13.pddl None None - None None - 589301 589301 0.0 252325 252325 0.0 30754 30754 0.0
p14.pddl 3267210 3267210 0.0 None None - 229182 229182 0.0 41866 41866 0.0 3548 3548 0.0
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

expansions

expansions issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (1) 252.00 252.00 0.0 21.00 21.00 0.0 17.00 17.00 0.0 246.00 246.00 0.0 79.00 79.00 0.0
tidybot-opt11-strips (1) 64.00 64.00 0.0 26.00 26.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
Geometric mean (2) 127.00 127.00 23.37 23.37 9.22 9.22 35.07 35.07 19.87 19.87
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

Only instances where all configurations have a value for "expansions" are considered. Each table entry gives the geometric mean of "expansions" for that domain. The last row reports the geometric mean across all domains.

pegsol-opt11-strips

expansions issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 252 252 0.0 21 21 0.0 17 17 0.0 246 246 0.0 79 79 0.0
p02.pddl 301845 301845 0.0 None None - 152995 152995 0.0 300073 300073 0.0 162986 162986 0.0
p03.pddl 60121 60121 0.0 None None - 928 928 0.0 25544 25544 0.0 2895 2895 0.0
p04.pddl 275396 275396 0.0 None None - 13071 13071 0.0 180569 180569 0.0 52407 52407 0.0
p05.pddl 90058 90058 0.0 None None - 59707 59707 0.0 89899 89899 0.0 17386 17386 0.0
p06.pddl 269554 269554 0.0 None None - 143595 143595 0.0 260108 260108 0.0 96748 96748 0.0
p07.pddl 248953 248953 0.0 None None - 3101 3101 0.0 129112 129112 0.0 21132 21132 0.0
p08.pddl 412016 412016 0.0 None None - 7418 7418 0.0 311347 311347 0.0 61635 61635 0.0
p09.pddl 429182 429182 0.0 None None - 13349 13349 0.0 312106 312106 0.0 64299 64299 0.0
p10.pddl 563522 563522 0.0 None None - 34116 34116 0.0 355890 355890 0.0 116788 116788 0.0
p11.pddl 64793 64793 0.0 None None - 3174 3174 0.0 39315 39315 0.0 12719 12719 0.0
p12.pddl 40041 40041 0.0 None None - 30785 30785 0.0 42077 42077 0.0 9273 9273 0.0
p13.pddl 1213266 1213266 0.0 None None - 36360 36360 0.0 773460 773460 0.0 194132 194132 0.0
p14.pddl 1648053 1648053 0.0 None None - 60023 60023 0.0 830139 830139 0.0 227050 227050 0.0
p15.pddl 1222408 1222408 0.0 None None - 61776 61776 0.0 779056 779056 0.0 152292 152292 0.0
p16.pddl 7949403 7949403 0.0 None None - 742052 742052 0.0 7704583 7704583 0.0 2057006 2057006 0.0
p17.pddl 5336798 5336798 0.0 None None - 458 458 0.0 641729 641729 0.0 133700 133700 0.0
p18.pddl None None - None None - 3229241 3229241 0.0 None None - 16708172 16708172 0.0
p19.pddl None None - None None - 130761 130761 0.0 None None - None None -
p20.pddl None None - None None - 4776017 4776017 0.0 None None - None None -
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

tidybot-opt11-strips

expansions issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 64 64 0.0 26 26 0.0 5 5 0.0 5 5 0.0 5 5 0.0
p02.pddl 444027 444027 0.0 None None - 19534 19534 0.0 13455 13455 0.0 3371 3371 0.0
p03.pddl 8485 8485 0.0 None None - 625 625 0.0 413 413 0.0 143 143 0.0
p04.pddl 302886 302886 0.0 None None - 17973 17973 0.0 4883 4883 0.0 1606 1606 0.0
p05.pddl 7018494 7018494 0.0 None None - 336858 336858 0.0 230687 230687 0.0 17830 17830 0.0
p06.pddl 748183 748183 0.0 None None - 12662 12662 0.0 5453 5453 0.0 452 452 0.0
p07.pddl 11893 11893 0.0 None None - 875 875 0.0 522 522 0.0 143 143 0.0
p08.pddl 4848237 4848237 0.0 None None - 228668 228668 0.0 156663 156663 0.0 11362 11362 0.0
p09.pddl 749809 749809 0.0 None None - 31990 31990 0.0 31221 31221 0.0 5638 5638 0.0
p10.pddl 3740670 3740670 0.0 None None - 51312 51312 0.0 20884 20884 0.0 1141 1141 0.0
p11.pddl None 4958324 - None None - 162301 162301 0.0 66756 66756 0.0 5574 5574 0.0
p12.pddl None None - None None - 797882 797882 0.0 367200 367200 0.0 44405 44405 0.0
p13.pddl None None - None None - 394156 394156 0.0 168754 168754 0.0 15667 15667 0.0
p14.pddl 2042196 2042196 0.0 None None - 142398 142398 0.0 25859 25859 0.0 1690 1690 0.0
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

expansions_until_last_jump

expansions_until_last_jump issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (1) 209 209 0.0 5 5 0.0 0 0 0.0 207 207 0.0 50 50 0.0
tidybot-opt11-strips (1) 29 29 0.0 8 8 0.0 0 0 0.0 0 0 0.0 0 0 0.0
Sum (2) 238 238 13 13 0 0 207 207 50 50
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

Only instances where all configurations have a value for "expansions_until_last_jump" are considered. Each table entry gives the sum of "expansions_until_last_jump" for that domain. The last row reports the sum across all domains.

pegsol-opt11-strips

expansions_until_last_jump issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 209 209 0.0 5 5 0.0 0 0 0.0 207 207 0.0 50 50 0.0
p02.pddl 301020 301020 0.0 None None - 149743 149743 0.0 299816 299816 0.0 160666 160666 0.0
p03.pddl 49937 49937 0.0 None None - 863 863 0.0 15701 15701 0.0 2011 2011 0.0
p04.pddl 257321 257321 0.0 None None - 4890 4890 0.0 177754 177754 0.0 33916 33916 0.0
p05.pddl 90055 90055 0.0 None None - 59690 59690 0.0 89896 89896 0.0 17374 17374 0.0
p06.pddl 263005 263005 0.0 None None - 142086 142086 0.0 255839 255839 0.0 95689 95689 0.0
p07.pddl 210856 210856 0.0 None None - 2910 2910 0.0 118431 118431 0.0 18667 18667 0.0
p08.pddl 341728 341728 0.0 None None - 7106 7106 0.0 272331 272331 0.0 43130 43130 0.0
p09.pddl 367911 367911 0.0 None None - 13181 13181 0.0 286195 286195 0.0 56409 56409 0.0
p10.pddl 491049 491049 0.0 None None - 12285 12285 0.0 335997 335997 0.0 71982 71982 0.0
p11.pddl 47882 47882 0.0 None None - 1064 1064 0.0 32322 32322 0.0 7461 7461 0.0
p12.pddl 40040 40040 0.0 None None - 30740 30740 0.0 42076 42076 0.0 9261 9261 0.0
p13.pddl 968389 968389 0.0 None None - 25818 25818 0.0 682033 682033 0.0 111672 111672 0.0
p14.pddl 1324204 1324204 0.0 None None - 56632 56632 0.0 771394 771394 0.0 194618 194618 0.0
p15.pddl 931245 931245 0.0 None None - 49227 49227 0.0 658541 658541 0.0 127822 127822 0.0
p16.pddl 6940656 6940656 0.0 None None - 385464 385464 0.0 6750856 6750856 0.0 1145730 1145730 0.0
p17.pddl 2766746 2766746 0.0 None None - 399 399 0.0 591600 591600 0.0 90853 90853 0.0
p18.pddl None None - None None - 3227669 3227669 0.0 None None - 16686074 16686074 0.0
p19.pddl None None - None None - 126790 126790 0.0 None None - None None -
p20.pddl None None - None None - 4771794 4771794 0.0 None None - None None -
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

tidybot-opt11-strips

expansions_until_last_jump issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 29 29 0.0 8 8 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p02.pddl 384304 384304 0.0 None None - 19528 19528 0.0 13451 13451 0.0 3366 3366 0.0
p03.pddl 7096 7096 0.0 None None - 622 622 0.0 410 410 0.0 136 136 0.0
p04.pddl 260107 260107 0.0 None None - 17970 17970 0.0 4879 4879 0.0 1597 1597 0.0
p05.pddl 6133474 6133474 0.0 None None - 336852 336852 0.0 230683 230683 0.0 17825 17825 0.0
p06.pddl 637795 637795 0.0 None None - 12659 12659 0.0 5446 5446 0.0 447 447 0.0
p07.pddl 10213 10213 0.0 None None - 870 870 0.0 512 512 0.0 136 136 0.0
p08.pddl 4234975 4234975 0.0 None None - 228661 228661 0.0 156659 156659 0.0 11352 11352 0.0
p09.pddl 635379 635379 0.0 None None - 31971 31971 0.0 31217 31217 0.0 5633 5633 0.0
p10.pddl 3145993 3145993 0.0 None None - 51305 51305 0.0 20871 20871 0.0 1134 1134 0.0
p11.pddl None 3586575 - None None - 162297 162297 0.0 66750 66750 0.0 5550 5550 0.0
p12.pddl None None - None None - 797879 797879 0.0 367197 367197 0.0 44398 44398 0.0
p13.pddl None None - None None - 394153 394153 0.0 168750 168750 0.0 15662 15662 0.0
p14.pddl 1554897 1554897 0.0 None None - 142396 142396 0.0 25856 25856 0.0 1683 1683 0.0
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

generated

generated issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (1) 425.00 425.00 0.0 43.00 43.00 0.0 33.00 33.00 0.0 416.00 416.00 0.0 189.00 189.00 0.0
tidybot-opt11-strips (1) 308.00 308.00 0.0 132.00 132.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
Geometric mean (2) 361.80 361.80 75.34 75.34 26.94 26.94 95.67 95.67 64.48 64.48
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

Only instances where all configurations have a value for "generated" are considered. Each table entry gives the geometric mean of "generated" for that domain. The last row reports the geometric mean across all domains.

pegsol-opt11-strips

generated issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 425 425 0.0 43 43 0.0 33 33 0.0 416 416 0.0 189 189 0.0
p02.pddl 606935 606935 0.0 None None - 346051 346051 0.0 606151 606151 0.0 391526 391526 0.0
p03.pddl 113039 113039 0.0 None None - 1804 1804 0.0 54732 54732 0.0 8070 8070 0.0
p04.pddl 524382 524382 0.0 None None - 32173 32173 0.0 372611 372611 0.0 136005 136005 0.0
p05.pddl 160841 160841 0.0 None None - 112904 112904 0.0 160756 160756 0.0 43099 43099 0.0
p06.pddl 490072 490072 0.0 None None - 289127 289127 0.0 476424 476424 0.0 229514 229514 0.0
p07.pddl 495570 495570 0.0 None None - 9077 9077 0.0 287471 287471 0.0 63581 63581 0.0
p08.pddl 899689 899689 0.0 None None - 19847 19847 0.0 710601 710601 0.0 185805 185805 0.0
p09.pddl 851099 851099 0.0 None None - 36250 36250 0.0 658256 658256 0.0 179455 179455 0.0
p10.pddl 1128661 1128661 0.0 None None - 90646 90646 0.0 776540 776540 0.0 317730 317730 0.0
p11.pddl 127791 127791 0.0 None None - 7734 7734 0.0 84879 84879 0.0 36182 36182 0.0
p12.pddl 74296 74296 0.0 None None - 59023 59023 0.0 77588 77588 0.0 21222 21222 0.0
p13.pddl 2494604 2494604 0.0 None None - 97493 97493 0.0 1716736 1716736 0.0 514650 514650 0.0
p14.pddl 3430283 3430283 0.0 None None - 166014 166014 0.0 1958402 1958402 0.0 657476 657476 0.0
p15.pddl 2570927 2570927 0.0 None None - 160981 160981 0.0 1752093 1752093 0.0 434081 434081 0.0
p16.pddl 16817278 16817278 0.0 None None - 2019400 2019400 0.0 16486850 16486850 0.0 5634668 5634668 0.0
p17.pddl 11902818 11902818 0.0 None None - 1291 1291 0.0 2074138 2074138 0.0 444424 444424 0.0
p18.pddl None None - None None - 7316871 7316871 0.0 None None - 48042518 48042518 0.0
p19.pddl None None - None None - 438471 438471 0.0 None None - None None -
p20.pddl None None - None None - 14818802 14818802 0.0 None None - None None -
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

tidybot-opt11-strips

generated issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 308 308 0.0 132 132 0.0 22 22 0.0 22 22 0.0 22 22 0.0
p02.pddl 1434051 1434051 0.0 None None - 59468 59468 0.0 40820 40820 0.0 11313 11313 0.0
p03.pddl 33423 33423 0.0 None None - 2391 2391 0.0 1623 1623 0.0 599 599 0.0
p04.pddl 981869 981869 0.0 None None - 53858 53858 0.0 15423 15423 0.0 5703 5703 0.0
p05.pddl 24611971 24611971 0.0 None None - 1134964 1134964 0.0 778378 778378 0.0 69336 69336 0.0
p06.pddl 2303131 2303131 0.0 None None - 37094 37094 0.0 15862 15862 0.0 1590 1590 0.0
p07.pddl 45622 45622 0.0 None None - 3233 3233 0.0 1937 1937 0.0 591 591 0.0
p08.pddl 17036795 17036795 0.0 None None - 772330 772330 0.0 528509 528509 0.0 41324 41324 0.0
p09.pddl 3265626 3265626 0.0 None None - 129566 129566 0.0 127079 127079 0.0 25202 25202 0.0
p10.pddl 11610966 11610966 0.0 None None - 153487 153487 0.0 62530 62530 0.0 4132 4132 0.0
p11.pddl None 18574962 - None None - 572208 572208 0.0 234196 234196 0.0 20815 20815 0.0
p12.pddl None None - None None - 2388918 2388918 0.0 1100985 1100985 0.0 154519 154519 0.0
p13.pddl None None - None None - 1372640 1372640 0.0 588083 588083 0.0 61712 61712 0.0
p14.pddl 7729811 7729811 0.0 None None - 517604 517604 0.0 94810 94810 0.0 6814 6814 0.0
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

memory

memory issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (1) 6580 6580 0.0 6844 6844 0.0 186192 186272 80.0 7380 7380 0.0 6580 6580 0.0
tidybot-opt11-strips (1) 12384 12384 0.0 14100 14100 0.0 12384 12516 132.0 21556 21556 0.0 12772 12772 0.0
Sum (2) 18964 18964 20944 20944 198576 198788 28936 28936 19352 19352
Sum 0.00 0.00 212.00 0.00 0.00
Average 0.00 0.00 106.00 0.00 0.00

Only instances where all configurations have a value for "memory" are considered. Each table entry gives the sum of "memory" for that domain. The last row reports the sum across all domains.

pegsol-opt11-strips

memory issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 6580 6580 0.0 6844 6844 0.0 186192 186272 80.0 7380 7380 0.0 6580 6580 0.0
p02.pddl 21076 21244 168.0 None None - 185928 186012 84.0 32612 32664 52.0 17916 17916 0.0
p03.pddl 9800 9812 12.0 None None - 16916 17064 148.0 10404 10416 12.0 6996 6996 0.0
p04.pddl 20416 20456 40.0 None None - 338288 338440 152.0 26532 26652 120.0 11352 11352 0.0
p05.pddl 10760 10884 124.0 None None - 44196 44344 148.0 14872 14888 16.0 8060 8068 8.0
p06.pddl 19912 19948 36.0 None None - 200888 201032 144.0 29980 30192 212.0 14112 14136 24.0
p07.pddl 19756 19920 164.0 None None - 235492 235532 40.0 22272 22444 172.0 9040 9040 0.0
p08.pddl 32400 32556 156.0 None None - 338940 339116 176.0 44304 44496 192.0 13640 13624 -16.0
p09.pddl 29840 30116 276.0 None None - 338232 338384 152.0 39028 39156 128.0 13216 13196 -20.0
p10.pddl 35592 35852 260.0 None None - 185992 186116 124.0 46256 46344 88.0 18096 18108 12.0
p11.pddl 10216 10200 -16.0 None None - 309948 310100 152.0 11936 11932 -4.0 7980 7980 0.0
p12.pddl 8412 8408 -4.0 None None - 49808 49956 148.0 10688 10684 -4.0 7328 7332 4.0
p13.pddl 71220 71860 640.0 None None - 190116 190240 124.0 93672 93968 296.0 24652 24732 80.0
p14.pddl 98144 98996 852.0 None None - 317660 317864 204.0 105060 105496 436.0 30996 30980 -16.0
p15.pddl 72992 73644 652.0 None None - 185920 186092 172.0 93948 94292 344.0 22252 22268 16.0
p16.pddl 414496 418220 3724.0 None None - 259724 260004 280.0 698916 703388 4472.0 199960 200060 100.0
p17.pddl 368728 371548 2820.0 None None - 264444 264744 300.0 132520 133068 548.0 24752 24720 -32.0
p18.pddl None None - None None - 256600 258012 1412.0 None None - 1600144 1602492 2348.0
p19.pddl None None - None None - 338696 339008 312.0 None None - None None -
p20.pddl None None - None None - 629156 632796 3640.0 None None - None None -
Sum 9904.00 0.00 7992.00 7080.00 2508.00
Average 582.59 0.00 399.60 416.47 139.33

tidybot-opt11-strips

memory issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 12384 12384 0.0 14100 14100 0.0 12384 12516 132.0 21556 21556 0.0 12772 12772 0.0
p02.pddl 57028 57756 728.0 None None - 24696 25024 328.0 36792 36844 52.0 17024 17024 0.0
p03.pddl 16636 16636 0.0 None None - 23584 23876 292.0 34732 34732 0.0 17024 17024 0.0
p04.pddl 45148 45632 484.0 None None - 23372 23612 240.0 35784 35708 -76.0 17024 17024 0.0
p05.pddl 757176 773144 15968.0 None None - 57744 57876 132.0 93488 94008 520.0 26632 26640 8.0
p06.pddl 105860 106576 716.0 None None - 40776 40776 0.0 59212 59164 -48.0 25248 25248 0.0
p07.pddl 24160 24160 0.0 None None - 35564 35564 0.0 58544 58528 -16.0 25248 25248 0.0
p08.pddl 546016 557120 11104.0 None None - 45996 46120 124.0 82708 83040 332.0 25516 25512 -4.0
p09.pddl 127624 130128 2504.0 None None - 60512 60512 0.0 82860 82908 48.0 37168 37168 0.0
p10.pddl 495736 499860 4124.0 None None - 64048 64048 0.0 80988 81028 40.0 37168 37168 0.0
p11.pddl None 678380 - None None - 58480 58480 0.0 89384 89428 44.0 37168 37168 0.0
p12.pddl None None - None None - 129352 129380 28.0 141740 142444 704.0 42836 42888 52.0
p13.pddl None None - None None - 80480 80744 264.0 107088 107444 356.0 38124 38132 8.0
p14.pddl 345832 351304 5472.0 None None - 132196 132196 0.0 136828 136868 40.0 55576 55576 0.0
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
Sum 41100.00 0.00 1540.00 1996.00 64.00
Average 3736.36 0.00 110.00 142.57 4.57

run_dir

Domain-wise reports only support numeric attributes, but run_dir has type unicode.

pegsol-opt11-strips

run_dir issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl runs-00201-00300/00261 runs-00301-00400/00301 - runs-00101-00200/00101 runs-00101-00200/00141 - runs-00301-00400/00341 runs-00301-00400/00381 - runs-00101-00200/00181 runs-00201-00300/00221 - runs-00001-00100/00021 runs-00001-00100/00061 -
p02.pddl runs-00201-00300/00262 runs-00301-00400/00302 - runs-00101-00200/00102 runs-00101-00200/00142 - runs-00301-00400/00342 runs-00301-00400/00382 - runs-00101-00200/00182 runs-00201-00300/00222 - runs-00001-00100/00022 runs-00001-00100/00062 -
p03.pddl runs-00201-00300/00263 runs-00301-00400/00303 - runs-00101-00200/00103 runs-00101-00200/00143 - runs-00301-00400/00343 runs-00301-00400/00383 - runs-00101-00200/00183 runs-00201-00300/00223 - runs-00001-00100/00023 runs-00001-00100/00063 -
p04.pddl runs-00201-00300/00264 runs-00301-00400/00304 - runs-00101-00200/00104 runs-00101-00200/00144 - runs-00301-00400/00344 runs-00301-00400/00384 - runs-00101-00200/00184 runs-00201-00300/00224 - runs-00001-00100/00024 runs-00001-00100/00064 -
p05.pddl runs-00201-00300/00265 runs-00301-00400/00305 - runs-00101-00200/00105 runs-00101-00200/00145 - runs-00301-00400/00345 runs-00301-00400/00385 - runs-00101-00200/00185 runs-00201-00300/00225 - runs-00001-00100/00025 runs-00001-00100/00065 -
p06.pddl runs-00201-00300/00266 runs-00301-00400/00306 - runs-00101-00200/00106 runs-00101-00200/00146 - runs-00301-00400/00346 runs-00301-00400/00386 - runs-00101-00200/00186 runs-00201-00300/00226 - runs-00001-00100/00026 runs-00001-00100/00066 -
p07.pddl runs-00201-00300/00267 runs-00301-00400/00307 - runs-00101-00200/00107 runs-00101-00200/00147 - runs-00301-00400/00347 runs-00301-00400/00387 - runs-00101-00200/00187 runs-00201-00300/00227 - runs-00001-00100/00027 runs-00001-00100/00067 -
p08.pddl runs-00201-00300/00268 runs-00301-00400/00308 - runs-00101-00200/00108 runs-00101-00200/00148 - runs-00301-00400/00348 runs-00301-00400/00388 - runs-00101-00200/00188 runs-00201-00300/00228 - runs-00001-00100/00028 runs-00001-00100/00068 -
p09.pddl runs-00201-00300/00269 runs-00301-00400/00309 - runs-00101-00200/00109 runs-00101-00200/00149 - runs-00301-00400/00349 runs-00301-00400/00389 - runs-00101-00200/00189 runs-00201-00300/00229 - runs-00001-00100/00029 runs-00001-00100/00069 -
p10.pddl runs-00201-00300/00270 runs-00301-00400/00310 - runs-00101-00200/00110 runs-00101-00200/00150 - runs-00301-00400/00350 runs-00301-00400/00390 - runs-00101-00200/00190 runs-00201-00300/00230 - runs-00001-00100/00030 runs-00001-00100/00070 -
p11.pddl runs-00201-00300/00271 runs-00301-00400/00311 - runs-00101-00200/00111 runs-00101-00200/00151 - runs-00301-00400/00351 runs-00301-00400/00391 - runs-00101-00200/00191 runs-00201-00300/00231 - runs-00001-00100/00031 runs-00001-00100/00071 -
p12.pddl runs-00201-00300/00272 runs-00301-00400/00312 - runs-00101-00200/00112 runs-00101-00200/00152 - runs-00301-00400/00352 runs-00301-00400/00392 - runs-00101-00200/00192 runs-00201-00300/00232 - runs-00001-00100/00032 runs-00001-00100/00072 -
p13.pddl runs-00201-00300/00273 runs-00301-00400/00313 - runs-00101-00200/00113 runs-00101-00200/00153 - runs-00301-00400/00353 runs-00301-00400/00393 - runs-00101-00200/00193 runs-00201-00300/00233 - runs-00001-00100/00033 runs-00001-00100/00073 -
p14.pddl runs-00201-00300/00274 runs-00301-00400/00314 - runs-00101-00200/00114 runs-00101-00200/00154 - runs-00301-00400/00354 runs-00301-00400/00394 - runs-00101-00200/00194 runs-00201-00300/00234 - runs-00001-00100/00034 runs-00001-00100/00074 -
p15.pddl runs-00201-00300/00275 runs-00301-00400/00315 - runs-00101-00200/00115 runs-00101-00200/00155 - runs-00301-00400/00355 runs-00301-00400/00395 - runs-00101-00200/00195 runs-00201-00300/00235 - runs-00001-00100/00035 runs-00001-00100/00075 -
p16.pddl runs-00201-00300/00276 runs-00301-00400/00316 - runs-00101-00200/00116 runs-00101-00200/00156 - runs-00301-00400/00356 runs-00301-00400/00396 - runs-00101-00200/00196 runs-00201-00300/00236 - runs-00001-00100/00036 runs-00001-00100/00076 -
p17.pddl runs-00201-00300/00277 runs-00301-00400/00317 - runs-00101-00200/00117 runs-00101-00200/00157 - runs-00301-00400/00357 runs-00301-00400/00397 - runs-00101-00200/00197 runs-00201-00300/00237 - runs-00001-00100/00037 runs-00001-00100/00077 -
p18.pddl runs-00201-00300/00278 runs-00301-00400/00318 - runs-00101-00200/00118 runs-00101-00200/00158 - runs-00301-00400/00358 runs-00301-00400/00398 - runs-00101-00200/00198 runs-00201-00300/00238 - runs-00001-00100/00038 runs-00001-00100/00078 -
p19.pddl runs-00201-00300/00279 runs-00301-00400/00319 - runs-00101-00200/00119 runs-00101-00200/00159 - runs-00301-00400/00359 runs-00301-00400/00399 - runs-00101-00200/00199 runs-00201-00300/00239 - runs-00001-00100/00039 runs-00001-00100/00079 -
p20.pddl runs-00201-00300/00280 runs-00301-00400/00320 - runs-00101-00200/00120 runs-00101-00200/00160 - runs-00301-00400/00360 runs-00301-00400/00400 - runs-00101-00200/00200 runs-00201-00300/00240 - runs-00001-00100/00040 runs-00001-00100/00080 -
Sum 0 0 0 0 0
Average None None None None None

tidybot-opt11-strips

run_dir issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl runs-00201-00300/00241 runs-00201-00300/00281 - runs-00001-00100/00081 runs-00101-00200/00121 - runs-00301-00400/00321 runs-00301-00400/00361 - runs-00101-00200/00161 runs-00201-00300/00201 - runs-00001-00100/00001 runs-00001-00100/00041 -
p02.pddl runs-00201-00300/00242 runs-00201-00300/00282 - runs-00001-00100/00082 runs-00101-00200/00122 - runs-00301-00400/00322 runs-00301-00400/00362 - runs-00101-00200/00162 runs-00201-00300/00202 - runs-00001-00100/00002 runs-00001-00100/00042 -
p03.pddl runs-00201-00300/00243 runs-00201-00300/00283 - runs-00001-00100/00083 runs-00101-00200/00123 - runs-00301-00400/00323 runs-00301-00400/00363 - runs-00101-00200/00163 runs-00201-00300/00203 - runs-00001-00100/00003 runs-00001-00100/00043 -
p04.pddl runs-00201-00300/00244 runs-00201-00300/00284 - runs-00001-00100/00084 runs-00101-00200/00124 - runs-00301-00400/00324 runs-00301-00400/00364 - runs-00101-00200/00164 runs-00201-00300/00204 - runs-00001-00100/00004 runs-00001-00100/00044 -
p05.pddl runs-00201-00300/00245 runs-00201-00300/00285 - runs-00001-00100/00085 runs-00101-00200/00125 - runs-00301-00400/00325 runs-00301-00400/00365 - runs-00101-00200/00165 runs-00201-00300/00205 - runs-00001-00100/00005 runs-00001-00100/00045 -
p06.pddl runs-00201-00300/00246 runs-00201-00300/00286 - runs-00001-00100/00086 runs-00101-00200/00126 - runs-00301-00400/00326 runs-00301-00400/00366 - runs-00101-00200/00166 runs-00201-00300/00206 - runs-00001-00100/00006 runs-00001-00100/00046 -
p07.pddl runs-00201-00300/00247 runs-00201-00300/00287 - runs-00001-00100/00087 runs-00101-00200/00127 - runs-00301-00400/00327 runs-00301-00400/00367 - runs-00101-00200/00167 runs-00201-00300/00207 - runs-00001-00100/00007 runs-00001-00100/00047 -
p08.pddl runs-00201-00300/00248 runs-00201-00300/00288 - runs-00001-00100/00088 runs-00101-00200/00128 - runs-00301-00400/00328 runs-00301-00400/00368 - runs-00101-00200/00168 runs-00201-00300/00208 - runs-00001-00100/00008 runs-00001-00100/00048 -
p09.pddl runs-00201-00300/00249 runs-00201-00300/00289 - runs-00001-00100/00089 runs-00101-00200/00129 - runs-00301-00400/00329 runs-00301-00400/00369 - runs-00101-00200/00169 runs-00201-00300/00209 - runs-00001-00100/00009 runs-00001-00100/00049 -
p10.pddl runs-00201-00300/00250 runs-00201-00300/00290 - runs-00001-00100/00090 runs-00101-00200/00130 - runs-00301-00400/00330 runs-00301-00400/00370 - runs-00101-00200/00170 runs-00201-00300/00210 - runs-00001-00100/00010 runs-00001-00100/00050 -
p11.pddl runs-00201-00300/00251 runs-00201-00300/00291 - runs-00001-00100/00091 runs-00101-00200/00131 - runs-00301-00400/00331 runs-00301-00400/00371 - runs-00101-00200/00171 runs-00201-00300/00211 - runs-00001-00100/00011 runs-00001-00100/00051 -
p12.pddl runs-00201-00300/00252 runs-00201-00300/00292 - runs-00001-00100/00092 runs-00101-00200/00132 - runs-00301-00400/00332 runs-00301-00400/00372 - runs-00101-00200/00172 runs-00201-00300/00212 - runs-00001-00100/00012 runs-00001-00100/00052 -
p13.pddl runs-00201-00300/00253 runs-00201-00300/00293 - runs-00001-00100/00093 runs-00101-00200/00133 - runs-00301-00400/00333 runs-00301-00400/00373 - runs-00101-00200/00173 runs-00201-00300/00213 - runs-00001-00100/00013 runs-00001-00100/00053 -
p14.pddl runs-00201-00300/00254 runs-00201-00300/00294 - runs-00001-00100/00094 runs-00101-00200/00134 - runs-00301-00400/00334 runs-00301-00400/00374 - runs-00101-00200/00174 runs-00201-00300/00214 - runs-00001-00100/00014 runs-00001-00100/00054 -
p15.pddl runs-00201-00300/00255 runs-00201-00300/00295 - runs-00001-00100/00095 runs-00101-00200/00135 - runs-00301-00400/00335 runs-00301-00400/00375 - runs-00101-00200/00175 runs-00201-00300/00215 - runs-00001-00100/00015 runs-00001-00100/00055 -
p16.pddl runs-00201-00300/00256 runs-00201-00300/00296 - runs-00001-00100/00096 runs-00101-00200/00136 - runs-00301-00400/00336 runs-00301-00400/00376 - runs-00101-00200/00176 runs-00201-00300/00216 - runs-00001-00100/00016 runs-00001-00100/00056 -
p17.pddl runs-00201-00300/00257 runs-00201-00300/00297 - runs-00001-00100/00097 runs-00101-00200/00137 - runs-00301-00400/00337 runs-00301-00400/00377 - runs-00101-00200/00177 runs-00201-00300/00217 - runs-00001-00100/00017 runs-00001-00100/00057 -
p18.pddl runs-00201-00300/00258 runs-00201-00300/00298 - runs-00001-00100/00098 runs-00101-00200/00138 - runs-00301-00400/00338 runs-00301-00400/00378 - runs-00101-00200/00178 runs-00201-00300/00218 - runs-00001-00100/00018 runs-00001-00100/00058 -
p19.pddl runs-00201-00300/00259 runs-00201-00300/00299 - runs-00001-00100/00099 runs-00101-00200/00139 - runs-00301-00400/00339 runs-00301-00400/00379 - runs-00101-00200/00179 runs-00201-00300/00219 - runs-00001-00100/00019 runs-00001-00100/00059 -
p20.pddl runs-00201-00300/00260 runs-00201-00300/00300 - runs-00001-00100/00100 runs-00101-00200/00140 - runs-00301-00400/00340 runs-00301-00400/00380 - runs-00101-00200/00180 runs-00201-00300/00220 - runs-00001-00100/00020 runs-00001-00100/00060 -
Sum 0 0 0 0 0
Average None None None None None

score_evaluations

score_evaluations issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (20) 14.14 14.14 0.0 5.00 5.00 0.0 34.61 34.61 0.0 15.41 15.41 0.0 23.72 23.72 0.0
tidybot-opt11-strips (20) 10.18 10.18 0.0 5.00 5.00 0.0 24.31 24.31 0.0 29.21 29.21 0.0 41.86 41.86 0.0
Average (40) 12.16 12.16 5.00 5.00 29.46 29.46 22.31 22.31 32.79 32.79
Sum (40) 24.32 24.32 10.00 10.00 58.91 58.91 44.62 44.62 65.59 65.59
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

Only instances where all configurations have a value for "score_evaluations" are considered. Each table entry gives the average of "score_evaluations" for that domain. The last rows report the average and sum across all domains.

pegsol-opt11-strips

score_evaluations issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 87.96 87.96 0.0 100.00 100.00 0.0 100.00 100.00 0.0 88.22 88.22 0.0 96.66 96.66 0.0
p02.pddl 12.99 12.99 0.0 0 0 0.0 17.52 17.52 0.0 13.07 13.07 0.0 16.34 16.34 0.0
p03.pddl 29.49 29.49 0.0 0 0 0.0 70.24 70.24 0.0 35.88 35.88 0.0 54.56 54.56 0.0
p04.pddl 13.66 13.66 0.0 0 0 0.0 40.25 40.25 0.0 16.38 16.38 0.0 25.44 25.44 0.0
p05.pddl 26.14 26.14 0.0 0 0 0.0 28.94 28.94 0.0 26.15 26.15 0.0 38.34 38.34 0.0
p06.pddl 14.12 14.12 0.0 0 0 0.0 18.41 18.41 0.0 14.32 14.32 0.0 20.44 20.44 0.0
p07.pddl 14.28 14.28 0.0 0 0 0.0 52.81 52.81 0.0 18.76 18.76 0.0 32.78 32.78 0.0
p08.pddl 7.18 7.18 0.0 0 0 0.0 44.79 44.79 0.0 9.31 9.31 0.0 21.52 21.52 0.0
p09.pddl 8.33 8.33 0.0 0 0 0.0 39.00 39.00 0.0 10.55 10.55 0.0 22.31 22.31 0.0
p10.pddl 5.59 5.59 0.0 0 0 0.0 29.40 29.40 0.0 8.72 8.72 0.0 16.48 16.48 0.0
p11.pddl 28.06 28.06 0.0 0 0 0.0 55.80 55.80 0.0 31.86 31.86 0.0 39.50 39.50 0.0
p12.pddl 34.94 34.94 0.0 0 0 0.0 36.53 36.53 0.0 34.95 34.95 0.0 46.81 46.81 0.0
p13.pddl 0.00 0.00 0.0 0 0 0.0 27.93 27.93 0.0 0.00 0.00 0.0 11.01 11.01 0.0
p14.pddl 0.00 0.00 0.0 0 0 0.0 22.69 22.69 0.0 0.00 0.00 0.0 8.36 8.36 0.0
p15.pddl 0.00 0.00 0.0 0 0 0.0 23.01 23.01 0.0 0.00 0.00 0.0 12.75 12.75 0.0
p16.pddl 0.00 0.00 0.0 0 0 0.0 0.00 0.00 0.0 0.00 0.00 0.0 0.00 0.00 0.0
p17.pddl 0.00 0.00 0.0 0 0 0.0 73.88 73.88 0.0 0.00 0.00 0.0 11.14 11.14 0.0
p18.pddl 0 0 0.0 0 0 0.0 0.00 0.00 0.0 0 0 0.0 0.00 0.00 0.0
p19.pddl 0 0 0.0 0 0 0.0 10.96 10.96 0.0 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 0.00 0.00 0.0 0 0 0.0 0 0 0.0
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

tidybot-opt11-strips

score_evaluations issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 98.48 98.48 0.0 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p02.pddl 4.79 4.79 0.0 0 0 0.0 38.81 38.81 0.0 43.03 43.03 0.0 55.97 55.97 0.0
p03.pddl 47.66 47.66 0.0 0 0 0.0 74.90 74.90 0.0 78.54 78.54 0.0 87.47 87.47 0.0
p04.pddl 8.81 8.81 0.0 0 0 0.0 39.84 39.84 0.0 53.50 53.50 0.0 63.08 63.08 0.0
p05.pddl 0.00 0.00 0.0 0 0 0.0 8.14 8.14 0.0 12.24 12.24 0.0 36.70 36.70 0.0
p06.pddl 0.00 0.00 0.0 0 0 0.0 43.15 43.15 0.0 52.39 52.39 0.0 75.26 75.26 0.0
p07.pddl 43.88 43.88 0.0 0 0 0.0 71.58 71.58 0.0 76.92 76.92 0.0 88.18 88.18 0.0
p08.pddl 0.00 0.00 0.0 0 0 0.0 12.29 12.29 0.0 16.43 16.43 0.0 42.70 42.70 0.0
p09.pddl 0.00 0.00 0.0 0 0 0.0 32.65 32.65 0.0 32.86 32.86 0.0 48.55 48.55 0.0
p10.pddl 0.00 0.00 0.0 0 0 0.0 27.84 27.84 0.0 37.52 37.52 0.0 64.75 64.75 0.0
p11.pddl 0 0.00 0.0 0 0 0.0 15.20 15.20 0.0 24.82 24.82 0.0 49.40 49.40 0.0
p12.pddl 0 0 0.0 0 0 0.0 0.00 0.00 0.0 6.56 6.56 0.0 26.17 26.17 0.0
p13.pddl 0 0 0.0 0 0 0.0 5.74 5.74 0.0 14.95 14.95 0.0 37.80 37.80 0.0
p14.pddl 0.00 0.00 0.0 0 0 0.0 16.00 16.00 0.0 34.45 34.45 0.0 61.25 61.25 0.0
p15.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p16.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p17.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p18.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p19.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

score_expansions

score_expansions issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (20) 14.63 14.63 0.0 5.00 5.00 0.0 40.01 40.01 0.0 17.16 17.16 0.0 29.21 29.21 0.0
tidybot-opt11-strips (20) 11.40 11.40 0.0 5.00 5.00 0.0 27.06 27.06 0.0 32.14 32.14 0.0 46.71 46.71 0.0
Average (40) 13.02 13.02 5.00 5.00 33.54 33.54 24.65 24.65 37.96 37.96
Sum (40) 26.03 26.03 10.00 10.00 67.08 67.08 49.29 49.29 75.92 75.92
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

Only instances where all configurations have a value for "score_expansions" are considered. Each table entry gives the average of "score_expansions" for that domain. The last rows report the average and sum across all domains.

pegsol-opt11-strips

score_expansions issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 89.96 89.96 0.0 100.00 100.00 0.0 100.00 100.00 0.0 90.23 90.23 0.0 100.00 100.00 0.0
p02.pddl 13.01 13.01 0.0 0 0 0.0 20.38 20.38 0.0 13.07 13.07 0.0 19.70 19.70 0.0
p03.pddl 30.52 30.52 0.0 0 0 0.0 75.81 75.81 0.0 39.82 39.82 0.0 63.46 63.46 0.0
p04.pddl 14.00 14.00 0.0 0 0 0.0 47.09 47.09 0.0 18.58 18.58 0.0 32.02 32.02 0.0
p05.pddl 26.14 26.14 0.0 0 0 0.0 30.60 30.60 0.0 26.16 26.16 0.0 44.00 44.00 0.0
p06.pddl 14.23 14.23 0.0 0 0 0.0 21.07 21.07 0.0 14.62 14.62 0.0 25.36 25.36 0.0
p07.pddl 15.10 15.10 0.0 0 0 0.0 62.71 62.71 0.0 22.23 22.23 0.0 41.88 41.88 0.0
p08.pddl 9.63 9.63 0.0 0 0 0.0 53.24 53.24 0.0 12.67 12.67 0.0 30.25 30.25 0.0
p09.pddl 9.18 9.18 0.0 0 0 0.0 46.86 46.86 0.0 12.64 12.64 0.0 29.79 29.79 0.0
p10.pddl 6.23 6.23 0.0 0 0 0.0 36.68 36.68 0.0 11.22 11.22 0.0 23.32 23.32 0.0
p11.pddl 29.71 29.71 0.0 0 0 0.0 62.46 62.46 0.0 35.14 35.14 0.0 47.39 47.39 0.0
p12.pddl 34.94 34.94 0.0 0 0 0.0 37.79 37.79 0.0 34.40 34.40 0.0 50.82 50.82 0.0
p13.pddl 0.00 0.00 0.0 0 0 0.0 35.98 35.98 0.0 2.79 2.79 0.0 17.80 17.80 0.0
p14.pddl 0.00 0.00 0.0 0 0 0.0 30.54 30.54 0.0 2.02 2.02 0.0 16.10 16.10 0.0
p15.pddl 0.00 0.00 0.0 0 0 0.0 30.23 30.23 0.0 2.71 2.71 0.0 20.43 20.43 0.0
p16.pddl 0.00 0.00 0.0 0 0 0.0 3.24 3.24 0.0 0.00 0.00 0.0 0.00 0.00 0.0
p17.pddl 0.00 0.00 0.0 0 0 0.0 83.48 83.48 0.0 4.82 4.82 0.0 21.85 21.85 0.0
p18.pddl 0 0 0.0 0 0 0.0 0.00 0.00 0.0 0 0 0.0 0.00 0.00 0.0
p19.pddl 0 0 0.0 0 0 0.0 22.09 22.09 0.0 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 0.00 0.00 0.0 0 0 0.0 0 0 0.0
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

tidybot-opt11-strips

score_expansions issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p02.pddl 8.81 8.81 0.0 0 0 0.0 42.73 42.73 0.0 46.78 46.78 0.0 61.81 61.81 0.0
p03.pddl 51.78 51.78 0.0 0 0 0.0 80.10 80.10 0.0 84.60 84.60 0.0 96.12 96.12 0.0
p04.pddl 12.97 12.97 0.0 0 0 0.0 43.63 43.63 0.0 57.78 57.78 0.0 69.86 69.86 0.0
p05.pddl 0.00 0.00 0.0 0 0 0.0 11.81 11.81 0.0 15.92 15.92 0.0 43.72 43.72 0.0
p06.pddl 3.15 3.15 0.0 0 0 0.0 47.44 47.44 0.0 56.58 56.58 0.0 83.62 83.62 0.0
p07.pddl 48.12 48.12 0.0 0 0 0.0 76.45 76.45 0.0 82.06 82.06 0.0 96.12 96.12 0.0
p08.pddl 0.00 0.00 0.0 0 0 0.0 16.02 16.02 0.0 20.13 20.13 0.0 48.61 48.61 0.0
p09.pddl 3.13 3.13 0.0 0 0 0.0 37.37 37.37 0.0 37.64 37.64 0.0 56.22 56.22 0.0
p10.pddl 0.00 0.00 0.0 0 0 0.0 32.24 32.24 0.0 42.00 42.00 0.0 73.57 73.57 0.0
p11.pddl 0 0.00 0.0 0 0 0.0 19.74 19.74 0.0 29.39 29.39 0.0 56.35 56.35 0.0
p12.pddl 0 0 0.0 0 0 0.0 2.45 2.45 0.0 10.88 10.88 0.0 33.81 33.81 0.0
p13.pddl 0 0 0.0 0 0 0.0 10.11 10.11 0.0 19.32 19.32 0.0 45.13 45.13 0.0
p14.pddl 0.00 0.00 0.0 0 0 0.0 21.16 21.16 0.0 39.68 39.68 0.0 69.30 69.30 0.0
p15.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p16.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p17.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p18.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p19.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
Sum 0.00 0.00 0.00 0.00 0.00
Average 0.00 0.00 0.00 0.00 0.00

score_memory

score_memory issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (20) 51.37 51.30 -0.07 4.12 4.12 0.0 34.22 34.20 -0.02 49.17 49.14 -0.04 60.25 60.24 -0.0
tidybot-opt11-strips (20) 23.92 24.65 0.73 3.60 3.60 0.0 38.40 38.36 -0.04 34.74 34.73 -0.01 43.70 43.70 -0.0
Average (40) 37.65 37.98 3.86 3.86 36.31 36.28 41.96 41.93 51.97 51.97
Sum (40) 75.29 75.95 7.71 7.71 72.62 72.55 83.91 83.86 103.94 103.94
Sum 0.66 0.00 -0.06 -0.05 -0.01
Average 0.33 0.00 -0.03 -0.03 -0.00

Only instances where all configurations have a value for "score_memory" are considered. Each table entry gives the average of "score_memory" for that domain. The last rows report the average and sum across all domains.

pegsol-opt11-strips

score_memory issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 82.88 82.88 0.0 82.31 82.31 0.0 34.82 34.81 -0.01 81.23 81.23 0.0 82.88 82.88 0.0
p02.pddl 66.14 66.03 -0.11 0 0 0.0 34.84 34.83 -0.01 59.86 59.84 -0.02 68.48 68.48 0.0
p03.pddl 77.15 77.13 -0.02 0 0 0.0 69.30 69.18 -0.12 76.29 76.27 -0.02 82.00 82.00 0.0
p04.pddl 66.60 66.57 -0.03 0 0 0.0 26.23 26.22 -0.01 62.83 62.77 -0.06 75.04 75.04 0.0
p05.pddl 75.81 75.64 -0.17 0 0 0.0 55.49 55.45 -0.04 71.15 71.14 -0.01 79.96 79.95 -0.01
p06.pddl 66.96 66.93 -0.03 0 0 0.0 33.72 33.71 -0.01 61.07 60.97 -0.1 71.91 71.88 -0.03
p07.pddl 67.07 66.95 -0.12 0 0 0.0 31.44 31.44 0.0 65.35 65.24 -0.11 78.31 78.31 0.0
p08.pddl 59.96 59.89 -0.07 0 0 0.0 26.20 26.20 0.0 55.46 55.40 -0.06 72.40 72.41 0.01
p09.pddl 61.14 61.01 -0.13 0 0 0.0 26.23 26.23 0.0 57.28 57.23 -0.05 72.85 72.87 0.02
p10.pddl 58.61 58.50 -0.11 0 0 0.0 34.83 34.82 -0.01 54.84 54.81 -0.03 68.33 68.32 -0.01
p11.pddl 76.55 76.58 0.03 0 0 0.0 27.49 27.48 -0.01 74.32 74.32 0.0 80.10 80.10 0.0
p12.pddl 79.35 79.35 0.0 0 0 0.0 53.78 53.73 -0.05 75.90 75.91 0.01 81.33 81.32 -0.01
p13.pddl 48.63 48.51 -0.12 0 0 0.0 34.52 34.51 -0.01 44.69 44.65 -0.04 63.89 63.84 -0.05
p14.pddl 44.02 43.90 -0.12 0 0 0.0 27.14 27.13 -0.01 43.04 42.98 -0.06 60.59 60.60 0.01
p15.pddl 48.28 48.15 -0.13 0 0 0.0 34.84 34.82 -0.02 44.65 44.60 -0.05 65.36 65.35 -0.01
p16.pddl 23.31 23.18 -0.13 0 0 0.0 30.03 30.02 -0.01 15.80 15.71 -0.09 33.79 33.78 -0.01
p17.pddl 24.99 24.88 -0.11 0 0 0.0 29.77 29.76 -0.01 39.71 39.65 -0.06 63.83 63.85 0.02
p18.pddl 0 0 0.0 0 0 0.0 30.21 30.13 -0.08 0 0 0.0 3.89 3.87 -0.02
p19.pddl 0 0 0.0 0 0 0.0 26.21 26.20 -0.01 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 17.31 17.23 -0.08 0 0 0.0 0 0 0.0
Sum -1.37 0.00 -0.50 -0.75 -0.09
Average -0.07 0.00 -0.03 -0.04 -0.00

tidybot-opt11-strips

score_memory issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 73.79 73.79 0.0 71.92 71.92 0.0 73.79 73.63 -0.16 65.82 65.82 0.0 73.34 73.34 0.0
p02.pddl 51.83 51.65 -0.18 0 0 0.0 63.86 63.67 -0.19 58.13 58.11 -0.02 69.21 69.21 0.0
p03.pddl 69.54 69.54 0.0 0 0 0.0 64.52 64.35 -0.17 58.96 58.96 0.0 69.21 69.21 0.0
p04.pddl 55.19 55.03 -0.16 0 0 0.0 64.65 64.51 -0.14 58.53 58.56 0.03 69.21 69.21 0.0
p05.pddl 14.65 14.35 -0.3 0 0 0.0 51.65 51.62 -0.03 44.72 44.64 -0.08 62.78 62.77 -0.01
p06.pddl 42.94 42.84 -0.1 0 0 0.0 56.65 56.65 0.0 51.29 51.30 0.01 63.54 63.54 0.0
p07.pddl 64.18 64.18 0.0 0 0 0.0 58.62 58.62 0.0 51.45 51.46 0.01 63.54 63.54 0.0
p08.pddl 19.35 19.06 -0.29 0 0 0.0 54.92 54.88 -0.04 46.48 46.43 -0.05 63.39 63.39 0.0
p09.pddl 40.25 39.97 -0.28 0 0 0.0 50.98 50.98 0.0 46.46 46.45 -0.01 57.98 57.98 0.0
p10.pddl 20.74 20.62 -0.12 0 0 0.0 50.16 50.16 0.0 46.79 46.78 -0.01 57.98 57.98 0.0
p11.pddl 0 16.23 16.23 0 0 0.0 51.47 51.47 0.0 45.37 45.36 -0.01 57.98 57.98 0.0
p12.pddl 0 0 0.0 0 0 0.0 40.05 40.05 0.0 38.74 38.67 -0.07 55.94 55.93 -0.01
p13.pddl 0 0 0.0 0 0 0.0 46.88 46.83 -0.05 42.77 42.72 -0.05 57.62 57.62 0.0
p14.pddl 25.91 25.69 -0.22 0 0 0.0 39.74 39.74 0.0 39.25 39.24 -0.01 52.20 52.20 0.0
p15.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p16.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p17.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p18.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p19.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
Sum 14.58 0.00 -0.78 -0.26 -0.02
Average 0.73 0.00 -0.04 -0.01 -0.00

score_search_time

score_search_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (20) 73.52 73.31 -0.21 3.00 3.00 0.0 75.61 75.98 0.37 65.91 65.88 -0.03 69.05 69.12 0.07
tidybot-opt11-strips (20) 22.80 23.82 1.02 1.45 1.48 0.03 45.40 46.81 1.41 49.10 50.64 1.54 39.26 39.45 0.19
Average (40) 48.16 48.56 2.23 2.24 60.50 61.39 57.50 58.26 54.16 54.28
Sum (40) 96.32 97.13 4.45 4.48 121.00 122.79 115.00 116.51 108.31 108.57
Sum 0.81 0.03 1.78 1.51 0.26
Average 0.40 0.02 0.89 0.76 0.13

Only instances where all configurations have a value for "score_search_time" are considered. Each table entry gives the average of "score_search_time" for that domain. The last rows report the average and sum across all domains.

pegsol-opt11-strips

score_search_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 100.00 100.00 0.0 59.99 60.06 0.07 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p02.pddl 93.90 94.07 0.17 0 0 0.0 65.60 66.10 0.5 77.04 77.04 0.0 75.47 75.38 -0.09
p03.pddl 100.00 100.00 0.0 0 0 0.0 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p04.pddl 95.90 95.90 0.0 0 0 0.0 93.00 93.65 0.65 82.19 82.33 0.14 85.12 84.86 -0.26
p05.pddl 100.00 100.00 0.0 0 0 0.0 79.02 79.58 0.56 93.90 93.81 -0.09 100.00 100.00 0.0
p06.pddl 96.10 95.42 -0.68 0 0 0.0 65.96 66.77 0.81 79.21 79.41 0.2 79.61 79.38 -0.23
p07.pddl 97.13 96.71 -0.42 0 0 0.0 100.00 100.00 0.0 87.05 86.95 -0.1 94.41 95.23 0.82
p08.pddl 88.66 88.26 -0.4 0 0 0.0 98.49 98.97 0.48 74.56 74.54 -0.02 81.57 81.84 0.27
p09.pddl 89.79 88.77 -1.02 0 0 0.0 91.44 92.46 1.02 75.72 75.47 -0.25 81.51 81.57 0.06
p10.pddl 85.80 85.93 0.13 0 0 0.0 79.90 80.39 0.49 73.12 72.99 -0.13 74.33 74.12 -0.21
p11.pddl 100.00 100.00 0.0 0 0 0.0 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p12.pddl 100.00 100.00 0.0 0 0 0.0 88.15 88.83 0.68 100.00 100.00 0.0 100.00 100.00 0.0
p13.pddl 76.05 74.91 -1.14 0 0 0.0 78.24 78.82 0.58 62.32 62.32 0.0 67.30 67.35 0.05
p14.pddl 69.84 69.87 0.03 0 0 0.0 71.59 71.72 0.13 60.25 60.57 0.32 63.88 63.51 -0.37
p15.pddl 74.50 74.29 -0.21 0 0 0.0 72.03 72.17 0.14 62.61 62.21 -0.4 69.78 70.13 0.35
p16.pddl 49.56 48.41 -1.15 0 0 0.0 38.46 38.92 0.46 32.22 32.08 -0.14 36.27 36.80 0.53
p17.pddl 53.20 53.75 0.55 0 0 0.0 100.00 100.00 0.0 57.95 57.81 -0.14 67.40 67.76 0.36
p18.pddl 0 0 0.0 0 0 0.0 22.21 22.64 0.43 0 0 0.0 4.40 4.56 0.16
p19.pddl 0 0 0.0 0 0 0.0 57.32 57.49 0.17 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 10.79 11.02 0.23 0 0 0.0 0 0 0.0
Sum -4.14 0.07 7.33 -0.61 1.44
Average -0.21 0.00 0.37 -0.03 0.07

tidybot-opt11-strips

score_search_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 100.00 100.00 0.0 29.01 29.60 0.59 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p02.pddl 49.90 51.62 1.72 0 0 0.0 91.30 93.00 1.7 90.69 91.94 1.25 64.73 64.72 -0.01
p03.pddl 100.00 100.00 0.0 0 0 0.0 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p04.pddl 55.11 56.74 1.63 0 0 0.0 92.31 93.81 1.5 100.00 100.00 0.0 73.23 73.37 0.14
p05.pddl 1.59 3.52 1.93 0 0 0.0 41.80 44.02 2.22 45.34 46.27 0.93 28.97 28.06 -0.91
p06.pddl 31.46 33.76 2.3 0 0 0.0 86.12 87.83 1.71 94.68 96.50 1.82 76.52 76.50 -0.02
p07.pddl 86.95 89.00 2.05 0 0 0.0 100.00 100.00 0.0 100.00 100.00 0.0 98.49 98.97 0.48
p08.pddl 6.47 8.61 2.14 0 0 0.0 47.06 48.92 1.86 50.00 51.89 1.89 36.02 36.49 0.47
p09.pddl 21.65 24.39 2.74 0 0 0.0 63.90 66.11 2.21 55.63 64.41 8.78 38.71 40.09 1.38
p10.pddl 1.08 3.22 2.14 0 0 0.0 57.50 59.39 1.89 66.31 70.70 4.39 54.67 55.09 0.42
p11.pddl 0 0.11 0.11 0 0 0.0 40.32 44.91 4.59 53.38 55.53 2.15 37.48 37.79 0.31
p12.pddl 0 0 0.0 0 0 0.0 21.21 24.37 3.16 26.25 31.38 5.13 7.60 8.52 0.92
p13.pddl 0 0 0.0 0 0 0.0 30.92 33.09 2.17 40.93 43.05 2.12 22.62 23.23 0.61
p14.pddl 1.77 5.34 3.57 0 0 0.0 35.46 40.74 5.28 58.70 61.07 2.37 46.14 46.08 -0.06
p15.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p16.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p17.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p18.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p19.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
Sum 20.33 0.59 28.29 30.83 3.73
Average 1.02 0.03 1.41 1.54 0.19

score_total_time

score_total_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (20) 73.49 73.29 -0.2 3.00 3.00 0.0 6.06 8.43 2.37 65.88 65.85 -0.03 69.04 69.11 0.07
tidybot-opt11-strips (20) 22.30 23.29 0.99 1.45 1.48 0.03 34.28 36.04 1.76 47.18 48.55 1.36 38.35 38.52 0.17
Average (40) 47.90 48.29 2.22 2.24 20.17 22.23 56.53 57.20 53.69 53.81
Sum (40) 95.79 96.58 4.45 4.48 40.34 44.47 113.07 114.40 107.39 107.63
Sum 0.79 0.03 4.13 1.33 0.24
Average 0.40 0.02 2.06 0.67 0.12

Only instances where all configurations have a value for "score_total_time" are considered. Each table entry gives the average of "score_total_time" for that domain. The last rows report the average and sum across all domains.

pegsol-opt11-strips

score_total_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 100.00 100.00 0.0 59.98 60.05 0.07 3.65 5.97 2.32 100.00 100.00 0.0 100.00 100.00 0.0
p02.pddl 93.81 93.98 0.17 0 0 0.0 5.14 7.56 2.42 76.99 77.02 0.03 75.44 75.36 -0.08
p03.pddl 100.00 100.00 0.0 0 0 0.0 15.15 17.78 2.63 100.00 100.00 0.0 100.00 100.00 0.0
p04.pddl 95.80 95.90 0.1 0 0 0.0 3.82 6.36 2.54 82.15 82.26 0.11 85.08 84.82 -0.26
p05.pddl 100.00 100.00 0.0 0 0 0.0 12.61 15.27 2.66 93.73 93.65 -0.08 100.00 100.00 0.0
p06.pddl 96.00 95.32 -0.68 0 0 0.0 3.16 5.63 2.47 79.18 79.35 0.17 79.58 79.35 -0.23
p07.pddl 97.02 96.60 -0.42 0 0 0.0 2.16 4.54 2.38 87.00 86.90 -0.1 94.33 95.14 0.81
p08.pddl 88.60 88.21 -0.39 0 0 0.0 2.38 4.93 2.55 74.52 74.50 -0.02 81.54 81.81 0.27
p09.pddl 89.73 88.72 -1.01 0 0 0.0 5.51 8.17 2.66 75.70 75.42 -0.28 81.47 81.54 0.07
p10.pddl 85.75 85.89 0.14 0 0 0.0 7.27 9.79 2.52 73.08 72.98 -0.1 74.31 74.10 -0.21
p11.pddl 100.00 100.00 0.0 0 0 0.0 7.12 9.60 2.48 100.00 100.00 0.0 100.00 100.00 0.0
p12.pddl 100.00 100.00 0.0 0 0 0.0 12.67 15.34 2.67 100.00 100.00 0.0 100.00 100.00 0.0
p13.pddl 76.03 74.88 -1.15 0 0 0.0 3.42 5.94 2.52 62.31 62.30 -0.01 67.29 67.34 0.05
p14.pddl 69.83 69.85 0.02 0 0 0.0 6.84 9.19 2.35 60.24 60.56 0.32 63.87 63.51 -0.36
p15.pddl 74.48 74.27 -0.21 0 0 0.0 5.80 8.13 2.33 62.60 62.20 -0.4 69.77 70.12 0.35
p16.pddl 49.56 48.41 -1.15 0 0 0.0 4.52 6.39 1.87 32.22 32.08 -0.14 36.26 36.80 0.54
p17.pddl 53.20 53.75 0.55 0 0 0.0 3.86 6.45 2.59 57.94 57.81 -0.13 67.39 67.74 0.35
p18.pddl 0 0 0.0 0 0 0.0 8.17 10.00 1.83 0 0 0.0 4.40 4.56 0.16
p19.pddl 0 0 0.0 0 0 0.0 7.46 9.70 2.24 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 0.46 1.77 1.31 0 0 0.0 0 0 0.0
Sum -4.03 0.07 47.34 -0.63 1.46
Average -0.20 0.00 2.37 -0.03 0.07

tidybot-opt11-strips

score_total_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 100.00 100.00 0.0 28.99 29.58 0.59 100.00 100.00 0.0 100.00 100.00 0.0 100.00 100.00 0.0
p02.pddl 49.70 51.39 1.69 0 0 0.0 63.44 65.66 2.22 85.66 86.50 0.84 64.13 64.11 -0.02
p03.pddl 95.42 95.70 0.28 0 0 0.0 69.74 71.72 1.98 100.00 100.00 0.0 97.68 97.57 -0.11
p04.pddl 54.82 56.42 1.6 0 0 0.0 66.46 68.39 1.93 92.69 93.16 0.47 72.09 72.26 0.17
p05.pddl 1.58 3.51 1.93 0 0 0.0 37.56 39.86 2.3 44.99 45.87 0.88 28.90 27.99 -0.91
p06.pddl 31.37 33.66 2.29 0 0 0.0 50.91 53.12 2.21 84.65 85.61 0.96 74.12 74.06 -0.06
p07.pddl 82.26 83.67 1.41 0 0 0.0 61.23 63.68 2.45 92.92 92.84 -0.08 89.06 89.36 0.3
p08.pddl 6.46 8.59 2.13 0 0 0.0 41.20 43.15 1.95 49.50 51.30 1.8 35.90 36.36 0.46
p09.pddl 21.58 24.30 2.72 0 0 0.0 45.09 47.82 2.73 54.33 62.13 7.8 38.46 39.82 1.36
p10.pddl 1.07 3.21 2.14 0 0 0.0 38.52 41.22 2.7 63.55 67.08 3.53 53.85 54.25 0.4
p11.pddl 0 0.10 0.1 0 0 0.0 34.28 38.54 4.26 52.32 54.28 1.96 37.25 37.55 0.3
p12.pddl 0 0 0.0 0 0 0.0 18.76 21.93 3.17 26.10 31.16 5.06 7.58 8.49 0.91
p13.pddl 0 0 0.0 0 0 0.0 27.86 30.11 2.25 40.51 42.56 2.05 22.54 23.15 0.61
p14.pddl 1.74 5.31 3.57 0 0 0.0 30.58 35.67 5.09 56.43 58.41 1.98 45.45 45.38 -0.07
p15.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p16.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p17.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p18.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p19.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
p20.pddl 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0 0 0 0.0
Sum 19.86 0.59 35.24 27.25 3.34
Average 0.99 0.03 1.76 1.36 0.17

search_time

search_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (1) 0.10 0.10 0.0 20.07 19.96 -0.11 0.10 0.10 0.0 0.10 0.10 0.0 0.10 0.10 0.0
tidybot-opt11-strips (1) 0.10 0.10 0.0 204.55 195.75 -8.8 0.10 0.10 0.0 0.10 0.10 0.0 0.10 0.10 0.0
Geometric mean (2) 0.10 0.10 64.07 62.51 0.10 0.10 0.10 0.10 0.10 0.10
Sum 0.00 -8.91 0.00 0.00 0.00
Average 0.00 -4.46 0.00 0.00 0.00

Only instances where all configurations have a value for "search_time" are considered. Each table entry gives the geometric mean of "search_time" for that domain. The last row reports the geometric mean across all domains.

pegsol-opt11-strips

search_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 0.10 0.10 0.0 20.07 19.96 -0.11 0.10 0.10 0.0 0.10 0.10 0.0 0.10 0.10 0.0
p02.pddl 1.58 1.56 -0.02 None None - 13.18 12.69 -0.49 5.59 5.59 0.0 6.29 6.33 0.04
p03.pddl 0.28 0.28 0.0 None None - 0.10 0.10 0.0 0.57 0.57 0.0 0.22 0.22 0.0
p04.pddl 1.36 1.36 0.0 None None - 1.69 1.61 -0.08 3.80 3.76 -0.04 3.05 3.11 0.06
p05.pddl 0.40 0.41 0.01 None None - 4.82 4.62 -0.2 1.58 1.59 0.01 0.97 0.96 -0.01
p06.pddl 1.34 1.41 0.07 None None - 12.83 12.07 -0.76 4.75 4.68 -0.07 4.61 4.69 0.08
p07.pddl 1.24 1.28 0.04 None None - 0.53 0.50 -0.03 2.64 2.66 0.02 1.52 1.43 -0.09
p08.pddl 2.34 2.41 0.07 None None - 1.12 1.08 -0.04 6.73 6.74 0.01 3.98 3.90 -0.08
p09.pddl 2.15 2.32 0.17 None None - 1.90 1.76 -0.14 6.17 6.29 0.12 4.00 3.98 -0.02
p10.pddl 2.90 2.87 -0.03 None None - 4.51 4.35 -0.16 7.50 7.57 0.07 6.85 6.96 0.11
p11.pddl 0.32 0.32 0.0 None None - 0.41 0.38 -0.03 0.83 0.83 0.0 0.71 0.71 0.0
p12.pddl 0.18 0.19 0.01 None None - 2.43 2.31 -0.12 0.77 0.82 0.05 0.41 0.41 0.0
p13.pddl 6.02 6.56 0.54 None None - 5.11 4.89 -0.22 16.85 16.85 0.0 11.60 11.56 -0.04
p14.pddl 9.59 9.57 -0.02 None None - 8.41 8.33 -0.08 19.68 19.21 -0.47 14.99 15.41 0.42
p15.pddl 6.76 6.87 0.11 None None - 8.14 8.05 -0.09 16.49 16.99 0.5 9.63 9.38 -0.25
p16.pddl 43.84 47.78 3.94 None None - 100.78 97.37 -3.41 160.80 162.54 1.74 118.78 114.15 -4.63
p17.pddl 33.38 32.03 -1.35 None None - 0.10 0.10 0.0 23.38 23.62 0.24 11.51 11.21 -0.3
p18.pddl None None - None None - 340.61 329.71 -10.9 None None - 1294.62 1278.53 -16.09
p19.pddl None None - None None - 24.51 24.20 -0.31 None None - None None -
p20.pddl None None - None None - 801.69 788.06 -13.63 None None - None None -
Sum 3.54 -0.11 -30.69 2.18 -20.80
Average 0.21 -0.11 -1.53 0.13 -1.16

tidybot-opt11-strips

search_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 0.10 0.10 0.0 204.55 195.75 -8.8 0.10 0.10 0.0 0.10 0.10 0.0 0.10 0.10 0.0
p02.pddl 42.74 37.58 -5.16 None None - 1.92 1.69 -0.23 2.01 1.83 -0.18 14.06 14.08 0.02
p03.pddl 0.79 0.73 -0.06 None None - 0.10 0.10 0.0 0.10 0.10 0.0 0.54 0.55 0.01
p04.pddl 28.92 25.59 -3.33 None None - 1.78 1.59 -0.19 0.79 0.73 -0.06 7.44 7.36 -0.08
p05.pddl 1597.86 1382.72 -215.14 None None - 78.44 66.44 -12.0 60.16 56.12 -4.04 205.21 219.67 14.46
p06.pddl 170.27 143.31 -26.96 None None - 2.83 2.49 -0.34 1.49 1.30 -0.19 5.81 5.82 0.01
p07.pddl 2.66 2.28 -0.38 None None - 0.20 0.17 -0.03 0.15 0.13 -0.02 1.12 1.08 -0.04
p08.pddl 1107.89 944.13 -163.76 None None - 52.89 45.99 -6.9 42.44 36.81 -5.63 120.95 116.81 -4.14
p09.pddl 355.12 289.26 -65.86 None None - 14.97 12.68 -2.29 27.82 14.41 -13.41 98.91 89.14 -9.77
p10.pddl 1659.65 1413.53 -246.12 None None - 24.18 20.98 -3.2 12.49 8.99 -3.5 29.89 28.97 -0.92
p11.pddl None 1784.64 - None None - 87.64 62.13 -25.51 32.93 28.03 -4.9 108.42 105.95 -2.47
p12.pddl None None - None None - 367.22 289.66 -77.56 251.59 171.31 -80.28 1018.22 950.59 -67.63
p13.pddl None None - None None - 177.27 150.73 -26.54 83.74 71.44 -12.3 330.39 315.45 -14.94
p14.pddl 1576.61 1205.81 -370.8 None None - 126.14 84.92 -41.22 22.11 18.50 -3.61 56.66 56.93 0.27
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
Sum -1097.57 -8.80 -196.01 -128.12 -85.22
Average -99.78 -8.80 -14.00 -9.15 -6.09

total_time

total_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
pegsol-opt11-strips (1) 0.10 0.10 0.0 20.08 19.97 -0.11 1369.35 1150.23 -219.12 0.10 0.10 0.0 0.10 0.10 0.0
tidybot-opt11-strips (1) 0.35 0.35 0.0 204.90 196.10 -8.8 0.59 0.57 -0.02 0.43 0.40 -0.03 0.35 0.34 -0.01
Geometric mean (2) 0.19 0.19 64.14 62.58 28.42 25.61 0.21 0.20 0.19 0.18
Sum 0.00 -8.91 -219.14 -0.03 -0.01
Average 0.00 -4.46 -109.57 -0.01 -0.01

Only instances where all configurations have a value for "total_time" are considered. Each table entry gives the geometric mean of "total_time" for that domain. The last row reports the geometric mean across all domains.

pegsol-opt11-strips

total_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 0.10 0.10 0.0 20.08 19.97 -0.11 1369.35 1150.23 -219.12 0.10 0.10 0.0 0.10 0.10 0.0
p02.pddl 1.59 1.57 -0.02 None None - 1224.71 1021.22 -203.49 5.61 5.60 -0.01 6.30 6.34 0.04
p03.pddl 0.29 0.29 0.0 None None - 578.11 474.71 -103.4 0.58 0.58 0.0 0.23 0.23 0.0
p04.pddl 1.37 1.36 -0.01 None None - 1351.90 1117.41 -234.49 3.81 3.78 -0.03 3.06 3.12 0.06
p05.pddl 0.41 0.42 0.01 None None - 699.71 573.11 -126.6 1.60 1.61 0.01 0.98 0.97 -0.01
p06.pddl 1.35 1.42 0.07 None None - 1420.28 1180.57 -239.71 4.76 4.70 -0.06 4.62 4.70 0.08
p07.pddl 1.25 1.29 0.04 None None - 1531.36 1280.85 -250.51 2.65 2.67 0.02 1.53 1.44 -0.09
p08.pddl 2.35 2.42 0.07 None None - 1505.97 1243.91 -262.06 6.75 6.76 0.01 3.99 3.91 -0.08
p09.pddl 2.16 2.33 0.17 None None - 1191.19 975.71 -215.48 6.18 6.31 0.13 4.01 3.99 -0.02
p10.pddl 2.91 2.88 -0.03 None None - 1044.04 864.29 -179.75 7.52 7.58 0.06 6.86 6.97 0.11
p11.pddl 0.33 0.33 0.0 None None - 1055.54 876.70 -178.84 0.84 0.85 0.01 0.72 0.72 0.0
p12.pddl 0.19 0.20 0.01 None None - 696.49 569.92 -126.57 0.78 0.83 0.05 0.42 0.42 0.0
p13.pddl 6.03 6.57 0.54 None None - 1392.70 1153.52 -239.18 16.86 16.87 0.01 11.61 11.57 -0.04
p14.pddl 9.60 9.58 -0.02 None None - 1078.20 903.59 -174.61 19.69 19.22 -0.47 15.00 15.41 0.41
p15.pddl 6.77 6.88 0.11 None None - 1165.72 978.74 -186.98 16.50 17.00 0.5 9.64 9.39 -0.25
p16.pddl 43.85 47.78 3.93 None None - 1283.10 1115.03 -168.07 160.82 162.56 1.74 118.79 114.15 -4.64
p17.pddl 33.39 32.04 -1.35 None None - 1347.38 1109.93 -237.45 23.40 23.63 0.23 11.52 11.22 -0.3
p18.pddl None None - None None - 975.90 850.40 -125.5 None None - 1294.63 1278.54 -16.09
p19.pddl None None - None None - 1029.02 870.27 -158.75 None None - None None -
p20.pddl None None - None None - 1739.30 1575.97 -163.33 None None - None None -
Sum 3.52 -0.11 -3793.89 2.20 -20.82
Average 0.21 -0.11 -189.69 0.13 -1.16

tidybot-opt11-strips

total_time issue348-base-astar_blind issue348-v1-astar_blind Diff - astar_blind issue348-base-astar_h2 issue348-v1-astar_h2 Diff - astar_h2 issue348-base-astar_ipdb issue348-v1-astar_ipdb Diff - astar_ipdb issue348-base-astar_lmcount_lm_merged_rhw_hm issue348-v1-astar_lmcount_lm_merged_rhw_hm Diff - astar_lmcount_lm_merged_rhw_hm issue348-base-astar_lmcut issue348-v1-astar_lmcut Diff - astar_lmcut
p01.pddl 0.35 0.35 0.0 204.90 196.10 -8.8 0.59 0.57 -0.02 0.43 0.40 -0.03 0.35 0.34 -0.01
p02.pddl 43.38 38.22 -5.16 None None - 15.49 13.12 -2.37 2.93 2.75 -0.18 14.71 14.73 0.02
p03.pddl 1.41 1.38 -0.03 None None - 9.66 8.33 -1.33 0.95 0.93 -0.02 1.19 1.20 0.01
p04.pddl 29.56 26.23 -3.33 None None - 12.35 10.69 -1.66 1.73 1.67 -0.06 8.10 8.00 -0.1
p05.pddl 1599.00 1383.85 -215.15 None None - 107.79 90.74 -17.05 61.77 57.83 -3.94 206.33 220.84 14.51
p06.pddl 171.40 144.43 -26.97 None None - 39.64 33.58 -6.06 3.16 2.94 -0.22 6.96 6.99 0.03
p07.pddl 3.78 3.40 -0.38 None None - 18.29 15.22 -3.07 1.70 1.71 0.01 2.27 2.22 -0.05
p08.pddl 1109.03 945.24 -163.79 None None - 82.08 70.88 -11.2 44.04 38.50 -5.54 122.11 117.92 -4.19
p09.pddl 357.00 291.16 -65.84 None None - 61.29 49.96 -11.33 30.66 17.09 -13.57 100.77 90.99 -9.78
p10.pddl 1661.55 1415.43 -246.12 None None - 100.29 81.93 -18.36 15.36 11.79 -3.57 31.79 30.85 -0.94
p11.pddl None 1786.53 - None None - 137.86 100.14 -37.72 35.65 30.79 -4.86 110.31 107.86 -2.45
p12.pddl None None - None None - 441.06 347.91 -93.15 254.57 174.09 -80.48 1020.14 952.46 -67.68
p13.pddl None None - None None - 223.05 188.48 -34.57 86.41 74.11 -12.3 332.30 317.36 -14.94
p14.pddl 1579.54 1208.88 -370.66 None None - 181.85 124.20 -57.65 26.20 22.59 -3.61 59.68 59.97 0.29
p15.pddl None None - None None - None None - None None - None None -
p16.pddl None None - None None - None None - None None - None None -
p17.pddl None None - None None - None None - None None - None None -
p18.pddl None None - None None - None None - None None - None None -
p19.pddl None None - None None - None None - None None - None None -
p20.pddl None None - None None - None None - None None - None None -
Sum -1097.43 -8.80 -295.54 -128.37 -85.28
Average -99.77 -8.80 -21.11 -9.17 -6.09