unexplained-errors

Contents of /infai/sieverss/repos/downward/dev/experiments/issue927/data/issue927-v2-grid-steps/slurm.err without "memory cg" errors:

slurmstepd: error: Unable to unlink domain socket: No such file or directory
2019-09-19 01:15:56,097 ERROR    There was output to *-grid-steps/slurm.err
2019-09-19 01:16:21,937 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-10001-10100/10031".
2019-09-19 01:16:21,941 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06377".
2019-09-19 01:16:21,944 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-08201-08300/08204".
2019-09-19 01:16:21,948 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02723".
2019-09-19 01:16:21,962 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-04501-04600/04550".
2019-09-19 01:16:25,604 ERROR    There were 5 runs with unexplained errors.
2019-09-19 01:16:39,380 ERROR    There were 5 runs with unexplained errors.

Unexplained errors domain problem algorithm unexplained_errors error planner_wall_clock_time raw_memory node
runs-02701-02800/02723 organic-synthesis-opt18-strips p12.pddl issue927-v1-rl-b50k-t900 [u'segfault', u'output-to-slurm.err'] segfault 187.86 ? ase42.cluster.bc2.ch
runs-04501-04600/04550 organic-synthesis-opt18-strips p12.pddl issue927-v1-sccs-dfp-b50k-t900 [u'segfault', u'output-to-slurm.err'] segfault 187.27 ? ase41.cluster.bc2.ch
runs-06301-06400/06377 organic-synthesis-opt18-strips p12.pddl issue927-v2-dfp-b50k-t900 [u'segfault', u'output-to-slurm.err'] segfault 187.48 ? ase36.cluster.bc2.ch
runs-08201-08300/08204 organic-synthesis-opt18-strips p12.pddl issue927-v2-rl-b50k-t900 [u'segfault', u'output-to-slurm.err'] segfault 187.14 ? ase41.cluster.bc2.ch
runs-10001-10100/10031 organic-synthesis-opt18-strips p12.pddl issue927-v2-sccs-dfp-b50k-t900 [u'segfault', u'output-to-slurm.err'] segfault 185.87 ? ase39.cluster.bc2.ch

info

algorithm local_revision global_revision revision_summary build_options driver_options component_options
issue927-v1-dfp-b50k-t900 issue927-v1 12f7417fce00 12f7417fce00 (issue927) issue927-v1 [u'release'] [u'--validate', u'--overall-time-limit', u'30m', u'--overall-memory-limit', u'3584M', u'--build', u'release'] [u'--search', u'astar(merge_and_shrink(merge_strategy=merge_stateless(merge_selector=score_based_filtering(scoring_functions=[goal_relevance,dfp,total_order])),shrink_strategy=shrink_bisimulation(greedy=false),label_reduction=exact(before_shrinking=true,before_merging=false),max_states=50000,threshold_before_merge=1,main_loop_max_time=900))']
issue927-v1-rl-b50k-t900 issue927-v1 12f7417fce00 12f7417fce00 (issue927) issue927-v1 [u'release'] [u'--validate', u'--overall-time-limit', u'30m', u'--overall-memory-limit', u'3584M', u'--build', u'release'] [u'--search', u'astar(merge_and_shrink(merge_strategy=merge_precomputed(merge_tree=linear(variable_order=reverse_level)),shrink_strategy=shrink_bisimulation(greedy=false),label_reduction=exact(before_shrinking=true,before_merging=false),max_states=50000,threshold_before_merge=1,main_loop_max_time=900))']
issue927-v1-sccs-dfp-b50k-t900 issue927-v1 12f7417fce00 12f7417fce00 (issue927) issue927-v1 [u'release'] [u'--validate', u'--overall-time-limit', u'30m', u'--overall-memory-limit', u'3584M', u'--build', u'release'] [u'--search', u'astar(merge_and_shrink(shrink_strategy=shrink_bisimulation(greedy=false),merge_strategy=merge_sccs(order_of_sccs=topological,merge_selector=score_based_filtering(scoring_functions=[goal_relevance,dfp,total_order(atomic_ts_order=reverse_level,product_ts_order=new_to_old,atomic_before_product=false)])),label_reduction=exact(before_shrinking=true,before_merging=false),max_states=50000,threshold_before_merge=1,main_loop_max_time=900))']
issue927-v2-dfp-b50k-t900 issue927-v2 c962c9bc0721 c962c9bc0721 (issue927) issue927-v2 [u'release'] [u'--validate', u'--overall-time-limit', u'30m', u'--overall-memory-limit', u'3584M', u'--build', u'release'] [u'--search', u'astar(merge_and_shrink(merge_strategy=merge_stateless(merge_selector=score_based_filtering(scoring_functions=[goal_relevance,dfp,total_order])),shrink_strategy=shrink_bisimulation(greedy=false),label_reduction=exact(before_shrinking=true,before_merging=false),max_states=50000,threshold_before_merge=1,main_loop_max_time=900))']
issue927-v2-rl-b50k-t900 issue927-v2 c962c9bc0721 c962c9bc0721 (issue927) issue927-v2 [u'release'] [u'--validate', u'--overall-time-limit', u'30m', u'--overall-memory-limit', u'3584M', u'--build', u'release'] [u'--search', u'astar(merge_and_shrink(merge_strategy=merge_precomputed(merge_tree=linear(variable_order=reverse_level)),shrink_strategy=shrink_bisimulation(greedy=false),label_reduction=exact(before_shrinking=true,before_merging=false),max_states=50000,threshold_before_merge=1,main_loop_max_time=900))']
issue927-v2-sccs-dfp-b50k-t900 issue927-v2 c962c9bc0721 c962c9bc0721 (issue927) issue927-v2 [u'release'] [u'--validate', u'--overall-time-limit', u'30m', u'--overall-memory-limit', u'3584M', u'--build', u'release'] [u'--search', u'astar(merge_and_shrink(shrink_strategy=shrink_bisimulation(greedy=false),merge_strategy=merge_sccs(order_of_sccs=topological,merge_selector=score_based_filtering(scoring_functions=[goal_relevance,dfp,total_order(atomic_ts_order=reverse_level,product_ts_order=new_to_old,atomic_before_product=false)])),label_reduction=exact(before_shrinking=true,before_merging=false),max_states=50000,threshold_before_merge=1,main_loop_max_time=900))']

Used nodes: {ase31, ..., ase54}

summary

Summary issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
cost - Sum 17025245.00 17025245.00 0.0 17025245.00 17025245.00 0.0 17025245.00 17025245.00 0.0
coverage - Sum 869 869 0.0 858 859 1.0 908 908 0.0
error-search-out-of-memory - Sum 898 900 2.0 906 906 0.0 862 859 -3.0
error-search-out-of-time - Sum 41 39 -2.0 46 45 -1.0 39 42 3.0
error-search-unsolvable-incomplete - Sum 6 6 0.0 4 4 0.0 5 5 0.0
error-segfault - Sum 0 1 1.0 1 1 0.0 1 1 0.0
error-success - Sum 869 869 0.0 858 859 1.0 908 908 0.0
error-translate-out-of-memory - Sum 13 12 -1.0 12 12 0.0 12 12 0.0
evaluations - Geometric mean 29573.11 29573.11 0.0 32858.29 32858.29 0.0 26806.36 26806.36 0.0
expansions - Geometric mean 0.00 0.00 0.0 0.00 0.00 0.0 0.00 0.00 0.0
expansions_until_last_jump - Sum 1322903137 1322903137 0.0 1735869109 1735869109 0.0 1420318805 1420318805 0.0
generated - Geometric mean 0.00 0.00 0.0 0.00 0.00 0.0 0.00 0.00 0.0
memory - Sum 255095444 253505552 -1589892.0 294224320 292809280 -1415040.0 262615280 260990452 -1624828.0
ms_abstraction_constructed - Sum 1768 1767 -1.0 1770 1772 2.0 1768 1768 0.0
ms_atomic_construction_time - Geometric mean 0.01 0.00 -0.0 0.01 0.00 -0.0 0.01 0.00 -0.0
ms_atomic_fts_constructed - Sum 1798 1800 2.0 1798 1800 2.0 1798 1800 2.0
ms_construction_time - Geometric mean 9.84 9.79 -0.04 7.89 7.84 -0.05 8.05 8.07 0.01
ms_out_of_memory - Sum 22 21 -1.0 17 15 -2.0 22 21 -1.0
ms_out_of_time - Sum 24 26 2.0 27 27 0.0 24 25 1.0
perfect_heuristic - Sum 276 276 0.0 272 272 0.0 318 318 0.0
planner_memory - Sum 274139520 272842060 -1297460.0 313468276 312281460 -1186816.0 282457136 281059844 -1397292.0
planner_time - Geometric mean 6.74 6.71 -0.02 6.80 6.74 -0.06 6.23 6.30 0.07
score_evaluations - Sum 417.88 417.88 0.0 415.63 415.63 0.0 454.50 454.50 0.0
score_expansions - Sum 467.47 467.47 0.0 463.19 463.19 0.0 509.42 509.42 0.0
score_generated - Sum 383.54 383.54 0.0 382.39 382.39 0.0 419.76 419.76 0.0
score_memory - Sum 342.44 343.04 0.6 337.01 337.79 0.78 359.15 359.80 0.65
score_search_time - Sum 748.64 749.00 0.37 732.89 733.37 0.47 785.56 785.25 -0.3
score_total_time - Sum 631.66 632.41 0.76 630.17 630.24 0.07 670.88 670.58 -0.3
search_out_of_memory - Sum 876 879 3.0 889 891 2.0 840 838 -2.0
search_out_of_time - Sum 17 13 -4.0 19 18 -1.0 15 17 2.0
search_time - Geometric mean 0.37 0.37 -0.0 0.46 0.46 0.0 0.37 0.37 0.0
total_time - Geometric mean 4.97 4.95 -0.02 5.01 4.99 -0.02 4.48 4.51 0.03

cost

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
airport (23) 1435.00 1435.00 0.0 1435.00 1435.00 0.0 1435.00 1435.00 0.0
barman-opt11-strips (4) 360.00 360.00 0.0 360.00 360.00 0.0 360.00 360.00 0.0
blocks (28) 640.00 640.00 0.0 640.00 640.00 0.0 640.00 640.00 0.0
data-network-opt18-strips (9) 697.00 697.00 0.0 697.00 697.00 0.0 697.00 697.00 0.0
depot (7) 152.00 152.00 0.0 152.00 152.00 0.0 152.00 152.00 0.0
driverlog (13) 230.00 230.00 0.0 230.00 230.00 0.0 230.00 230.00 0.0
elevators-opt08-strips (14) 740.00 740.00 0.0 740.00 740.00 0.0 740.00 740.00 0.0
elevators-opt11-strips (12) 672.00 672.00 0.0 672.00 672.00 0.0 672.00 672.00 0.0
floortile-opt11-strips (4) 186.00 186.00 0.0 186.00 186.00 0.0 186.00 186.00 0.0
floortile-opt14-strips (2) 112.00 112.00 0.0 112.00 112.00 0.0 112.00 112.00 0.0
freecell (20) 292.00 292.00 0.0 292.00 292.00 0.0 292.00 292.00 0.0
ged-opt14-strips (19) 67.00 67.00 0.0 67.00 67.00 0.0 67.00 67.00 0.0
grid (2) 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0
gripper (20) 1360.00 1360.00 0.0 1360.00 1360.00 0.0 1360.00 1360.00 0.0
hiking-opt14-strips (13) 282.00 282.00 0.0 282.00 282.00 0.0 282.00 282.00 0.0
logistics00 (20) 592.00 592.00 0.0 592.00 592.00 0.0 592.00 592.00 0.0
logistics98 (5) 108.00 108.00 0.0 108.00 108.00 0.0 108.00 108.00 0.0
miconic (72) 1848.00 1848.00 0.0 1848.00 1848.00 0.0 1848.00 1848.00 0.0
movie (30) 210.00 210.00 0.0 210.00 210.00 0.0 210.00 210.00 0.0
mprime (23) 135.00 135.00 0.0 135.00 135.00 0.0 135.00 135.00 0.0
mystery (15) 89.00 89.00 0.0 89.00 89.00 0.0 89.00 89.00 0.0
nomystery-opt11-strips (18) 421.00 421.00 0.0 421.00 421.00 0.0 421.00 421.00 0.0
openstacks-opt08-strips (22) 76.00 76.00 0.0 76.00 76.00 0.0 76.00 76.00 0.0
openstacks-opt11-strips (17) 63.00 63.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0
openstacks-opt14-strips (3) 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
openstacks-strips (7) 206.00 206.00 0.0 206.00 206.00 0.0 206.00 206.00 0.0
organic-synthesis-opt18-strips (7) 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
organic-synthesis-split-opt18-strips (7) 832.00 832.00 0.0 832.00 832.00 0.0 832.00 832.00 0.0
parcprinter-08-strips (14) 9146341.00 9146341.00 0.0 9146341.00 9146341.00 0.0 9146341.00 9146341.00 0.0
parcprinter-opt11-strips (10) 7843999.00 7843999.00 0.0 7843999.00 7843999.00 0.0 7843999.00 7843999.00 0.0
parking-opt11-strips (2) 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
parking-opt14-strips (4) 72.00 72.00 0.0 72.00 72.00 0.0 72.00 72.00 0.0
pathways-noneg (4) 53.00 53.00 0.0 53.00 53.00 0.0 53.00 53.00 0.0
pegsol-08-strips (29) 199.00 199.00 0.0 199.00 199.00 0.0 199.00 199.00 0.0
pegsol-opt11-strips (19) 159.00 159.00 0.0 159.00 159.00 0.0 159.00 159.00 0.0
petri-net-alignment-opt18-strips (4) 194.00 194.00 0.0 194.00 194.00 0.0 194.00 194.00 0.0
pipesworld-notankage (19) 293.00 293.00 0.0 293.00 293.00 0.0 293.00 293.00 0.0
pipesworld-tankage (16) 280.00 280.00 0.0 280.00 280.00 0.0 280.00 280.00 0.0
psr-small (50) 894.00 894.00 0.0 894.00 894.00 0.0 894.00 894.00 0.0
rovers (8) 132.00 132.00 0.0 132.00 132.00 0.0 132.00 132.00 0.0
satellite (6) 85.00 85.00 0.0 85.00 85.00 0.0 85.00 85.00 0.0
scanalyzer-08-strips (13) 315.00 315.00 0.0 315.00 315.00 0.0 315.00 315.00 0.0
scanalyzer-opt11-strips (10) 271.00 271.00 0.0 271.00 271.00 0.0 271.00 271.00 0.0
snake-opt18-strips (12) 345.00 345.00 0.0 345.00 345.00 0.0 345.00 345.00 0.0
sokoban-opt08-strips (26) 715.00 715.00 0.0 715.00 715.00 0.0 715.00 715.00 0.0
sokoban-opt11-strips (20) 603.00 603.00 0.0 603.00 603.00 0.0 603.00 603.00 0.0
spider-opt18-strips (11) 222.00 222.00 0.0 222.00 222.00 0.0 222.00 222.00 0.0
storage (15) 176.00 176.00 0.0 176.00 176.00 0.0 176.00 176.00 0.0
termes-opt18-strips (12) 938.00 938.00 0.0 938.00 938.00 0.0 938.00 938.00 0.0
tetris-opt14-strips (8) 184.00 184.00 0.0 184.00 184.00 0.0 184.00 184.00 0.0
tidybot-opt11-strips (13) 349.00 349.00 0.0 349.00 349.00 0.0 349.00 349.00 0.0
tidybot-opt14-strips (6) 163.00 163.00 0.0 163.00 163.00 0.0 163.00 163.00 0.0
tpp (7) 116.00 116.00 0.0 116.00 116.00 0.0 116.00 116.00 0.0
transport-opt08-strips (11) 4707.00 4707.00 0.0 4707.00 4707.00 0.0 4707.00 4707.00 0.0
transport-opt11-strips (6) 2956.00 2956.00 0.0 2956.00 2956.00 0.0 2956.00 2956.00 0.0
transport-opt14-strips (7) 3899.00 3899.00 0.0 3899.00 3899.00 0.0 3899.00 3899.00 0.0
trucks-strips (7) 146.00 146.00 0.0 146.00 146.00 0.0 146.00 146.00 0.0
visitall-opt11-strips (9) 109.00 109.00 0.0 109.00 109.00 0.0 109.00 109.00 0.0
visitall-opt14-strips (4) 104.00 104.00 0.0 104.00 104.00 0.0 104.00 104.00 0.0
woodworking-opt08-strips (12) 2470.00 2470.00 0.0 2470.00 2470.00 0.0 2470.00 2470.00 0.0
woodworking-opt11-strips (7) 1705.00 1705.00 0.0 1705.00 1705.00 0.0 1705.00 1705.00 0.0
zenotravel (12) 147.00 147.00 0.0 147.00 147.00 0.0 147.00 147.00 0.0
Sum (849) 17025245.00 17025245.00 17025245.00 17025245.00 17025245.00 17025245.00
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

Only instances where all algorithms have a value for "cost" are considered. Each table entry gives the sum of "cost" for that domain. The last row reports the sum across all domains.

agricola-opt18-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl None None - None None - None None -
p02.pddl None None - None None - None None -
p03.pddl None None - None None - None None -
p04.pddl None None - None None - None None -
p05.pddl None None - None None - None None -
p06.pddl None None - None None - None None -
p07.pddl None None - None None - None None -
p08.pddl None None - None None - None None -
p09.pddl None None - None None - None None -
p10.pddl None None - None None - None None -
p11.pddl None None - None None - None None -
p12.pddl None None - None None - None None -
p13.pddl None None - None None - None None -
p14.pddl None None - None None - None None -
p15.pddl None None - None None - None None -
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
Sum of diffs None None None
Arithmetic mean of diffs None None None

airport

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01-airport1-p1.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
p02-airport1-p1.pddl 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0
p03-airport1-p2.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
p04-airport2-p1.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
p05-airport2-p1.pddl 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0
p06-airport2-p2.pddl 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0
p07-airport2-p2.pddl 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0
p08-airport2-p3.pddl 62.00 62.00 0.0 62.00 62.00 0.0 62.00 62.00 0.0
p09-airport2-p4.pddl 71.00 71.00 0.0 71.00 71.00 0.0 71.00 71.00 0.0
p10-airport3-p1.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p11-airport3-p1.pddl 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0
p12-airport3-p2.pddl 39.00 39.00 0.0 39.00 39.00 0.0 39.00 39.00 0.0
p13-airport3-p2.pddl 37.00 37.00 0.0 37.00 37.00 0.0 37.00 37.00 0.0
p14-airport3-p3.pddl 60.00 60.00 0.0 60.00 60.00 0.0 60.00 60.00 0.0
p15-airport3-p3.pddl 58.00 58.00 0.0 58.00 58.00 0.0 58.00 58.00 0.0
p16-airport3-p4.pddl 79.00 79.00 0.0 79.00 79.00 0.0 79.00 79.00 0.0
p17-airport3-p5.pddl 88.00 88.00 0.0 88.00 88.00 0.0 88.00 88.00 0.0
p18-airport3-p6.pddl None None - None None - None None -
p19-airport3-p6.pddl 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0
p20-airport3-p7.pddl None None - None None - None None -
p21-airport4halfMUC-p2.pddl 101.00 101.00 0.0 101.00 101.00 0.0 101.00 101.00 0.0
p22-airport4halfMUC-p3.pddl 148.00 148.00 0.0 148.00 148.00 0.0 148.00 148.00 0.0
p23-airport4halfMUC-p4.pddl None None - None None - None None -
p24-airport4halfMUC-p4.pddl None None - None None - None None -
p25-airport4halfMUC-p5.pddl None None - None None - None None -
p26-airport4halfMUC-p6.pddl None None - None None - None None -
p27-airport4halfMUC-p6.pddl None None - None None - None None -
p28-airport4halfMUC-p7.pddl None None - None None - None None -
p29-airport4halfMUC-p8.pddl None None - None None - None None -
p30-airport4halfMUC-p8.pddl None None - None None - None None -
p31-airport4halfMUC-p9.pddl None None - None None - None None -
p32-airport4halfMUC-p10.pddl None None - None None - None None -
p33-airport4halfMUC-p10.pddl None None - None None - None None -
p34-airport4halfMUC-p11.pddl None None - None None - None None -
p35-airport4halfMUC-p12.pddl None None - None None - None None -
p36-airport5MUC-p2.pddl 109.00 109.00 0.0 109.00 109.00 0.0 109.00 109.00 0.0
p37-airport5MUC-p3.pddl 142.00 142.00 0.0 142.00 142.00 0.0 142.00 142.00 0.0
p38-airport5MUC-p3.pddl 155.00 155.00 0.0 155.00 155.00 0.0 155.00 155.00 0.0
p39-airport5MUC-p4.pddl None None - None None - None None -
p40-airport5MUC-p4.pddl None None - None None - None None -
p41-airport5MUC-p4.pddl None None - None None - None None -
p42-airport5MUC-p5.pddl None None - None None - None None -
p43-airport5MUC-p5.pddl None None - None None - None None -
p44-airport5MUC-p5.pddl None None - None None - None None -
p45-airport5MUC-p6.pddl None None - None None - None None -
p46-airport5MUC-p6.pddl None None - None None - None None -
p47-airport5MUC-p8.pddl None None - None None - None None -
p48-airport5MUC-p9.pddl None None - None None - None None -
p49-airport5MUC-p10.pddl None None - None None - None None -
p50-airport5MUC-p15.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

barman-opt11-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
pfile01-001.pddl 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0
pfile01-002.pddl 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0
pfile01-003.pddl 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0
pfile01-004.pddl 90.00 90.00 0.0 90.00 90.00 0.0 90.00 90.00 0.0
pfile02-005.pddl None None - None None - None None -
pfile02-006.pddl None None - None None - None None -
pfile02-007.pddl None None - None None - None None -
pfile02-008.pddl None None - None None - None None -
pfile03-009.pddl None None - None None - None None -
pfile03-010.pddl None None - None None - None None -
pfile03-011.pddl None None - None None - None None -
pfile03-012.pddl None None - None None - None None -
pfile04-013.pddl None None - None None - None None -
pfile04-014.pddl None None - None None - None None -
pfile04-015.pddl None None - None None - None None -
pfile04-016.pddl None None - None None - None None -
pfile05-017.pddl None None - None None - None None -
pfile05-018.pddl None None - None None - None None -
pfile05-019.pddl None None - None None - None None -
pfile05-020.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

barman-opt14-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p435-1.pddl None None - None None - None None -
p435-2.pddl None None - None None - None None -
p435-3.pddl None None - None None - None None -
p536-1.pddl None None - None None - None None -
p536-2.pddl None None - None None - None None -
p536-3.pddl None None - None None - None None -
p638-1.pddl None None - None None - None None -
p638-2.pddl None None - None None - None None -
p638-3.pddl None None - None None - None None -
p739-1.pddl None None - None None - None None -
p739-2.pddl None None - None None - None None -
p739-3.pddl None None - None None - None None -
p839-1.pddl None None - None None - None None -
p839-2.pddl None None - None None - None None -
Sum of diffs None None None
Arithmetic mean of diffs None None None

blocks

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
probBLOCKS-4-0.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
probBLOCKS-4-1.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
probBLOCKS-4-2.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
probBLOCKS-5-0.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
probBLOCKS-5-1.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
probBLOCKS-5-2.pddl 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0
probBLOCKS-6-0.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
probBLOCKS-6-1.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
probBLOCKS-6-2.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probBLOCKS-7-0.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probBLOCKS-7-1.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
probBLOCKS-7-2.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probBLOCKS-8-0.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
probBLOCKS-8-1.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probBLOCKS-8-2.pddl 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0
probBLOCKS-9-0.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
probBLOCKS-9-1.pddl 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0
probBLOCKS-9-2.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
probBLOCKS-10-0.pddl 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
probBLOCKS-10-1.pddl 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0
probBLOCKS-10-2.pddl 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
probBLOCKS-11-0.pddl 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0
probBLOCKS-11-1.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
probBLOCKS-11-2.pddl 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
probBLOCKS-12-0.pddl 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
probBLOCKS-12-1.pddl 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
probBLOCKS-13-0.pddl None None - None None - None None -
probBLOCKS-13-1.pddl None None - None None - None None -
probBLOCKS-14-0.pddl 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
probBLOCKS-14-1.pddl 36.00 36.00 0.0 36.00 36.00 0.0 36.00 36.00 0.0
probBLOCKS-15-0.pddl None None - None None - None None -
probBLOCKS-15-1.pddl None None - None None - None None -
probBLOCKS-16-1.pddl None None - None None - None None -
probBLOCKS-16-2.pddl None None - None None - None None -
probBLOCKS-17-0.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

childsnack-opt14-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
child-snack_pfile01-2.pddl None None - None None - None None -
child-snack_pfile01.pddl None None - None None - None None -
child-snack_pfile02-2.pddl None None - None None - None None -
child-snack_pfile02.pddl None None - None None - None None -
child-snack_pfile03-2.pddl None None - None None - None None -
child-snack_pfile03.pddl None None - None None - None None -
child-snack_pfile04-2.pddl None None - None None - None None -
child-snack_pfile04.pddl None None - None None - None None -
child-snack_pfile05-2.pddl None None - None None - None None -
child-snack_pfile05.pddl None None - None None - None None -
child-snack_pfile06-2.pddl None None - None None - None None -
child-snack_pfile06.pddl None None - None None - None None -
child-snack_pfile07-2.pddl None None - None None - None None -
child-snack_pfile07.pddl None None - None None - None None -
child-snack_pfile08-2.pddl None None - None None - None None -
child-snack_pfile08.pddl None None - None None - None None -
child-snack_pfile09-2.pddl None None - None None - None None -
child-snack_pfile09.pddl None None - None None - None None -
child-snack_pfile10-2.pddl None None - None None - None None -
child-snack_pfile10.pddl None None - None None - None None -
Sum of diffs None None None
Arithmetic mean of diffs None None None

data-network-opt18-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 105.00 105.00 0.0 105.00 105.00 0.0 105.00 105.00 0.0
p02.pddl 73.00 73.00 0.0 73.00 73.00 0.0 73.00 73.00 0.0
p03.pddl 78.00 78.00 0.0 78.00 78.00 0.0 78.00 78.00 0.0
p04.pddl 121.00 121.00 0.0 None None - 121.00 121.00 0.0
p05.pddl None None - None None - None None -
p06.pddl None None - None None - None None -
p07.pddl None None - None None - None None -
p08.pddl None None - None None - None None -
p09.pddl 73.00 73.00 0.0 73.00 73.00 0.0 73.00 73.00 0.0
p10.pddl 105.00 105.00 0.0 105.00 105.00 0.0 105.00 105.00 0.0
p11.pddl 47.00 47.00 0.0 47.00 47.00 0.0 47.00 47.00 0.0
p12.pddl 62.00 62.00 0.0 62.00 62.00 0.0 62.00 62.00 0.0
p13.pddl 104.00 104.00 0.0 104.00 104.00 0.0 104.00 104.00 0.0
p14.pddl None None - None None - None None -
p15.pddl 50.00 50.00 0.0 50.00 50.00 0.0 50.00 50.00 0.0
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

depot

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
p02.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
p03.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
p04.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
p05.pddl None None - None None - None None -
p06.pddl None None - None None - None None -
p07.pddl 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0
p08.pddl None None - None None - None None -
p09.pddl None None - None None - None None -
p10.pddl 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0
p11.pddl None None - None None - None None -
p12.pddl None None - None None - None None -
p13.pddl 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
p14.pddl None None - None None - None None -
p15.pddl None None - None None - None None -
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
p21.pddl None None - None None - None None -
p22.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

driverlog

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
p02.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
p03.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
p04.pddl 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0
p05.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p06.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
p07.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
p08.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
p09.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
p10.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
p11.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
p12.pddl None None - None None - None None -
p13.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
p14.pddl 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0
p15.pddl None None - None None - None None -
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

elevators-opt08-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0
p02.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
p03.pddl 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0
p04.pddl 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0
p05.pddl 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0
p06.pddl 53.00 53.00 0.0 53.00 53.00 0.0 53.00 53.00 0.0
p07.pddl None None - None None - 62.00 62.00 0.0
p08.pddl 53.00 53.00 0.0 None None - None None -
p09.pddl None None - None None - None None -
p10.pddl None None - None None - None None -
p11.pddl 56.00 56.00 0.0 56.00 56.00 0.0 56.00 56.00 0.0
p12.pddl 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0
p13.pddl 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0
p14.pddl 63.00 63.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0
p15.pddl 66.00 66.00 0.0 66.00 66.00 0.0 66.00 66.00 0.0
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
p21.pddl 48.00 48.00 0.0 48.00 48.00 0.0 48.00 48.00 0.0
p22.pddl 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0
p23.pddl 69.00 69.00 0.0 69.00 69.00 0.0 69.00 69.00 0.0
p24.pddl 56.00 56.00 0.0 None None - 56.00 56.00 0.0
p25.pddl 63.00 63.00 0.0 None None - 63.00 63.00 0.0
p26.pddl 48.00 48.00 0.0 None None - 48.00 48.00 0.0
p27.pddl None None - None None - None None -
p28.pddl None None - None None - None None -
p29.pddl None None - None None - None None -
p30.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

elevators-opt11-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 56.00 56.00 0.0 56.00 56.00 0.0 56.00 56.00 0.0
p02.pddl 48.00 48.00 0.0 48.00 48.00 0.0 48.00 48.00 0.0
p03.pddl 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0
p04.pddl 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0
p05.pddl 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0
p06.pddl 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0
p07.pddl 48.00 48.00 0.0 None None - 48.00 48.00 0.0
p08.pddl 55.00 55.00 0.0 55.00 55.00 0.0 55.00 55.00 0.0
p09.pddl 54.00 54.00 0.0 54.00 54.00 0.0 54.00 54.00 0.0
p10.pddl 63.00 63.00 0.0 63.00 63.00 0.0 63.00 63.00 0.0
p11.pddl None None - None None - None None -
p12.pddl 53.00 53.00 0.0 53.00 53.00 0.0 53.00 53.00 0.0
p13.pddl None None - None None - 62.00 62.00 0.0
p14.pddl 53.00 53.00 0.0 None None - None None -
p15.pddl None None - None None - None None -
p16.pddl 66.00 66.00 0.0 66.00 66.00 0.0 66.00 66.00 0.0
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl 69.00 69.00 0.0 69.00 69.00 0.0 69.00 69.00 0.0
p20.pddl 56.00 56.00 0.0 None None - 56.00 56.00 0.0
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

floortile-opt11-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
opt-p01-001.pddl 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
opt-p01-002.pddl 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0
opt-p02-003.pddl 62.00 62.00 0.0 62.00 62.00 0.0 62.00 62.00 0.0
opt-p02-004.pddl 53.00 53.00 0.0 53.00 53.00 0.0 53.00 53.00 0.0
opt-p03-005.pddl 58.00 58.00 0.0 58.00 58.00 0.0 None None -
opt-p03-006.pddl 60.00 60.00 0.0 60.00 60.00 0.0 None None -
opt-p04-007.pddl None None - None None - None None -
opt-p04-008.pddl None None - None None - None None -
opt-p05-009.pddl None None - None None - None None -
opt-p05-010.pddl None None - None None - None None -
opt-p06-011.pddl None None - None None - None None -
opt-p06-012.pddl None None - None None - None None -
opt-p07-013.pddl None None - None None - None None -
opt-p07-014.pddl None None - None None - None None -
opt-p08-015.pddl None None - None None - None None -
opt-p08-016.pddl None None - None None - None None -
opt-p09-017.pddl None None - None None - None None -
opt-p09-018.pddl None None - None None - None None -
opt-p10-019.pddl None None - None None - None None -
opt-p10-020.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

floortile-opt14-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01-4-3-2.pddl 56.00 56.00 0.0 56.00 56.00 0.0 56.00 56.00 0.0
p01-4-4-2.pddl None None - None None - None None -
p01-5-3-2.pddl None None - None None - None None -
p01-5-4-2.pddl None None - None None - None None -
p01-5-5-2.pddl None None - None None - None None -
p01-6-4-2.pddl None None - None None - None None -
p01-6-5-2.pddl None None - None None - None None -
p02-4-4-2.pddl None None - None None - None None -
p02-5-3-2.pddl None None - None None - None None -
p02-5-4-2.pddl None None - None None - None None -
p02-5-5-2.pddl None None - None None - None None -
p02-6-4-2.pddl None None - None None - None None -
p02-6-5-2.pddl None None - None None - None None -
p03-4-3-2.pddl 56.00 56.00 0.0 56.00 56.00 0.0 56.00 56.00 0.0
p03-4-4-2.pddl None None - None None - None None -
p03-5-3-2.pddl None None - None None - None None -
p03-5-4-2.pddl None None - None None - None None -
p03-5-5-2.pddl None None - None None - None None -
p03-6-4-2.pddl None None - None None - None None -
p03-6-5-2.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

freecell

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
p02.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
p03.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p04.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
p05.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
p06.pddl None None - None None - None None -
p07.pddl None None - None None - None None -
p08.pddl None None - None None - None None -
p09.pddl None None - None None - None None -
p10.pddl None None - None None - None None -
p11.pddl None None - None None - None None -
p12.pddl None None - None None - None None -
p13.pddl None None - None None - None None -
p14.pddl None None - None None - None None -
p15.pddl None None - None None - None None -
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
probfreecell-2-1.pddl 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0
probfreecell-2-2.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-3.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-4.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-5.pddl 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0
probfreecell-3-1.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
probfreecell-3-2.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
probfreecell-3-3.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
probfreecell-3-4.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
probfreecell-3-5.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
probfreecell-4-1.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
probfreecell-4-2.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
probfreecell-4-3.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
probfreecell-4-4.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
probfreecell-4-5.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
probfreecell-5-1.pddl None None - None None - None None -
probfreecell-5-2.pddl None None - None None - None None -
probfreecell-5-3.pddl None None - None None - None None -
probfreecell-5-4.pddl None None - None None - None None -
probfreecell-5-5.pddl None None - None None - None None -
probfreecell-6-1.pddl None None - None None - None None -
probfreecell-6-2.pddl None None - None None - None None -
probfreecell-6-3.pddl None None - None None - None None -
probfreecell-6-4.pddl None None - None None - None None -
probfreecell-6-5.pddl None None - None None - None None -
probfreecell-7-1.pddl None None - None None - None None -
probfreecell-7-2.pddl None None - None None - None None -
probfreecell-7-3.pddl None None - None None - None None -
probfreecell-7-4.pddl None None - None None - None None -
probfreecell-7-5.pddl None None - None None - None None -
probfreecell-8-1.pddl None None - None None - None None -
probfreecell-8-2.pddl None None - None None - None None -
probfreecell-8-3.pddl None None - None None - None None -
probfreecell-8-4.pddl None None - None None - None None -
probfreecell-8-5.pddl None None - None None - None None -
probfreecell-9-1.pddl None None - None None - None None -
probfreecell-9-2.pddl None None - None None - None None -
probfreecell-9-3.pddl None None - None None - None None -
probfreecell-9-4.pddl None None - None None - None None -
probfreecell-9-5.pddl None None - None None - None None -
probfreecell-10-1.pddl None None - None None - None None -
probfreecell-10-2.pddl None None - None None - None None -
probfreecell-10-3.pddl None None - None None - None None -
probfreecell-10-4.pddl None None - None None - None None -
probfreecell-10-5.pddl None None - None None - None None -
probfreecell-11-1.pddl None None - None None - None None -
probfreecell-11-2.pddl None None - None None - None None -
probfreecell-11-3.pddl None None - None None - None None -
probfreecell-11-4.pddl None None - None None - None None -
probfreecell-11-5.pddl None None - None None - None None -
probfreecell-12-1.pddl None None - None None - None None -
probfreecell-12-2.pddl None None - None None - None None -
probfreecell-12-3.pddl None None - None None - None None -
probfreecell-12-4.pddl None None - None None - None None -
probfreecell-12-5.pddl None None - None None - None None -
probfreecell-13-1.pddl None None - None None - None None -
probfreecell-13-2.pddl None None - None None - None None -
probfreecell-13-3.pddl None None - None None - None None -
probfreecell-13-4.pddl None None - None None - None None -
probfreecell-13-5.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

ged-opt14-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
d-1-2.pddl 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0
d-1-3.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-1-4.pddl 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0
d-1-8.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-2-1.pddl 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0
d-2-3.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
d-2-4.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
d-2-8.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
d-3-1.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-3-2.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
d-3-4.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
d-4-2.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
d-4-3.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
d-4-8.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
d-7-5.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-7-6.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-8-1.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
d-8-2.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
d-8-4.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
d-8-9.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

grid

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
prob01.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
prob02.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
prob03.pddl None None - None None - None None -
prob04.pddl None None - None None - None None -
prob05.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

gripper

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
prob01.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
prob02.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
prob03.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
prob04.pddl 29.00 29.00 0.0 29.00 29.00 0.0 29.00 29.00 0.0
prob05.pddl 35.00 35.00 0.0 35.00 35.00 0.0 35.00 35.00 0.0
prob06.pddl 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0
prob07.pddl 47.00 47.00 0.0 47.00 47.00 0.0 47.00 47.00 0.0
prob08.pddl 53.00 53.00 0.0 53.00 53.00 0.0 53.00 53.00 0.0
prob09.pddl 59.00 59.00 0.0 59.00 59.00 0.0 59.00 59.00 0.0
prob10.pddl 65.00 65.00 0.0 65.00 65.00 0.0 65.00 65.00 0.0
prob11.pddl 71.00 71.00 0.0 71.00 71.00 0.0 71.00 71.00 0.0
prob12.pddl 77.00 77.00 0.0 77.00 77.00 0.0 77.00 77.00 0.0
prob13.pddl 83.00 83.00 0.0 83.00 83.00 0.0 83.00 83.00 0.0
prob14.pddl 89.00 89.00 0.0 89.00 89.00 0.0 89.00 89.00 0.0
prob15.pddl 95.00 95.00 0.0 95.00 95.00 0.0 95.00 95.00 0.0
prob16.pddl 101.00 101.00 0.0 101.00 101.00 0.0 101.00 101.00 0.0
prob17.pddl 107.00 107.00 0.0 107.00 107.00 0.0 107.00 107.00 0.0
prob18.pddl 113.00 113.00 0.0 113.00 113.00 0.0 113.00 113.00 0.0
prob19.pddl 119.00 119.00 0.0 119.00 119.00 0.0 119.00 119.00 0.0
prob20.pddl 125.00 125.00 0.0 125.00 125.00 0.0 125.00 125.00 0.0
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

hiking-opt14-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
ptesting-1-2-3.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
ptesting-1-2-4.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
ptesting-1-2-5.pddl 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
ptesting-1-2-7.pddl 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
ptesting-1-2-8.pddl 45.00 45.00 0.0 45.00 45.00 0.0 45.00 45.00 0.0
ptesting-2-2-3.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
ptesting-2-2-4.pddl 16.00 16.00 0.0 16.00 16.00 0.0 16.00 16.00 0.0
ptesting-2-2-5.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
ptesting-2-2-6.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
ptesting-2-2-7.pddl 34.00 34.00 0.0 None None - 34.00 34.00 0.0
ptesting-2-2-8.pddl None None - None None - None None -
ptesting-2-3-4.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
ptesting-2-3-5.pddl 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0
ptesting-2-3-6.pddl None None - None None - None None -
ptesting-2-3-7.pddl None None - None None - None None -
ptesting-2-4-3.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
ptesting-2-4-4.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
ptesting-2-4-5.pddl None None - None None - None None -
ptesting-2-4-6.pddl None None - None None - None None -
ptesting-2-4-7.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

logistics00

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
probLOGISTICS-4-0.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
probLOGISTICS-4-1.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
probLOGISTICS-4-2.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
probLOGISTICS-5-0.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
probLOGISTICS-5-1.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
probLOGISTICS-5-2.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
probLOGISTICS-6-0.pddl 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
probLOGISTICS-6-1.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
probLOGISTICS-6-2.pddl 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
probLOGISTICS-6-9.pddl 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0
probLOGISTICS-7-0.pddl 36.00 36.00 0.0 36.00 36.00 0.0 36.00 36.00 0.0
probLOGISTICS-7-1.pddl 44.00 44.00 0.0 44.00 44.00 0.0 44.00 44.00 0.0
probLOGISTICS-8-0.pddl 31.00 31.00 0.0 31.00 31.00 0.0 31.00 31.00 0.0
probLOGISTICS-8-1.pddl 44.00 44.00 0.0 44.00 44.00 0.0 44.00 44.00 0.0
probLOGISTICS-9-0.pddl 36.00 36.00 0.0 36.00 36.00 0.0 36.00 36.00 0.0
probLOGISTICS-9-1.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
probLOGISTICS-10-0.pddl 45.00 45.00 0.0 45.00 45.00 0.0 45.00 45.00 0.0
probLOGISTICS-10-1.pddl 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0
probLOGISTICS-11-0.pddl 48.00 48.00 0.0 48.00 48.00 0.0 48.00 48.00 0.0
probLOGISTICS-11-1.pddl None None - None None - None None -
probLOGISTICS-12-0.pddl 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0
probLOGISTICS-12-1.pddl None None - None None - None None -
probLOGISTICS-13-0.pddl None None - None None - None None -
probLOGISTICS-13-1.pddl None None - None None - None None -
probLOGISTICS-14-0.pddl None None - None None - None None -
probLOGISTICS-14-1.pddl None None - None None - None None -
probLOGISTICS-15-0.pddl None None - None None - None None -
probLOGISTICS-15-1.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

logistics98

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
prob01.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
prob02.pddl None None - None None - None None -
prob03.pddl None None - None None - None None -
prob04.pddl None None - None None - None None -
prob05.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
prob06.pddl None None - None None - None None -
prob07.pddl None None - None None - None None -
prob08.pddl None None - None None - None None -
prob09.pddl None None - None None - None None -
prob10.pddl None None - None None - None None -
prob11.pddl None None - None None - None None -
prob12.pddl None None - None None - None None -
prob13.pddl None None - None None - None None -
prob14.pddl None None - None None - None None -
prob15.pddl None None - None None - None None -
prob16.pddl None None - None None - None None -
prob17.pddl None None - None None - None None -
prob18.pddl None None - None None - None None -
prob19.pddl None None - None None - None None -
prob20.pddl None None - None None - None None -
prob21.pddl None None - None None - None None -
prob22.pddl None None - None None - None None -
prob23.pddl None None - None None - None None -
prob24.pddl None None - None None - None None -
prob25.pddl None None - None None - None None -
prob26.pddl None None - None None - None None -
prob27.pddl None None - None None - None None -
prob28.pddl None None - None None - None None -
prob29.pddl None None - None None - None None -
prob30.pddl None None - None None - None None -
prob31.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
prob32.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
prob33.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
prob34.pddl None None - None None - None None -
prob35.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

miconic

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
s1-0.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-1.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
s1-2.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-3.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s1-4.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
s2-0.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s2-1.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s2-2.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s2-3.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s2-4.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
s3-0.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
s3-1.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
s3-2.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
s3-3.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
s3-4.pddl 10.00 10.00 0.0 10.00 10.00 0.0 10.00 10.00 0.0
s4-0.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
s4-1.pddl 13.00 13.00 0.0 13.00 13.00 0.0 13.00 13.00 0.0
s4-2.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
s4-3.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
s4-4.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
s5-0.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
s5-1.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
s5-2.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
s5-3.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
s5-4.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
s6-0.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
s6-1.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
s6-2.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
s6-3.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
s6-4.pddl 21.00 21.00 0.0 21.00 21.00 0.0 21.00 21.00 0.0
s7-0.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
s7-1.pddl 24.00 24.00 0.0 24.00 24.00 0.0 24.00 24.00 0.0
s7-2.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
s7-3.pddl 22.00 22.00 0.0 22.00 22.00 0.0 22.00 22.00 0.0
s7-4.pddl 25.00 25.00 0.0 25.00 25.00 0.0 25.00 25.00 0.0
s8-0.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
s8-1.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
s8-2.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
s8-3.pddl 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0
s8-4.pddl 27.00 27.00 0.0 27.00 27.00 0.0 27.00 27.00 0.0
s9-0.pddl 31.00 31.00 0.0 31.00 31.00 0.0 31.00 31.00 0.0
s9-1.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
s9-2.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
s9-3.pddl 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0
s9-4.pddl 28.00 28.00 0.0 28.00 28.00 0.0 28.00 28.00 0.0
s10-0.pddl 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0
s10-1.pddl 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0
s10-2.pddl 32.00 32.00 0.0 32.00 32.00 0.0 32.00 32.00 0.0
s10-3.pddl 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
s10-4.pddl 33.00 33.00 0.0 33.00 33.00 0.0 33.00 33.00 0.0
s11-0.pddl 37.00 37.00 0.0 37.00 37.00 0.0 37.00 37.00 0.0
s11-1.pddl 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
s11-2.pddl 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
s11-3.pddl 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
s11-4.pddl 35.00 35.00 0.0 35.00 35.00 0.0 35.00 35.00 0.0
s12-0.pddl 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0
s12-1.pddl 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0
s12-2.pddl 40.00 40.00 0.0 40.00 40.00 0.0 40.00 40.00 0.0
s12-3.pddl 39.00 39.00 0.0 39.00 39.00 0.0 39.00 39.00 0.0
s12-4.pddl 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0
s13-0.pddl 44.00 44.00 0.0 44.00 44.00 0.0 44.00 44.00 0.0
s13-1.pddl 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0
s13-2.pddl 46.00 46.00 0.0 46.00 46.00 0.0 46.00 46.00 0.0
s13-3.pddl 43.00 43.00 0.0 43.00 43.00 0.0 43.00 43.00 0.0
s13-4.pddl 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0
s14-0.pddl 45.00 45.00 0.0 45.00 45.00 0.0 45.00 45.00 0.0
s14-1.pddl 47.00 47.00 0.0 47.00 47.00 0.0 47.00 47.00 0.0
s14-2.pddl 49.00 49.00 0.0 49.00 49.00 0.0 49.00 49.00 0.0
s14-3.pddl 42.00 42.00 0.0 42.00 42.00 0.0 42.00 42.00 0.0
s14-4.pddl 45.00 45.00 0.0 45.00 45.00 0.0 45.00 45.00 0.0
s15-0.pddl 46.00 46.00 0.0 46.00 46.00 0.0 46.00 46.00 0.0
s15-1.pddl None None - None None - 50.00 50.00 0.0
s15-2.pddl None None - None None - 50.00 50.00 0.0
s15-3.pddl 50.00 50.00 0.0 50.00 50.00 0.0 50.00 50.00 0.0
s15-4.pddl None None - None None - 47.00 47.00 0.0
s16-0.pddl None None - None None - 53.00 53.00 0.0
s16-1.pddl None None - None None - None None -
s16-2.pddl None None - None None - 55.00 55.00 0.0
s16-3.pddl None None - None None - 52.00 52.00 0.0
s16-4.pddl None None - None None - None None -
s17-0.pddl None None - None None - None None -
s17-1.pddl None None - None None - None None -
s17-2.pddl None None - None None - None None -
s17-3.pddl None None - None None - None None -
s17-4.pddl None None - None None - 55.00 55.00 0.0
s18-0.pddl None None - None None - None None -
s18-1.pddl None None - None None - None None -
s18-2.pddl None None - None None - None None -
s18-3.pddl None None - None None - None None -
s18-4.pddl None None - None None - None None -
s19-0.pddl None None - None None - None None -
s19-1.pddl None None - None None - None None -
s19-2.pddl None None - None None - None None -
s19-3.pddl None None - None None - 64.00 64.00 0.0
s19-4.pddl None None - None None - None None -
s20-0.pddl None None - None None - None None -
s20-1.pddl None None - None None - None None -
s20-2.pddl None None - None None - None None -
s20-3.pddl None None - None None - None None -
s20-4.pddl None None - None None - None None -
s21-0.pddl None None - None None - None None -
s21-1.pddl None None - None None - None None -
s21-2.pddl None None - None None - None None -
s21-3.pddl None None - None None - None None -
s21-4.pddl None None - None None - None None -
s22-0.pddl None None - None None - None None -
s22-1.pddl None None - None None - None None -
s22-2.pddl None None - None None - None None -
s22-3.pddl None None - None None - None None -
s22-4.pddl None None - None None - None None -
s23-0.pddl None None - None None - None None -
s23-1.pddl None None - None None - None None -
s23-2.pddl None None - None None - None None -
s23-3.pddl None None - None None - None None -
s23-4.pddl None None - None None - None None -
s24-0.pddl None None - None None - None None -
s24-1.pddl None None - None None - None None -
s24-2.pddl None None - None None - None None -
s24-3.pddl None None - None None - None None -
s24-4.pddl None None - None None - None None -
s25-0.pddl None None - None None - None None -
s25-1.pddl None None - None None - None None -
s25-2.pddl None None - None None - None None -
s25-3.pddl None None - None None - None None -
s25-4.pddl None None - None None - None None -
s26-0.pddl None None - None None - None None -
s26-1.pddl None None - None None - None None -
s26-2.pddl None None - None None - None None -
s26-3.pddl None None - None None - None None -
s26-4.pddl None None - None None - None None -
s27-0.pddl None None - None None - None None -
s27-1.pddl None None - None None - None None -
s27-2.pddl None None - None None - None None -
s27-3.pddl None None - None None - None None -
s27-4.pddl None None - None None - None None -
s28-0.pddl None None - None None - None None -
s28-1.pddl None None - None None - None None -
s28-2.pddl None None - None None - None None -
s28-3.pddl None None - None None - None None -
s28-4.pddl None None - None None - None None -
s29-0.pddl None None - None None - None None -
s29-1.pddl None None - None None - None None -
s29-2.pddl None None - None None - None None -
s29-3.pddl None None - None None - None None -
s29-4.pddl None None - None None - None None -
s30-0.pddl None None - None None - None None -
s30-1.pddl None None - None None - None None -
s30-2.pddl None None - None None - None None -
s30-3.pddl None None - None None - None None -
s30-4.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

movie

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
prob01.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob02.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob03.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob04.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob05.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob06.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob07.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob08.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob09.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob10.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob11.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob12.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob13.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob14.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob15.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob16.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob17.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob18.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob19.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob20.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob21.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob22.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob23.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob24.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob25.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob26.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob27.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob28.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob29.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob30.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

mprime

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
prob01.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob02.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob03.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob04.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
prob05.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
prob06.pddl None None - None None - None None -
prob07.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob08.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob09.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
prob10.pddl None None - None None - None None -
prob11.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob12.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob13.pddl None None - None None - None None -
prob14.pddl None None - None None - None None -
prob15.pddl None None - None None - None None -
prob16.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob17.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob18.pddl None None - None None - None None -
prob19.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob20.pddl None None - None None - None None -
prob21.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob22.pddl None None - None None - None None -
prob23.pddl None None - None None - None None -
prob24.pddl None None - None None - None None -
prob25.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob26.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob27.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob28.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob29.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob30.pddl None None - None None - None None -
prob31.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob32.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob33.pddl None None - None None - None None -
prob34.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob35.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

mystery

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
prob01.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob02.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob03.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob04.pddl None None - None None - None None -
prob05.pddl None None - None None - None None -
prob06.pddl 11.00 11.00 0.0 None None - None None -
prob07.pddl None None - None None - None None -
prob08.pddl None None - None None - None None -
prob09.pddl 8.00 8.00 0.0 8.00 8.00 0.0 8.00 8.00 0.0
prob10.pddl None None - 8.00 8.00 0.0 8.00 8.00 0.0
prob11.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob12.pddl None None - None None - None None -
prob13.pddl None None - None None - None None -
prob14.pddl None None - None None - None None -
prob15.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob16.pddl None None - None None - None None -
prob17.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob18.pddl None None - None None - None None -
prob19.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob20.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob21.pddl None None - None None - None None -
prob22.pddl None None - None None - None None -
prob23.pddl None None - None None - None None -
prob24.pddl None None - None None - None None -
prob25.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob26.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
prob27.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
prob28.pddl 7.00 7.00 0.0 7.00 7.00 0.0 7.00 7.00 0.0
prob29.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
prob30.pddl 9.00 9.00 0.0 9.00 9.00 0.0 9.00 9.00 0.0
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

nomystery-opt11-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 11.00 11.00 0.0 11.00 11.00 0.0 11.00 11.00 0.0
p02.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
p03.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
p04.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
p05.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
p06.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
p07.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
p08.pddl 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
p09.pddl None None - None None - None None -
p10.pddl 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
p11.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
p12.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
p13.pddl 15.00 15.00 0.0 15.00 15.00 0.0 15.00 15.00 0.0
p14.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
p15.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
p16.pddl 26.00 26.00 0.0 26.00 26.00 0.0 26.00 26.00 0.0
p17.pddl 30.00 30.00 0.0 30.00 30.00 0.0 30.00 30.00 0.0
p18.pddl 34.00 34.00 0.0 34.00 34.00 0.0 34.00 34.00 0.0
p19.pddl None None - None None - None None -
p20.pddl 38.00 38.00 0.0 38.00 38.00 0.0 38.00 38.00 0.0
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

openstacks-opt08-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p02.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p03.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p04.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p05.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p06.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p07.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
p08.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
p09.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p10.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p11.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p12.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p13.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p14.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p15.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p16.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p17.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p18.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p19.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p20.pddl None None - None None - None None -
p21.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p22.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p23.pddl None None - None None - None None -
p24.pddl None None - None None - None None -
p25.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p26.pddl None None - None None - None None -
p27.pddl None None - None None - None None -
p28.pddl None None - None None - None None -
p29.pddl None None - None None - None None -
p30.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

openstacks-opt11-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p02.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
p03.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
p04.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p05.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p06.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p07.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p08.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p09.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p10.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p11.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p12.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p13.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p14.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p15.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p16.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

openstacks-opt14-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p20_1.pddl 3.00 3.00 0.0 3.00 3.00 0.0 3.00 3.00 0.0
p20_2.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p20_3.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
p25_1.pddl None None - None None - None None -
p25_3.pddl None None - None None - None None -
p30_1.pddl None None - None None - None None -
p30_2.pddl None None - None None - None None -
p30_3.pddl None None - None None - None None -
p35_1.pddl None None - None None - None None -
p35_2.pddl None None - None None - None None -
p35_3.pddl None None - None None - None None -
p40_1.pddl None None - None None - None None -
p40_2.pddl None None - None None - None None -
p40_3.pddl None None - None None - None None -
p45_1.pddl None None - None None - None None -
p45_2.pddl None None - None None - None None -
p45_3.pddl None None - None None - None None -
p50_1.pddl None None - None None - None None -
p50_2.pddl None None - None None - None None -
p50_3.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

openstacks-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
p02.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
p03.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
p04.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
p05.pddl 23.00 23.00 0.0 23.00 23.00 0.0 23.00 23.00 0.0
p06.pddl 45.00 45.00 0.0 45.00 45.00 0.0 45.00 45.00 0.0
p07.pddl 46.00 46.00 0.0 46.00 46.00 0.0 46.00 46.00 0.0
p08.pddl None None - None None - None None -
p09.pddl None None - None None - None None -
p10.pddl None None - None None - None None -
p11.pddl None None - None None - None None -
p12.pddl None None - None None - None None -
p13.pddl None None - None None - None None -
p14.pddl None None - None None - None None -
p15.pddl None None - None None - None None -
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
p21.pddl None None - None None - None None -
p22.pddl None None - None None - None None -
p23.pddl None None - None None - None None -
p24.pddl None None - None None - None None -
p25.pddl None None - None None - None None -
p26.pddl None None - None None - None None -
p27.pddl None None - None None - None None -
p28.pddl None None - None None - None None -
p29.pddl None None - None None - None None -
p30.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

organic-synthesis-opt18-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0
p02.pddl 1.00 1.00 0.0 1.00 1.00 0.0 1.00 1.00 0.0
p03.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p04.pddl None None - None None - None None -
p05.pddl None None - None None - None None -
p06.pddl None None - None None - None None -
p07.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p08.pddl None None - None None - None None -
p09.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p10.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p11.pddl None None - None None - None None -
p12.pddl None None - None None - None None -
p13.pddl None None - None None - None None -
p14.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p15.pddl None None - None None - None None -
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

organic-synthesis-split-opt18-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0
p02.pddl 41.00 41.00 0.0 41.00 41.00 0.0 41.00 41.00 0.0
p03.pddl 252.00 252.00 0.0 252.00 252.00 0.0 252.00 252.00 0.0
p04.pddl 252.00 252.00 0.0 None 252.00 - 252.00 252.00 0.0
p05.pddl None None - None None - None None -
p06.pddl None None - None None - None None -
p07.pddl 252.00 252.00 0.0 252.00 252.00 0.0 252.00 252.00 0.0
p08.pddl None None - None None - None None -
p09.pddl 82.00 82.00 0.0 82.00 82.00 0.0 82.00 82.00 0.0
p10.pddl 82.00 82.00 0.0 82.00 82.00 0.0 82.00 82.00 0.0
p11.pddl None None - None None - None None -
p12.pddl None None - None None - None None -
p13.pddl None None - None None - None None -
p14.pddl 82.00 82.00 0.0 82.00 82.00 0.0 82.00 82.00 0.0
p15.pddl None None - None None - None None -
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

parcprinter-08-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 169009.00 169009.00 0.0 169009.00 169009.00 0.0 169009.00 169009.00 0.0
p02.pddl 438047.00 438047.00 0.0 438047.00 438047.00 0.0 438047.00 438047.00 0.0
p03.pddl 807114.00 807114.00 0.0 807114.00 807114.00 0.0 807114.00 807114.00 0.0
p04.pddl 876094.00 876094.00 0.0 876094.00 876094.00 0.0 876094.00 876094.00 0.0
p05.pddl 1145132.00 1145132.00 0.0 1145132.00 1145132.00 0.0 1145132.00 1145132.00 0.0
p06.pddl 1514199.00 1514199.00 0.0 1514199.00 1514199.00 0.0 1514199.00 1514199.00 0.0
p07.pddl None None - None None - 1383121.00 1383121.00 0.0
p08.pddl None None - None None - 1852217.00 1852217.00 0.0
p09.pddl None None - None None - 2121255.00 2121255.00 0.0
p10.pddl None None - None None - 2490322.00 2490322.00 0.0
p11.pddl 182808.00 182808.00 0.0 182808.00 182808.00 0.0 182808.00 182808.00 0.0
p12.pddl 510256.00 510256.00 0.0 510256.00 510256.00 0.0 510256.00 510256.00 0.0
p13.pddl 693064.00 693064.00 0.0 693064.00 693064.00 0.0 693064.00 693064.00 0.0
p14.pddl 1020512.00 1020512.00 0.0 1020512.00 1020512.00 0.0 1020512.00 1020512.00 0.0
p15.pddl None None - None None - 1695507.00 1695507.00 0.0
p16.pddl None None - None None - 1675408.00 1675408.00 0.0
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
p21.pddl 143411.00 143411.00 0.0 143411.00 143411.00 0.0 143411.00 143411.00 0.0
p22.pddl 375821.00 375821.00 0.0 375821.00 375821.00 0.0 375821.00 375821.00 0.0
p23.pddl 519232.00 519232.00 0.0 519232.00 519232.00 0.0 519232.00 519232.00 0.0
p24.pddl 751642.00 751642.00 0.0 751642.00 751642.00 0.0 751642.00 751642.00 0.0
p25.pddl None None - 1215839.00 1215839.00 0.0 1215839.00 1215839.00 0.0
p26.pddl None None - 1216462.00 1216462.00 0.0 1216462.00 1216462.00 0.0
p27.pddl None None - None None - 1270874.00 1270874.00 0.0
p28.pddl None None - None None - 1681282.00 1681282.00 0.0
p29.pddl None None - None None - 2377265.00 2377265.00 0.0
p30.pddl None None - None None - 2021893.00 2021893.00 0.0
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

parcprinter-opt11-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 375821.00 375821.00 0.0 375821.00 375821.00 0.0 375821.00 375821.00 0.0
p02.pddl 438047.00 438047.00 0.0 438047.00 438047.00 0.0 438047.00 438047.00 0.0
p03.pddl 510256.00 510256.00 0.0 510256.00 510256.00 0.0 510256.00 510256.00 0.0
p04.pddl 876094.00 876094.00 0.0 876094.00 876094.00 0.0 876094.00 876094.00 0.0
p05.pddl 519232.00 519232.00 0.0 519232.00 519232.00 0.0 519232.00 519232.00 0.0
p06.pddl 1514199.00 1514199.00 0.0 1514199.00 1514199.00 0.0 1514199.00 1514199.00 0.0
p07.pddl 1145132.00 1145132.00 0.0 1145132.00 1145132.00 0.0 1145132.00 1145132.00 0.0
p08.pddl 751642.00 751642.00 0.0 751642.00 751642.00 0.0 751642.00 751642.00 0.0
p09.pddl 693064.00 693064.00 0.0 693064.00 693064.00 0.0 693064.00 693064.00 0.0
p10.pddl None None - 1215839.00 1215839.00 0.0 1215839.00 1215839.00 0.0
p11.pddl None None - 1216462.00 1216462.00 0.0 1216462.00 1216462.00 0.0
p12.pddl 1020512.00 1020512.00 0.0 1020512.00 1020512.00 0.0 1020512.00 1020512.00 0.0
p13.pddl None None - None None - 1383121.00 1383121.00 0.0
p14.pddl None None - None None - 1852217.00 1852217.00 0.0
p15.pddl None None - None None - 2121255.00 2121255.00 0.0
p16.pddl None None - None None - 2490322.00 2490322.00 0.0
p17.pddl None None - None None - 1695507.00 1695507.00 0.0
p18.pddl None None - None None - 1675408.00 1675408.00 0.0
p19.pddl None None - None None - None None -
p20.pddl None None - None None - 1270874.00 1270874.00 0.0
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

parking-opt11-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
pfile03-011.pddl 14.00 14.00 0.0 14.00 14.00 0.0 14.00 14.00 0.0
pfile03-012.pddl 20.00 20.00 0.0 20.00 20.00 0.0 20.00 20.00 0.0
pfile04-013.pddl None None - None None - None None -
pfile04-014.pddl None None - None None - None None -
pfile04-015.pddl None None - None None - None None -
pfile04-016.pddl None None - None None - None None -
pfile05-017.pddl None None - None None - None None -
pfile05-018.pddl None None - None None - None None -
pfile05-019.pddl None None - None None - None None -
pfile05-020.pddl None None - None None - None None -
pfile06-021.pddl None None - None None - None None -
pfile06-022.pddl None None - None None - None None -
pfile06-023.pddl None None - None None - None None -
pfile06-024.pddl None None - None None - None None -
pfile07-025.pddl None None - None None - None None -
pfile07-026.pddl None None - None None - None None -
pfile07-027.pddl None None - None None - None None -
pfile07-028.pddl None None - None None - None None -
pfile08-029.pddl None None - None None - None None -
pfile08-030.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

parking-opt14-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p_12_7-01.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p_12_7-02.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p_12_7-03.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
p_12_7-04.pddl 19.00 19.00 0.0 19.00 19.00 0.0 19.00 19.00 0.0
p_14_8-01.pddl None None - None None - None None -
p_14_8-02.pddl None None - None None - None None -
p_14_8-03.pddl None None - None None - None None -
p_14_8-04.pddl None None - None None - None None -
p_16_9-01.pddl None None - None None - None None -
p_16_9-02.pddl None None - None None - None None -
p_16_9-03.pddl None None - None None - None None -
p_16_9-04.pddl None None - None None - None None -
p_18_10-01.pddl None None - None None - None None -
p_18_10-02.pddl None None - None None - None None -
p_18_10-03.pddl None None - None None - None None -
p_18_10-04.pddl None None - None None - None None -
p_20_11-01.pddl None None - None None - None None -
p_20_11-02.pddl None None - None None - None None -
p_20_11-03.pddl None None - None None - None None -
p_20_11-04.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

pathways-noneg

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 6.00 6.00 0.0 6.00 6.00 0.0 6.00 6.00 0.0
p02.pddl 12.00 12.00 0.0 12.00 12.00 0.0 12.00 12.00 0.0
p03.pddl 18.00 18.00 0.0 18.00 18.00 0.0 18.00 18.00 0.0
p04.pddl 17.00 17.00 0.0 17.00 17.00 0.0 17.00 17.00 0.0
p05.pddl None None - None None - None None -
p06.pddl None None - None None - None None -
p07.pddl None None - None None - None None -
p08.pddl None None - None None - None None -
p09.pddl None None - None None - None None -
p10.pddl None None - None None - None None -
p11.pddl None None - None None - None None -
p12.pddl None None - None None - None None -
p13.pddl None None - None None - None None -
p14.pddl None None - None None - None None -
p15.pddl None None - None None - None None -
p16.pddl None None - None None - None None -
p17.pddl None None - None None - None None -
p18.pddl None None - None None - None None -
p19.pddl None None - None None - None None -
p20.pddl None None - None None - None None -
p21.pddl None None - None None - None None -
p22.pddl None None - None None - None None -
p23.pddl None None - None None - None None -
p24.pddl None None - None None - None None -
p25.pddl None None - None None - None None -
p26.pddl None None - None None - None None -
p27.pddl None None - None None - None None -
p28.pddl None None - None None - None None -
p29.pddl None None - None None - None None -
p30.pddl None None - None None - None None -
Sum of diffs 0.00 0.00 0.00
Arithmetic mean of diffs 0.00 0.00 0.00

pegsol-08-strips

cost issue927-v1-dfp-b50k-t900 issue927-v2-dfp-b50k-t900 Diff (dfp-b50k-t900) issue927-v1-rl-b50k-t900 issue927-v2-rl-b50k-t900 Diff (rl-b50k-t900) issue927-v1-sccs-dfp-b50k-t900 issue927-v2-sccs-dfp-b50k-t900 Diff (sccs-dfp-b50k-t900)
p01.pddl 2.00 2.00 0.0 2.00 2.00 0.0 2.00 2.00 0.0
p02.pddl 5.00 5.00 0.0 5.00 5.00 0.0 5.00 5.00 0.0
p03.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00 4.00 0.0
p04.pddl 4.00 4.00 0.0 4.00 4.00 0.0 4.00