issue999-optimal-compare

2021-06-28

unexplained-errors

Contents of /infai/kellert/fast-downward/fork-fast-downward/experiments/issue999/data/issue999-optimal-grid-steps/slurm.err without "memory cg" errors:

slurmstepd: error: Unable to unlink domain socket: No such file or directory
slurmstepd: error: Unable to unlink domain socket: No such file or directory

Unexplained errors domain problem algorithm unexplained_errors error planner_wall_clock_time raw_memory node
runs-00801-00900/00896 organic-synthesis-opt18-strips p12.pddl issue999-base-seq-opt-bjolp ['segfault', 'output-to-slurm.err'] segfault 134.63 ? ase36.cluster.bc2.ch
runs-00901-01000/00938 parcprinter-08-strips p14.pddl issue999-base-seq-opt-bjolp ['driver.err: 2021-06-25 17:30:33,493 ERROR    planner finished and wrote 1322.2587890625 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
success 49.91 387612 ase48.cluster.bc2.ch
runs-00901-01000/00939 parcprinter-08-strips p15.pddl issue999-base-seq-opt-bjolp ['driver.err: 2021-06-25 15:36:31,212 ERROR    planner finished and wrote 2653.25 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
search-out-of-memory 603.32 3655468 ase33.cluster.bc2.ch
runs-00901-01000/00966 parcprinter-opt11-strips p12.pddl issue999-base-seq-opt-bjolp ['driver.err: 2021-06-25 14:36:28,422 ERROR    planner finished and wrote 1322.236328125 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
success 50.03 387612 ase35.cluster.bc2.ch
runs-00901-01000/00971 parcprinter-opt11-strips p17.pddl issue999-base-seq-opt-bjolp ['driver.err: 2021-06-25 17:51:16,973 ERROR    planner finished and wrote 2653.2958984375 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
search-out-of-memory 601.75 3655468 ase43.cluster.bc2.ch
runs-02701-02800/02765 parcprinter-08-strips p14.pddl issue999-v1-seq-opt-bjolp ['driver.err: 2021-06-25 14:56:11,613 ERROR    planner finished and wrote 1322.3046875 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
success 52.13 387580 ase53.cluster.bc2.ch
runs-02701-02800/02766 parcprinter-08-strips p15.pddl issue999-v1-seq-opt-bjolp ['driver.err: 2021-06-25 15:54:59,872 ERROR    planner finished and wrote 2653.302734375 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
search-out-of-memory 620.97 3655604 ase40.cluster.bc2.ch
runs-02701-02800/02793 parcprinter-opt11-strips p12.pddl issue999-v1-seq-opt-bjolp ['driver.err: 2021-06-25 15:59:35,729 ERROR    planner finished and wrote 1322.271484375 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
success 53.23 387580 ase54.cluster.bc2.ch
runs-02701-02800/02798 parcprinter-opt11-strips p17.pddl issue999-v1-seq-opt-bjolp ['driver.err: 2021-06-25 13:10:19,853 ERROR    planner finished and wrote 2653.2861328125 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
search-out-of-memory 661.36 3655604 ase42.cluster.bc2.ch
runs-04501-04600/04550 organic-synthesis-opt18-strips p12.pddl issue999-v4-seq-opt-bjolp ['segfault', 'output-to-slurm.err'] segfault 134.79 ? ase47.cluster.bc2.ch
runs-04501-04600/04592 parcprinter-08-strips p14.pddl issue999-v4-seq-opt-bjolp ['driver.err: 2021-06-25 17:42:06,053 ERROR    planner finished and wrote 1322.283203125 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
success 51.65 387548 ase54.cluster.bc2.ch
runs-04501-04600/04593 parcprinter-08-strips p15.pddl issue999-v4-seq-opt-bjolp ['driver.err: 2021-06-25 15:17:42,501 ERROR    planner finished and wrote 2653.251953125 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
search-out-of-memory 602.96 3655484 ase38.cluster.bc2.ch
runs-04601-04700/04620 parcprinter-opt11-strips p12.pddl issue999-v4-seq-opt-bjolp ['driver.err: 2021-06-25 16:33:16,441 ERROR    planner finished and wrote 1322.3125 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
success 52.35 387548 ase54.cluster.bc2.ch
runs-04601-04700/04625 parcprinter-opt11-strips p17.pddl issue999-v4-seq-opt-bjolp ['driver.err: 2021-06-25 13:53:47,325 ERROR    planner finished and wrote 2653.26953125 KiB to run.log (soft limit: 1024.0 KiB)
', 'output-to-slurm.err']
search-out-of-memory 608.32 3655484 ase50.cluster.bc2.ch

info

algorithm local_revision global_revision driver_options
issue999-base-seq-opt-bjolp issue999-base b99b577ce79c39fd65760b1c90a0236ae652d843 ['--validate', '--overall-time-limit', '30m', '--overall-memory-limit', '3584M', '--alias', 'seq-opt-bjolp']
issue999-v1-seq-opt-bjolp issue999-v1 79aaffcecf79eba1b672905531acef636e699b1e ['--validate', '--overall-time-limit', '30m', '--overall-memory-limit', '3584M', '--alias', 'seq-opt-bjolp']
issue999-v4-seq-opt-bjolp issue999-v4 46201125e80dfd2f7e0f22ddc66d92dd23568ae7 ['--validate', '--overall-time-limit', '30m', '--overall-memory-limit', '3584M', '--alias', 'seq-opt-bjolp']

Used nodes: {ase31, ..., ase50, ase53, ase54}

summary

Summary issue999-base-seq-opt-bjolp issue999-v1-seq-opt-bjolp Diff issue999-base-seq-opt-bjolp issue999-v4-seq-opt-bjolp Diff
cost - Sum 19466446.00 19466446.00 0.0 19466446.00 19466446.00 0.0
coverage - Sum 980 980 0.0 980 980 0.0
error-search-out-of-memory - Sum 485 485 0.0 485 479 -6.0
error-search-out-of-time - Sum 345 345 0.0 345 351 6.0
error-search-unsolvable-incomplete - Sum 4 4 0.0 4 4 0.0
error-segfault - Sum 1 0 -1.0 1 1 0.0
error-success - Sum 980 980 0.0 980 980 0.0
error-translate-out-of-memory - Sum 12 13 1.0 12 12 0.0
evaluations - Geometric mean 69436.12 69436.12 0.0 69436.12 69436.12 0.0
expansions - Geometric mean 0.00 0.00 0.0 0.00 0.00 0.0
expansions_until_last_jump - Sum 1087493808 1087493808 0.0 1087493808 1087493808 0.0
generated - Geometric mean 0.00 0.00 0.0 0.00 0.00 0.0
initial_h_value - Finite sum 57898416 57898416 0.0 57898416 57898416 0.0
landmarks - Sum 164317 164317 0.0 164317 164312 -5.0
landmarks_disjunctive - Sum 8988 8988 0.0 8988 8988 0.0
lmgraph_generation_time - Sum 1532.06 1375.55 -156.5 1532.06 1465.82 -66.24
memory - Sum 221729452 221729484 32.0 221729452 221732208 2756.0
orderings - Sum 1794254 1794254 0.0 1794254 1794249 -5.0
score_evaluations - Sum 434.63 434.63 0.0 434.63 434.63 0.0
score_expansions - Sum 529.43 529.43 0.0 529.43 529.43 0.0
score_generated - Sum 392.44 392.44 0.0 392.44 392.44 0.0
score_memory - Sum 471.27 471.27 0.0 471.27 471.27 -0.0
score_search_time - Sum 799.57 798.77 -0.8 799.57 798.13 -1.44
score_total_time - Sum 798.21 797.42 -0.79 798.21 796.77 -1.44
search_time - Geometric mean 1.35 1.36 0.01 1.35 1.37 0.02
total_time - Geometric mean 1.66 1.68 0.01 1.66 1.69 0.02

cost

Only instances where all algorithms have a value for "cost" are considered. Each table entry gives the sum of "cost" for that domain. The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

coverage

The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

error

error-search-out-of-memory

error-search-out-of-time

error-search-unsolvable-incomplete

error-segfault

error-success

error-translate-out-of-memory

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

evaluations

Only instances where all algorithms have a value for "evaluations" are considered. Each table entry gives the geometric mean of "evaluations" for that domain. The bottom row reports the geometric mean across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

expansions

Only instances where all algorithms have a value for "expansions" are considered. Each table entry gives the geometric mean of "expansions" for that domain. The bottom row reports the geometric mean across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

expansions_until_last_jump

Only instances where all algorithms have a value for "expansions_until_last_jump" are considered. Each table entry gives the sum of "expansions_until_last_jump" for that domain. The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

generated

Only instances where all algorithms have a value for "generated" are considered. Each table entry gives the geometric mean of "generated" for that domain. The bottom row reports the geometric mean across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

initial_h_value

Only instances where all algorithms have a value for "initial_h_value" are considered. Each table entry gives the finite sum of "initial_h_value" for that domain. The bottom row reports the finite sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

landmarks

Only instances where all algorithms have a value for "landmarks" are considered. Each table entry gives the sum of "landmarks" for that domain. The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

landmarks_disjunctive

Only instances where all algorithms have a value for "landmarks_disjunctive" are considered. Each table entry gives the sum of "landmarks_disjunctive" for that domain. The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

lmgraph_generation_time

Only instances where all algorithms have a value for "lmgraph_generation_time" are considered. Each table entry gives the sum of "lmgraph_generation_time" for that domain. The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

memory

Only instances where all algorithms have a value for "memory" are considered. Each table entry gives the sum of "memory" for that domain. The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

orderings

Only instances where all algorithms have a value for "orderings" are considered. Each table entry gives the sum of "orderings" for that domain. The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

run_dir

Domain-wise reports only support numeric attributes, but run_dir has type str.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

score_evaluations

The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

score_expansions

The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

score_generated

The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

score_memory

The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

score_search_time

The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

score_total_time

The bottom row reports the sum across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

search_time

Only instances where all algorithms have a value for "search_time" are considered. Each table entry gives the geometric mean of "search_time" for that domain. The bottom row reports the geometric mean across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel

total_time

Only instances where all algorithms have a value for "total_time" are considered. Each table entry gives the geometric mean of "total_time" for that domain. The bottom row reports the geometric mean across all domains.

agricola-opt18-strips

airport

barman-opt11-strips

barman-opt14-strips

blocks

childsnack-opt14-strips

data-network-opt18-strips

depot

driverlog

elevators-opt08-strips

elevators-opt11-strips

floortile-opt11-strips

floortile-opt14-strips

freecell

ged-opt14-strips

grid

gripper

hiking-opt14-strips

logistics00

logistics98

miconic

movie

mprime

mystery

nomystery-opt11-strips

openstacks-opt08-strips

openstacks-opt11-strips

openstacks-opt14-strips

openstacks-strips

organic-synthesis-opt18-strips

organic-synthesis-split-opt18-strips

parcprinter-08-strips

parcprinter-opt11-strips

parking-opt11-strips

parking-opt14-strips

pathways-noneg

pegsol-08-strips

pegsol-opt11-strips

petri-net-alignment-opt18-strips

pipesworld-notankage

pipesworld-tankage

psr-small

rovers

satellite

scanalyzer-08-strips

scanalyzer-opt11-strips

snake-opt18-strips

sokoban-opt08-strips

sokoban-opt11-strips

spider-opt18-strips

storage

termes-opt18-strips

tetris-opt14-strips

tidybot-opt11-strips

tidybot-opt14-strips

tpp

transport-opt08-strips

transport-opt11-strips

transport-opt14-strips

trucks-strips

visitall-opt11-strips

visitall-opt14-strips

woodworking-opt08-strips

woodworking-opt11-strips

zenotravel