unexplained-errors
Hide table
Unexplained errors
domain
problem
algorithm
unexplained_errors
error
planner_wall_clock_time
raw_memory
node
runs-00801-00900/00895
organic-synthesis-opt18-strips
p11.pddl
issue995-base-lama-first
['segfault']
segfault
215.72
?
ase44.cluster.bc2.ch
runs-00801-00900/00896
organic-synthesis-opt18-strips
p12.pddl
issue995-base-lama-first
['segfault']
segfault
133.68
?
ase51.cluster.bc2.ch
runs-02501-02600/02568
mystery
prob07.pddl
issue995-base-lm_zg
['exitcode-248']
exitcode-248
0.20
?
ase48.cluster.bc2.ch
runs-02501-02600/02579
mystery
prob18.pddl
issue995-base-lm_zg
['exitcode-248']
exitcode-248
0.45
?
ase33.cluster.bc2.ch
runs-02701-02800/02722
organic-synthesis-opt18-strips
p11.pddl
issue995-base-lm_zg
['segfault']
segfault
212.59
?
ase52.cluster.bc2.ch
runs-04501-04600/04550
organic-synthesis-opt18-strips
p12.pddl
issue995-v1-lama-first
['segfault']
segfault
138.69
?
ase35.cluster.bc2.ch
runs-06201-06300/06222
mystery
prob07.pddl
issue995-v1-lm_zg
['exitcode-248']
exitcode-248
0.22
?
ase37.cluster.bc2.ch
runs-06201-06300/06233
mystery
prob18.pddl
issue995-v1-lm_zg
['exitcode-248']
exitcode-248
0.41
?
ase45.cluster.bc2.ch
info
Hide table
algorithm
local_revision
global_revision
revision_summary
driver_options
component_options
issue995-base-lama-first
issue995-base
fa9f31b
fa9f31b
['--validate', '--overall-time-limit', '30m', '--overall-memory-limit', '3584M', '--alias', 'lama-first']
None
issue995-base-lm_zg
issue995-base
fa9f31b
fa9f31b
['--validate', '--overall-time-limit', '30m', '--overall-memory-limit', '3584M']
['--search', 'eager_greedy([lmcount(lm_zg())])']
issue995-v1-lama-first
issue995-v1
37987b9
37987b9
['--validate', '--overall-time-limit', '30m', '--overall-memory-limit', '3584M', '--alias', 'lama-first']
None
issue995-v1-lm_zg
issue995-v1
37987b9
37987b9
['--validate', '--overall-time-limit', '30m', '--overall-memory-limit', '3584M']
['--search', 'eager_greedy([lmcount(lm_zg())])']
Used nodes: {ase31, ..., ase54}
cost
Show table
Only instances where all algorithms have a value for "cost" are considered. Each table entry gives the sum of "cost" for that domain. The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1115.00 1115.00 0.0 1116.00 1116.00 0.0
p02.pddl
1116.00 1116.00 0.0 1116.00 1116.00 0.0
p03.pddl
1115.00 1115.00 0.0 1116.00 1116.00 0.0
p04.pddl
1367.00 1367.00 0.0 1365.00 1365.00 0.0
p05.pddl
1364.00 1364.00 0.0 1365.00 1365.00 0.0
p06.pddl
1364.00 1364.00 0.0 1365.00 1365.00 0.0
p07.pddl
1614.00 1614.00 0.0 1615.00 1615.00 0.0
p08.pddl
1613.00 1613.00 0.0 1613.00 1613.00 0.0
p09.pddl
1613.00 1613.00 0.0 1613.00 1613.00 0.0
p10.pddl
1740.00 1740.00 0.0 1740.00 1740.00 0.0
p11.pddl
1740.00 1740.00 0.0 1740.00 1740.00 0.0
p12.pddl
1744.00 1744.00 0.0 1741.00 1741.00 0.0
p13.pddl
1867.00 1867.00 0.0 1866.00 1866.00 0.0
p14.pddl
1867.00 1867.00 0.0 1868.00 1868.00 0.0
p15.pddl
1866.00 1866.00 0.0 1868.00 1868.00 0.0
p16.pddl
1994.00 1994.00 0.0 1995.00 1995.00 0.0
p17.pddl
1996.00 1996.00 0.0 1993.00 1993.00 0.0
p18.pddl
1995.00 1995.00 0.0 1996.00 1996.00 0.0
p19.pddl
2121.00 2121.00 0.0 2121.00 2121.00 0.0
p20.pddl
2122.00 2122.00 0.0 2118.00 2118.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
airport
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
8.00 8.00 0.0 8.00 8.00 0.0
p02-airport1-p1.pddl
9.00 9.00 0.0 9.00 9.00 0.0
p03-airport1-p2.pddl
17.00 17.00 0.0 17.00 17.00 0.0
p04-airport2-p1.pddl
20.00 20.00 0.0 20.00 20.00 0.0
p05-airport2-p1.pddl
23.00 23.00 0.0 21.00 21.00 0.0
p06-airport2-p2.pddl
43.00 43.00 0.0 41.00 41.00 0.0
p07-airport2-p2.pddl
43.00 43.00 0.0 43.00 43.00 0.0
p08-airport2-p3.pddl
66.00 66.00 0.0 64.00 64.00 0.0
p09-airport2-p4.pddl
75.00 75.00 0.0 75.00 75.00 0.0
p10-airport3-p1.pddl
18.00 18.00 0.0 18.00 18.00 0.0
p11-airport3-p1.pddl
23.00 23.00 0.0 21.00 21.00 0.0
p12-airport3-p2.pddl
41.00 41.00 0.0 39.00 39.00 0.0
p13-airport3-p2.pddl
37.00 37.00 0.0 39.00 39.00 0.0
p14-airport3-p3.pddl
64.00 64.00 0.0 60.00 60.00 0.0
p15-airport3-p3.pddl
62.00 62.00 0.0 62.00 62.00 0.0
p16-airport3-p4.pddl
83.00 83.00 0.0 83.00 83.00 0.0
p17-airport3-p5.pddl
92.00 92.00 0.0 92.00 92.00 0.0
p18-airport3-p6.pddl
113.00 113.00 0.0 111.00 111.00 0.0
p19-airport3-p6.pddl
94.00 94.00 0.0 92.00 92.00 0.0
p20-airport3-p7.pddl
121.00 121.00 0.0 119.00 119.00 0.0
p21-airport4halfMUC-p2.pddl
101.00 101.00 0.0 101.00 101.00 0.0
p22-airport4halfMUC-p3.pddl
148.00 148.00 0.0 148.00 148.00 0.0
p23-airport4halfMUC-p4.pddl
168.00 168.00 0.0 168.00 168.00 0.0
p24-airport4halfMUC-p4.pddl
164.00 164.00 0.0 162.00 162.00 0.0
p25-airport4halfMUC-p5.pddl
214.00 214.00 0.0 None None -
p26-airport4halfMUC-p6.pddl
None None - None None -
p27-airport4halfMUC-p6.pddl
250.00 250.00 0.0 None None -
p28-airport4halfMUC-p7.pddl
None None - None None -
p29-airport4halfMUC-p8.pddl
None None - None None -
p30-airport4halfMUC-p8.pddl
None None - None None -
p31-airport4halfMUC-p9.pddl
None None - None None -
p32-airport4halfMUC-p10.pddl
None None - None None -
p33-airport4halfMUC-p10.pddl
None None - None None -
p34-airport4halfMUC-p11.pddl
None None - None None -
p35-airport4halfMUC-p12.pddl
None None - None None -
p36-airport5MUC-p2.pddl
111.00 111.00 0.0 109.00 109.00 0.0
p37-airport5MUC-p3.pddl
184.00 184.00 0.0 214.00 214.00 0.0
p38-airport5MUC-p3.pddl
220.00 220.00 0.0 155.00 155.00 0.0
p39-airport5MUC-p4.pddl
214.00 214.00 0.0 None None -
p40-airport5MUC-p4.pddl
195.00 195.00 0.0 263.00 263.00 0.0
p41-airport5MUC-p4.pddl
244.00 244.00 0.0 None None -
p42-airport5MUC-p5.pddl
None None - None None -
p43-airport5MUC-p5.pddl
291.00 291.00 0.0 240.00 240.00 0.0
p44-airport5MUC-p5.pddl
231.00 231.00 0.0 None None -
p45-airport5MUC-p6.pddl
None None - None None -
p46-airport5MUC-p6.pddl
None None - None None -
p47-airport5MUC-p8.pddl
None None - None None -
p48-airport5MUC-p9.pddl
None None - None None -
p49-airport5MUC-p10.pddl
None None - None None -
p50-airport5MUC-p15.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
102.00 102.00 0.0 104.00 104.00 0.0
pfile01-002.pddl
104.00 104.00 0.0 99.00 99.00 0.0
pfile01-003.pddl
104.00 104.00 0.0 99.00 99.00 0.0
pfile01-004.pddl
104.00 104.00 0.0 99.00 99.00 0.0
pfile02-005.pddl
142.00 142.00 0.0 130.00 130.00 0.0
pfile02-006.pddl
138.00 138.00 0.0 130.00 130.00 0.0
pfile02-007.pddl
135.00 135.00 0.0 130.00 130.00 0.0
pfile02-008.pddl
134.00 134.00 0.0 130.00 130.00 0.0
pfile03-009.pddl
167.00 167.00 0.0 161.00 161.00 0.0
pfile03-010.pddl
192.00 192.00 0.0 161.00 161.00 0.0
pfile03-011.pddl
168.00 168.00 0.0 161.00 161.00 0.0
pfile03-012.pddl
180.00 180.00 0.0 161.00 161.00 0.0
pfile04-013.pddl
232.00 232.00 0.0 203.00 203.00 0.0
pfile04-014.pddl
220.00 220.00 0.0 193.00 193.00 0.0
pfile04-015.pddl
214.00 214.00 0.0 208.00 208.00 0.0
pfile04-016.pddl
214.00 214.00 0.0 203.00 203.00 0.0
pfile05-017.pddl
245.00 245.00 0.0 229.00 229.00 0.0
pfile05-018.pddl
243.00 243.00 0.0 224.00 224.00 0.0
pfile05-019.pddl
254.00 254.00 0.0 229.00 229.00 0.0
pfile05-020.pddl
247.00 247.00 0.0 224.00 224.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
63.00 63.00 0.0 58.00 58.00 0.0
p435-2.pddl
65.00 65.00 0.0 58.00 58.00 0.0
p435-3.pddl
63.00 63.00 0.0 58.00 58.00 0.0
p536-1.pddl
77.00 77.00 0.0 76.00 76.00 0.0
p536-2.pddl
97.00 97.00 0.0 71.00 71.00 0.0
p536-3.pddl
77.00 77.00 0.0 71.00 71.00 0.0
p638-1.pddl
108.00 108.00 0.0 86.00 86.00 0.0
p638-2.pddl
99.00 99.00 0.0 85.00 85.00 0.0
p638-3.pddl
100.00 100.00 0.0 90.00 90.00 0.0
p739-1.pddl
126.00 126.00 0.0 99.00 99.00 0.0
p739-2.pddl
126.00 126.00 0.0 104.00 104.00 0.0
p739-3.pddl
127.00 127.00 0.0 104.00 104.00 0.0
p839-1.pddl
121.00 121.00 0.0 120.00 120.00 0.0
p839-2.pddl
141.00 141.00 0.0 110.00 110.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
blocks
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
6.00 6.00 0.0 6.00 6.00 0.0
probBLOCKS-4-1.pddl
10.00 10.00 0.0 20.00 20.00 0.0
probBLOCKS-4-2.pddl
6.00 6.00 0.0 6.00 6.00 0.0
probBLOCKS-5-0.pddl
12.00 12.00 0.0 22.00 22.00 0.0
probBLOCKS-5-1.pddl
10.00 10.00 0.0 30.00 30.00 0.0
probBLOCKS-5-2.pddl
20.00 20.00 0.0 34.00 34.00 0.0
probBLOCKS-6-0.pddl
12.00 12.00 0.0 44.00 44.00 0.0
probBLOCKS-6-1.pddl
10.00 10.00 0.0 10.00 10.00 0.0
probBLOCKS-6-2.pddl
28.00 28.00 0.0 32.00 32.00 0.0
probBLOCKS-7-0.pddl
26.00 26.00 0.0 62.00 62.00 0.0
probBLOCKS-7-1.pddl
28.00 28.00 0.0 56.00 56.00 0.0
probBLOCKS-7-2.pddl
28.00 28.00 0.0 60.00 60.00 0.0
probBLOCKS-8-0.pddl
30.00 30.00 0.0 60.00 60.00 0.0
probBLOCKS-8-1.pddl
24.00 24.00 0.0 64.00 64.00 0.0
probBLOCKS-8-2.pddl
22.00 22.00 0.0 36.00 36.00 0.0
probBLOCKS-9-0.pddl
72.00 72.00 0.0 100.00 100.00 0.0
probBLOCKS-9-1.pddl
76.00 76.00 0.0 100.00 100.00 0.0
probBLOCKS-9-2.pddl
30.00 30.00 0.0 84.00 84.00 0.0
probBLOCKS-10-0.pddl
44.00 44.00 0.0 46.00 46.00 0.0
probBLOCKS-10-1.pddl
44.00 44.00 0.0 98.00 98.00 0.0
probBLOCKS-10-2.pddl
38.00 38.00 0.0 108.00 108.00 0.0
probBLOCKS-11-0.pddl
46.00 46.00 0.0 96.00 96.00 0.0
probBLOCKS-11-1.pddl
38.00 38.00 0.0 134.00 134.00 0.0
probBLOCKS-11-2.pddl
64.00 64.00 0.0 88.00 88.00 0.0
probBLOCKS-12-0.pddl
74.00 74.00 0.0 102.00 102.00 0.0
probBLOCKS-12-1.pddl
52.00 52.00 0.0 108.00 108.00 0.0
probBLOCKS-13-0.pddl
82.00 82.00 0.0 130.00 130.00 0.0
probBLOCKS-13-1.pddl
104.00 104.00 0.0 130.00 130.00 0.0
probBLOCKS-14-0.pddl
76.00 76.00 0.0 128.00 128.00 0.0
probBLOCKS-14-1.pddl
42.00 42.00 0.0 164.00 164.00 0.0
probBLOCKS-15-0.pddl
142.00 142.00 0.0 160.00 160.00 0.0
probBLOCKS-15-1.pddl
112.00 112.00 0.0 234.00 234.00 0.0
probBLOCKS-16-1.pddl
58.00 58.00 0.0 200.00 200.00 0.0
probBLOCKS-16-2.pddl
236.00 236.00 0.0 182.00 182.00 0.0
probBLOCKS-17-0.pddl
188.00 188.00 0.0 258.00 258.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
childsnack-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
33.00 33.00 0.0 28.00 28.00 0.0
child-snack_pfile01.pddl
33.00 33.00 0.0 28.00 28.00 0.0
child-snack_pfile02-2.pddl
38.00 38.00 0.0 33.00 33.00 0.0
child-snack_pfile02.pddl
38.00 38.00 0.0 33.00 33.00 0.0
child-snack_pfile03-2.pddl
46.00 46.00 0.0 38.00 38.00 0.0
child-snack_pfile03.pddl
44.00 44.00 0.0 38.00 38.00 0.0
child-snack_pfile04-2.pddl
47.00 47.00 0.0 None None -
child-snack_pfile04.pddl
49.00 49.00 0.0 None None -
child-snack_pfile05-2.pddl
56.00 56.00 0.0 None None -
child-snack_pfile05.pddl
53.00 53.00 0.0 None None -
child-snack_pfile06-2.pddl
59.00 59.00 0.0 None None -
child-snack_pfile06.pddl
59.00 59.00 0.0 None None -
child-snack_pfile07-2.pddl
64.00 64.00 0.0 None None -
child-snack_pfile07.pddl
66.00 66.00 0.0 None None -
child-snack_pfile08-2.pddl
69.00 69.00 0.0 None None -
child-snack_pfile08.pddl
None None - None None -
child-snack_pfile09-2.pddl
None None - None None -
child-snack_pfile09.pddl
None None - None None -
child-snack_pfile10-2.pddl
None None - None None -
child-snack_pfile10.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
data-network-opt18-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
125.00 125.00 0.0 105.00 105.00 0.0
p02.pddl
81.00 81.00 0.0 77.00 77.00 0.0
p03.pddl
119.00 119.00 0.0 111.00 111.00 0.0
p04.pddl
176.00 176.00 0.0 150.00 150.00 0.0
p05.pddl
161.00 161.00 0.0 156.00 156.00 0.0
p06.pddl
135.00 135.00 0.0 123.00 123.00 0.0
p07.pddl
216.00 216.00 0.0 192.00 192.00 0.0
p08.pddl
300.00 300.00 0.0 171.00 171.00 0.0
p09.pddl
84.00 84.00 0.0 73.00 73.00 0.0
p10.pddl
143.00 143.00 0.0 143.00 143.00 0.0
p11.pddl
78.00 78.00 0.0 78.00 78.00 0.0
p12.pddl
70.00 70.00 0.0 72.00 72.00 0.0
p13.pddl
129.00 129.00 0.0 129.00 129.00 0.0
p14.pddl
274.00 274.00 0.0 200.00 200.00 0.0
p15.pddl
70.00 70.00 0.0 195.00 195.00 0.0
p16.pddl
383.00 383.00 0.0 348.00 348.00 0.0
p17.pddl
226.00 226.00 0.0 225.00 225.00 0.0
p18.pddl
518.00 518.00 0.0 459.00 459.00 0.0
p19.pddl
354.00 354.00 0.0 216.00 216.00 0.0
p20.pddl
334.00 334.00 0.0 439.00 439.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
depot
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
10.00 10.00 0.0 12.00 12.00 0.0
p02.pddl
16.00 16.00 0.0 16.00 16.00 0.0
p03.pddl
33.00 33.00 0.0 51.00 51.00 0.0
p04.pddl
48.00 48.00 0.0 32.00 32.00 0.0
p05.pddl
218.00 218.00 0.0 50.00 50.00 0.0
p06.pddl
165.00 165.00 0.0 60.00 60.00 0.0
p07.pddl
21.00 21.00 0.0 36.00 36.00 0.0
p08.pddl
59.00 59.00 0.0 41.00 41.00 0.0
p09.pddl
99.00 99.00 0.0 123.00 123.00 0.0
p10.pddl
34.00 34.00 0.0 26.00 26.00 0.0
p11.pddl
76.00 76.00 0.0 53.00 53.00 0.0
p12.pddl
91.00 91.00 0.0 None None -
p13.pddl
28.00 28.00 0.0 27.00 27.00 0.0
p14.pddl
42.00 42.00 0.0 42.00 42.00 0.0
p15.pddl
141.00 141.00 0.0 108.00 108.00 0.0
p16.pddl
27.00 27.00 0.0 35.00 35.00 0.0
p17.pddl
26.00 26.00 0.0 26.00 26.00 0.0
p18.pddl
68.00 68.00 0.0 None None -
p19.pddl
43.00 43.00 0.0 50.00 50.00 0.0
p20.pddl
None None - 76.00 76.00 0.0
p21.pddl
34.00 34.00 0.0 35.00 35.00 0.0
p22.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
driverlog
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
7.00 7.00 0.0 8.00 8.00 0.0
p02.pddl
23.00 23.00 0.0 25.00 25.00 0.0
p03.pddl
13.00 13.00 0.0 14.00 14.00 0.0
p04.pddl
19.00 19.00 0.0 20.00 20.00 0.0
p05.pddl
23.00 23.00 0.0 24.00 24.00 0.0
p06.pddl
17.00 17.00 0.0 15.00 15.00 0.0
p07.pddl
18.00 18.00 0.0 18.00 18.00 0.0
p08.pddl
27.00 27.00 0.0 30.00 30.00 0.0
p09.pddl
56.00 56.00 0.0 25.00 25.00 0.0
p10.pddl
20.00 20.00 0.0 21.00 21.00 0.0
p11.pddl
26.00 26.00 0.0 26.00 26.00 0.0
p12.pddl
40.00 40.00 0.0 44.00 44.00 0.0
p13.pddl
41.00 41.00 0.0 40.00 40.00 0.0
p14.pddl
38.00 38.00 0.0 39.00 39.00 0.0
p15.pddl
48.00 48.00 0.0 46.00 46.00 0.0
p16.pddl
158.00 158.00 0.0 104.00 104.00 0.0
p17.pddl
134.00 134.00 0.0 None None -
p18.pddl
124.00 124.00 0.0 115.00 115.00 0.0
p19.pddl
212.00 212.00 0.0 197.00 197.00 0.0
p20.pddl
210.00 210.00 0.0 149.00 149.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt08-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
80.00 80.00 0.0 58.00 58.00 0.0
p02.pddl
26.00 26.00 0.0 26.00 26.00 0.0
p03.pddl
72.00 72.00 0.0 85.00 85.00 0.0
p04.pddl
104.00 104.00 0.0 97.00 97.00 0.0
p05.pddl
93.00 93.00 0.0 95.00 95.00 0.0
p06.pddl
103.00 103.00 0.0 106.00 106.00 0.0
p07.pddl
134.00 134.00 0.0 134.00 134.00 0.0
p08.pddl
82.00 82.00 0.0 126.00 126.00 0.0
p09.pddl
143.00 143.00 0.0 180.00 180.00 0.0
p10.pddl
99.00 99.00 0.0 93.00 93.00 0.0
p11.pddl
69.00 69.00 0.0 101.00 101.00 0.0
p12.pddl
74.00 74.00 0.0 67.00 67.00 0.0
p13.pddl
130.00 130.00 0.0 104.00 104.00 0.0
p14.pddl
109.00 109.00 0.0 112.00 112.00 0.0
p15.pddl
94.00 94.00 0.0 98.00 98.00 0.0
p16.pddl
155.00 155.00 0.0 128.00 128.00 0.0
p17.pddl
121.00 121.00 0.0 132.00 132.00 0.0
p18.pddl
138.00 138.00 0.0 91.00 91.00 0.0
p19.pddl
169.00 169.00 0.0 193.00 193.00 0.0
p20.pddl
197.00 197.00 0.0 189.00 189.00 0.0
p21.pddl
122.00 122.00 0.0 70.00 70.00 0.0
p22.pddl
134.00 134.00 0.0 68.00 68.00 0.0
p23.pddl
148.00 148.00 0.0 122.00 122.00 0.0
p24.pddl
143.00 143.00 0.0 119.00 119.00 0.0
p25.pddl
106.00 106.00 0.0 125.00 125.00 0.0
p26.pddl
55.00 55.00 0.0 74.00 74.00 0.0
p27.pddl
132.00 132.00 0.0 113.00 113.00 0.0
p28.pddl
141.00 141.00 0.0 159.00 159.00 0.0
p29.pddl
277.00 277.00 0.0 197.00 197.00 0.0
p30.pddl
222.00 222.00 0.0 170.00 170.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
69.00 69.00 0.0 101.00 101.00 0.0
p02.pddl
122.00 122.00 0.0 70.00 70.00 0.0
p03.pddl
74.00 74.00 0.0 67.00 67.00 0.0
p04.pddl
72.00 72.00 0.0 85.00 85.00 0.0
p05.pddl
130.00 130.00 0.0 104.00 104.00 0.0
p06.pddl
104.00 104.00 0.0 97.00 97.00 0.0
p07.pddl
55.00 55.00 0.0 74.00 74.00 0.0
p08.pddl
93.00 93.00 0.0 95.00 95.00 0.0
p09.pddl
134.00 134.00 0.0 68.00 68.00 0.0
p10.pddl
109.00 109.00 0.0 112.00 112.00 0.0
p11.pddl
141.00 141.00 0.0 159.00 159.00 0.0
p12.pddl
103.00 103.00 0.0 106.00 106.00 0.0
p13.pddl
134.00 134.00 0.0 134.00 134.00 0.0
p14.pddl
82.00 82.00 0.0 126.00 126.00 0.0
p15.pddl
143.00 143.00 0.0 180.00 180.00 0.0
p16.pddl
94.00 94.00 0.0 98.00 98.00 0.0
p17.pddl
121.00 121.00 0.0 132.00 132.00 0.0
p18.pddl
138.00 138.00 0.0 91.00 91.00 0.0
p19.pddl
148.00 148.00 0.0 122.00 122.00 0.0
p20.pddl
143.00 143.00 0.0 119.00 119.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
64.00 64.00 0.0 66.00 66.00 0.0
opt-p01-002.pddl
74.00 74.00 0.0 59.00 59.00 0.0
opt-p02-003.pddl
111.00 111.00 0.0 None None -
opt-p02-004.pddl
114.00 114.00 0.0 None None -
opt-p03-005.pddl
104.00 104.00 0.0 None None -
opt-p03-006.pddl
143.00 143.00 0.0 None None -
opt-p04-007.pddl
138.00 138.00 0.0 None None -
opt-p04-008.pddl
166.00 166.00 0.0 None None -
opt-p05-009.pddl
162.00 162.00 0.0 None None -
opt-p05-010.pddl
None None - None None -
opt-p06-011.pddl
None None - None None -
opt-p06-012.pddl
None None - None None -
opt-p07-013.pddl
None None - None None -
opt-p07-014.pddl
None None - None None -
opt-p08-015.pddl
None None - None None -
opt-p08-016.pddl
None None - None None -
opt-p09-017.pddl
None None - None None -
opt-p09-018.pddl
None None - None None -
opt-p10-019.pddl
None None - None None -
opt-p10-020.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
97.00 97.00 0.0 None None -
p01-4-4-2.pddl
128.00 128.00 0.0 None None -
p01-5-3-2.pddl
152.00 152.00 0.0 None None -
p01-5-4-2.pddl
None None - None None -
p01-5-5-2.pddl
None None - None None -
p01-6-4-2.pddl
None None - None None -
p01-6-5-2.pddl
None None - None None -
p02-4-4-2.pddl
147.00 147.00 0.0 None None -
p02-5-3-2.pddl
132.00 132.00 0.0 None None -
p02-5-4-2.pddl
None None - None None -
p02-5-5-2.pddl
None None - None None -
p02-6-4-2.pddl
None None - None None -
p02-6-5-2.pddl
None None - None None -
p03-4-3-2.pddl
141.00 141.00 0.0 None None -
p03-4-4-2.pddl
135.00 135.00 0.0 None None -
p03-5-3-2.pddl
130.00 130.00 0.0 None None -
p03-5-4-2.pddl
188.00 188.00 0.0 None None -
p03-5-5-2.pddl
None None - None None -
p03-6-4-2.pddl
None None - None None -
p03-6-5-2.pddl
None None - None None -
Sum of diffs
0.00
None
Arithmetic mean of diffs
0.00
None
freecell
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
8.00 8.00 0.0 8.00 8.00 0.0
p02.pddl
15.00 15.00 0.0 14.00 14.00 0.0
p03.pddl
18.00 18.00 0.0 22.00 22.00 0.0
p04.pddl
34.00 34.00 0.0 31.00 31.00 0.0
p05.pddl
33.00 33.00 0.0 34.00 34.00 0.0
p06.pddl
44.00 44.00 0.0 41.00 41.00 0.0
p07.pddl
53.00 53.00 0.0 52.00 52.00 0.0
p08.pddl
52.00 52.00 0.0 52.00 52.00 0.0
p09.pddl
52.00 52.00 0.0 55.00 55.00 0.0
p10.pddl
69.00 69.00 0.0 67.00 67.00 0.0
p11.pddl
90.00 90.00 0.0 88.00 88.00 0.0
p12.pddl
57.00 57.00 0.0 52.00 52.00 0.0
p13.pddl
83.00 83.00 0.0 78.00 78.00 0.0
p14.pddl
67.00 67.00 0.0 75.00 75.00 0.0
p15.pddl
99.00 99.00 0.0 76.00 76.00 0.0
p16.pddl
86.00 86.00 0.0 83.00 83.00 0.0
p17.pddl
95.00 95.00 0.0 80.00 80.00 0.0
p18.pddl
109.00 109.00 0.0 104.00 104.00 0.0
p19.pddl
160.00 160.00 0.0 176.00 176.00 0.0
p20.pddl
108.00 108.00 0.0 162.00 162.00 0.0
probfreecell-2-1.pddl
9.00 9.00 0.0 9.00 9.00 0.0
probfreecell-2-2.pddl
8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-3.pddl
8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-4.pddl
8.00 8.00 0.0 8.00 8.00 0.0
probfreecell-2-5.pddl
9.00 9.00 0.0 9.00 9.00 0.0
probfreecell-3-1.pddl
14.00 14.00 0.0 14.00 14.00 0.0
probfreecell-3-2.pddl
13.00 13.00 0.0 13.00 13.00 0.0
probfreecell-3-3.pddl
13.00 13.00 0.0 13.00 13.00 0.0
probfreecell-3-4.pddl
12.00 12.00 0.0 12.00 12.00 0.0
probfreecell-3-5.pddl
14.00 14.00 0.0 14.00 14.00 0.0
probfreecell-4-1.pddl
21.00 21.00 0.0 20.00 20.00 0.0
probfreecell-4-2.pddl
17.00 17.00 0.0 17.00 17.00 0.0
probfreecell-4-3.pddl
18.00 18.00 0.0 18.00 18.00 0.0
probfreecell-4-4.pddl
19.00 19.00 0.0 18.00 18.00 0.0
probfreecell-4-5.pddl
19.00 19.00 0.0 19.00 19.00 0.0
probfreecell-5-1.pddl
26.00 26.00 0.0 27.00 27.00 0.0
probfreecell-5-2.pddl
24.00 24.00 0.0 23.00 23.00 0.0
probfreecell-5-3.pddl
25.00 25.00 0.0 26.00 26.00 0.0
probfreecell-5-4.pddl
25.00 25.00 0.0 26.00 26.00 0.0
probfreecell-5-5.pddl
27.00 27.00 0.0 26.00 26.00 0.0
probfreecell-6-1.pddl
35.00 35.00 0.0 33.00 33.00 0.0
probfreecell-6-2.pddl
29.00 29.00 0.0 30.00 30.00 0.0
probfreecell-6-3.pddl
33.00 33.00 0.0 31.00 31.00 0.0
probfreecell-6-4.pddl
33.00 33.00 0.0 33.00 33.00 0.0
probfreecell-6-5.pddl
39.00 39.00 0.0 36.00 36.00 0.0
probfreecell-7-1.pddl
43.00 43.00 0.0 41.00 41.00 0.0
probfreecell-7-2.pddl
36.00 36.00 0.0 37.00 37.00 0.0
probfreecell-7-3.pddl
37.00 37.00 0.0 38.00 38.00 0.0
probfreecell-7-4.pddl
47.00 47.00 0.0 51.00 51.00 0.0
probfreecell-7-5.pddl
44.00 44.00 0.0 48.00 48.00 0.0
probfreecell-8-1.pddl
57.00 57.00 0.0 54.00 54.00 0.0
probfreecell-8-2.pddl
49.00 49.00 0.0 44.00 44.00 0.0
probfreecell-8-3.pddl
47.00 47.00 0.0 44.00 44.00 0.0
probfreecell-8-4.pddl
49.00 49.00 0.0 50.00 50.00 0.0
probfreecell-8-5.pddl
57.00 57.00 0.0 56.00 56.00 0.0
probfreecell-9-1.pddl
61.00 61.00 0.0 62.00 62.00 0.0
probfreecell-9-2.pddl
58.00 58.00 0.0 58.00 58.00 0.0
probfreecell-9-3.pddl
52.00 52.00 0.0 51.00 51.00 0.0
probfreecell-9-4.pddl
64.00 64.00 0.0 58.00 58.00 0.0
probfreecell-9-5.pddl
66.00 66.00 0.0 61.00 61.00 0.0
probfreecell-10-1.pddl
81.00 81.00 0.0 109.00 109.00 0.0
probfreecell-10-2.pddl
65.00 65.00 0.0 72.00 72.00 0.0
probfreecell-10-3.pddl
66.00 66.00 0.0 75.00 75.00 0.0
probfreecell-10-4.pddl
79.00 79.00 0.0 80.00 80.00 0.0
probfreecell-10-5.pddl
92.00 92.00 0.0 85.00 85.00 0.0
probfreecell-11-1.pddl
92.00 92.00 0.0 126.00 126.00 0.0
probfreecell-11-2.pddl
89.00 89.00 0.0 91.00 91.00 0.0
probfreecell-11-3.pddl
93.00 93.00 0.0 75.00 75.00 0.0
probfreecell-11-4.pddl
92.00 92.00 0.0 88.00 88.00 0.0
probfreecell-11-5.pddl
None None - 104.00 104.00 0.0
probfreecell-12-1.pddl
121.00 121.00 0.0 132.00 132.00 0.0
probfreecell-12-2.pddl
99.00 99.00 0.0 106.00 106.00 0.0
probfreecell-12-3.pddl
88.00 88.00 0.0 88.00 88.00 0.0
probfreecell-12-4.pddl
111.00 111.00 0.0 122.00 122.00 0.0
probfreecell-12-5.pddl
158.00 158.00 0.0 143.00 143.00 0.0
probfreecell-13-1.pddl
172.00 172.00 0.0 150.00 150.00 0.0
probfreecell-13-2.pddl
219.00 219.00 0.0 139.00 139.00 0.0
probfreecell-13-3.pddl
116.00 116.00 0.0 100.00 100.00 0.0
probfreecell-13-4.pddl
148.00 148.00 0.0 126.00 126.00 0.0
probfreecell-13-5.pddl
177.00 177.00 0.0 172.00 172.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
ged-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
1.00 1.00 0.0 1.00 1.00 0.0
d-1-3.pddl
5.00 5.00 0.0 5.00 5.00 0.0
d-1-4.pddl
1.00 1.00 0.0 1.00 1.00 0.0
d-1-8.pddl
5.00 5.00 0.0 5.00 5.00 0.0
d-2-1.pddl
1.00 1.00 0.0 1.00 1.00 0.0
d-2-3.pddl
4.00 4.00 0.0 4.00 4.00 0.0
d-2-4.pddl
3.00 3.00 0.0 3.00 3.00 0.0
d-2-8.pddl
6.00 6.00 0.0 6.00 6.00 0.0
d-3-1.pddl
5.00 5.00 0.0 5.00 5.00 0.0
d-3-2.pddl
4.00 4.00 0.0 4.00 4.00 0.0
d-3-4.pddl
7.00 7.00 0.0 7.00 7.00 0.0
d-4-2.pddl
3.00 3.00 0.0 3.00 3.00 0.0
d-4-3.pddl
7.00 7.00 0.0 7.00 7.00 0.0
d-4-8.pddl
6.00 6.00 0.0 6.00 6.00 0.0
d-7-5.pddl
5.00 5.00 0.0 5.00 5.00 0.0
d-7-6.pddl
4.00 4.00 0.0 4.00 4.00 0.0
d-8-1.pddl
5.00 5.00 0.0 5.00 5.00 0.0
d-8-2.pddl
6.00 6.00 0.0 6.00 6.00 0.0
d-8-4.pddl
6.00 6.00 0.0 6.00 6.00 0.0
d-8-9.pddl
9.00 9.00 0.0 9.00 9.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
grid
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
14.00 14.00 0.0 17.00 17.00 0.0
prob02.pddl
32.00 32.00 0.0 40.00 40.00 0.0
prob03.pddl
75.00 75.00 0.0 None None -
prob04.pddl
53.00 53.00 0.0 49.00 49.00 0.0
prob05.pddl
167.00 167.00 0.0 172.00 172.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
gripper
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
11.00 11.00 0.0 15.00 15.00 0.0
prob02.pddl
17.00 17.00 0.0 23.00 23.00 0.0
prob03.pddl
23.00 23.00 0.0 31.00 31.00 0.0
prob04.pddl
29.00 29.00 0.0 39.00 39.00 0.0
prob05.pddl
35.00 35.00 0.0 47.00 47.00 0.0
prob06.pddl
41.00 41.00 0.0 55.00 55.00 0.0
prob07.pddl
47.00 47.00 0.0 63.00 63.00 0.0
prob08.pddl
53.00 53.00 0.0 71.00 71.00 0.0
prob09.pddl
59.00 59.00 0.0 79.00 79.00 0.0
prob10.pddl
65.00 65.00 0.0 87.00 87.00 0.0
prob11.pddl
71.00 71.00 0.0 95.00 95.00 0.0
prob12.pddl
77.00 77.00 0.0 103.00 103.00 0.0
prob13.pddl
83.00 83.00 0.0 111.00 111.00 0.0
prob14.pddl
89.00 89.00 0.0 119.00 119.00 0.0
prob15.pddl
95.00 95.00 0.0 127.00 127.00 0.0
prob16.pddl
101.00 101.00 0.0 135.00 135.00 0.0
prob17.pddl
107.00 107.00 0.0 143.00 143.00 0.0
prob18.pddl
113.00 113.00 0.0 151.00 151.00 0.0
prob19.pddl
119.00 119.00 0.0 159.00 159.00 0.0
prob20.pddl
125.00 125.00 0.0 167.00 167.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
hiking-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
13.00 13.00 0.0 17.00 17.00 0.0
ptesting-1-2-4.pddl
30.00 30.00 0.0 34.00 34.00 0.0
ptesting-1-2-5.pddl
41.00 41.00 0.0 36.00 36.00 0.0
ptesting-1-2-7.pddl
60.00 60.00 0.0 64.00 64.00 0.0
ptesting-1-2-8.pddl
70.00 70.00 0.0 74.00 74.00 0.0
ptesting-2-2-3.pddl
10.00 10.00 0.0 15.00 15.00 0.0
ptesting-2-2-4.pddl
27.00 27.00 0.0 31.00 31.00 0.0
ptesting-2-2-5.pddl
38.00 38.00 0.0 41.00 41.00 0.0
ptesting-2-2-6.pddl
51.00 51.00 0.0 53.00 53.00 0.0
ptesting-2-2-7.pddl
58.00 58.00 0.0 61.00 61.00 0.0
ptesting-2-2-8.pddl
70.00 70.00 0.0 73.00 73.00 0.0
ptesting-2-3-4.pddl
28.00 28.00 0.0 31.00 31.00 0.0
ptesting-2-3-5.pddl
36.00 36.00 0.0 43.00 43.00 0.0
ptesting-2-3-6.pddl
47.00 47.00 0.0 51.00 51.00 0.0
ptesting-2-3-7.pddl
58.00 58.00 0.0 61.00 61.00 0.0
ptesting-2-4-3.pddl
10.00 10.00 0.0 15.00 15.00 0.0
ptesting-2-4-4.pddl
28.00 28.00 0.0 31.00 31.00 0.0
ptesting-2-4-5.pddl
33.00 33.00 0.0 41.00 41.00 0.0
ptesting-2-4-6.pddl
44.00 44.00 0.0 53.00 53.00 0.0
ptesting-2-4-7.pddl
51.00 51.00 0.0 61.00 61.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics00
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
20.00 20.00 0.0 26.00 26.00 0.0
probLOGISTICS-4-1.pddl
19.00 19.00 0.0 23.00 23.00 0.0
probLOGISTICS-4-2.pddl
15.00 15.00 0.0 20.00 20.00 0.0
probLOGISTICS-5-0.pddl
27.00 27.00 0.0 32.00 32.00 0.0
probLOGISTICS-5-1.pddl
17.00 17.00 0.0 21.00 21.00 0.0
probLOGISTICS-5-2.pddl
8.00 8.00 0.0 10.00 10.00 0.0
probLOGISTICS-6-0.pddl
25.00 25.00 0.0 30.00 30.00 0.0
probLOGISTICS-6-1.pddl
14.00 14.00 0.0 20.00 20.00 0.0
probLOGISTICS-6-2.pddl
25.00 25.00 0.0 30.00 30.00 0.0
probLOGISTICS-6-9.pddl
24.00 24.00 0.0 29.00 29.00 0.0
probLOGISTICS-7-0.pddl
38.00 38.00 0.0 45.00 45.00 0.0
probLOGISTICS-7-1.pddl
44.00 44.00 0.0 52.00 52.00 0.0
probLOGISTICS-8-0.pddl
32.00 32.00 0.0 39.00 39.00 0.0
probLOGISTICS-8-1.pddl
44.00 44.00 0.0 54.00 54.00 0.0
probLOGISTICS-9-0.pddl
38.00 38.00 0.0 47.00 47.00 0.0
probLOGISTICS-9-1.pddl
30.00 30.00 0.0 39.00 39.00 0.0
probLOGISTICS-10-0.pddl
48.00 48.00 0.0 57.00 57.00 0.0
probLOGISTICS-10-1.pddl
44.00 44.00 0.0 54.00 54.00 0.0
probLOGISTICS-11-0.pddl
52.00 52.00 0.0 63.00 63.00 0.0
probLOGISTICS-11-1.pddl
64.00 64.00 0.0 73.00 73.00 0.0
probLOGISTICS-12-0.pddl
45.00 45.00 0.0 54.00 54.00 0.0
probLOGISTICS-12-1.pddl
74.00 74.00 0.0 84.00 84.00 0.0
probLOGISTICS-13-0.pddl
81.00 81.00 0.0 93.00 93.00 0.0
probLOGISTICS-13-1.pddl
66.00 66.00 0.0 79.00 79.00 0.0
probLOGISTICS-14-0.pddl
62.00 62.00 0.0 77.00 77.00 0.0
probLOGISTICS-14-1.pddl
83.00 83.00 0.0 95.00 95.00 0.0
probLOGISTICS-15-0.pddl
84.00 84.00 0.0 97.00 97.00 0.0
probLOGISTICS-15-1.pddl
69.00 69.00 0.0 87.00 87.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics98
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
27.00 27.00 0.0 33.00 33.00 0.0
prob02.pddl
33.00 33.00 0.0 35.00 35.00 0.0
prob03.pddl
56.00 56.00 0.0 61.00 61.00 0.0
prob04.pddl
65.00 65.00 0.0 None None -
prob05.pddl
23.00 23.00 0.0 31.00 31.00 0.0
prob06.pddl
81.00 81.00 0.0 None None -
prob07.pddl
35.00 35.00 0.0 35.00 35.00 0.0
prob08.pddl
47.00 47.00 0.0 None None -
prob09.pddl
96.00 96.00 0.0 None None -
prob10.pddl
116.00 116.00 0.0 126.00 126.00 0.0
prob11.pddl
31.00 31.00 0.0 31.00 31.00 0.0
prob12.pddl
41.00 41.00 0.0 None None -
prob13.pddl
77.00 77.00 0.0 None None -
prob14.pddl
99.00 99.00 0.0 None None -
prob15.pddl
98.00 98.00 0.0 112.00 112.00 0.0
prob16.pddl
55.00 55.00 0.0 None None -
prob17.pddl
44.00 44.00 0.0 None None -
prob18.pddl
181.00 181.00 0.0 None None -
prob19.pddl
159.00 159.00 0.0 None None -
prob20.pddl
164.00 164.00 0.0 None None -
prob21.pddl
110.00 110.00 0.0 None None -
prob22.pddl
324.00 324.00 0.0 None None -
prob23.pddl
127.00 127.00 0.0 136.00 136.00 0.0
prob24.pddl
42.00 42.00 0.0 None None -
prob25.pddl
208.00 208.00 0.0 None None -
prob26.pddl
218.00 218.00 0.0 None None -
prob27.pddl
162.00 162.00 0.0 None None -
prob28.pddl
326.00 326.00 0.0 None None -
prob29.pddl
341.00 341.00 0.0 None None -
prob30.pddl
154.00 154.00 0.0 None None -
prob31.pddl
14.00 14.00 0.0 16.00 16.00 0.0
prob32.pddl
20.00 20.00 0.0 23.00 23.00 0.0
prob33.pddl
27.00 27.00 0.0 32.00 32.00 0.0
prob34.pddl
52.00 52.00 0.0 48.00 48.00 0.0
prob35.pddl
31.00 31.00 0.0 40.00 40.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
miconic
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
4.00 4.00 0.0 4.00 4.00 0.0
s1-1.pddl
3.00 3.00 0.0 3.00 3.00 0.0
s1-2.pddl
4.00 4.00 0.0 4.00 4.00 0.0
s1-3.pddl
4.00 4.00 0.0 4.00 4.00 0.0
s1-4.pddl
4.00 4.00 0.0 4.00 4.00 0.0
s2-0.pddl
8.00 8.00 0.0 8.00 8.00 0.0
s2-1.pddl
8.00 8.00 0.0 7.00 7.00 0.0
s2-2.pddl
8.00 8.00 0.0 7.00 7.00 0.0
s2-3.pddl
7.00 7.00 0.0 7.00 7.00 0.0
s2-4.pddl
9.00 9.00 0.0 8.00 8.00 0.0
s3-0.pddl
13.00 13.00 0.0 11.00 11.00 0.0
s3-1.pddl
13.00 13.00 0.0 11.00 11.00 0.0
s3-2.pddl
12.00 12.00 0.0 10.00 10.00 0.0
s3-3.pddl
12.00 12.00 0.0 10.00 10.00 0.0
s3-4.pddl
11.00 11.00 0.0 10.00 10.00 0.0
s4-0.pddl
15.00 15.00 0.0 15.00 15.00 0.0
s4-1.pddl
16.00 16.00 0.0 14.00 14.00 0.0
s4-2.pddl
17.00 17.00 0.0 16.00 16.00 0.0
s4-3.pddl
19.00 19.00 0.0 16.00 16.00 0.0
s4-4.pddl
21.00 21.00 0.0 16.00 16.00 0.0
s5-0.pddl
24.00 24.00 0.0 19.00 19.00 0.0
s5-1.pddl
20.00 20.00 0.0 18.00 18.00 0.0
s5-2.pddl
18.00 18.00 0.0 16.00 16.00 0.0
s5-3.pddl
18.00 18.00 0.0 19.00 19.00 0.0
s5-4.pddl
24.00 24.00 0.0 19.00 19.00 0.0
s6-0.pddl
25.00 25.00 0.0 21.00 21.00 0.0
s6-1.pddl
21.00 21.00 0.0 22.00 22.00 0.0
s6-2.pddl
27.00 27.00 0.0 23.00 23.00 0.0
s6-3.pddl
21.00 21.00 0.0 21.00 21.00 0.0
s6-4.pddl
25.00 25.00 0.0 23.00 23.00 0.0
s7-0.pddl
29.00 29.00 0.0 26.00 26.00 0.0
s7-1.pddl
33.00 33.00 0.0 28.00 28.00 0.0
s7-2.pddl
23.00 23.00 0.0 24.00 24.00 0.0
s7-3.pddl
29.00 29.00 0.0 25.00 25.00 0.0
s7-4.pddl
34.00 34.00 0.0 26.00 26.00 0.0
s8-0.pddl
33.00 33.00 0.0 30.00 30.00 0.0
s8-1.pddl
37.00 37.00 0.0 31.00 31.00 0.0
s8-2.pddl
36.00 36.00 0.0 30.00 30.00 0.0
s8-3.pddl
36.00 36.00 0.0 30.00 30.00 0.0
s8-4.pddl
31.00 31.00 0.0 29.00 29.00 0.0
s9-0.pddl
42.00 42.00 0.0 33.00 33.00 0.0
s9-1.pddl
41.00 41.00 0.0 33.00 33.00 0.0
s9-2.pddl
40.00 40.00 0.0 33.00 33.00 0.0
s9-3.pddl
35.00 35.00 0.0 33.00 33.00 0.0
s9-4.pddl
35.00 35.00 0.0 30.00 30.00 0.0
s10-0.pddl
47.00 47.00 0.0 36.00 36.00 0.0
s10-1.pddl
41.00 41.00 0.0 35.00 35.00 0.0
s10-2.pddl
40.00 40.00 0.0 37.00 37.00 0.0
s10-3.pddl
45.00 45.00 0.0 36.00 36.00 0.0
s10-4.pddl
42.00 42.00 0.0 36.00 36.00 0.0
s11-0.pddl
51.00 51.00 0.0 42.00 42.00 0.0
s11-1.pddl
43.00 43.00 0.0 39.00 39.00 0.0
s11-2.pddl
53.00 53.00 0.0 42.00 42.00 0.0
s11-3.pddl
48.00 48.00 0.0 41.00 41.00 0.0
s11-4.pddl
48.00 48.00 0.0 39.00 39.00 0.0
s12-0.pddl
46.00 46.00 0.0 43.00 43.00 0.0
s12-1.pddl
56.00 56.00 0.0 46.00 46.00 0.0
s12-2.pddl
56.00 56.00 0.0 45.00 45.00 0.0
s12-3.pddl
53.00 53.00 0.0 44.00 44.00 0.0
s12-4.pddl
59.00 59.00 0.0 44.00 44.00 0.0
s13-0.pddl
60.00 60.00 0.0 49.00 49.00 0.0
s13-1.pddl
53.00 53.00 0.0 46.00 46.00 0.0
s13-2.pddl
64.00 64.00 0.0 49.00 49.00 0.0
s13-3.pddl
53.00 53.00 0.0 48.00 48.00 0.0
s13-4.pddl
53.00 53.00 0.0 48.00 48.00 0.0
s14-0.pddl
59.00 59.00 0.0 50.00 50.00 0.0
s14-1.pddl
66.00 66.00 0.0 52.00 52.00 0.0
s14-2.pddl
66.00 66.00 0.0 53.00 53.00 0.0
s14-3.pddl
61.00 61.00 0.0 50.00 50.00 0.0
s14-4.pddl
63.00 63.00 0.0 51.00 51.00 0.0
s15-0.pddl
66.00 66.00 0.0 52.00 52.00 0.0
s15-1.pddl
75.00 75.00 0.0 56.00 56.00 0.0
s15-2.pddl
70.00 70.00 0.0 54.00 54.00 0.0
s15-3.pddl
70.00 70.00 0.0 56.00 56.00 0.0
s15-4.pddl
66.00 66.00 0.0 54.00 54.00 0.0
s16-0.pddl
73.00 73.00 0.0 59.00 59.00 0.0
s16-1.pddl
71.00 71.00 0.0 58.00 58.00 0.0
s16-2.pddl
80.00 80.00 0.0 61.00 61.00 0.0
s16-3.pddl
73.00 73.00 0.0 57.00 57.00 0.0
s16-4.pddl
72.00 72.00 0.0 59.00 59.00 0.0
s17-0.pddl
77.00 77.00 0.0 63.00 63.00 0.0
s17-1.pddl
73.00 73.00 0.0 60.00 60.00 0.0
s17-2.pddl
79.00 79.00 0.0 65.00 65.00 0.0
s17-3.pddl
82.00 82.00 0.0 63.00 63.00 0.0
s17-4.pddl
75.00 75.00 0.0 60.00 60.00 0.0
s18-0.pddl
79.00 79.00 0.0 67.00 67.00 0.0
s18-1.pddl
77.00 77.00 0.0 64.00 64.00 0.0
s18-2.pddl
80.00 80.00 0.0 66.00 66.00 0.0
s18-3.pddl
84.00 84.00 0.0 68.00 68.00 0.0
s18-4.pddl
80.00 80.00 0.0 64.00 64.00 0.0
s19-0.pddl
87.00 87.00 0.0 73.00 73.00 0.0
s19-1.pddl
91.00 91.00 0.0 73.00 73.00 0.0
s19-2.pddl
88.00 88.00 0.0 69.00 69.00 0.0
s19-3.pddl
89.00 89.00 0.0 70.00 70.00 0.0
s19-4.pddl
86.00 86.00 0.0 70.00 70.00 0.0
s20-0.pddl
86.00 86.00 0.0 74.00 74.00 0.0
s20-1.pddl
89.00 89.00 0.0 74.00 74.00 0.0
s20-2.pddl
87.00 87.00 0.0 70.00 70.00 0.0
s20-3.pddl
88.00 88.00 0.0 74.00 74.00 0.0
s20-4.pddl
89.00 89.00 0.0 73.00 73.00 0.0
s21-0.pddl
97.00 97.00 0.0 78.00 78.00 0.0
s21-1.pddl
96.00 96.00 0.0 78.00 78.00 0.0
s21-2.pddl
90.00 90.00 0.0 78.00 78.00 0.0
s21-3.pddl
91.00 91.00 0.0 75.00 75.00 0.0
s21-4.pddl
93.00 93.00 0.0 78.00 78.00 0.0
s22-0.pddl
104.00 104.00 0.0 81.00 81.00 0.0
s22-1.pddl
98.00 98.00 0.0 81.00 81.00 0.0
s22-2.pddl
103.00 103.00 0.0 83.00 83.00 0.0
s22-3.pddl
105.00 105.00 0.0 82.00 82.00 0.0
s22-4.pddl
102.00 102.00 0.0 80.00 80.00 0.0
s23-0.pddl
108.00 108.00 0.0 85.00 85.00 0.0
s23-1.pddl
100.00 100.00 0.0 83.00 83.00 0.0
s23-2.pddl
101.00 101.00 0.0 84.00 84.00 0.0
s23-3.pddl
96.00 96.00 0.0 81.00 81.00 0.0
s23-4.pddl
104.00 104.00 0.0 83.00 83.00 0.0
s24-0.pddl
100.00 100.00 0.0 90.00 90.00 0.0
s24-1.pddl
108.00 108.00 0.0 89.00 89.00 0.0
s24-2.pddl
111.00 111.00 0.0 87.00 87.00 0.0
s24-3.pddl
113.00 113.00 0.0 88.00 88.00 0.0
s24-4.pddl
110.00 110.00 0.0 88.00 88.00 0.0
s25-0.pddl
115.00 115.00 0.0 92.00 92.00 0.0
s25-1.pddl
123.00 123.00 0.0 94.00 94.00 0.0
s25-2.pddl
113.00 113.00 0.0 90.00 90.00 0.0
s25-3.pddl
118.00 118.00 0.0 95.00 95.00 0.0
s25-4.pddl
118.00 118.00 0.0 93.00 93.00 0.0
s26-0.pddl
118.00 118.00 0.0 96.00 96.00 0.0
s26-1.pddl
116.00 116.00 0.0 94.00 94.00 0.0
s26-2.pddl
121.00 121.00 0.0 100.00 100.00 0.0
s26-3.pddl
123.00 123.00 0.0 96.00 96.00 0.0
s26-4.pddl
117.00 117.00 0.0 94.00 94.00 0.0
s27-0.pddl
128.00 128.00 0.0 100.00 100.00 0.0
s27-1.pddl
126.00 126.00 0.0 101.00 101.00 0.0
s27-2.pddl
127.00 127.00 0.0 99.00 99.00 0.0
s27-3.pddl
128.00 128.00 0.0 100.00 100.00 0.0
s27-4.pddl
126.00 126.00 0.0 100.00 100.00 0.0
s28-0.pddl
133.00 133.00 0.0 105.00 105.00 0.0
s28-1.pddl
130.00 130.00 0.0 105.00 105.00 0.0
s28-2.pddl
136.00 136.00 0.0 104.00 104.00 0.0
s28-3.pddl
121.00 121.00 0.0 98.00 98.00 0.0
s28-4.pddl
130.00 130.00 0.0 102.00 102.00 0.0
s29-0.pddl
131.00 131.00 0.0 107.00 107.00 0.0
s29-1.pddl
131.00 131.00 0.0 103.00 103.00 0.0
s29-2.pddl
134.00 134.00 0.0 111.00 111.00 0.0
s29-3.pddl
140.00 140.00 0.0 111.00 111.00 0.0
s29-4.pddl
146.00 146.00 0.0 112.00 112.00 0.0
s30-0.pddl
133.00 133.00 0.0 107.00 107.00 0.0
s30-1.pddl
138.00 138.00 0.0 110.00 110.00 0.0
s30-2.pddl
133.00 133.00 0.0 107.00 107.00 0.0
s30-3.pddl
144.00 144.00 0.0 111.00 111.00 0.0
s30-4.pddl
141.00 141.00 0.0 109.00 109.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
movie
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob02.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob03.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob04.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob05.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob06.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob07.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob08.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob09.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob10.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob11.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob12.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob13.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob14.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob15.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob16.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob17.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob18.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob19.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob20.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob21.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob22.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob23.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob24.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob25.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob26.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob27.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob28.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob29.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob30.pddl
8.00 8.00 0.0 7.00 7.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mprime
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
5.00 5.00 0.0 5.00 5.00 0.0
prob02.pddl
13.00 13.00 0.0 9.00 9.00 0.0
prob03.pddl
6.00 6.00 0.0 4.00 4.00 0.0
prob04.pddl
9.00 9.00 0.0 11.00 11.00 0.0
prob05.pddl
14.00 14.00 0.0 11.00 11.00 0.0
prob06.pddl
22.00 22.00 0.0 None None -
prob07.pddl
5.00 5.00 0.0 5.00 5.00 0.0
prob08.pddl
7.00 7.00 0.0 None None -
prob09.pddl
11.00 11.00 0.0 8.00 8.00 0.0
prob10.pddl
8.00 8.00 0.0 None None -
prob11.pddl
7.00 7.00 0.0 7.00 7.00 0.0
prob12.pddl
11.00 11.00 0.0 6.00 6.00 0.0
prob13.pddl
17.00 17.00 0.0 None None -
prob14.pddl
11.00 11.00 0.0 None None -
prob15.pddl
6.00 6.00 0.0 None None -
prob16.pddl
7.00 7.00 0.0 9.00 9.00 0.0
prob17.pddl
4.00 4.00 0.0 4.00 4.00 0.0
prob18.pddl
20.00 20.00 0.0 None None -
prob19.pddl
8.00 8.00 0.0 None None -
prob20.pddl
7.00 7.00 0.0 None None -
prob21.pddl
7.00 7.00 0.0 6.00 6.00 0.0
prob22.pddl
13.00 13.00 0.0 None None -
prob23.pddl
11.00 11.00 0.0 None None -
prob24.pddl
13.00 13.00 0.0 None None -
prob25.pddl
4.00 4.00 0.0 4.00 4.00 0.0
prob26.pddl
6.00 6.00 0.0 6.00 6.00 0.0
prob27.pddl
5.00 5.00 0.0 7.00 7.00 0.0
prob28.pddl
9.00 9.00 0.0 9.00 9.00 0.0
prob29.pddl
4.00 4.00 0.0 4.00 4.00 0.0
prob30.pddl
9.00 9.00 0.0 None None -
prob31.pddl
5.00 5.00 0.0 4.00 4.00 0.0
prob32.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob33.pddl
14.00 14.00 0.0 None None -
prob34.pddl
4.00 4.00 0.0 4.00 4.00 0.0
prob35.pddl
6.00 6.00 0.0 5.00 5.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mystery
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
5.00 5.00 0.0 5.00 5.00 0.0
prob02.pddl
14.00 14.00 0.0 9.00 9.00 0.0
prob03.pddl
4.00 4.00 0.0 4.00 4.00 0.0
prob04.pddl
None None - None None -
prob05.pddl
None None - None None -
prob06.pddl
16.00 16.00 0.0 None None -
prob07.pddl
None None - None None -
prob08.pddl
None None - None None -
prob09.pddl
9.00 9.00 0.0 8.00 8.00 0.0
prob10.pddl
8.00 8.00 0.0 None None -
prob11.pddl
7.00 7.00 0.0 7.00 7.00 0.0
prob12.pddl
None None - None None -
prob13.pddl
21.00 21.00 0.0 None None -
prob14.pddl
11.00 11.00 0.0 None None -
prob15.pddl
6.00 6.00 0.0 6.00 6.00 0.0
prob16.pddl
None None - None None -
prob17.pddl
4.00 4.00 0.0 4.00 4.00 0.0
prob18.pddl
None None - None None -
prob19.pddl
6.00 6.00 0.0 6.00 6.00 0.0
prob20.pddl
8.00 8.00 0.0 7.00 7.00 0.0
prob21.pddl
None None - None None -
prob22.pddl
None None - None None -
prob23.pddl
None None - None None -
prob24.pddl
None None - None None -
prob25.pddl
4.00 4.00 0.0 4.00 4.00 0.0
prob26.pddl
6.00 6.00 0.0 6.00 6.00 0.0
prob27.pddl
5.00 5.00 0.0 7.00 7.00 0.0
prob28.pddl
9.00 9.00 0.0 9.00 9.00 0.0
prob29.pddl
4.00 4.00 0.0 4.00 4.00 0.0
prob30.pddl
10.00 10.00 0.0 10.00 10.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
nomystery-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
11.00 11.00 0.0 11.00 11.00 0.0
p02.pddl
14.00 14.00 0.0 16.00 16.00 0.0
p03.pddl
16.00 16.00 0.0 19.00 19.00 0.0
p04.pddl
21.00 21.00 0.0 21.00 21.00 0.0
p05.pddl
26.00 26.00 0.0 29.00 29.00 0.0
p06.pddl
32.00 32.00 0.0 None None -
p07.pddl
33.00 33.00 0.0 None None -
p08.pddl
37.00 37.00 0.0 None None -
p09.pddl
44.00 44.00 0.0 45.00 45.00 0.0
p10.pddl
41.00 41.00 0.0 None None -
p11.pddl
12.00 12.00 0.0 12.00 12.00 0.0
p12.pddl
15.00 15.00 0.0 14.00 14.00 0.0
p13.pddl
15.00 15.00 0.0 15.00 15.00 0.0
p14.pddl
19.00 19.00 0.0 20.00 20.00 0.0
p15.pddl
24.00 24.00 0.0 26.00 26.00 0.0
p16.pddl
None None - None None -
p17.pddl
32.00 32.00 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
40.00 40.00 0.0 None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt08-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
3.00 3.00 0.0 2.00 2.00 0.0
p02.pddl
2.00 2.00 0.0 2.00 2.00 0.0
p03.pddl
2.00 2.00 0.0 2.00 2.00 0.0
p04.pddl
3.00 3.00 0.0 3.00 3.00 0.0
p05.pddl
4.00 4.00 0.0 4.00 4.00 0.0
p06.pddl
4.00 4.00 0.0 2.00 2.00 0.0
p07.pddl
7.00 7.00 0.0 5.00 5.00 0.0
p08.pddl
8.00 8.00 0.0 6.00 6.00 0.0
p09.pddl
5.00 5.00 0.0 4.00 4.00 0.0
p10.pddl
10.00 10.00 0.0 5.00 5.00 0.0
p11.pddl
8.00 8.00 0.0 5.00 5.00 0.0
p12.pddl
6.00 6.00 0.0 4.00 4.00 0.0
p13.pddl
9.00 9.00 0.0 4.00 4.00 0.0
p14.pddl
9.00 9.00 0.0 6.00 6.00 0.0
p15.pddl
10.00 10.00 0.0 5.00 5.00 0.0
p16.pddl
11.00 11.00 0.0 5.00 5.00 0.0
p17.pddl
12.00 12.00 0.0 7.00 7.00 0.0
p18.pddl
10.00 10.00 0.0 6.00 6.00 0.0
p19.pddl
12.00 12.00 0.0 6.00 6.00 0.0
p20.pddl
7.00 7.00 0.0 6.00 6.00 0.0
p21.pddl
10.00 10.00 0.0 5.00 5.00 0.0
p22.pddl
16.00 16.00 0.0 8.00 8.00 0.0
p23.pddl
10.00 10.00 0.0 9.00 9.00 0.0
p24.pddl
12.00 12.00 0.0 7.00 7.00 0.0
p25.pddl
12.00 12.00 0.0 8.00 8.00 0.0
p26.pddl
16.00 16.00 0.0 7.00 7.00 0.0
p27.pddl
20.00 20.00 0.0 9.00 9.00 0.0
p28.pddl
15.00 15.00 0.0 9.00 9.00 0.0
p29.pddl
17.00 17.00 0.0 11.00 11.00 0.0
p30.pddl
18.00 18.00 0.0 11.00 11.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
4.00 4.00 0.0 2.00 2.00 0.0
p02.pddl
7.00 7.00 0.0 5.00 5.00 0.0
p03.pddl
8.00 8.00 0.0 6.00 6.00 0.0
p04.pddl
5.00 5.00 0.0 4.00 4.00 0.0
p05.pddl
10.00 10.00 0.0 5.00 5.00 0.0
p06.pddl
8.00 8.00 0.0 5.00 5.00 0.0
p07.pddl
6.00 6.00 0.0 4.00 4.00 0.0
p08.pddl
9.00 9.00 0.0 4.00 4.00 0.0
p09.pddl
9.00 9.00 0.0 6.00 6.00 0.0
p10.pddl
16.00 16.00 0.0 8.00 8.00 0.0
p11.pddl
10.00 10.00 0.0 5.00 5.00 0.0
p12.pddl
11.00 11.00 0.0 5.00 5.00 0.0
p13.pddl
12.00 12.00 0.0 7.00 7.00 0.0
p14.pddl
10.00 10.00 0.0 6.00 6.00 0.0
p15.pddl
12.00 12.00 0.0 6.00 6.00 0.0
p16.pddl
10.00 10.00 0.0 5.00 5.00 0.0
p17.pddl
7.00 7.00 0.0 6.00 6.00 0.0
p18.pddl
10.00 10.00 0.0 9.00 9.00 0.0
p19.pddl
12.00 12.00 0.0 7.00 7.00 0.0
p20.pddl
12.00 12.00 0.0 8.00 8.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
7.00 7.00 0.0 4.00 4.00 0.0
p20_2.pddl
11.00 11.00 0.0 5.00 5.00 0.0
p20_3.pddl
16.00 16.00 0.0 7.00 7.00 0.0
p25_1.pddl
11.00 11.00 0.0 6.00 6.00 0.0
p25_3.pddl
21.00 21.00 0.0 15.00 15.00 0.0
p30_1.pddl
9.00 9.00 0.0 6.00 6.00 0.0
p30_2.pddl
12.00 12.00 0.0 8.00 8.00 0.0
p30_3.pddl
23.00 23.00 0.0 20.00 20.00 0.0
p35_1.pddl
12.00 12.00 0.0 7.00 7.00 0.0
p35_2.pddl
15.00 15.00 0.0 7.00 7.00 0.0
p35_3.pddl
30.00 30.00 0.0 25.00 25.00 0.0
p40_1.pddl
13.00 13.00 0.0 7.00 7.00 0.0
p40_2.pddl
18.00 18.00 0.0 9.00 9.00 0.0
p40_3.pddl
33.00 33.00 0.0 28.00 28.00 0.0
p45_1.pddl
17.00 17.00 0.0 8.00 8.00 0.0
p45_2.pddl
28.00 28.00 0.0 13.00 13.00 0.0
p45_3.pddl
40.00 40.00 0.0 38.00 38.00 0.0
p50_1.pddl
15.00 15.00 0.0 11.00 11.00 0.0
p50_2.pddl
26.00 26.00 0.0 11.00 11.00 0.0
p50_3.pddl
45.00 45.00 0.0 38.00 38.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
25.00 25.00 0.0 23.00 23.00 0.0
p02.pddl
25.00 25.00 0.0 24.00 24.00 0.0
p03.pddl
25.00 25.00 0.0 23.00 23.00 0.0
p04.pddl
25.00 25.00 0.0 23.00 23.00 0.0
p05.pddl
25.00 25.00 0.0 23.00 23.00 0.0
p06.pddl
49.00 49.00 0.0 47.00 47.00 0.0
p07.pddl
50.00 50.00 0.0 49.00 49.00 0.0
p08.pddl
95.00 95.00 0.0 91.00 91.00 0.0
p09.pddl
95.00 95.00 0.0 94.00 94.00 0.0
p10.pddl
100.00 100.00 0.0 96.00 96.00 0.0
p11.pddl
100.00 100.00 0.0 98.00 98.00 0.0
p12.pddl
100.00 100.00 0.0 98.00 98.00 0.0
p13.pddl
100.00 100.00 0.0 99.00 99.00 0.0
p14.pddl
100.00 100.00 0.0 100.00 100.00 0.0
p15.pddl
100.00 100.00 0.0 98.00 98.00 0.0
p16.pddl
100.00 100.00 0.0 98.00 98.00 0.0
p17.pddl
120.00 120.00 0.0 119.00 119.00 0.0
p18.pddl
193.00 193.00 0.0 187.00 187.00 0.0
p19.pddl
125.00 125.00 0.0 116.00 116.00 0.0
p20.pddl
150.00 150.00 0.0 150.00 150.00 0.0
p21.pddl
150.00 150.00 0.0 148.00 148.00 0.0
p22.pddl
150.00 150.00 0.0 148.00 148.00 0.0
p23.pddl
150.00 150.00 0.0 150.00 150.00 0.0
p24.pddl
250.00 250.00 0.0 250.00 250.00 0.0
p25.pddl
250.00 250.00 0.0 250.00 250.00 0.0
p26.pddl
249.00 249.00 0.0 243.00 243.00 0.0
p27.pddl
375.00 375.00 0.0 368.00 368.00 0.0
p28.pddl
500.00 500.00 0.0 500.00 500.00 0.0
p29.pddl
500.00 500.00 0.0 500.00 500.00 0.0
p30.pddl
500.00 500.00 0.0 491.00 491.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-opt18-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.00 1.00 0.0 1.00 1.00 0.0
p02.pddl
1.00 1.00 0.0 1.00 1.00 0.0
p03.pddl
2.00 2.00 0.0 2.00 2.00 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
2.00 2.00 0.0 2.00 2.00 0.0
p08.pddl
None None - None None -
p09.pddl
2.00 2.00 0.0 2.00 2.00 0.0
p10.pddl
2.00 2.00 0.0 2.00 2.00 0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
2.00 2.00 0.0 2.00 2.00 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-split-opt18-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
41.00 41.00 0.0 41.00 41.00 0.0
p02.pddl
41.00 41.00 0.0 41.00 41.00 0.0
p03.pddl
252.00 252.00 0.0 252.00 252.00 0.0
p04.pddl
252.00 252.00 0.0 252.00 252.00 0.0
p05.pddl
252.00 252.00 0.0 252.00 252.00 0.0
p06.pddl
252.00 252.00 0.0 252.00 252.00 0.0
p07.pddl
252.00 252.00 0.0 252.00 252.00 0.0
p08.pddl
252.00 252.00 0.0 252.00 252.00 0.0
p09.pddl
82.00 82.00 0.0 82.00 82.00 0.0
p10.pddl
82.00 82.00 0.0 82.00 82.00 0.0
p11.pddl
82.00 82.00 0.0 None None -
p12.pddl
82.00 82.00 0.0 None None -
p13.pddl
378.00 378.00 0.0 None None -
p14.pddl
82.00 82.00 0.0 82.00 82.00 0.0
p15.pddl
None None - None None -
p16.pddl
252.00 252.00 0.0 None None -
p17.pddl
378.00 378.00 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
504.00 504.00 0.0 None None -
p20.pddl
630.00 630.00 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-08-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
269038.00 269038.00 0.0 169009.00 169009.00 0.0
p02.pddl
538076.00 538076.00 0.0 538076.00 538076.00 0.0
p03.pddl
807114.00 807114.00 0.0 807114.00 807114.00 0.0
p04.pddl
1076152.00 1076152.00 0.0 1076152.00 1076152.00 0.0
p05.pddl
1345190.00 1345190.00 0.0 1345190.00 1345190.00 0.0
p06.pddl
1614228.00 1614228.00 0.0 1614228.00 1614228.00 0.0
p07.pddl
1883266.00 1883266.00 0.0 1883266.00 1883266.00 0.0
p08.pddl
2152304.00 2152304.00 0.0 2152304.00 2152304.00 0.0
p09.pddl
2421342.00 2421342.00 0.0 2421342.00 2421342.00 0.0
p10.pddl
2690380.00 2690380.00 0.0 2690380.00 2690380.00 0.0
p11.pddl
183207.00 183207.00 0.0 182808.00 182808.00 0.0
p12.pddl
520923.00 520923.00 0.0 510256.00 510256.00 0.0
p13.pddl
704130.00 704130.00 0.0 693064.00 693064.00 0.0
p14.pddl
1041846.00 1041846.00 0.0 1020512.00 1020512.00 0.0
p15.pddl
1736917.00 1736917.00 0.0 None None -
p16.pddl
1717278.00 1717278.00 0.0 None None -
p17.pddl
1745976.00 1745976.00 0.0 None None -
p18.pddl
2392710.00 2392710.00 0.0 None None -
p19.pddl
3539303.00 3539303.00 0.0 None None -
p20.pddl
2807461.00 2807461.00 0.0 None None -
p21.pddl
232509.00 232509.00 0.0 232410.00 232410.00 0.0
p22.pddl
465018.00 465018.00 0.0 464820.00 464820.00 0.0
p23.pddl
697527.00 697527.00 0.0 697230.00 697230.00 0.0
p24.pddl
930036.00 930036.00 0.0 929640.00 929640.00 0.0
p25.pddl
1404332.00 1404332.00 0.0 1403837.00 1403837.00 0.0
p26.pddl
1395054.00 1395054.00 0.0 1394460.00 1394460.00 0.0
p27.pddl
1627563.00 1627563.00 0.0 1626870.00 1626870.00 0.0
p28.pddl
1860072.00 1860072.00 0.0 1859280.00 1859280.00 0.0
p29.pddl
2576155.00 2576155.00 0.0 None None -
p30.pddl
2566877.00 2566877.00 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
465018.00 465018.00 0.0 464820.00 464820.00 0.0
p02.pddl
538076.00 538076.00 0.0 538076.00 538076.00 0.0
p03.pddl
520923.00 520923.00 0.0 510256.00 510256.00 0.0
p04.pddl
1076152.00 1076152.00 0.0 1076152.00 1076152.00 0.0
p05.pddl
697527.00 697527.00 0.0 697230.00 697230.00 0.0
p06.pddl
1614228.00 1614228.00 0.0 1614228.00 1614228.00 0.0
p07.pddl
1345190.00 1345190.00 0.0 1345190.00 1345190.00 0.0
p08.pddl
930036.00 930036.00 0.0 929640.00 929640.00 0.0
p09.pddl
704130.00 704130.00 0.0 693064.00 693064.00 0.0
p10.pddl
1404332.00 1404332.00 0.0 1403837.00 1403837.00 0.0
p11.pddl
1395054.00 1395054.00 0.0 1394460.00 1394460.00 0.0
p12.pddl
1041846.00 1041846.00 0.0 1020512.00 1020512.00 0.0
p13.pddl
1883266.00 1883266.00 0.0 1883266.00 1883266.00 0.0
p14.pddl
2152304.00 2152304.00 0.0 2152304.00 2152304.00 0.0
p15.pddl
2421342.00 2421342.00 0.0 2421342.00 2421342.00 0.0
p16.pddl
2690380.00 2690380.00 0.0 2690380.00 2690380.00 0.0
p17.pddl
1736917.00 1736917.00 0.0 None None -
p18.pddl
1717278.00 1717278.00 0.0 None None -
p19.pddl
1745976.00 1745976.00 0.0 None None -
p20.pddl
1627563.00 1627563.00 0.0 1626870.00 1626870.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parking-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
24.00 24.00 0.0 None None -
pfile03-012.pddl
39.00 39.00 0.0 None None -
pfile04-013.pddl
51.00 51.00 0.0 None None -
pfile04-014.pddl
47.00 47.00 0.0 None None -
pfile04-015.pddl
41.00 41.00 0.0 None None -
pfile04-016.pddl
39.00 39.00 0.0 None None -
pfile05-017.pddl
40.00 40.00 0.0 None None -
pfile05-018.pddl
46.00 46.00 0.0 None None -
pfile05-019.pddl
58.00 58.00 0.0 None None -
pfile05-020.pddl
51.00 51.00 0.0 None None -
pfile06-021.pddl
61.00 61.00 0.0 None None -
pfile06-022.pddl
59.00 59.00 0.0 None None -
pfile06-023.pddl
51.00 51.00 0.0 None None -
pfile06-024.pddl
59.00 59.00 0.0 None None -
pfile07-025.pddl
63.00 63.00 0.0 None None -
pfile07-026.pddl
59.00 59.00 0.0 None None -
pfile07-027.pddl
57.00 57.00 0.0 None None -
pfile07-028.pddl
76.00 76.00 0.0 None None -
pfile08-029.pddl
75.00 75.00 0.0 None None -
pfile08-030.pddl
70.00 70.00 0.0 None None -
Sum of diffs
0.00
None
Arithmetic mean of diffs
0.00
None
parking-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
34.00 34.00 0.0 None None -
p_12_7-02.pddl
32.00 32.00 0.0 36.00 36.00 0.0
p_12_7-03.pddl
38.00 38.00 0.0 None None -
p_12_7-04.pddl
37.00 37.00 0.0 None None -
p_14_8-01.pddl
40.00 40.00 0.0 None None -
p_14_8-02.pddl
44.00 44.00 0.0 None None -
p_14_8-03.pddl
55.00 55.00 0.0 None None -
p_14_8-04.pddl
45.00 45.00 0.0 None None -
p_16_9-01.pddl
46.00 46.00 0.0 None None -
p_16_9-02.pddl
45.00 45.00 0.0 None None -
p_16_9-03.pddl
40.00 40.00 0.0 None None -
p_16_9-04.pddl
49.00 49.00 0.0 None None -
p_18_10-01.pddl
56.00 56.00 0.0 None None -
p_18_10-02.pddl
54.00 54.00 0.0 None None -
p_18_10-03.pddl
38.00 38.00 0.0 None None -
p_18_10-04.pddl
35.00 35.00 0.0 None None -
p_20_11-01.pddl
62.00 62.00 0.0 None None -
p_20_11-02.pddl
48.00 48.00 0.0 None None -
p_20_11-03.pddl
61.00 61.00 0.0 None None -
p_20_11-04.pddl
68.00 68.00 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pathways-noneg
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
6.00 6.00 0.0 6.00 6.00 0.0
p02.pddl
12.00 12.00 0.0 12.00 12.00 0.0
p03.pddl
18.00 18.00 0.0 18.00 18.00 0.0
p04.pddl
17.00 17.00 0.0 17.00 17.00 0.0
p05.pddl
30.00 30.00 0.0 31.00 31.00 0.0
p06.pddl
55.00 55.00 0.0 55.00 55.00 0.0
p07.pddl
64.00 64.00 0.0 63.00 63.00 0.0
p08.pddl
98.00 98.00 0.0 None None -
p09.pddl
71.00 71.00 0.0 72.00 72.00 0.0
p10.pddl
None None - None None -
p11.pddl
87.00 87.00 0.0 84.00 84.00 0.0
p12.pddl
113.00 113.00 0.0 None None -
p13.pddl
102.00 102.00 0.0 None None -
p14.pddl
112.00 112.00 0.0 None None -
p15.pddl
108.00 108.00 0.0 None None -
p16.pddl
None None - None None -
p17.pddl
154.00 154.00 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
186.00 186.00 0.0 None None -
p24.pddl
226.00 226.00 0.0 None None -
p25.pddl
211.00 211.00 0.0 None None -
p26.pddl
240.00 240.00 0.0 None None -
p27.pddl
251.00 251.00 0.0 None None -
p28.pddl
211.00 211.00 0.0 None None -
p29.pddl
261.00 261.00 0.0 None None -
p30.pddl
295.00 295.00 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-08-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
4.00 4.00 0.0 2.00 2.00 0.0
p02.pddl
5.00 5.00 0.0 5.00 5.00 0.0
p03.pddl
5.00 5.00 0.0 4.00 4.00 0.0
p04.pddl
7.00 7.00 0.0 5.00 5.00 0.0
p05.pddl
7.00 7.00 0.0 6.00 6.00 0.0
p06.pddl
9.00 9.00 0.0 6.00 6.00 0.0
p07.pddl
9.00 9.00 0.0 3.00 3.00 0.0
p08.pddl
11.00 11.00 0.0 10.00 10.00 0.0
p09.pddl
10.00 10.00 0.0 6.00 6.00 0.0
p10.pddl
12.00 12.00 0.0 9.00 9.00 0.0
p11.pddl
10.00 10.00 0.0 8.00 8.00 0.0
p12.pddl
12.00 12.00 0.0 8.00 8.00 0.0
p13.pddl
11.00 11.00 0.0 12.00 12.00 0.0
p14.pddl
13.00 13.00 0.0 9.00 9.00 0.0
p15.pddl
12.00 12.00 0.0 10.00 10.00 0.0
p16.pddl
14.00 14.00 0.0 9.00 9.00 0.0
p17.pddl
14.00 14.00 0.0 13.00 13.00 0.0
p18.pddl
15.00 15.00 0.0 10.00 10.00 0.0
p19.pddl
12.00 12.00 0.0 12.00 12.00 0.0
p20.pddl
14.00 14.00 0.0 11.00 11.00 0.0
p21.pddl
15.00 15.00 0.0 15.00 15.00 0.0
p22.pddl
15.00 15.00 0.0 10.00 10.00 0.0
p23.pddl
16.00 16.00 0.0 12.00 12.00 0.0
p24.pddl
15.00 15.00 0.0 15.00 15.00 0.0
p25.pddl
15.00 15.00 0.0 13.00 13.00 0.0
p26.pddl
18.00 18.00 0.0 15.00 15.00 0.0
p27.pddl
19.00 19.00 0.0 12.00 12.00 0.0
p28.pddl
22.00 22.00 0.0 15.00 15.00 0.0
p29.pddl
25.00 25.00 0.0 17.00 17.00 0.0
p30.pddl
30.00 30.00 0.0 28.00 28.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
8.00 8.00 0.0 3.00 3.00 0.0
p02.pddl
14.00 14.00 0.0 13.00 13.00 0.0
p03.pddl
15.00 15.00 0.0 10.00 10.00 0.0
p04.pddl
12.00 12.00 0.0 12.00 12.00 0.0
p05.pddl
14.00 14.00 0.0 12.00 12.00 0.0
p06.pddl
14.00 14.00 0.0 11.00 11.00 0.0
p07.pddl
13.00 13.00 0.0 11.00 11.00 0.0
p08.pddl
14.00 14.00 0.0 11.00 11.00 0.0
p09.pddl
15.00 15.00 0.0 13.00 13.00 0.0
p10.pddl
15.00 15.00 0.0 15.00 15.00 0.0
p11.pddl
15.00 15.00 0.0 10.00 10.00 0.0
p12.pddl
15.00 15.00 0.0 12.00 12.00 0.0
p13.pddl
16.00 16.00 0.0 12.00 12.00 0.0
p14.pddl
15.00 15.00 0.0 15.00 15.00 0.0
p15.pddl
15.00 15.00 0.0 13.00 13.00 0.0
p16.pddl
18.00 18.00 0.0 15.00 15.00 0.0
p17.pddl
19.00 19.00 0.0 12.00 12.00 0.0
p18.pddl
22.00 22.00 0.0 15.00 15.00 0.0
p19.pddl
25.00 25.00 0.0 17.00 17.00 0.0
p20.pddl
30.00 30.00 0.0 28.00 28.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
petri-net-alignment-opt18-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
224.00 224.00 0.0 220.00 220.00 0.0
p02.pddl
289.00 289.00 0.0 285.00 285.00 0.0
p03.pddl
342.00 342.00 0.0 338.00 338.00 0.0
p04.pddl
351.00 351.00 0.0 347.00 347.00 0.0
p05.pddl
279.00 279.00 0.0 275.00 275.00 0.0
p06.pddl
352.00 352.00 0.0 348.00 348.00 0.0
p07.pddl
334.00 334.00 0.0 330.00 330.00 0.0
p08.pddl
353.00 353.00 0.0 349.00 349.00 0.0
p09.pddl
343.00 343.00 0.0 339.00 339.00 0.0
p10.pddl
436.00 436.00 0.0 432.00 432.00 0.0
p11.pddl
381.00 381.00 0.0 377.00 377.00 0.0
p12.pddl
500.00 500.00 0.0 496.00 496.00 0.0
p13.pddl
435.00 435.00 0.0 431.00 431.00 0.0
p14.pddl
443.00 443.00 0.0 439.00 439.00 0.0
p15.pddl
430.00 430.00 0.0 426.00 426.00 0.0
p16.pddl
473.00 473.00 0.0 469.00 469.00 0.0
p17.pddl
490.00 490.00 0.0 486.00 486.00 0.0
p18.pddl
473.00 473.00 0.0 469.00 469.00 0.0
p19.pddl
489.00 489.00 0.0 485.00 485.00 0.0
p20.pddl
502.00 502.00 0.0 498.00 498.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-notankage
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
5.00 5.00 0.0 5.00 5.00 0.0
p02-net1-b6-g4.pddl
14.00 14.00 0.0 12.00 12.00 0.0
p03-net1-b8-g3.pddl
10.00 10.00 0.0 9.00 9.00 0.0
p04-net1-b8-g5.pddl
17.00 17.00 0.0 11.00 11.00 0.0
p05-net1-b10-g4.pddl
9.00 9.00 0.0 9.00 9.00 0.0
p06-net1-b10-g6.pddl
31.00 31.00 0.0 11.00 11.00 0.0
p07-net1-b12-g5.pddl
10.00 10.00 0.0 9.00 9.00 0.0
p08-net1-b12-g7.pddl
12.00 12.00 0.0 11.00 11.00 0.0
p09-net1-b14-g6.pddl
18.00 18.00 0.0 13.00 13.00 0.0
p10-net1-b14-g8.pddl
21.00 21.00 0.0 18.00 18.00 0.0
p11-net2-b10-g2.pddl
120.00 120.00 0.0 24.00 24.00 0.0
p12-net2-b10-g4.pddl
148.00 148.00 0.0 40.00 40.00 0.0
p13-net2-b12-g3.pddl
22.00 22.00 0.0 32.00 32.00 0.0
p14-net2-b12-g5.pddl
100.00 100.00 0.0 54.00 54.00 0.0
p15-net2-b14-g4.pddl
76.00 76.00 0.0 42.00 42.00 0.0
p16-net2-b14-g6.pddl
86.00 86.00 0.0 90.00 90.00 0.0
p17-net2-b16-g5.pddl
86.00 86.00 0.0 30.00 30.00 0.0
p18-net2-b16-g7.pddl
98.00 98.00 0.0 52.00 52.00 0.0
p19-net2-b18-g6.pddl
30.00 30.00 0.0 30.00 30.00 0.0
p20-net2-b18-g8.pddl
81.00 81.00 0.0 48.00 48.00 0.0
p21-net3-b12-g2.pddl
18.00 18.00 0.0 14.00 14.00 0.0
p22-net3-b12-g4.pddl
58.00 58.00 0.0 47.00 47.00 0.0
p23-net3-b14-g3.pddl
21.00 21.00 0.0 24.00 24.00 0.0
p24-net3-b14-g5.pddl
45.00 45.00 0.0 48.00 48.00 0.0
p25-net3-b16-g5.pddl
48.00 48.00 0.0 48.00 48.00 0.0
p26-net3-b16-g7.pddl
145.00 145.00 0.0 54.00 54.00 0.0
p27-net3-b18-g6.pddl
96.00 96.00 0.0 51.00 51.00 0.0
p28-net3-b18-g7.pddl
150.00 150.00 0.0 64.00 64.00 0.0
p29-net3-b20-g6.pddl
99.00 99.00 0.0 48.00 48.00 0.0
p30-net3-b20-g8.pddl
94.00 94.00 0.0 57.00 57.00 0.0
p31-net4-b14-g3.pddl
29.00 29.00 0.0 27.00 27.00 0.0
p32-net4-b14-g5.pddl
66.00 66.00 0.0 55.00 55.00 0.0
p33-net4-b16-g5.pddl
130.00 130.00 0.0 40.00 40.00 0.0
p34-net4-b16-g6.pddl
78.00 78.00 0.0 37.00 37.00 0.0
p35-net4-b18-g4.pddl
67.00 67.00 0.0 24.00 24.00 0.0
p36-net4-b18-g6.pddl
48.00 48.00 0.0 54.00 54.00 0.0
p37-net4-b20-g5.pddl
80.00 80.00 0.0 None None -
p38-net4-b20-g7.pddl
75.00 75.00 0.0 39.00 39.00 0.0
p39-net4-b22-g7.pddl
41.00 41.00 0.0 None None -
p40-net4-b22-g8.pddl
78.00 78.00 0.0 53.00 53.00 0.0
p41-net5-b22-g2.pddl
32.00 32.00 0.0 13.00 13.00 0.0
p42-net5-b22-g4.pddl
None None - None None -
p43-net5-b24-g3.pddl
None None - None None -
p44-net5-b24-g5.pddl
None None - None None -
p45-net5-b26-g4.pddl
None None - None None -
p46-net5-b26-g6.pddl
None None - None None -
p47-net5-b28-g5.pddl
None None - None None -
p48-net5-b28-g7.pddl
None None - None None -
p49-net5-b30-g6.pddl
72.00 72.00 0.0 None None -
p50-net5-b30-g8.pddl
139.00 139.00 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-tankage
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
5.00 5.00 0.0 5.00 5.00 0.0
p02-net1-b6-g4-t50.pddl
32.00 32.00 0.0 18.00 18.00 0.0
p03-net1-b8-g3-t80.pddl
10.00 10.00 0.0 9.00 9.00 0.0
p04-net1-b8-g5-t80.pddl
21.00 21.00 0.0 11.00 11.00 0.0
p05-net1-b10-g4-t50.pddl
13.00 13.00 0.0 9.00 9.00 0.0
p06-net1-b10-g6-t50.pddl
21.00 21.00 0.0 11.00 11.00 0.0
p07-net1-b12-g5-t80.pddl
11.00 11.00 0.0 8.00 8.00 0.0
p08-net1-b12-g7-t80.pddl
17.00 17.00 0.0 11.00 11.00 0.0
p09-net1-b14-g6-t50.pddl
28.00 28.00 0.0 24.00 24.00 0.0
p10-net1-b14-g8-t50.pddl
28.00 28.00 0.0 23.00 23.00 0.0
p11-net2-b10-g2-t30.pddl
42.00 42.00 0.0 38.00 38.00 0.0
p12-net2-b10-g4-t60.pddl
32.00 32.00 0.0 46.00 46.00 0.0
p13-net2-b12-g3-t70.pddl
26.00 26.00 0.0 32.00 32.00 0.0
p14-net2-b12-g5-t30.pddl
62.00 62.00 0.0 66.00 66.00 0.0
p15-net2-b14-g4-t30.pddl
50.00 50.00 0.0 78.00 78.00 0.0
p16-net2-b14-g6-t80.pddl
136.00 136.00 0.0 None None -
p17-net2-b16-g5-t20.pddl
130.00 130.00 0.0 76.00 76.00 0.0
p18-net2-b16-g7-t60.pddl
82.00 82.00 0.0 76.00 76.00 0.0
p19-net2-b18-g6-t60.pddl
34.00 34.00 0.0 42.00 42.00 0.0
p20-net2-b18-g8-t90.pddl
72.00 72.00 0.0 None None -
p21-net3-b12-g2-t60.pddl
22.00 22.00 0.0 17.00 17.00 0.0
p22-net3-b12-g4-t60.pddl
72.00 72.00 0.0 51.00 51.00 0.0
p23-net3-b14-g3-t60.pddl
39.00 39.00 0.0 None None -
p24-net3-b14-g5-t60.pddl
44.00 44.00 0.0 None None -
p25-net3-b16-g5-t60.pddl
48.00 48.00 0.0 None None -
p26-net3-b16-g7-t70.pddl
75.00 75.00 0.0 None None -
p27-net3-b18-g6-t70.pddl
63.00 63.00 0.0 None None -
p28-net3-b18-g7-t70.pddl
101.00 101.00 0.0 None None -
p29-net3-b20-g6-t70.pddl
75.00 75.00 0.0 None None -
p30-net3-b20-g8-t70.pddl
70.00 70.00 0.0 None None -
p31-net4-b14-g3-t20.pddl
86.00 86.00 0.0 68.00 68.00 0.0
p32-net4-b14-g5-t30.pddl
179.00 179.00 0.0 55.00 55.00 0.0
p33-net4-b16-g5-t60.pddl
54.00 54.00 0.0 None None -
p34-net4-b16-g6-t60.pddl
63.00 63.00 0.0 None None -
p35-net4-b18-g4-t90.pddl
40.00 40.00 0.0 None None -
p36-net4-b18-g6-t90.pddl
125.00 125.00 0.0 None None -
p37-net4-b20-g5-t60.pddl
40.00 40.00 0.0 None None -
p38-net4-b20-g7-t60.pddl
129.00 129.00 0.0 None None -
p39-net4-b22-g7-t50.pddl
74.00 74.00 0.0 None None -
p40-net4-b22-g8-t50.pddl
71.00 71.00 0.0 None None -
p41-net5-b22-g2-t20.pddl
30.00 30.00 0.0 None None -
p42-net5-b22-g4-t50.pddl
None None - None None -
p43-net5-b24-g3-t80.pddl
None None - None None -
p44-net5-b24-g5-t80.pddl
None None - None None -
p45-net5-b26-g4-t50.pddl
None None - None None -
p46-net5-b26-g6-t50.pddl
None None - None None -
p47-net5-b28-g5-t50.pddl
None None - None None -
p48-net5-b28-g7-t50.pddl
None None - None None -
p49-net5-b30-g6-t50.pddl
75.00 75.00 0.0 None None -
p50-net5-b30-g8-t50.pddl
110.00 110.00 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
psr-small
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
8.00 8.00 0.0 8.00 8.00 0.0
p02-s5-n1-l3-f30.pddl
11.00 11.00 0.0 11.00 11.00 0.0
p03-s7-n1-l3-f70.pddl
11.00 11.00 0.0 11.00 11.00 0.0
p04-s8-n1-l4-f10.pddl
10.00 10.00 0.0 10.00 10.00 0.0
p05-s9-n1-l4-f30.pddl
11.00 11.00 0.0 11.00 11.00 0.0
p06-s10-n1-l4-f50.pddl
8.00 8.00 0.0 8.00 8.00 0.0
p07-s11-n1-l4-f70.pddl
11.00 11.00 0.0 11.00 11.00 0.0
p08-s12-n1-l5-f10.pddl
8.00 8.00 0.0 8.00 8.00 0.0
p09-s13-n1-l5-f30.pddl
8.00 8.00 0.0 8.00 8.00 0.0
p10-s17-n2-l2-f30.pddl
7.00 7.00 0.0 7.00 7.00 0.0
p11-s18-n2-l2-f50.pddl
19.00 19.00 0.0 19.00 19.00 0.0
p12-s21-n2-l3-f30.pddl
16.00 16.00 0.0 16.00 16.00 0.0
p13-s22-n2-l3-f50.pddl
15.00 15.00 0.0 15.00 15.00 0.0
p14-s23-n2-l3-f70.pddl
9.00 9.00 0.0 9.00 9.00 0.0
p15-s24-n2-l4-f10.pddl
10.00 10.00 0.0 10.00 10.00 0.0
p16-s29-n2-l5-f30.pddl
25.00 25.00 0.0 25.00 25.00 0.0
p17-s30-n2-l5-f50.pddl
9.00 9.00 0.0 9.00 9.00 0.0
p18-s31-n2-l5-f70.pddl
12.00 12.00 0.0 12.00 12.00 0.0
p19-s33-n3-l2-f30.pddl
31.00 31.00 0.0 25.00 25.00 0.0
p20-s34-n3-l2-f50.pddl
17.00 17.00 0.0 17.00 17.00 0.0
p21-s35-n3-l2-f70.pddl
10.00 10.00 0.0 10.00 10.00 0.0
p22-s37-n3-l3-f30.pddl
33.00 33.00 0.0 33.00 33.00 0.0
p23-s38-n3-l3-f50.pddl
12.00 12.00 0.0 12.00 12.00 0.0
p24-s39-n3-l3-f70.pddl
10.00 10.00 0.0 10.00 10.00 0.0
p25-s40-n3-l4-f10.pddl
9.00 9.00 0.0 9.00 9.00 0.0
p26-s41-n3-l4-f30.pddl
17.00 17.00 0.0 17.00 17.00 0.0
p27-s42-n3-l4-f50.pddl
21.00 21.00 0.0 21.00 21.00 0.0
p28-s43-n3-l4-f70.pddl
14.00 14.00 0.0 14.00 14.00 0.0
p29-s45-n3-l5-f30.pddl
27.00 27.00 0.0 21.00 21.00 0.0
p30-s46-n3-l5-f50.pddl
22.00 22.00 0.0 22.00 22.00 0.0
p31-s49-n4-l2-f30.pddl
19.00 19.00 0.0 19.00 19.00 0.0
p32-s50-n4-l2-f50.pddl
24.00 24.00 0.0 24.00 24.00 0.0
p33-s51-n4-l2-f70.pddl
21.00 21.00 0.0 21.00 21.00 0.0
p34-s55-n4-l3-f70.pddl
21.00 21.00 0.0 21.00 21.00 0.0
p35-s57-n5-l2-f30.pddl
22.00 22.00 0.0 22.00 22.00 0.0
p36-s65-n6-l2-f30.pddl
26.00 26.00 0.0 26.00 26.00 0.0
p37-s67-n6-l2-f70.pddl
23.00 23.00 0.0 23.00 23.00 0.0
p38-s78-n3-l3-f50.pddl
13.00 13.00 0.0 13.00 13.00 0.0
p39-s79-n3-l3-f70.pddl
23.00 23.00 0.0 23.00 23.00 0.0
p40-s80-n3-l4-f10.pddl
20.00 20.00 0.0 20.00 20.00 0.0
p41-s81-n3-l4-f30.pddl
10.00 10.00 0.0 10.00 10.00 0.0
p42-s82-n3-l4-f50.pddl
30.00 30.00 0.0 30.00 30.00 0.0
p43-s83-n3-l4-f70.pddl
20.00 20.00 0.0 20.00 20.00 0.0
p44-s89-n4-l2-f30.pddl
19.00 19.00 0.0 19.00 19.00 0.0
p45-s94-n4-l3-f50.pddl
20.00 20.00 0.0 20.00 20.00 0.0
p46-s97-n5-l2-f30.pddl
34.00 34.00 0.0 34.00 34.00 0.0
p47-s98-n5-l2-f50.pddl
27.00 27.00 0.0 27.00 27.00 0.0
p48-s101-n5-l3-f30.pddl
37.00 37.00 0.0 37.00 37.00 0.0
p49-s105-n6-l2-f30.pddl
47.00 47.00 0.0 47.00 47.00 0.0
p50-s107-n6-l2-f70.pddl
23.00 23.00 0.0 23.00 23.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
rovers
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
10.00 10.00 0.0 12.00 12.00 0.0
p02.pddl
8.00 8.00 0.0 8.00 8.00 0.0
p03.pddl
12.00 12.00 0.0 14.00 14.00 0.0
p04.pddl
8.00 8.00 0.0 8.00 8.00 0.0
p05.pddl
22.00 22.00 0.0 24.00 24.00 0.0
p06.pddl
37.00 37.00 0.0 39.00 39.00 0.0
p07.pddl
20.00 20.00 0.0 20.00 20.00 0.0
p08.pddl
28.00 28.00 0.0 26.00 26.00 0.0
p09.pddl
36.00 36.00 0.0 34.00 34.00 0.0
p10.pddl
39.00 39.00 0.0 39.00 39.00 0.0
p11.pddl
36.00 36.00 0.0 36.00 36.00 0.0
p12.pddl
21.00 21.00 0.0 21.00 21.00 0.0
p13.pddl
46.00 46.00 0.0 46.00 46.00 0.0
p14.pddl
33.00 33.00 0.0 34.00 34.00 0.0
p15.pddl
46.00 46.00 0.0 45.00 45.00 0.0
p16.pddl
44.00 44.00 0.0 44.00 44.00 0.0
p17.pddl
54.00 54.00 0.0 50.00 50.00 0.0
p18.pddl
46.00 46.00 0.0 47.00 47.00 0.0
p19.pddl
74.00 74.00 0.0 None None -
p20.pddl
99.00 99.00 0.0 None None -
p21.pddl
71.00 71.00 0.0 None None -
p22.pddl
76.00 76.00 0.0 67.00 67.00 0.0
p23.pddl
83.00 83.00 0.0 None None -
p24.pddl
116.00 116.00 0.0 None None -
p25.pddl
30.00 30.00 0.0 30.00 30.00 0.0
p26.pddl
64.00 64.00 0.0 None None -
p27.pddl
103.00 103.00 0.0 None None -
p28.pddl
84.00 84.00 0.0 None None -
p29.pddl
63.00 63.00 0.0 None None -
p30.pddl
119.00 119.00 0.0 None None -
p31.pddl
129.00 129.00 0.0 None None -
p32.pddl
173.00 173.00 0.0 None None -
p33.pddl
270.00 270.00 0.0 None None -
p34.pddl
143.00 143.00 0.0 None None -
p35.pddl
418.00 418.00 0.0 None None -
p36.pddl
235.00 235.00 0.0 None None -
p37.pddl
411.00 411.00 0.0 None None -
p38.pddl
300.00 300.00 0.0 None None -
p39.pddl
358.00 358.00 0.0 None None -
p40.pddl
360.00 360.00 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
satellite
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
9.00 9.00 0.0 9.00 9.00 0.0
p02-pfile2.pddl
13.00 13.00 0.0 13.00 13.00 0.0
p03-pfile3.pddl
11.00 11.00 0.0 11.00 11.00 0.0
p04-pfile4.pddl
21.00 21.00 0.0 21.00 21.00 0.0
p05-pfile5.pddl
20.00 20.00 0.0 24.00 24.00 0.0
p06-pfile6.pddl
20.00 20.00 0.0 20.00 20.00 0.0
p07-pfile7.pddl
22.00 22.00 0.0 22.00 22.00 0.0
p08-pfile8.pddl
29.00 29.00 0.0 31.00 31.00 0.0
p09-pfile9.pddl
37.00 37.00 0.0 33.00 33.00 0.0
p10-pfile10.pddl
35.00 35.00 0.0 31.00 31.00 0.0
p11-pfile11.pddl
34.00 34.00 0.0 35.00 35.00 0.0
p12-pfile12.pddl
43.00 43.00 0.0 46.00 46.00 0.0
p13-pfile13.pddl
78.00 78.00 0.0 None None -
p14-pfile14.pddl
43.00 43.00 0.0 43.00 43.00 0.0
p15-pfile15.pddl
53.00 53.00 0.0 None None -
p16-pfile16.pddl
48.00 48.00 0.0 None None -
p17-pfile17.pddl
47.00 47.00 0.0 None None -
p18-pfile18.pddl
36.00 36.00 0.0 None None -
p19-pfile19.pddl
69.00 69.00 0.0 None None -
p20-pfile20.pddl
107.00 107.00 0.0 None None -
p21-HC-pfile1.pddl
84.00 84.00 0.0 74.00 74.00 0.0
p22-HC-pfile2.pddl
107.00 107.00 0.0 None None -
p23-HC-pfile3.pddl
133.00 133.00 0.0 100.00 100.00 0.0
p24-HC-pfile4.pddl
186.00 186.00 0.0 None None -
p25-HC-pfile5.pddl
182.00 182.00 0.0 None None -
p26-HC-pfile6.pddl
164.00 164.00 0.0 None None -
p27-HC-pfile7.pddl
136.00 136.00 0.0 None None -
p28-HC-pfile8.pddl
220.00 220.00 0.0 None None -
p29-HC-pfile9.pddl
192.00 192.00 0.0 None None -
p30-HC-pfile10.pddl
288.00 288.00 0.0 None None -
p31-HC-pfile11.pddl
272.00 272.00 0.0 None None -
p32-HC-pfile12.pddl
411.00 411.00 0.0 None None -
p33-HC-pfile13.pddl
556.00 556.00 0.0 None None -
p34-HC-pfile14.pddl
288.00 288.00 0.0 None None -
p35-HC-pfile15.pddl
478.00 478.00 0.0 None None -
p36-HC-pfile16.pddl
360.00 360.00 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-08-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
30.00 30.00 0.0 20.00 20.00 0.0
p02.pddl
34.00 34.00 0.0 26.00 26.00 0.0
p03.pddl
42.00 42.00 0.0 30.00 30.00 0.0
p04.pddl
42.00 42.00 0.0 28.00 28.00 0.0
p05.pddl
48.00 48.00 0.0 36.00 36.00 0.0
p06.pddl
60.00 60.00 0.0 42.00 42.00 0.0
p07.pddl
54.00 54.00 0.0 36.00 36.00 0.0
p08.pddl
62.00 62.00 0.0 46.00 46.00 0.0
p09.pddl
76.00 76.00 0.0 54.00 54.00 0.0
p10.pddl
66.00 66.00 0.0 44.00 44.00 0.0
p11.pddl
76.00 76.00 0.0 56.00 56.00 0.0
p12.pddl
94.00 94.00 0.0 66.00 66.00 0.0
p13.pddl
78.00 78.00 0.0 52.00 52.00 0.0
p14.pddl
90.00 90.00 0.0 66.00 66.00 0.0
p15.pddl
112.00 112.00 0.0 78.00 78.00 0.0
p16.pddl
90.00 90.00 0.0 60.00 60.00 0.0
p17.pddl
104.00 104.00 0.0 76.00 76.00 0.0
p18.pddl
130.00 130.00 0.0 90.00 90.00 0.0
p19.pddl
102.00 102.00 0.0 68.00 68.00 0.0
p20.pddl
118.00 118.00 0.0 86.00 86.00 0.0
p21.pddl
148.00 148.00 0.0 102.00 102.00 0.0
p22.pddl
15.00 15.00 0.0 13.00 13.00 0.0
p23.pddl
15.00 15.00 0.0 13.00 13.00 0.0
p24.pddl
15.00 15.00 0.0 13.00 13.00 0.0
p25.pddl
30.00 30.00 0.0 30.00 30.00 0.0
p26.pddl
66.00 66.00 0.0 46.00 46.00 0.0
p27.pddl
58.00 58.00 0.0 102.00 102.00 0.0
p28.pddl
45.00 45.00 0.0 47.00 47.00 0.0
p29.pddl
179.00 179.00 0.0 79.00 79.00 0.0
p30.pddl
89.00 89.00 0.0 131.00 131.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
15.00 15.00 0.0 13.00 13.00 0.0
p02.pddl
34.00 34.00 0.0 26.00 26.00 0.0
p03.pddl
42.00 42.00 0.0 30.00 30.00 0.0
p04.pddl
42.00 42.00 0.0 28.00 28.00 0.0
p05.pddl
54.00 54.00 0.0 36.00 36.00 0.0
p06.pddl
48.00 48.00 0.0 36.00 36.00 0.0
p07.pddl
102.00 102.00 0.0 68.00 68.00 0.0
p08.pddl
66.00 66.00 0.0 44.00 44.00 0.0
p09.pddl
78.00 78.00 0.0 52.00 52.00 0.0
p10.pddl
90.00 90.00 0.0 60.00 60.00 0.0
p11.pddl
30.00 30.00 0.0 30.00 30.00 0.0
p12.pddl
60.00 60.00 0.0 42.00 42.00 0.0
p13.pddl
58.00 58.00 0.0 102.00 102.00 0.0
p14.pddl
66.00 66.00 0.0 46.00 46.00 0.0
p15.pddl
62.00 62.00 0.0 46.00 46.00 0.0
p16.pddl
76.00 76.00 0.0 56.00 56.00 0.0
p17.pddl
90.00 90.00 0.0 66.00 66.00 0.0
p18.pddl
104.00 104.00 0.0 76.00 76.00 0.0
p19.pddl
118.00 118.00 0.0 86.00 86.00 0.0
p20.pddl
45.00 45.00 0.0 47.00 47.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
snake-opt18-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
30.00 30.00 0.0 25.00 25.00 0.0
p02.pddl
54.00 54.00 0.0 54.00 54.00 0.0
p03.pddl
53.00 53.00 0.0 49.00 49.00 0.0
p04.pddl
14.00 14.00 0.0 12.00 12.00 0.0
p05.pddl
17.00 17.00 0.0 17.00 17.00 0.0
p06.pddl
35.00 35.00 0.0 35.00 35.00 0.0
p07.pddl
87.00 87.00 0.0 53.00 53.00 0.0
p08.pddl
None None - 61.00 61.00 0.0
p09.pddl
20.00 20.00 0.0 26.00 26.00 0.0
p10.pddl
27.00 27.00 0.0 33.00 33.00 0.0
p11.pddl
58.00 58.00 0.0 50.00 50.00 0.0
p12.pddl
104.00 104.00 0.0 53.00 53.00 0.0
p13.pddl
96.00 96.00 0.0 None None -
p14.pddl
None None - None None -
p15.pddl
35.00 35.00 0.0 27.00 27.00 0.0
p16.pddl
82.00 82.00 0.0 44.00 44.00 0.0
p17.pddl
157.00 157.00 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
59.00 59.00 0.0 34.00 34.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt08-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
13.00 13.00 0.0 11.00 11.00 0.0
p02.pddl
13.00 13.00 0.0 13.00 13.00 0.0
p03.pddl
10.00 10.00 0.0 10.00 10.00 0.0
p04.pddl
33.00 33.00 0.0 33.00 33.00 0.0
p05.pddl
8.00 8.00 0.0 None None -
p06.pddl
13.00 13.00 0.0 9.00 9.00 0.0
p07.pddl
31.00 31.00 0.0 25.00 25.00 0.0
p08.pddl
35.00 35.00 0.0 49.00 49.00 0.0
p09.pddl
23.00 23.00 0.0 23.00 23.00 0.0
p10.pddl
38.00 38.00 0.0 30.00 30.00 0.0
p11.pddl
49.00 49.00 0.0 45.00 45.00 0.0
p12.pddl
44.00 44.00 0.0 32.00 32.00 0.0
p13.pddl
26.00 26.00 0.0 44.00 44.00 0.0
p14.pddl
29.00 29.00 0.0 29.00 29.00 0.0
p15.pddl
92.00 92.00 0.0 78.00 78.00 0.0
p16.pddl
64.00 64.00 0.0 54.00 54.00 0.0
p17.pddl
49.00 49.00 0.0 37.00 37.00 0.0
p18.pddl
61.00 61.00 0.0 67.00 67.00 0.0
p19.pddl
69.00 69.00 0.0 107.00 107.00 0.0
p20.pddl
4.00 4.00 0.0 6.00 6.00 0.0
p21.pddl
14.00 14.00 0.0 10.00 10.00 0.0
p22.pddl
92.00 92.00 0.0 90.00 90.00 0.0
p23.pddl
31.00 31.00 0.0 31.00 31.00 0.0
p24.pddl
114.00 114.00 0.0 None None -
p25.pddl
59.00 59.00 0.0 None None -
p26.pddl
67.00 67.00 0.0 None None -
p27.pddl
41.00 41.00 0.0 27.00 27.00 0.0
p28.pddl
85.00 85.00 0.0 45.00 45.00 0.0
p29.pddl
18.00 18.00 0.0 None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
13.00 13.00 0.0 9.00 9.00 0.0
p02.pddl
49.00 49.00 0.0 37.00 37.00 0.0
p03.pddl
29.00 29.00 0.0 29.00 29.00 0.0
p04.pddl
33.00 33.00 0.0 33.00 33.00 0.0
p05.pddl
64.00 64.00 0.0 54.00 54.00 0.0
p06.pddl
49.00 49.00 0.0 45.00 45.00 0.0
p07.pddl
38.00 38.00 0.0 30.00 30.00 0.0
p08.pddl
23.00 23.00 0.0 23.00 23.00 0.0
p09.pddl
31.00 31.00 0.0 25.00 25.00 0.0
p10.pddl
8.00 8.00 0.0 None None -
p11.pddl
26.00 26.00 0.0 44.00 44.00 0.0
p12.pddl
4.00 4.00 0.0 6.00 6.00 0.0
p13.pddl
35.00 35.00 0.0 49.00 49.00 0.0
p14.pddl
44.00 44.00 0.0 32.00 32.00 0.0
p15.pddl
61.00 61.00 0.0 67.00 67.00 0.0
p16.pddl
92.00 92.00 0.0 78.00 78.00 0.0
p17.pddl
69.00 69.00 0.0 107.00 107.00 0.0
p18.pddl
14.00 14.00 0.0 10.00 10.00 0.0
p19.pddl
92.00 92.00 0.0 90.00 90.00 0.0
p20.pddl
31.00 31.00 0.0 31.00 31.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
spider-opt18-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
16.00 16.00 0.0 16.00 16.00 0.0
p02.pddl
23.00 23.00 0.0 25.00 25.00 0.0
p03.pddl
31.00 31.00 0.0 32.00 32.00 0.0
p04.pddl
32.00 32.00 0.0 41.00 41.00 0.0
p05.pddl
50.00 50.00 0.0 56.00 56.00 0.0
p06.pddl
70.00 70.00 0.0 95.00 95.00 0.0
p07.pddl
18.00 18.00 0.0 16.00 16.00 0.0
p08.pddl
21.00 21.00 0.0 18.00 18.00 0.0
p09.pddl
39.00 39.00 0.0 37.00 37.00 0.0
p10.pddl
37.00 37.00 0.0 38.00 38.00 0.0
p11.pddl
40.00 40.00 0.0 44.00 44.00 0.0
p12.pddl
45.00 45.00 0.0 51.00 51.00 0.0
p13.pddl
62.00 62.00 0.0 77.00 77.00 0.0
p14.pddl
12.00 12.00 0.0 12.00 12.00 0.0
p15.pddl
17.00 17.00 0.0 19.00 19.00 0.0
p16.pddl
19.00 19.00 0.0 22.00 22.00 0.0
p17.pddl
36.00 36.00 0.0 32.00 32.00 0.0
p18.pddl
38.00 38.00 0.0 38.00 38.00 0.0
p19.pddl
36.00 36.00 0.0 39.00 39.00 0.0
p20.pddl
46.00 46.00 0.0 44.00 44.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
storage
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
3.00 3.00 0.0 3.00 3.00 0.0
p02.pddl
3.00 3.00 0.0 3.00 3.00 0.0
p03.pddl
3.00 3.00 0.0 3.00 3.00 0.0
p04.pddl
8.00 8.00 0.0 12.00 12.00 0.0
p05.pddl
11.00 11.00 0.0 8.00 8.00 0.0
p06.pddl
9.00 9.00 0.0 8.00 8.00 0.0
p07.pddl
14.00 14.00 0.0 20.00 20.00 0.0
p08.pddl
14.00 14.00 0.0 12.00 12.00 0.0
p09.pddl
14.00 14.00 0.0 11.00 11.00 0.0
p10.pddl
18.00 18.00 0.0 26.00 26.00 0.0
p11.pddl
34.00 34.00 0.0 20.00 20.00 0.0
p12.pddl
34.00 34.00 0.0 19.00 19.00 0.0
p13.pddl
38.00 38.00 0.0 28.00 28.00 0.0
p14.pddl
34.00 34.00 0.0 21.00 21.00 0.0
p15.pddl
22.00 22.00 0.0 20.00 20.00 0.0
p16.pddl
26.00 26.00 0.0 22.00 22.00 0.0
p17.pddl
33.00 33.00 0.0 29.00 29.00 0.0
p18.pddl
63.00 63.00 0.0 None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
79.00 79.00 0.0 None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
termes-opt18-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
66.00 66.00 0.0 36.00 36.00 0.0
p02.pddl
108.00 108.00 0.0 62.00 62.00 0.0
p03.pddl
146.00 146.00 0.0 78.00 78.00 0.0
p04.pddl
270.00 270.00 0.0 108.00 108.00 0.0
p05.pddl
258.00 258.00 0.0 154.00 154.00 0.0
p06.pddl
220.00 220.00 0.0 220.00 220.00 0.0
p07.pddl
386.00 386.00 0.0 422.00 422.00 0.0
p08.pddl
500.00 500.00 0.0 390.00 390.00 0.0
p09.pddl
None None - None None -
p10.pddl
738.00 738.00 0.0 None None -
p11.pddl
142.00 142.00 0.0 120.00 120.00 0.0
p12.pddl
150.00 150.00 0.0 78.00 78.00 0.0
p13.pddl
160.00 160.00 0.0 156.00 156.00 0.0
p14.pddl
264.00 264.00 0.0 150.00 150.00 0.0
p15.pddl
428.00 428.00 0.0 214.00 214.00 0.0
p16.pddl
386.00 386.00 0.0 316.00 316.00 0.0
p17.pddl
292.00 292.00 0.0 230.00 230.00 0.0
p18.pddl
132.00 132.00 0.0 132.00 132.00 0.0
p19.pddl
198.00 198.00 0.0 174.00 174.00 0.0
p20.pddl
250.00 250.00 0.0 206.00 206.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tetris-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
79.00 79.00 0.0 30.00 30.00 0.0
p01-8.pddl
75.00 75.00 0.0 36.00 36.00 0.0
p01-10.pddl
60.00 60.00 0.0 48.00 48.00 0.0
p02-4.pddl
24.00 24.00 0.0 10.00 10.00 0.0
p02-6.pddl
76.00 76.00 0.0 32.00 32.00 0.0
p02-8.pddl
69.00 69.00 0.0 44.00 44.00 0.0
p02-10.pddl
69.00 69.00 0.0 54.00 54.00 0.0
p03-4.pddl
12.00 12.00 0.0 11.00 11.00 0.0
p03-6.pddl
43.00 43.00 0.0 24.00 24.00 0.0
p03-8.pddl
82.00 82.00 0.0 48.00 48.00 0.0
p03-10.pddl
119.00 119.00 0.0 78.00 78.00 0.0
p04-6.pddl
39.00 39.00 0.0 31.00 31.00 0.0
p04-8.pddl
72.00 72.00 0.0 56.00 56.00 0.0
p04-10.pddl
95.00 95.00 0.0 76.00 76.00 0.0
p05-6.pddl
66.00 66.00 0.0 19.00 19.00 0.0
p05-8.pddl
144.00 144.00 0.0 60.00 60.00 0.0
p05-10.pddl
72.00 72.00 0.0 69.00 69.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
4.00 4.00 0.0 4.00 4.00 0.0
p02.pddl
35.00 35.00 0.0 45.00 45.00 0.0
p03.pddl
25.00 25.00 0.0 21.00 21.00 0.0
p04.pddl
38.00 38.00 0.0 60.00 60.00 0.0
p05.pddl
40.00 40.00 0.0 50.00 50.00 0.0
p06.pddl
38.00 38.00 0.0 52.00 52.00 0.0
p07.pddl
27.00 27.00 0.0 20.00 20.00 0.0
p08.pddl
49.00 49.00 0.0 65.00 65.00 0.0
p09.pddl
41.00 41.00 0.0 35.00 35.00 0.0
p10.pddl
34.00 34.00 0.0 50.00 50.00 0.0
p11.pddl
29.00 29.00 0.0 35.00 35.00 0.0
p12.pddl
60.00 60.00 0.0 61.00 61.00 0.0
p13.pddl
38.00 38.00 0.0 42.00 42.00 0.0
p14.pddl
43.00 43.00 0.0 25.00 25.00 0.0
p15.pddl
None None - 49.00 49.00 0.0
p16.pddl
50.00 50.00 0.0 63.00 63.00 0.0
p17.pddl
67.00 67.00 0.0 79.00 79.00 0.0
p18.pddl
65.00 65.00 0.0 71.00 71.00 0.0
p19.pddl
63.00 63.00 0.0 53.00 53.00 0.0
p20.pddl
92.00 92.00 0.0 67.00 67.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
91.00 91.00 0.0 103.00 103.00 0.0
p02.pddl
74.00 74.00 0.0 57.00 57.00 0.0
p03.pddl
47.00 47.00 0.0 52.00 52.00 0.0
p04.pddl
24.00 24.00 0.0 26.00 26.00 0.0
p05.pddl
64.00 64.00 0.0 69.00 69.00 0.0
p06.pddl
113.00 113.00 0.0 101.00 101.00 0.0
p07.pddl
49.00 49.00 0.0 49.00 49.00 0.0
p08.pddl
28.00 28.00 0.0 28.00 28.00 0.0
p09.pddl
39.00 39.00 0.0 47.00 47.00 0.0
p10.pddl
88.00 88.00 0.0 78.00 78.00 0.0
p11.pddl
29.00 29.00 0.0 35.00 35.00 0.0
p12.pddl
60.00 60.00 0.0 61.00 61.00 0.0
p13.pddl
38.00 38.00 0.0 42.00 42.00 0.0
p14.pddl
43.00 43.00 0.0 25.00 25.00 0.0
p15.pddl
None None - 49.00 49.00 0.0
p16.pddl
50.00 50.00 0.0 63.00 63.00 0.0
p17.pddl
67.00 67.00 0.0 79.00 79.00 0.0
p18.pddl
65.00 65.00 0.0 71.00 71.00 0.0
p19.pddl
63.00 63.00 0.0 53.00 53.00 0.0
p20.pddl
92.00 92.00 0.0 67.00 67.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tpp
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
5.00 5.00 0.0 5.00 5.00 0.0
p02.pddl
8.00 8.00 0.0 8.00 8.00 0.0
p03.pddl
11.00 11.00 0.0 11.00 11.00 0.0
p04.pddl
14.00 14.00 0.0 14.00 14.00 0.0
p05.pddl
19.00 19.00 0.0 35.00 35.00 0.0
p06.pddl
29.00 29.00 0.0 47.00 47.00 0.0
p07.pddl
46.00 46.00 0.0 68.00 68.00 0.0
p08.pddl
56.00 56.00 0.0 82.00 82.00 0.0
p09.pddl
58.00 58.00 0.0 90.00 90.00 0.0
p10.pddl
74.00 74.00 0.0 108.00 108.00 0.0
p11.pddl
103.00 103.00 0.0 125.00 125.00 0.0
p12.pddl
91.00 91.00 0.0 121.00 121.00 0.0
p13.pddl
59.00 59.00 0.0 73.00 73.00 0.0
p14.pddl
89.00 89.00 0.0 111.00 111.00 0.0
p15.pddl
105.00 105.00 0.0 129.00 129.00 0.0
p16.pddl
128.00 128.00 0.0 168.00 168.00 0.0
p17.pddl
121.00 121.00 0.0 153.00 153.00 0.0
p18.pddl
106.00 106.00 0.0 132.00 132.00 0.0
p19.pddl
163.00 163.00 0.0 203.00 203.00 0.0
p20.pddl
208.00 208.00 0.0 246.00 246.00 0.0
p21.pddl
195.00 195.00 0.0 228.00 228.00 0.0
p22.pddl
136.00 136.00 0.0 167.00 167.00 0.0
p23.pddl
171.00 171.00 0.0 223.00 223.00 0.0
p24.pddl
173.00 173.00 0.0 217.00 217.00 0.0
p25.pddl
191.00 191.00 0.0 261.00 261.00 0.0
p26.pddl
198.00 198.00 0.0 262.00 262.00 0.0
p27.pddl
220.00 220.00 0.0 280.00 280.00 0.0
p28.pddl
238.00 238.00 0.0 None None -
p29.pddl
299.00 299.00 0.0 None None -
p30.pddl
302.00 302.00 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt08-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54.00 54.00 0.0 126.00 126.00 0.0
p02.pddl
131.00 131.00 0.0 295.00 295.00 0.0
p03.pddl
330.00 330.00 0.0 330.00 330.00 0.0
p04.pddl
526.00 526.00 0.0 425.00 425.00 0.0
p05.pddl
529.00 529.00 0.0 452.00 452.00 0.0
p06.pddl
747.00 747.00 0.0 670.00 670.00 0.0
p07.pddl
783.00 783.00 0.0 939.00 939.00 0.0
p08.pddl
790.00 790.00 0.0 947.00 947.00 0.0
p09.pddl
709.00 709.00 0.0 901.00 901.00 0.0
p10.pddl
974.00 974.00 0.0 1083.00 1083.00 0.0
p11.pddl
456.00 456.00 0.0 878.00 878.00 0.0
p12.pddl
594.00 594.00 0.0 1332.00 1332.00 0.0
p13.pddl
639.00 639.00 0.0 1617.00 1617.00 0.0
p14.pddl
1198.00 1198.00 0.0 2244.00 2244.00 0.0
p15.pddl
2216.00 2216.00 0.0 2468.00 2468.00 0.0
p16.pddl
2016.00 2016.00 0.0 2998.00 2998.00 0.0
p17.pddl
3352.00 3352.00 0.0 3958.00 3958.00 0.0
p18.pddl
2741.00 2741.00 0.0 4406.00 4406.00 0.0
p19.pddl
3540.00 3540.00 0.0 5189.00 5189.00 0.0
p20.pddl
4162.00 4162.00 0.0 6236.00 6236.00 0.0
p21.pddl
636.00 636.00 0.0 636.00 636.00 0.0
p22.pddl
632.00 632.00 0.0 632.00 632.00 0.0
p23.pddl
1280.00 1280.00 0.0 1102.00 1102.00 0.0
p24.pddl
695.00 695.00 0.0 1289.00 1289.00 0.0
p25.pddl
1538.00 1538.00 0.0 1530.00 1530.00 0.0
p26.pddl
1472.00 1472.00 0.0 1289.00 1289.00 0.0
p27.pddl
1117.00 1117.00 0.0 1384.00 1384.00 0.0
p28.pddl
3229.00 3229.00 0.0 2792.00 2792.00 0.0
p29.pddl
2405.00 2405.00 0.0 2678.00 2678.00 0.0
p30.pddl
2061.00 2061.00 0.0 2746.00 2746.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1280.00 1280.00 0.0 1102.00 1102.00 0.0
p02.pddl
330.00 330.00 0.0 330.00 330.00 0.0
p03.pddl
594.00 594.00 0.0 1332.00 1332.00 0.0
p04.pddl
639.00 639.00 0.0 1617.00 1617.00 0.0
p05.pddl
695.00 695.00 0.0 1289.00 1289.00 0.0
p06.pddl
526.00 526.00 0.0 425.00 425.00 0.0
p07.pddl
390.00 390.00 0.0 374.00 374.00 0.0
p08.pddl
466.00 466.00 0.0 608.00 608.00 0.0
p09.pddl
496.00 496.00 0.0 482.00 482.00 0.0
p10.pddl
787.00 787.00 0.0 695.00 695.00 0.0
p11.pddl
2856.00 2856.00 0.0 3640.00 3640.00 0.0
p12.pddl
2976.00 2976.00 0.0 3704.00 3704.00 0.0
p13.pddl
618.00 618.00 0.0 919.00 919.00 0.0
p14.pddl
695.00 695.00 0.0 665.00 665.00 0.0
p15.pddl
1825.00 1825.00 0.0 2002.00 2002.00 0.0
p16.pddl
2346.00 2346.00 0.0 2517.00 2517.00 0.0
p17.pddl
529.00 529.00 0.0 452.00 452.00 0.0
p18.pddl
1198.00 1198.00 0.0 2244.00 2244.00 0.0
p19.pddl
1538.00 1538.00 0.0 1530.00 1530.00 0.0
p20.pddl
747.00 747.00 0.0 670.00 670.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
170.00 170.00 0.0 286.00 286.00 0.0
p02.pddl
238.00 238.00 0.0 287.00 287.00 0.0
p03.pddl
439.00 439.00 0.0 463.00 463.00 0.0
p04.pddl
351.00 351.00 0.0 331.00 331.00 0.0
p05.pddl
663.00 663.00 0.0 853.00 853.00 0.0
p06.pddl
713.00 713.00 0.0 703.00 703.00 0.0
p07.pddl
1618.00 1618.00 0.0 2024.00 2024.00 0.0
p08.pddl
1378.00 1378.00 0.0 2136.00 2136.00 0.0
p09.pddl
1111.00 1111.00 0.0 2180.00 2180.00 0.0
p10.pddl
1484.00 1484.00 0.0 2719.00 2719.00 0.0
p11.pddl
1978.00 1978.00 0.0 2866.00 2866.00 0.0
p12.pddl
2246.00 2246.00 0.0 3497.00 3497.00 0.0
p13.pddl
666.00 666.00 0.0 1589.00 1589.00 0.0
p14.pddl
797.00 797.00 0.0 858.00 858.00 0.0
p15.pddl
1009.00 1009.00 0.0 1260.00 1260.00 0.0
p16.pddl
1695.00 1695.00 0.0 1881.00 1881.00 0.0
p17.pddl
1844.00 1844.00 0.0 1783.00 1783.00 0.0
p18.pddl
2024.00 2024.00 0.0 1715.00 1715.00 0.0
p19.pddl
2678.00 2678.00 0.0 2294.00 2294.00 0.0
p20.pddl
2678.00 2678.00 0.0 2294.00 2294.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
trucks-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
15.00 15.00 0.0 14.00 14.00 0.0
p02.pddl
18.00 18.00 0.0 18.00 18.00 0.0
p03.pddl
24.00 24.00 0.0 23.00 23.00 0.0
p04.pddl
27.00 27.00 0.0 27.00 27.00 0.0
p05.pddl
31.00 31.00 0.0 31.00 31.00 0.0
p06.pddl
36.00 36.00 0.0 35.00 35.00 0.0
p07.pddl
26.00 26.00 0.0 26.00 26.00 0.0
p08.pddl
33.00 33.00 0.0 None None -
p09.pddl
36.00 36.00 0.0 None None -
p10.pddl
41.00 41.00 0.0 None None -
p11.pddl
46.00 46.00 0.0 None None -
p12.pddl
47.00 47.00 0.0 None None -
p13.pddl
37.00 37.00 0.0 None None -
p14.pddl
44.00 44.00 0.0 None None -
p15.pddl
48.00 48.00 0.0 None None -
p16.pddl
51.00 51.00 0.0 None None -
p17.pddl
55.00 55.00 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
None None - None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
3.00 3.00 0.0 3.00 3.00 0.0
problem02-half.pddl
1.00 1.00 0.0 1.00 1.00 0.0
problem03-full.pddl
12.00 12.00 0.0 8.00 8.00 0.0
problem03-half.pddl
7.00 7.00 0.0 6.00 6.00 0.0
problem04-full.pddl
17.00 17.00 0.0 15.00 15.00 0.0
problem04-half.pddl
11.00 11.00 0.0 11.00 11.00 0.0
problem05-full.pddl
27.00 27.00 0.0 24.00 24.00 0.0
problem05-half.pddl
21.00 21.00 0.0 22.00 22.00 0.0
problem06-full.pddl
47.00 47.00 0.0 35.00 35.00 0.0
problem06-half.pddl
29.00 29.00 0.0 28.00 28.00 0.0
problem07-full.pddl
52.00 52.00 0.0 52.00 52.00 0.0
problem07-half.pddl
46.00 46.00 0.0 44.00 44.00 0.0
problem08-full.pddl
76.00 76.00 0.0 63.00 63.00 0.0
problem08-half.pddl
55.00 55.00 0.0 47.00 47.00 0.0
problem09-full.pddl
96.00 96.00 0.0 80.00 80.00 0.0
problem09-half.pddl
90.00 90.00 0.0 78.00 78.00 0.0
problem10-full.pddl
118.00 118.00 0.0 99.00 99.00 0.0
problem10-half.pddl
87.00 87.00 0.0 76.00 76.00 0.0
problem11-full.pddl
151.00 151.00 0.0 126.00 126.00 0.0
problem11-half.pddl
93.00 93.00 0.0 95.00 95.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt14-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
27.00 27.00 0.0 24.00 24.00 0.0
p-1-6.pddl
47.00 47.00 0.0 35.00 35.00 0.0
p-1-7.pddl
52.00 52.00 0.0 52.00 52.00 0.0
p-1-8.pddl
76.00 76.00 0.0 63.00 63.00 0.0
p-1-9.pddl
96.00 96.00 0.0 80.00 80.00 0.0
p-1-10.pddl
118.00 118.00 0.0 99.00 99.00 0.0
p-1-11.pddl
151.00 151.00 0.0 126.00 126.00 0.0
p-1-12.pddl
164.00 164.00 0.0 145.00 145.00 0.0
p-1-13.pddl
228.00 228.00 0.0 172.00 172.00 0.0
p-1-14.pddl
272.00 272.00 0.0 199.00 199.00 0.0
p-1-15.pddl
296.00 296.00 0.0 234.00 234.00 0.0
p-1-16.pddl
383.00 383.00 0.0 261.00 261.00 0.0
p-1-17.pddl
364.00 364.00 0.0 300.00 300.00 0.0
p-1-18.pddl
444.00 444.00 0.0 333.00 333.00 0.0
p-05-5.pddl
27.00 27.00 0.0 22.00 22.00 0.0
p-05-6.pddl
29.00 29.00 0.0 28.00 28.00 0.0
p-05-7.pddl
44.00 44.00 0.0 37.00 37.00 0.0
p-05-8.pddl
65.00 65.00 0.0 48.00 48.00 0.0
p-05-9.pddl
78.00 78.00 0.0 64.00 64.00 0.0
p-05-10.pddl
76.00 76.00 0.0 68.00 68.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt08-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
180.00 180.00 0.0 190.00 190.00 0.0
p02.pddl
270.00 270.00 0.0 245.00 245.00 0.0
p03.pddl
350.00 350.00 0.0 360.00 360.00 0.0
p04.pddl
340.00 340.00 0.0 None None -
p05.pddl
330.00 330.00 0.0 335.00 335.00 0.0
p06.pddl
560.00 560.00 0.0 550.00 550.00 0.0
p07.pddl
505.00 505.00 0.0 515.00 515.00 0.0
p08.pddl
540.00 540.00 0.0 None None -
p09.pddl
515.00 515.00 0.0 None None -
p10.pddl
720.00 720.00 0.0 735.00 735.00 0.0
p11.pddl
165.00 165.00 0.0 145.00 145.00 0.0
p12.pddl
270.00 270.00 0.0 290.00 290.00 0.0
p13.pddl
270.00 270.00 0.0 310.00 310.00 0.0
p14.pddl
285.00 285.00 0.0 275.00 275.00 0.0
p15.pddl
425.00 425.00 0.0 390.00 390.00 0.0
p16.pddl
360.00 360.00 0.0 None None -
p17.pddl
415.00 415.00 0.0 405.00 405.00 0.0
p18.pddl
560.00 560.00 0.0 575.00 575.00 0.0
p19.pddl
565.00 565.00 0.0 555.00 555.00 0.0
p20.pddl
630.00 630.00 0.0 705.00 705.00 0.0
p21.pddl
110.00 110.00 0.0 105.00 105.00 0.0
p22.pddl
195.00 195.00 0.0 195.00 195.00 0.0
p23.pddl
235.00 235.00 0.0 230.00 230.00 0.0
p24.pddl
295.00 295.00 0.0 295.00 295.00 0.0
p25.pddl
520.00 520.00 0.0 505.00 505.00 0.0
p26.pddl
345.00 345.00 0.0 None None -
p27.pddl
475.00 475.00 0.0 None None -
p28.pddl
655.00 655.00 0.0 None None -
p29.pddl
685.00 685.00 0.0 675.00 675.00 0.0
p30.pddl
820.00 820.00 0.0 860.00 860.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt11-strips
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
235.00 235.00 0.0 230.00 230.00 0.0
p02.pddl
270.00 270.00 0.0 290.00 290.00 0.0
p03.pddl
270.00 270.00 0.0 310.00 310.00 0.0
p04.pddl
350.00 350.00 0.0 360.00 360.00 0.0
p05.pddl
295.00 295.00 0.0 295.00 295.00 0.0
p06.pddl
340.00 340.00 0.0 None None -
p07.pddl
285.00 285.00 0.0 275.00 275.00 0.0
p08.pddl
520.00 520.00 0.0 505.00 505.00 0.0
p09.pddl
330.00 330.00 0.0 335.00 335.00 0.0
p10.pddl
425.00 425.00 0.0 390.00 390.00 0.0
p11.pddl
345.00 345.00 0.0 None None -
p12.pddl
360.00 360.00 0.0 None None -
p13.pddl
560.00 560.00 0.0 550.00 550.00 0.0
p14.pddl
475.00 475.00 0.0 None None -
p15.pddl
415.00 415.00 0.0 405.00 405.00 0.0
p16.pddl
505.00 505.00 0.0 515.00 515.00 0.0
p17.pddl
655.00 655.00 0.0 None None -
p18.pddl
560.00 560.00 0.0 575.00 575.00 0.0
p19.pddl
540.00 540.00 0.0 None None -
p20.pddl
685.00 685.00 0.0 675.00 675.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
zenotravel
Show table
cost
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.00 1.00 0.0 1.00 1.00 0.0
p02.pddl
8.00 8.00 0.0 6.00 6.00 0.0
p03.pddl
6.00 6.00 0.0 6.00 6.00 0.0
p04.pddl
9.00 9.00 0.0 11.00 11.00 0.0
p05.pddl
12.00 12.00 0.0 14.00 14.00 0.0
p06.pddl
12.00 12.00 0.0 14.00 14.00 0.0
p07.pddl
18.00 18.00 0.0 21.00 21.00 0.0
p08.pddl
15.00 15.00 0.0 16.00 16.00 0.0
p09.pddl
25.00 25.00 0.0 26.00 26.00 0.0
p10.pddl
26.00 26.00 0.0 29.00 29.00 0.0
p11.pddl
16.00 16.00 0.0 16.00 16.00 0.0
p12.pddl
23.00 23.00 0.0 23.00 23.00 0.0
p13.pddl
35.00 35.00 0.0 38.00 38.00 0.0
p14.pddl
40.00 40.00 0.0 41.00 41.00 0.0
p15.pddl
47.00 47.00 0.0 55.00 55.00 0.0
p16.pddl
51.00 51.00 0.0 56.00 56.00 0.0
p17.pddl
89.00 89.00 0.0 99.00 99.00 0.0
p18.pddl
74.00 74.00 0.0 76.00 76.00 0.0
p19.pddl
100.00 100.00 0.0 108.00 108.00 0.0
p20.pddl
104.00 104.00 0.0 116.00 116.00 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
coverage
Show table
The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
airport
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
1 1 0.0 1 1 0.0
p02-airport1-p1.pddl
1 1 0.0 1 1 0.0
p03-airport1-p2.pddl
1 1 0.0 1 1 0.0
p04-airport2-p1.pddl
1 1 0.0 1 1 0.0
p05-airport2-p1.pddl
1 1 0.0 1 1 0.0
p06-airport2-p2.pddl
1 1 0.0 1 1 0.0
p07-airport2-p2.pddl
1 1 0.0 1 1 0.0
p08-airport2-p3.pddl
1 1 0.0 1 1 0.0
p09-airport2-p4.pddl
1 1 0.0 1 1 0.0
p10-airport3-p1.pddl
1 1 0.0 1 1 0.0
p11-airport3-p1.pddl
1 1 0.0 1 1 0.0
p12-airport3-p2.pddl
1 1 0.0 1 1 0.0
p13-airport3-p2.pddl
1 1 0.0 1 1 0.0
p14-airport3-p3.pddl
1 1 0.0 1 1 0.0
p15-airport3-p3.pddl
1 1 0.0 1 1 0.0
p16-airport3-p4.pddl
1 1 0.0 1 1 0.0
p17-airport3-p5.pddl
1 1 0.0 1 1 0.0
p18-airport3-p6.pddl
1 1 0.0 1 1 0.0
p19-airport3-p6.pddl
1 1 0.0 1 1 0.0
p20-airport3-p7.pddl
1 1 0.0 1 1 0.0
p21-airport4halfMUC-p2.pddl
1 1 0.0 1 1 0.0
p22-airport4halfMUC-p3.pddl
1 1 0.0 1 1 0.0
p23-airport4halfMUC-p4.pddl
1 1 0.0 1 1 0.0
p24-airport4halfMUC-p4.pddl
1 1 0.0 1 1 0.0
p25-airport4halfMUC-p5.pddl
1 1 0.0 0 0 0.0
p26-airport4halfMUC-p6.pddl
0 0 0.0 0 0 0.0
p27-airport4halfMUC-p6.pddl
1 1 0.0 0 0 0.0
p28-airport4halfMUC-p7.pddl
0 0 0.0 0 0 0.0
p29-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p30-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p31-airport4halfMUC-p9.pddl
0 0 0.0 0 0 0.0
p32-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p33-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p34-airport4halfMUC-p11.pddl
0 0 0.0 0 0 0.0
p35-airport4halfMUC-p12.pddl
0 0 0.0 0 0 0.0
p36-airport5MUC-p2.pddl
1 1 0.0 1 1 0.0
p37-airport5MUC-p3.pddl
1 1 0.0 1 1 0.0
p38-airport5MUC-p3.pddl
1 1 0.0 1 1 0.0
p39-airport5MUC-p4.pddl
1 1 0.0 0 0 0.0
p40-airport5MUC-p4.pddl
1 1 0.0 1 1 0.0
p41-airport5MUC-p4.pddl
1 1 0.0 0 0 0.0
p42-airport5MUC-p5.pddl
0 0 0.0 0 0 0.0
p43-airport5MUC-p5.pddl
1 1 0.0 1 1 0.0
p44-airport5MUC-p5.pddl
1 1 0.0 0 0 0.0
p45-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p46-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p47-airport5MUC-p8.pddl
0 0 0.0 0 0 0.0
p48-airport5MUC-p9.pddl
0 0 0.0 0 0 0.0
p49-airport5MUC-p10.pddl
0 0 0.0 0 0 0.0
p50-airport5MUC-p15.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
1 1 0.0 1 1 0.0
pfile01-002.pddl
1 1 0.0 1 1 0.0
pfile01-003.pddl
1 1 0.0 1 1 0.0
pfile01-004.pddl
1 1 0.0 1 1 0.0
pfile02-005.pddl
1 1 0.0 1 1 0.0
pfile02-006.pddl
1 1 0.0 1 1 0.0
pfile02-007.pddl
1 1 0.0 1 1 0.0
pfile02-008.pddl
1 1 0.0 1 1 0.0
pfile03-009.pddl
1 1 0.0 1 1 0.0
pfile03-010.pddl
1 1 0.0 1 1 0.0
pfile03-011.pddl
1 1 0.0 1 1 0.0
pfile03-012.pddl
1 1 0.0 1 1 0.0
pfile04-013.pddl
1 1 0.0 1 1 0.0
pfile04-014.pddl
1 1 0.0 1 1 0.0
pfile04-015.pddl
1 1 0.0 1 1 0.0
pfile04-016.pddl
1 1 0.0 1 1 0.0
pfile05-017.pddl
1 1 0.0 1 1 0.0
pfile05-018.pddl
1 1 0.0 1 1 0.0
pfile05-019.pddl
1 1 0.0 1 1 0.0
pfile05-020.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
1 1 0.0 1 1 0.0
p435-2.pddl
1 1 0.0 1 1 0.0
p435-3.pddl
1 1 0.0 1 1 0.0
p536-1.pddl
1 1 0.0 1 1 0.0
p536-2.pddl
1 1 0.0 1 1 0.0
p536-3.pddl
1 1 0.0 1 1 0.0
p638-1.pddl
1 1 0.0 1 1 0.0
p638-2.pddl
1 1 0.0 1 1 0.0
p638-3.pddl
1 1 0.0 1 1 0.0
p739-1.pddl
1 1 0.0 1 1 0.0
p739-2.pddl
1 1 0.0 1 1 0.0
p739-3.pddl
1 1 0.0 1 1 0.0
p839-1.pddl
1 1 0.0 1 1 0.0
p839-2.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
blocks
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-4-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-4-2.pddl
1 1 0.0 1 1 0.0
probBLOCKS-5-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-5-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-5-2.pddl
1 1 0.0 1 1 0.0
probBLOCKS-6-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-6-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-6-2.pddl
1 1 0.0 1 1 0.0
probBLOCKS-7-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-7-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-7-2.pddl
1 1 0.0 1 1 0.0
probBLOCKS-8-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-8-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-8-2.pddl
1 1 0.0 1 1 0.0
probBLOCKS-9-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-9-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-9-2.pddl
1 1 0.0 1 1 0.0
probBLOCKS-10-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-10-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-10-2.pddl
1 1 0.0 1 1 0.0
probBLOCKS-11-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-11-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-11-2.pddl
1 1 0.0 1 1 0.0
probBLOCKS-12-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-12-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-13-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-13-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-14-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-14-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-15-0.pddl
1 1 0.0 1 1 0.0
probBLOCKS-15-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-16-1.pddl
1 1 0.0 1 1 0.0
probBLOCKS-16-2.pddl
1 1 0.0 1 1 0.0
probBLOCKS-17-0.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
childsnack-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
1 1 0.0 1 1 0.0
child-snack_pfile01.pddl
1 1 0.0 1 1 0.0
child-snack_pfile02-2.pddl
1 1 0.0 1 1 0.0
child-snack_pfile02.pddl
1 1 0.0 1 1 0.0
child-snack_pfile03-2.pddl
1 1 0.0 1 1 0.0
child-snack_pfile03.pddl
1 1 0.0 1 1 0.0
child-snack_pfile04-2.pddl
1 1 0.0 0 0 0.0
child-snack_pfile04.pddl
1 1 0.0 0 0 0.0
child-snack_pfile05-2.pddl
1 1 0.0 0 0 0.0
child-snack_pfile05.pddl
1 1 0.0 0 0 0.0
child-snack_pfile06-2.pddl
1 1 0.0 0 0 0.0
child-snack_pfile06.pddl
1 1 0.0 0 0 0.0
child-snack_pfile07-2.pddl
1 1 0.0 0 0 0.0
child-snack_pfile07.pddl
1 1 0.0 0 0 0.0
child-snack_pfile08-2.pddl
1 1 0.0 0 0 0.0
child-snack_pfile08.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
data-network-opt18-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
depot
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 0 0 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 0 0 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
0 0 0.0 1 1 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
driverlog
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 0 0 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt08-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 1 1 0.0
p24.pddl
1 1 0.0 1 1 0.0
p25.pddl
1 1 0.0 1 1 0.0
p26.pddl
1 1 0.0 1 1 0.0
p27.pddl
1 1 0.0 1 1 0.0
p28.pddl
1 1 0.0 1 1 0.0
p29.pddl
1 1 0.0 1 1 0.0
p30.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
1 1 0.0 1 1 0.0
opt-p01-002.pddl
1 1 0.0 1 1 0.0
opt-p02-003.pddl
1 1 0.0 0 0 0.0
opt-p02-004.pddl
1 1 0.0 0 0 0.0
opt-p03-005.pddl
1 1 0.0 0 0 0.0
opt-p03-006.pddl
1 1 0.0 0 0 0.0
opt-p04-007.pddl
1 1 0.0 0 0 0.0
opt-p04-008.pddl
1 1 0.0 0 0 0.0
opt-p05-009.pddl
1 1 0.0 0 0 0.0
opt-p05-010.pddl
0 0 0.0 0 0 0.0
opt-p06-011.pddl
0 0 0.0 0 0 0.0
opt-p06-012.pddl
0 0 0.0 0 0 0.0
opt-p07-013.pddl
0 0 0.0 0 0 0.0
opt-p07-014.pddl
0 0 0.0 0 0 0.0
opt-p08-015.pddl
0 0 0.0 0 0 0.0
opt-p08-016.pddl
0 0 0.0 0 0 0.0
opt-p09-017.pddl
0 0 0.0 0 0 0.0
opt-p09-018.pddl
0 0 0.0 0 0 0.0
opt-p10-019.pddl
0 0 0.0 0 0 0.0
opt-p10-020.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
1 1 0.0 0 0 0.0
p01-4-4-2.pddl
1 1 0.0 0 0 0.0
p01-5-3-2.pddl
1 1 0.0 0 0 0.0
p01-5-4-2.pddl
0 0 0.0 0 0 0.0
p01-5-5-2.pddl
0 0 0.0 0 0 0.0
p01-6-4-2.pddl
0 0 0.0 0 0 0.0
p01-6-5-2.pddl
0 0 0.0 0 0 0.0
p02-4-4-2.pddl
1 1 0.0 0 0 0.0
p02-5-3-2.pddl
1 1 0.0 0 0 0.0
p02-5-4-2.pddl
0 0 0.0 0 0 0.0
p02-5-5-2.pddl
0 0 0.0 0 0 0.0
p02-6-4-2.pddl
0 0 0.0 0 0 0.0
p02-6-5-2.pddl
0 0 0.0 0 0 0.0
p03-4-3-2.pddl
1 1 0.0 0 0 0.0
p03-4-4-2.pddl
1 1 0.0 0 0 0.0
p03-5-3-2.pddl
1 1 0.0 0 0 0.0
p03-5-4-2.pddl
1 1 0.0 0 0 0.0
p03-5-5-2.pddl
0 0 0.0 0 0 0.0
p03-6-4-2.pddl
0 0 0.0 0 0 0.0
p03-6-5-2.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
freecell
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
probfreecell-2-1.pddl
1 1 0.0 1 1 0.0
probfreecell-2-2.pddl
1 1 0.0 1 1 0.0
probfreecell-2-3.pddl
1 1 0.0 1 1 0.0
probfreecell-2-4.pddl
1 1 0.0 1 1 0.0
probfreecell-2-5.pddl
1 1 0.0 1 1 0.0
probfreecell-3-1.pddl
1 1 0.0 1 1 0.0
probfreecell-3-2.pddl
1 1 0.0 1 1 0.0
probfreecell-3-3.pddl
1 1 0.0 1 1 0.0
probfreecell-3-4.pddl
1 1 0.0 1 1 0.0
probfreecell-3-5.pddl
1 1 0.0 1 1 0.0
probfreecell-4-1.pddl
1 1 0.0 1 1 0.0
probfreecell-4-2.pddl
1 1 0.0 1 1 0.0
probfreecell-4-3.pddl
1 1 0.0 1 1 0.0
probfreecell-4-4.pddl
1 1 0.0 1 1 0.0
probfreecell-4-5.pddl
1 1 0.0 1 1 0.0
probfreecell-5-1.pddl
1 1 0.0 1 1 0.0
probfreecell-5-2.pddl
1 1 0.0 1 1 0.0
probfreecell-5-3.pddl
1 1 0.0 1 1 0.0
probfreecell-5-4.pddl
1 1 0.0 1 1 0.0
probfreecell-5-5.pddl
1 1 0.0 1 1 0.0
probfreecell-6-1.pddl
1 1 0.0 1 1 0.0
probfreecell-6-2.pddl
1 1 0.0 1 1 0.0
probfreecell-6-3.pddl
1 1 0.0 1 1 0.0
probfreecell-6-4.pddl
1 1 0.0 1 1 0.0
probfreecell-6-5.pddl
1 1 0.0 1 1 0.0
probfreecell-7-1.pddl
1 1 0.0 1 1 0.0
probfreecell-7-2.pddl
1 1 0.0 1 1 0.0
probfreecell-7-3.pddl
1 1 0.0 1 1 0.0
probfreecell-7-4.pddl
1 1 0.0 1 1 0.0
probfreecell-7-5.pddl
1 1 0.0 1 1 0.0
probfreecell-8-1.pddl
1 1 0.0 1 1 0.0
probfreecell-8-2.pddl
1 1 0.0 1 1 0.0
probfreecell-8-3.pddl
1 1 0.0 1 1 0.0
probfreecell-8-4.pddl
1 1 0.0 1 1 0.0
probfreecell-8-5.pddl
1 1 0.0 1 1 0.0
probfreecell-9-1.pddl
1 1 0.0 1 1 0.0
probfreecell-9-2.pddl
1 1 0.0 1 1 0.0
probfreecell-9-3.pddl
1 1 0.0 1 1 0.0
probfreecell-9-4.pddl
1 1 0.0 1 1 0.0
probfreecell-9-5.pddl
1 1 0.0 1 1 0.0
probfreecell-10-1.pddl
1 1 0.0 1 1 0.0
probfreecell-10-2.pddl
1 1 0.0 1 1 0.0
probfreecell-10-3.pddl
1 1 0.0 1 1 0.0
probfreecell-10-4.pddl
1 1 0.0 1 1 0.0
probfreecell-10-5.pddl
1 1 0.0 1 1 0.0
probfreecell-11-1.pddl
1 1 0.0 1 1 0.0
probfreecell-11-2.pddl
1 1 0.0 1 1 0.0
probfreecell-11-3.pddl
1 1 0.0 1 1 0.0
probfreecell-11-4.pddl
1 1 0.0 1 1 0.0
probfreecell-11-5.pddl
0 0 0.0 1 1 0.0
probfreecell-12-1.pddl
1 1 0.0 1 1 0.0
probfreecell-12-2.pddl
1 1 0.0 1 1 0.0
probfreecell-12-3.pddl
1 1 0.0 1 1 0.0
probfreecell-12-4.pddl
1 1 0.0 1 1 0.0
probfreecell-12-5.pddl
1 1 0.0 1 1 0.0
probfreecell-13-1.pddl
1 1 0.0 1 1 0.0
probfreecell-13-2.pddl
1 1 0.0 1 1 0.0
probfreecell-13-3.pddl
1 1 0.0 1 1 0.0
probfreecell-13-4.pddl
1 1 0.0 1 1 0.0
probfreecell-13-5.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
ged-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
1 1 0.0 1 1 0.0
d-1-3.pddl
1 1 0.0 1 1 0.0
d-1-4.pddl
1 1 0.0 1 1 0.0
d-1-8.pddl
1 1 0.0 1 1 0.0
d-2-1.pddl
1 1 0.0 1 1 0.0
d-2-3.pddl
1 1 0.0 1 1 0.0
d-2-4.pddl
1 1 0.0 1 1 0.0
d-2-8.pddl
1 1 0.0 1 1 0.0
d-3-1.pddl
1 1 0.0 1 1 0.0
d-3-2.pddl
1 1 0.0 1 1 0.0
d-3-4.pddl
1 1 0.0 1 1 0.0
d-4-2.pddl
1 1 0.0 1 1 0.0
d-4-3.pddl
1 1 0.0 1 1 0.0
d-4-8.pddl
1 1 0.0 1 1 0.0
d-7-5.pddl
1 1 0.0 1 1 0.0
d-7-6.pddl
1 1 0.0 1 1 0.0
d-8-1.pddl
1 1 0.0 1 1 0.0
d-8-2.pddl
1 1 0.0 1 1 0.0
d-8-4.pddl
1 1 0.0 1 1 0.0
d-8-9.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
grid
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1 1 0.0 1 1 0.0
prob02.pddl
1 1 0.0 1 1 0.0
prob03.pddl
1 1 0.0 0 0 0.0
prob04.pddl
1 1 0.0 1 1 0.0
prob05.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
gripper
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1 1 0.0 1 1 0.0
prob02.pddl
1 1 0.0 1 1 0.0
prob03.pddl
1 1 0.0 1 1 0.0
prob04.pddl
1 1 0.0 1 1 0.0
prob05.pddl
1 1 0.0 1 1 0.0
prob06.pddl
1 1 0.0 1 1 0.0
prob07.pddl
1 1 0.0 1 1 0.0
prob08.pddl
1 1 0.0 1 1 0.0
prob09.pddl
1 1 0.0 1 1 0.0
prob10.pddl
1 1 0.0 1 1 0.0
prob11.pddl
1 1 0.0 1 1 0.0
prob12.pddl
1 1 0.0 1 1 0.0
prob13.pddl
1 1 0.0 1 1 0.0
prob14.pddl
1 1 0.0 1 1 0.0
prob15.pddl
1 1 0.0 1 1 0.0
prob16.pddl
1 1 0.0 1 1 0.0
prob17.pddl
1 1 0.0 1 1 0.0
prob18.pddl
1 1 0.0 1 1 0.0
prob19.pddl
1 1 0.0 1 1 0.0
prob20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
hiking-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
1 1 0.0 1 1 0.0
ptesting-1-2-4.pddl
1 1 0.0 1 1 0.0
ptesting-1-2-5.pddl
1 1 0.0 1 1 0.0
ptesting-1-2-7.pddl
1 1 0.0 1 1 0.0
ptesting-1-2-8.pddl
1 1 0.0 1 1 0.0
ptesting-2-2-3.pddl
1 1 0.0 1 1 0.0
ptesting-2-2-4.pddl
1 1 0.0 1 1 0.0
ptesting-2-2-5.pddl
1 1 0.0 1 1 0.0
ptesting-2-2-6.pddl
1 1 0.0 1 1 0.0
ptesting-2-2-7.pddl
1 1 0.0 1 1 0.0
ptesting-2-2-8.pddl
1 1 0.0 1 1 0.0
ptesting-2-3-4.pddl
1 1 0.0 1 1 0.0
ptesting-2-3-5.pddl
1 1 0.0 1 1 0.0
ptesting-2-3-6.pddl
1 1 0.0 1 1 0.0
ptesting-2-3-7.pddl
1 1 0.0 1 1 0.0
ptesting-2-4-3.pddl
1 1 0.0 1 1 0.0
ptesting-2-4-4.pddl
1 1 0.0 1 1 0.0
ptesting-2-4-5.pddl
1 1 0.0 1 1 0.0
ptesting-2-4-6.pddl
1 1 0.0 1 1 0.0
ptesting-2-4-7.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics00
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-4-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-4-2.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-5-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-5-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-5-2.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-6-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-6-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-6-2.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-6-9.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-7-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-7-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-8-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-8-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-9-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-9-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-10-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-10-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-11-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-11-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-12-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-12-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-13-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-13-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-14-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-14-1.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-15-0.pddl
1 1 0.0 1 1 0.0
probLOGISTICS-15-1.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics98
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1 1 0.0 1 1 0.0
prob02.pddl
1 1 0.0 1 1 0.0
prob03.pddl
1 1 0.0 1 1 0.0
prob04.pddl
1 1 0.0 0 0 0.0
prob05.pddl
1 1 0.0 1 1 0.0
prob06.pddl
1 1 0.0 0 0 0.0
prob07.pddl
1 1 0.0 1 1 0.0
prob08.pddl
1 1 0.0 0 0 0.0
prob09.pddl
1 1 0.0 0 0 0.0
prob10.pddl
1 1 0.0 1 1 0.0
prob11.pddl
1 1 0.0 1 1 0.0
prob12.pddl
1 1 0.0 0 0 0.0
prob13.pddl
1 1 0.0 0 0 0.0
prob14.pddl
1 1 0.0 0 0 0.0
prob15.pddl
1 1 0.0 1 1 0.0
prob16.pddl
1 1 0.0 0 0 0.0
prob17.pddl
1 1 0.0 0 0 0.0
prob18.pddl
1 1 0.0 0 0 0.0
prob19.pddl
1 1 0.0 0 0 0.0
prob20.pddl
1 1 0.0 0 0 0.0
prob21.pddl
1 1 0.0 0 0 0.0
prob22.pddl
1 1 0.0 0 0 0.0
prob23.pddl
1 1 0.0 1 1 0.0
prob24.pddl
1 1 0.0 0 0 0.0
prob25.pddl
1 1 0.0 0 0 0.0
prob26.pddl
1 1 0.0 0 0 0.0
prob27.pddl
1 1 0.0 0 0 0.0
prob28.pddl
1 1 0.0 0 0 0.0
prob29.pddl
1 1 0.0 0 0 0.0
prob30.pddl
1 1 0.0 0 0 0.0
prob31.pddl
1 1 0.0 1 1 0.0
prob32.pddl
1 1 0.0 1 1 0.0
prob33.pddl
1 1 0.0 1 1 0.0
prob34.pddl
1 1 0.0 1 1 0.0
prob35.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
miconic
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
1 1 0.0 1 1 0.0
s1-1.pddl
1 1 0.0 1 1 0.0
s1-2.pddl
1 1 0.0 1 1 0.0
s1-3.pddl
1 1 0.0 1 1 0.0
s1-4.pddl
1 1 0.0 1 1 0.0
s2-0.pddl
1 1 0.0 1 1 0.0
s2-1.pddl
1 1 0.0 1 1 0.0
s2-2.pddl
1 1 0.0 1 1 0.0
s2-3.pddl
1 1 0.0 1 1 0.0
s2-4.pddl
1 1 0.0 1 1 0.0
s3-0.pddl
1 1 0.0 1 1 0.0
s3-1.pddl
1 1 0.0 1 1 0.0
s3-2.pddl
1 1 0.0 1 1 0.0
s3-3.pddl
1 1 0.0 1 1 0.0
s3-4.pddl
1 1 0.0 1 1 0.0
s4-0.pddl
1 1 0.0 1 1 0.0
s4-1.pddl
1 1 0.0 1 1 0.0
s4-2.pddl
1 1 0.0 1 1 0.0
s4-3.pddl
1 1 0.0 1 1 0.0
s4-4.pddl
1 1 0.0 1 1 0.0
s5-0.pddl
1 1 0.0 1 1 0.0
s5-1.pddl
1 1 0.0 1 1 0.0
s5-2.pddl
1 1 0.0 1 1 0.0
s5-3.pddl
1 1 0.0 1 1 0.0
s5-4.pddl
1 1 0.0 1 1 0.0
s6-0.pddl
1 1 0.0 1 1 0.0
s6-1.pddl
1 1 0.0 1 1 0.0
s6-2.pddl
1 1 0.0 1 1 0.0
s6-3.pddl
1 1 0.0 1 1 0.0
s6-4.pddl
1 1 0.0 1 1 0.0
s7-0.pddl
1 1 0.0 1 1 0.0
s7-1.pddl
1 1 0.0 1 1 0.0
s7-2.pddl
1 1 0.0 1 1 0.0
s7-3.pddl
1 1 0.0 1 1 0.0
s7-4.pddl
1 1 0.0 1 1 0.0
s8-0.pddl
1 1 0.0 1 1 0.0
s8-1.pddl
1 1 0.0 1 1 0.0
s8-2.pddl
1 1 0.0 1 1 0.0
s8-3.pddl
1 1 0.0 1 1 0.0
s8-4.pddl
1 1 0.0 1 1 0.0
s9-0.pddl
1 1 0.0 1 1 0.0
s9-1.pddl
1 1 0.0 1 1 0.0
s9-2.pddl
1 1 0.0 1 1 0.0
s9-3.pddl
1 1 0.0 1 1 0.0
s9-4.pddl
1 1 0.0 1 1 0.0
s10-0.pddl
1 1 0.0 1 1 0.0
s10-1.pddl
1 1 0.0 1 1 0.0
s10-2.pddl
1 1 0.0 1 1 0.0
s10-3.pddl
1 1 0.0 1 1 0.0
s10-4.pddl
1 1 0.0 1 1 0.0
s11-0.pddl
1 1 0.0 1 1 0.0
s11-1.pddl
1 1 0.0 1 1 0.0
s11-2.pddl
1 1 0.0 1 1 0.0
s11-3.pddl
1 1 0.0 1 1 0.0
s11-4.pddl
1 1 0.0 1 1 0.0
s12-0.pddl
1 1 0.0 1 1 0.0
s12-1.pddl
1 1 0.0 1 1 0.0
s12-2.pddl
1 1 0.0 1 1 0.0
s12-3.pddl
1 1 0.0 1 1 0.0
s12-4.pddl
1 1 0.0 1 1 0.0
s13-0.pddl
1 1 0.0 1 1 0.0
s13-1.pddl
1 1 0.0 1 1 0.0
s13-2.pddl
1 1 0.0 1 1 0.0
s13-3.pddl
1 1 0.0 1 1 0.0
s13-4.pddl
1 1 0.0 1 1 0.0
s14-0.pddl
1 1 0.0 1 1 0.0
s14-1.pddl
1 1 0.0 1 1 0.0
s14-2.pddl
1 1 0.0 1 1 0.0
s14-3.pddl
1 1 0.0 1 1 0.0
s14-4.pddl
1 1 0.0 1 1 0.0
s15-0.pddl
1 1 0.0 1 1 0.0
s15-1.pddl
1 1 0.0 1 1 0.0
s15-2.pddl
1 1 0.0 1 1 0.0
s15-3.pddl
1 1 0.0 1 1 0.0
s15-4.pddl
1 1 0.0 1 1 0.0
s16-0.pddl
1 1 0.0 1 1 0.0
s16-1.pddl
1 1 0.0 1 1 0.0
s16-2.pddl
1 1 0.0 1 1 0.0
s16-3.pddl
1 1 0.0 1 1 0.0
s16-4.pddl
1 1 0.0 1 1 0.0
s17-0.pddl
1 1 0.0 1 1 0.0
s17-1.pddl
1 1 0.0 1 1 0.0
s17-2.pddl
1 1 0.0 1 1 0.0
s17-3.pddl
1 1 0.0 1 1 0.0
s17-4.pddl
1 1 0.0 1 1 0.0
s18-0.pddl
1 1 0.0 1 1 0.0
s18-1.pddl
1 1 0.0 1 1 0.0
s18-2.pddl
1 1 0.0 1 1 0.0
s18-3.pddl
1 1 0.0 1 1 0.0
s18-4.pddl
1 1 0.0 1 1 0.0
s19-0.pddl
1 1 0.0 1 1 0.0
s19-1.pddl
1 1 0.0 1 1 0.0
s19-2.pddl
1 1 0.0 1 1 0.0
s19-3.pddl
1 1 0.0 1 1 0.0
s19-4.pddl
1 1 0.0 1 1 0.0
s20-0.pddl
1 1 0.0 1 1 0.0
s20-1.pddl
1 1 0.0 1 1 0.0
s20-2.pddl
1 1 0.0 1 1 0.0
s20-3.pddl
1 1 0.0 1 1 0.0
s20-4.pddl
1 1 0.0 1 1 0.0
s21-0.pddl
1 1 0.0 1 1 0.0
s21-1.pddl
1 1 0.0 1 1 0.0
s21-2.pddl
1 1 0.0 1 1 0.0
s21-3.pddl
1 1 0.0 1 1 0.0
s21-4.pddl
1 1 0.0 1 1 0.0
s22-0.pddl
1 1 0.0 1 1 0.0
s22-1.pddl
1 1 0.0 1 1 0.0
s22-2.pddl
1 1 0.0 1 1 0.0
s22-3.pddl
1 1 0.0 1 1 0.0
s22-4.pddl
1 1 0.0 1 1 0.0
s23-0.pddl
1 1 0.0 1 1 0.0
s23-1.pddl
1 1 0.0 1 1 0.0
s23-2.pddl
1 1 0.0 1 1 0.0
s23-3.pddl
1 1 0.0 1 1 0.0
s23-4.pddl
1 1 0.0 1 1 0.0
s24-0.pddl
1 1 0.0 1 1 0.0
s24-1.pddl
1 1 0.0 1 1 0.0
s24-2.pddl
1 1 0.0 1 1 0.0
s24-3.pddl
1 1 0.0 1 1 0.0
s24-4.pddl
1 1 0.0 1 1 0.0
s25-0.pddl
1 1 0.0 1 1 0.0
s25-1.pddl
1 1 0.0 1 1 0.0
s25-2.pddl
1 1 0.0 1 1 0.0
s25-3.pddl
1 1 0.0 1 1 0.0
s25-4.pddl
1 1 0.0 1 1 0.0
s26-0.pddl
1 1 0.0 1 1 0.0
s26-1.pddl
1 1 0.0 1 1 0.0
s26-2.pddl
1 1 0.0 1 1 0.0
s26-3.pddl
1 1 0.0 1 1 0.0
s26-4.pddl
1 1 0.0 1 1 0.0
s27-0.pddl
1 1 0.0 1 1 0.0
s27-1.pddl
1 1 0.0 1 1 0.0
s27-2.pddl
1 1 0.0 1 1 0.0
s27-3.pddl
1 1 0.0 1 1 0.0
s27-4.pddl
1 1 0.0 1 1 0.0
s28-0.pddl
1 1 0.0 1 1 0.0
s28-1.pddl
1 1 0.0 1 1 0.0
s28-2.pddl
1 1 0.0 1 1 0.0
s28-3.pddl
1 1 0.0 1 1 0.0
s28-4.pddl
1 1 0.0 1 1 0.0
s29-0.pddl
1 1 0.0 1 1 0.0
s29-1.pddl
1 1 0.0 1 1 0.0
s29-2.pddl
1 1 0.0 1 1 0.0
s29-3.pddl
1 1 0.0 1 1 0.0
s29-4.pddl
1 1 0.0 1 1 0.0
s30-0.pddl
1 1 0.0 1 1 0.0
s30-1.pddl
1 1 0.0 1 1 0.0
s30-2.pddl
1 1 0.0 1 1 0.0
s30-3.pddl
1 1 0.0 1 1 0.0
s30-4.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
movie
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1 1 0.0 1 1 0.0
prob02.pddl
1 1 0.0 1 1 0.0
prob03.pddl
1 1 0.0 1 1 0.0
prob04.pddl
1 1 0.0 1 1 0.0
prob05.pddl
1 1 0.0 1 1 0.0
prob06.pddl
1 1 0.0 1 1 0.0
prob07.pddl
1 1 0.0 1 1 0.0
prob08.pddl
1 1 0.0 1 1 0.0
prob09.pddl
1 1 0.0 1 1 0.0
prob10.pddl
1 1 0.0 1 1 0.0
prob11.pddl
1 1 0.0 1 1 0.0
prob12.pddl
1 1 0.0 1 1 0.0
prob13.pddl
1 1 0.0 1 1 0.0
prob14.pddl
1 1 0.0 1 1 0.0
prob15.pddl
1 1 0.0 1 1 0.0
prob16.pddl
1 1 0.0 1 1 0.0
prob17.pddl
1 1 0.0 1 1 0.0
prob18.pddl
1 1 0.0 1 1 0.0
prob19.pddl
1 1 0.0 1 1 0.0
prob20.pddl
1 1 0.0 1 1 0.0
prob21.pddl
1 1 0.0 1 1 0.0
prob22.pddl
1 1 0.0 1 1 0.0
prob23.pddl
1 1 0.0 1 1 0.0
prob24.pddl
1 1 0.0 1 1 0.0
prob25.pddl
1 1 0.0 1 1 0.0
prob26.pddl
1 1 0.0 1 1 0.0
prob27.pddl
1 1 0.0 1 1 0.0
prob28.pddl
1 1 0.0 1 1 0.0
prob29.pddl
1 1 0.0 1 1 0.0
prob30.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mprime
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1 1 0.0 1 1 0.0
prob02.pddl
1 1 0.0 1 1 0.0
prob03.pddl
1 1 0.0 1 1 0.0
prob04.pddl
1 1 0.0 1 1 0.0
prob05.pddl
1 1 0.0 1 1 0.0
prob06.pddl
1 1 0.0 0 0 0.0
prob07.pddl
1 1 0.0 1 1 0.0
prob08.pddl
1 1 0.0 0 0 0.0
prob09.pddl
1 1 0.0 1 1 0.0
prob10.pddl
1 1 0.0 0 0 0.0
prob11.pddl
1 1 0.0 1 1 0.0
prob12.pddl
1 1 0.0 1 1 0.0
prob13.pddl
1 1 0.0 0 0 0.0
prob14.pddl
1 1 0.0 0 0 0.0
prob15.pddl
1 1 0.0 0 0 0.0
prob16.pddl
1 1 0.0 1 1 0.0
prob17.pddl
1 1 0.0 1 1 0.0
prob18.pddl
1 1 0.0 0 0 0.0
prob19.pddl
1 1 0.0 0 0 0.0
prob20.pddl
1 1 0.0 0 0 0.0
prob21.pddl
1 1 0.0 1 1 0.0
prob22.pddl
1 1 0.0 0 0 0.0
prob23.pddl
1 1 0.0 0 0 0.0
prob24.pddl
1 1 0.0 0 0 0.0
prob25.pddl
1 1 0.0 1 1 0.0
prob26.pddl
1 1 0.0 1 1 0.0
prob27.pddl
1 1 0.0 1 1 0.0
prob28.pddl
1 1 0.0 1 1 0.0
prob29.pddl
1 1 0.0 1 1 0.0
prob30.pddl
1 1 0.0 0 0 0.0
prob31.pddl
1 1 0.0 1 1 0.0
prob32.pddl
1 1 0.0 1 1 0.0
prob33.pddl
1 1 0.0 0 0 0.0
prob34.pddl
1 1 0.0 1 1 0.0
prob35.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mystery
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1 1 0.0 1 1 0.0
prob02.pddl
1 1 0.0 1 1 0.0
prob03.pddl
1 1 0.0 1 1 0.0
prob04.pddl
0 0 0.0 0 0 0.0
prob05.pddl
0 0 0.0 0 0 0.0
prob06.pddl
1 1 0.0 0 0 0.0
prob07.pddl
0 0 0.0 0 0 0.0
prob08.pddl
0 0 0.0 0 0 0.0
prob09.pddl
1 1 0.0 1 1 0.0
prob10.pddl
1 1 0.0 0 0 0.0
prob11.pddl
1 1 0.0 1 1 0.0
prob12.pddl
0 0 0.0 0 0 0.0
prob13.pddl
1 1 0.0 0 0 0.0
prob14.pddl
1 1 0.0 0 0 0.0
prob15.pddl
1 1 0.0 1 1 0.0
prob16.pddl
0 0 0.0 0 0 0.0
prob17.pddl
1 1 0.0 1 1 0.0
prob18.pddl
0 0 0.0 0 0 0.0
prob19.pddl
1 1 0.0 1 1 0.0
prob20.pddl
1 1 0.0 1 1 0.0
prob21.pddl
0 0 0.0 0 0 0.0
prob22.pddl
0 0 0.0 0 0 0.0
prob23.pddl
0 0 0.0 0 0 0.0
prob24.pddl
0 0 0.0 0 0 0.0
prob25.pddl
1 1 0.0 1 1 0.0
prob26.pddl
1 1 0.0 1 1 0.0
prob27.pddl
1 1 0.0 1 1 0.0
prob28.pddl
1 1 0.0 1 1 0.0
prob29.pddl
1 1 0.0 1 1 0.0
prob30.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
nomystery-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 0 0 0.0
p07.pddl
1 1 0.0 0 0 0.0
p08.pddl
1 1 0.0 0 0 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 0 0 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
1 1 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
1 1 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt08-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 1 1 0.0
p24.pddl
1 1 0.0 1 1 0.0
p25.pddl
1 1 0.0 1 1 0.0
p26.pddl
1 1 0.0 1 1 0.0
p27.pddl
1 1 0.0 1 1 0.0
p28.pddl
1 1 0.0 1 1 0.0
p29.pddl
1 1 0.0 1 1 0.0
p30.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
1 1 0.0 1 1 0.0
p20_2.pddl
1 1 0.0 1 1 0.0
p20_3.pddl
1 1 0.0 1 1 0.0
p25_1.pddl
1 1 0.0 1 1 0.0
p25_3.pddl
1 1 0.0 1 1 0.0
p30_1.pddl
1 1 0.0 1 1 0.0
p30_2.pddl
1 1 0.0 1 1 0.0
p30_3.pddl
1 1 0.0 1 1 0.0
p35_1.pddl
1 1 0.0 1 1 0.0
p35_2.pddl
1 1 0.0 1 1 0.0
p35_3.pddl
1 1 0.0 1 1 0.0
p40_1.pddl
1 1 0.0 1 1 0.0
p40_2.pddl
1 1 0.0 1 1 0.0
p40_3.pddl
1 1 0.0 1 1 0.0
p45_1.pddl
1 1 0.0 1 1 0.0
p45_2.pddl
1 1 0.0 1 1 0.0
p45_3.pddl
1 1 0.0 1 1 0.0
p50_1.pddl
1 1 0.0 1 1 0.0
p50_2.pddl
1 1 0.0 1 1 0.0
p50_3.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 1 1 0.0
p24.pddl
1 1 0.0 1 1 0.0
p25.pddl
1 1 0.0 1 1 0.0
p26.pddl
1 1 0.0 1 1 0.0
p27.pddl
1 1 0.0 1 1 0.0
p28.pddl
1 1 0.0 1 1 0.0
p29.pddl
1 1 0.0 1 1 0.0
p30.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-opt18-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
0 0 0.0 0 0 0.0
p05.pddl
0 0 0.0 0 0 0.0
p06.pddl
0 0 0.0 0 0 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
0 0 0.0 0 0 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
0 0 0.0 0 0 0.0
p12.pddl
0 0 0.0 0 0 0.0
p13.pddl
0 0 0.0 0 0 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0 0 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-split-opt18-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 0 0 0.0
p12.pddl
1 1 0.0 0 0 0.0
p13.pddl
1 1 0.0 0 0 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
1 1 0.0 0 0 0.0
p17.pddl
1 1 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
1 1 0.0 0 0 0.0
p20.pddl
1 1 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-08-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 0 0 0.0
p16.pddl
1 1 0.0 0 0 0.0
p17.pddl
1 1 0.0 0 0 0.0
p18.pddl
1 1 0.0 0 0 0.0
p19.pddl
1 1 0.0 0 0 0.0
p20.pddl
1 1 0.0 0 0 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 1 1 0.0
p24.pddl
1 1 0.0 1 1 0.0
p25.pddl
1 1 0.0 1 1 0.0
p26.pddl
1 1 0.0 1 1 0.0
p27.pddl
1 1 0.0 1 1 0.0
p28.pddl
1 1 0.0 1 1 0.0
p29.pddl
1 1 0.0 0 0 0.0
p30.pddl
1 1 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 0 0 0.0
p18.pddl
1 1 0.0 0 0 0.0
p19.pddl
1 1 0.0 0 0 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parking-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
1 1 0.0 0 0 0.0
pfile03-012.pddl
1 1 0.0 0 0 0.0
pfile04-013.pddl
1 1 0.0 0 0 0.0
pfile04-014.pddl
1 1 0.0 0 0 0.0
pfile04-015.pddl
1 1 0.0 0 0 0.0
pfile04-016.pddl
1 1 0.0 0 0 0.0
pfile05-017.pddl
1 1 0.0 0 0 0.0
pfile05-018.pddl
1 1 0.0 0 0 0.0
pfile05-019.pddl
1 1 0.0 0 0 0.0
pfile05-020.pddl
1 1 0.0 0 0 0.0
pfile06-021.pddl
1 1 0.0 0 0 0.0
pfile06-022.pddl
1 1 0.0 0 0 0.0
pfile06-023.pddl
1 1 0.0 0 0 0.0
pfile06-024.pddl
1 1 0.0 0 0 0.0
pfile07-025.pddl
1 1 0.0 0 0 0.0
pfile07-026.pddl
1 1 0.0 0 0 0.0
pfile07-027.pddl
1 1 0.0 0 0 0.0
pfile07-028.pddl
1 1 0.0 0 0 0.0
pfile08-029.pddl
1 1 0.0 0 0 0.0
pfile08-030.pddl
1 1 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parking-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
1 1 0.0 0 0 0.0
p_12_7-02.pddl
1 1 0.0 1 1 0.0
p_12_7-03.pddl
1 1 0.0 0 0 0.0
p_12_7-04.pddl
1 1 0.0 0 0 0.0
p_14_8-01.pddl
1 1 0.0 0 0 0.0
p_14_8-02.pddl
1 1 0.0 0 0 0.0
p_14_8-03.pddl
1 1 0.0 0 0 0.0
p_14_8-04.pddl
1 1 0.0 0 0 0.0
p_16_9-01.pddl
1 1 0.0 0 0 0.0
p_16_9-02.pddl
1 1 0.0 0 0 0.0
p_16_9-03.pddl
1 1 0.0 0 0 0.0
p_16_9-04.pddl
1 1 0.0 0 0 0.0
p_18_10-01.pddl
1 1 0.0 0 0 0.0
p_18_10-02.pddl
1 1 0.0 0 0 0.0
p_18_10-03.pddl
1 1 0.0 0 0 0.0
p_18_10-04.pddl
1 1 0.0 0 0 0.0
p_20_11-01.pddl
1 1 0.0 0 0 0.0
p_20_11-02.pddl
1 1 0.0 0 0 0.0
p_20_11-03.pddl
1 1 0.0 0 0 0.0
p_20_11-04.pddl
1 1 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pathways-noneg
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 0 0 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
0 0 0.0 0 0 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 0 0 0.0
p13.pddl
1 1 0.0 0 0 0.0
p14.pddl
1 1 0.0 0 0 0.0
p15.pddl
1 1 0.0 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
1 1 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
1 1 0.0 0 0 0.0
p24.pddl
1 1 0.0 0 0 0.0
p25.pddl
1 1 0.0 0 0 0.0
p26.pddl
1 1 0.0 0 0 0.0
p27.pddl
1 1 0.0 0 0 0.0
p28.pddl
1 1 0.0 0 0 0.0
p29.pddl
1 1 0.0 0 0 0.0
p30.pddl
1 1 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-08-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 1 1 0.0
p24.pddl
1 1 0.0 1 1 0.0
p25.pddl
1 1 0.0 1 1 0.0
p26.pddl
1 1 0.0 1 1 0.0
p27.pddl
1 1 0.0 1 1 0.0
p28.pddl
1 1 0.0 1 1 0.0
p29.pddl
1 1 0.0 1 1 0.0
p30.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
petri-net-alignment-opt18-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-notankage
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
1 1 0.0 1 1 0.0
p02-net1-b6-g4.pddl
1 1 0.0 1 1 0.0
p03-net1-b8-g3.pddl
1 1 0.0 1 1 0.0
p04-net1-b8-g5.pddl
1 1 0.0 1 1 0.0
p05-net1-b10-g4.pddl
1 1 0.0 1 1 0.0
p06-net1-b10-g6.pddl
1 1 0.0 1 1 0.0
p07-net1-b12-g5.pddl
1 1 0.0 1 1 0.0
p08-net1-b12-g7.pddl
1 1 0.0 1 1 0.0
p09-net1-b14-g6.pddl
1 1 0.0 1 1 0.0
p10-net1-b14-g8.pddl
1 1 0.0 1 1 0.0
p11-net2-b10-g2.pddl
1 1 0.0 1 1 0.0
p12-net2-b10-g4.pddl
1 1 0.0 1 1 0.0
p13-net2-b12-g3.pddl
1 1 0.0 1 1 0.0
p14-net2-b12-g5.pddl
1 1 0.0 1 1 0.0
p15-net2-b14-g4.pddl
1 1 0.0 1 1 0.0
p16-net2-b14-g6.pddl
1 1 0.0 1 1 0.0
p17-net2-b16-g5.pddl
1 1 0.0 1 1 0.0
p18-net2-b16-g7.pddl
1 1 0.0 1 1 0.0
p19-net2-b18-g6.pddl
1 1 0.0 1 1 0.0
p20-net2-b18-g8.pddl
1 1 0.0 1 1 0.0
p21-net3-b12-g2.pddl
1 1 0.0 1 1 0.0
p22-net3-b12-g4.pddl
1 1 0.0 1 1 0.0
p23-net3-b14-g3.pddl
1 1 0.0 1 1 0.0
p24-net3-b14-g5.pddl
1 1 0.0 1 1 0.0
p25-net3-b16-g5.pddl
1 1 0.0 1 1 0.0
p26-net3-b16-g7.pddl
1 1 0.0 1 1 0.0
p27-net3-b18-g6.pddl
1 1 0.0 1 1 0.0
p28-net3-b18-g7.pddl
1 1 0.0 1 1 0.0
p29-net3-b20-g6.pddl
1 1 0.0 1 1 0.0
p30-net3-b20-g8.pddl
1 1 0.0 1 1 0.0
p31-net4-b14-g3.pddl
1 1 0.0 1 1 0.0
p32-net4-b14-g5.pddl
1 1 0.0 1 1 0.0
p33-net4-b16-g5.pddl
1 1 0.0 1 1 0.0
p34-net4-b16-g6.pddl
1 1 0.0 1 1 0.0
p35-net4-b18-g4.pddl
1 1 0.0 1 1 0.0
p36-net4-b18-g6.pddl
1 1 0.0 1 1 0.0
p37-net4-b20-g5.pddl
1 1 0.0 0 0 0.0
p38-net4-b20-g7.pddl
1 1 0.0 1 1 0.0
p39-net4-b22-g7.pddl
1 1 0.0 0 0 0.0
p40-net4-b22-g8.pddl
1 1 0.0 1 1 0.0
p41-net5-b22-g2.pddl
1 1 0.0 1 1 0.0
p42-net5-b22-g4.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6.pddl
1 1 0.0 0 0 0.0
p50-net5-b30-g8.pddl
1 1 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-tankage
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
1 1 0.0 1 1 0.0
p02-net1-b6-g4-t50.pddl
1 1 0.0 1 1 0.0
p03-net1-b8-g3-t80.pddl
1 1 0.0 1 1 0.0
p04-net1-b8-g5-t80.pddl
1 1 0.0 1 1 0.0
p05-net1-b10-g4-t50.pddl
1 1 0.0 1 1 0.0
p06-net1-b10-g6-t50.pddl
1 1 0.0 1 1 0.0
p07-net1-b12-g5-t80.pddl
1 1 0.0 1 1 0.0
p08-net1-b12-g7-t80.pddl
1 1 0.0 1 1 0.0
p09-net1-b14-g6-t50.pddl
1 1 0.0 1 1 0.0
p10-net1-b14-g8-t50.pddl
1 1 0.0 1 1 0.0
p11-net2-b10-g2-t30.pddl
1 1 0.0 1 1 0.0
p12-net2-b10-g4-t60.pddl
1 1 0.0 1 1 0.0
p13-net2-b12-g3-t70.pddl
1 1 0.0 1 1 0.0
p14-net2-b12-g5-t30.pddl
1 1 0.0 1 1 0.0
p15-net2-b14-g4-t30.pddl
1 1 0.0 1 1 0.0
p16-net2-b14-g6-t80.pddl
1 1 0.0 0 0 0.0
p17-net2-b16-g5-t20.pddl
1 1 0.0 1 1 0.0
p18-net2-b16-g7-t60.pddl
1 1 0.0 1 1 0.0
p19-net2-b18-g6-t60.pddl
1 1 0.0 1 1 0.0
p20-net2-b18-g8-t90.pddl
1 1 0.0 0 0 0.0
p21-net3-b12-g2-t60.pddl
1 1 0.0 1 1 0.0
p22-net3-b12-g4-t60.pddl
1 1 0.0 1 1 0.0
p23-net3-b14-g3-t60.pddl
1 1 0.0 0 0 0.0
p24-net3-b14-g5-t60.pddl
1 1 0.0 0 0 0.0
p25-net3-b16-g5-t60.pddl
1 1 0.0 0 0 0.0
p26-net3-b16-g7-t70.pddl
1 1 0.0 0 0 0.0
p27-net3-b18-g6-t70.pddl
1 1 0.0 0 0 0.0
p28-net3-b18-g7-t70.pddl
1 1 0.0 0 0 0.0
p29-net3-b20-g6-t70.pddl
1 1 0.0 0 0 0.0
p30-net3-b20-g8-t70.pddl
1 1 0.0 0 0 0.0
p31-net4-b14-g3-t20.pddl
1 1 0.0 1 1 0.0
p32-net4-b14-g5-t30.pddl
1 1 0.0 1 1 0.0
p33-net4-b16-g5-t60.pddl
1 1 0.0 0 0 0.0
p34-net4-b16-g6-t60.pddl
1 1 0.0 0 0 0.0
p35-net4-b18-g4-t90.pddl
1 1 0.0 0 0 0.0
p36-net4-b18-g6-t90.pddl
1 1 0.0 0 0 0.0
p37-net4-b20-g5-t60.pddl
1 1 0.0 0 0 0.0
p38-net4-b20-g7-t60.pddl
1 1 0.0 0 0 0.0
p39-net4-b22-g7-t50.pddl
1 1 0.0 0 0 0.0
p40-net4-b22-g8-t50.pddl
1 1 0.0 0 0 0.0
p41-net5-b22-g2-t20.pddl
1 1 0.0 0 0 0.0
p42-net5-b22-g4-t50.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3-t80.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5-t80.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4-t50.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6-t50.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5-t50.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7-t50.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6-t50.pddl
1 1 0.0 0 0 0.0
p50-net5-b30-g8-t50.pddl
1 1 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
psr-small
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
1 1 0.0 1 1 0.0
p02-s5-n1-l3-f30.pddl
1 1 0.0 1 1 0.0
p03-s7-n1-l3-f70.pddl
1 1 0.0 1 1 0.0
p04-s8-n1-l4-f10.pddl
1 1 0.0 1 1 0.0
p05-s9-n1-l4-f30.pddl
1 1 0.0 1 1 0.0
p06-s10-n1-l4-f50.pddl
1 1 0.0 1 1 0.0
p07-s11-n1-l4-f70.pddl
1 1 0.0 1 1 0.0
p08-s12-n1-l5-f10.pddl
1 1 0.0 1 1 0.0
p09-s13-n1-l5-f30.pddl
1 1 0.0 1 1 0.0
p10-s17-n2-l2-f30.pddl
1 1 0.0 1 1 0.0
p11-s18-n2-l2-f50.pddl
1 1 0.0 1 1 0.0
p12-s21-n2-l3-f30.pddl
1 1 0.0 1 1 0.0
p13-s22-n2-l3-f50.pddl
1 1 0.0 1 1 0.0
p14-s23-n2-l3-f70.pddl
1 1 0.0 1 1 0.0
p15-s24-n2-l4-f10.pddl
1 1 0.0 1 1 0.0
p16-s29-n2-l5-f30.pddl
1 1 0.0 1 1 0.0
p17-s30-n2-l5-f50.pddl
1 1 0.0 1 1 0.0
p18-s31-n2-l5-f70.pddl
1 1 0.0 1 1 0.0
p19-s33-n3-l2-f30.pddl
1 1 0.0 1 1 0.0
p20-s34-n3-l2-f50.pddl
1 1 0.0 1 1 0.0
p21-s35-n3-l2-f70.pddl
1 1 0.0 1 1 0.0
p22-s37-n3-l3-f30.pddl
1 1 0.0 1 1 0.0
p23-s38-n3-l3-f50.pddl
1 1 0.0 1 1 0.0
p24-s39-n3-l3-f70.pddl
1 1 0.0 1 1 0.0
p25-s40-n3-l4-f10.pddl
1 1 0.0 1 1 0.0
p26-s41-n3-l4-f30.pddl
1 1 0.0 1 1 0.0
p27-s42-n3-l4-f50.pddl
1 1 0.0 1 1 0.0
p28-s43-n3-l4-f70.pddl
1 1 0.0 1 1 0.0
p29-s45-n3-l5-f30.pddl
1 1 0.0 1 1 0.0
p30-s46-n3-l5-f50.pddl
1 1 0.0 1 1 0.0
p31-s49-n4-l2-f30.pddl
1 1 0.0 1 1 0.0
p32-s50-n4-l2-f50.pddl
1 1 0.0 1 1 0.0
p33-s51-n4-l2-f70.pddl
1 1 0.0 1 1 0.0
p34-s55-n4-l3-f70.pddl
1 1 0.0 1 1 0.0
p35-s57-n5-l2-f30.pddl
1 1 0.0 1 1 0.0
p36-s65-n6-l2-f30.pddl
1 1 0.0 1 1 0.0
p37-s67-n6-l2-f70.pddl
1 1 0.0 1 1 0.0
p38-s78-n3-l3-f50.pddl
1 1 0.0 1 1 0.0
p39-s79-n3-l3-f70.pddl
1 1 0.0 1 1 0.0
p40-s80-n3-l4-f10.pddl
1 1 0.0 1 1 0.0
p41-s81-n3-l4-f30.pddl
1 1 0.0 1 1 0.0
p42-s82-n3-l4-f50.pddl
1 1 0.0 1 1 0.0
p43-s83-n3-l4-f70.pddl
1 1 0.0 1 1 0.0
p44-s89-n4-l2-f30.pddl
1 1 0.0 1 1 0.0
p45-s94-n4-l3-f50.pddl
1 1 0.0 1 1 0.0
p46-s97-n5-l2-f30.pddl
1 1 0.0 1 1 0.0
p47-s98-n5-l2-f50.pddl
1 1 0.0 1 1 0.0
p48-s101-n5-l3-f30.pddl
1 1 0.0 1 1 0.0
p49-s105-n6-l2-f30.pddl
1 1 0.0 1 1 0.0
p50-s107-n6-l2-f70.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
rovers
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 0 0 0.0
p20.pddl
1 1 0.0 0 0 0.0
p21.pddl
1 1 0.0 0 0 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 0 0 0.0
p24.pddl
1 1 0.0 0 0 0.0
p25.pddl
1 1 0.0 1 1 0.0
p26.pddl
1 1 0.0 0 0 0.0
p27.pddl
1 1 0.0 0 0 0.0
p28.pddl
1 1 0.0 0 0 0.0
p29.pddl
1 1 0.0 0 0 0.0
p30.pddl
1 1 0.0 0 0 0.0
p31.pddl
1 1 0.0 0 0 0.0
p32.pddl
1 1 0.0 0 0 0.0
p33.pddl
1 1 0.0 0 0 0.0
p34.pddl
1 1 0.0 0 0 0.0
p35.pddl
1 1 0.0 0 0 0.0
p36.pddl
1 1 0.0 0 0 0.0
p37.pddl
1 1 0.0 0 0 0.0
p38.pddl
1 1 0.0 0 0 0.0
p39.pddl
1 1 0.0 0 0 0.0
p40.pddl
1 1 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
satellite
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
1 1 0.0 1 1 0.0
p02-pfile2.pddl
1 1 0.0 1 1 0.0
p03-pfile3.pddl
1 1 0.0 1 1 0.0
p04-pfile4.pddl
1 1 0.0 1 1 0.0
p05-pfile5.pddl
1 1 0.0 1 1 0.0
p06-pfile6.pddl
1 1 0.0 1 1 0.0
p07-pfile7.pddl
1 1 0.0 1 1 0.0
p08-pfile8.pddl
1 1 0.0 1 1 0.0
p09-pfile9.pddl
1 1 0.0 1 1 0.0
p10-pfile10.pddl
1 1 0.0 1 1 0.0
p11-pfile11.pddl
1 1 0.0 1 1 0.0
p12-pfile12.pddl
1 1 0.0 1 1 0.0
p13-pfile13.pddl
1 1 0.0 0 0 0.0
p14-pfile14.pddl
1 1 0.0 1 1 0.0
p15-pfile15.pddl
1 1 0.0 0 0 0.0
p16-pfile16.pddl
1 1 0.0 0 0 0.0
p17-pfile17.pddl
1 1 0.0 0 0 0.0
p18-pfile18.pddl
1 1 0.0 0 0 0.0
p19-pfile19.pddl
1 1 0.0 0 0 0.0
p20-pfile20.pddl
1 1 0.0 0 0 0.0
p21-HC-pfile1.pddl
1 1 0.0 1 1 0.0
p22-HC-pfile2.pddl
1 1 0.0 0 0 0.0
p23-HC-pfile3.pddl
1 1 0.0 1 1 0.0
p24-HC-pfile4.pddl
1 1 0.0 0 0 0.0
p25-HC-pfile5.pddl
1 1 0.0 0 0 0.0
p26-HC-pfile6.pddl
1 1 0.0 0 0 0.0
p27-HC-pfile7.pddl
1 1 0.0 0 0 0.0
p28-HC-pfile8.pddl
1 1 0.0 0 0 0.0
p29-HC-pfile9.pddl
1 1 0.0 0 0 0.0
p30-HC-pfile10.pddl
1 1 0.0 0 0 0.0
p31-HC-pfile11.pddl
1 1 0.0 0 0 0.0
p32-HC-pfile12.pddl
1 1 0.0 0 0 0.0
p33-HC-pfile13.pddl
1 1 0.0 0 0 0.0
p34-HC-pfile14.pddl
1 1 0.0 0 0 0.0
p35-HC-pfile15.pddl
1 1 0.0 0 0 0.0
p36-HC-pfile16.pddl
1 1 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-08-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 1 1 0.0
p24.pddl
1 1 0.0 1 1 0.0
p25.pddl
1 1 0.0 1 1 0.0
p26.pddl
1 1 0.0 1 1 0.0
p27.pddl
1 1 0.0 1 1 0.0
p28.pddl
1 1 0.0 1 1 0.0
p29.pddl
1 1 0.0 1 1 0.0
p30.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
snake-opt18-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
0 0 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 0 0 0.0
p14.pddl
0 0 0.0 0 0 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt08-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 0 0 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 1 1 0.0
p24.pddl
1 1 0.0 0 0 0.0
p25.pddl
1 1 0.0 0 0 0.0
p26.pddl
1 1 0.0 0 0 0.0
p27.pddl
1 1 0.0 1 1 0.0
p28.pddl
1 1 0.0 1 1 0.0
p29.pddl
1 1 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 0 0 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
spider-opt18-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
storage
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
1 1 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
termes-opt18-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
0 0 0.0 0 0 0.0
p10.pddl
1 1 0.0 0 0 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tetris-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
1 1 0.0 1 1 0.0
p01-8.pddl
1 1 0.0 1 1 0.0
p01-10.pddl
1 1 0.0 1 1 0.0
p02-4.pddl
1 1 0.0 1 1 0.0
p02-6.pddl
1 1 0.0 1 1 0.0
p02-8.pddl
1 1 0.0 1 1 0.0
p02-10.pddl
1 1 0.0 1 1 0.0
p03-4.pddl
1 1 0.0 1 1 0.0
p03-6.pddl
1 1 0.0 1 1 0.0
p03-8.pddl
1 1 0.0 1 1 0.0
p03-10.pddl
1 1 0.0 1 1 0.0
p04-6.pddl
1 1 0.0 1 1 0.0
p04-8.pddl
1 1 0.0 1 1 0.0
p04-10.pddl
1 1 0.0 1 1 0.0
p05-6.pddl
1 1 0.0 1 1 0.0
p05-8.pddl
1 1 0.0 1 1 0.0
p05-10.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
0 0 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
0 0 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tpp
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 1 1 0.0
p24.pddl
1 1 0.0 1 1 0.0
p25.pddl
1 1 0.0 1 1 0.0
p26.pddl
1 1 0.0 1 1 0.0
p27.pddl
1 1 0.0 1 1 0.0
p28.pddl
1 1 0.0 0 0 0.0
p29.pddl
1 1 0.0 0 0 0.0
p30.pddl
1 1 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt08-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 1 1 0.0
p24.pddl
1 1 0.0 1 1 0.0
p25.pddl
1 1 0.0 1 1 0.0
p26.pddl
1 1 0.0 1 1 0.0
p27.pddl
1 1 0.0 1 1 0.0
p28.pddl
1 1 0.0 1 1 0.0
p29.pddl
1 1 0.0 1 1 0.0
p30.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
trucks-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 0 0 0.0
p09.pddl
1 1 0.0 0 0 0.0
p10.pddl
1 1 0.0 0 0 0.0
p11.pddl
1 1 0.0 0 0 0.0
p12.pddl
1 1 0.0 0 0 0.0
p13.pddl
1 1 0.0 0 0 0.0
p14.pddl
1 1 0.0 0 0 0.0
p15.pddl
1 1 0.0 0 0 0.0
p16.pddl
1 1 0.0 0 0 0.0
p17.pddl
1 1 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0 0 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
1 1 0.0 1 1 0.0
problem02-half.pddl
1 1 0.0 1 1 0.0
problem03-full.pddl
1 1 0.0 1 1 0.0
problem03-half.pddl
1 1 0.0 1 1 0.0
problem04-full.pddl
1 1 0.0 1 1 0.0
problem04-half.pddl
1 1 0.0 1 1 0.0
problem05-full.pddl
1 1 0.0 1 1 0.0
problem05-half.pddl
1 1 0.0 1 1 0.0
problem06-full.pddl
1 1 0.0 1 1 0.0
problem06-half.pddl
1 1 0.0 1 1 0.0
problem07-full.pddl
1 1 0.0 1 1 0.0
problem07-half.pddl
1 1 0.0 1 1 0.0
problem08-full.pddl
1 1 0.0 1 1 0.0
problem08-half.pddl
1 1 0.0 1 1 0.0
problem09-full.pddl
1 1 0.0 1 1 0.0
problem09-half.pddl
1 1 0.0 1 1 0.0
problem10-full.pddl
1 1 0.0 1 1 0.0
problem10-half.pddl
1 1 0.0 1 1 0.0
problem11-full.pddl
1 1 0.0 1 1 0.0
problem11-half.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt14-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
1 1 0.0 1 1 0.0
p-1-6.pddl
1 1 0.0 1 1 0.0
p-1-7.pddl
1 1 0.0 1 1 0.0
p-1-8.pddl
1 1 0.0 1 1 0.0
p-1-9.pddl
1 1 0.0 1 1 0.0
p-1-10.pddl
1 1 0.0 1 1 0.0
p-1-11.pddl
1 1 0.0 1 1 0.0
p-1-12.pddl
1 1 0.0 1 1 0.0
p-1-13.pddl
1 1 0.0 1 1 0.0
p-1-14.pddl
1 1 0.0 1 1 0.0
p-1-15.pddl
1 1 0.0 1 1 0.0
p-1-16.pddl
1 1 0.0 1 1 0.0
p-1-17.pddl
1 1 0.0 1 1 0.0
p-1-18.pddl
1 1 0.0 1 1 0.0
p-05-5.pddl
1 1 0.0 1 1 0.0
p-05-6.pddl
1 1 0.0 1 1 0.0
p-05-7.pddl
1 1 0.0 1 1 0.0
p-05-8.pddl
1 1 0.0 1 1 0.0
p-05-9.pddl
1 1 0.0 1 1 0.0
p-05-10.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt08-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 0 0 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 0 0 0.0
p09.pddl
1 1 0.0 0 0 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 0 0 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
p21.pddl
1 1 0.0 1 1 0.0
p22.pddl
1 1 0.0 1 1 0.0
p23.pddl
1 1 0.0 1 1 0.0
p24.pddl
1 1 0.0 1 1 0.0
p25.pddl
1 1 0.0 1 1 0.0
p26.pddl
1 1 0.0 0 0 0.0
p27.pddl
1 1 0.0 0 0 0.0
p28.pddl
1 1 0.0 0 0 0.0
p29.pddl
1 1 0.0 1 1 0.0
p30.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt11-strips
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 0 0 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 0 0 0.0
p12.pddl
1 1 0.0 0 0 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 0 0 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 0 0 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 0 0 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
zenotravel
Show table
coverage
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 1 1 0.0
p02.pddl
1 1 0.0 1 1 0.0
p03.pddl
1 1 0.0 1 1 0.0
p04.pddl
1 1 0.0 1 1 0.0
p05.pddl
1 1 0.0 1 1 0.0
p06.pddl
1 1 0.0 1 1 0.0
p07.pddl
1 1 0.0 1 1 0.0
p08.pddl
1 1 0.0 1 1 0.0
p09.pddl
1 1 0.0 1 1 0.0
p10.pddl
1 1 0.0 1 1 0.0
p11.pddl
1 1 0.0 1 1 0.0
p12.pddl
1 1 0.0 1 1 0.0
p13.pddl
1 1 0.0 1 1 0.0
p14.pddl
1 1 0.0 1 1 0.0
p15.pddl
1 1 0.0 1 1 0.0
p16.pddl
1 1 0.0 1 1 0.0
p17.pddl
1 1 0.0 1 1 0.0
p18.pddl
1 1 0.0 1 1 0.0
p19.pddl
1 1 0.0 1 1 0.0
p20.pddl
1 1 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
edges
Show table
Only instances where all algorithms have a value for "edges" are considered. Each table entry gives the sum of "edges" for that domain. The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
332 332 0.0 30 30 0.0
p02.pddl
337 337 0.0 31 31 0.0
p03.pddl
333 333 0.0 31 31 0.0
p04.pddl
474 474 0.0 36 36 0.0
p05.pddl
474 474 0.0 36 36 0.0
p06.pddl
476 476 0.0 36 36 0.0
p07.pddl
636 636 0.0 41 41 0.0
p08.pddl
636 636 0.0 41 41 0.0
p09.pddl
638 638 0.0 41 41 0.0
p10.pddl
825 825 0.0 46 46 0.0
p11.pddl
827 827 0.0 46 46 0.0
p12.pddl
827 827 0.0 46 46 0.0
p13.pddl
1039 1039 0.0 51 51 0.0
p14.pddl
1038 1038 0.0 50 50 0.0
p15.pddl
1043 1043 0.0 51 51 0.0
p16.pddl
1280 1280 0.0 56 56 0.0
p17.pddl
1280 1280 0.0 56 56 0.0
p18.pddl
1278 1278 0.0 56 56 0.0
p19.pddl
1544 1544 0.0 61 61 0.0
p20.pddl
1546 1546 0.0 61 61 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
airport
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
78 78 0.0 27 27 0.0
p02-airport1-p1.pddl
85 85 0.0 26 26 0.0
p03-airport1-p2.pddl
225 225 0.0 80 80 0.0
p04-airport2-p1.pddl
323 323 0.0 65 65 0.0
p05-airport2-p1.pddl
322 322 0.0 64 64 0.0
p06-airport2-p2.pddl
694 694 0.0 177 177 0.0
p07-airport2-p2.pddl
750 750 0.0 180 180 0.0
p08-airport2-p3.pddl
1170 1170 0.0 334 334 0.0
p09-airport2-p4.pddl
1515 1515 0.0 457 457 0.0
p10-airport3-p1.pddl
274 274 0.0 59 59 0.0
p11-airport3-p1.pddl
324 324 0.0 66 66 0.0
p12-airport3-p2.pddl
653 653 0.0 171 171 0.0
p13-airport3-p2.pddl
655 655 0.0 164 164 0.0
p14-airport3-p3.pddl
1061 1061 0.0 325 325 0.0
p15-airport3-p3.pddl
1062 1062 0.0 316 316 0.0
p16-airport3-p4.pddl
1509 1509 0.0 510 510 0.0
p17-airport3-p5.pddl
1899 1899 0.0 660 660 0.0
p18-airport3-p6.pddl
2365 2365 0.0 907 907 0.0
p19-airport3-p6.pddl
2571 2571 0.0 735 735 0.0
p20-airport3-p7.pddl
2829 2829 0.0 1093 1093 0.0
p21-airport4halfMUC-p2.pddl
3174 3174 0.0 427 427 0.0
p22-airport4halfMUC-p3.pddl
5360 5360 0.0 778 778 0.0
p23-airport4halfMUC-p4.pddl
6534 6534 0.0 1052 1052 0.0
p24-airport4halfMUC-p4.pddl
4859 4859 0.0 983 983 0.0
p25-airport4halfMUC-p5.pddl
7427 7427 0.0 1530 1530 0.0
p26-airport4halfMUC-p6.pddl
8231 8231 0.0 1800 1800 0.0
p27-airport4halfMUC-p6.pddl
7787 7787 0.0 1967 1967 0.0
p28-airport4halfMUC-p7.pddl
10466 10466 0.0 2701 2701 0.0
p29-airport4halfMUC-p8.pddl
11798 11798 0.0 3130 3130 0.0
p30-airport4halfMUC-p8.pddl
10093 10093 0.0 3055 3055 0.0
p31-airport4halfMUC-p9.pddl
13054 13054 0.0 3979 3979 0.0
p32-airport4halfMUC-p10.pddl
15427 15427 0.0 4733 4733 0.0
p33-airport4halfMUC-p10.pddl
14538 14538 0.0 4750 4750 0.0
p34-airport4halfMUC-p11.pddl
17081 17081 0.0 5594 5594 0.0
p35-airport4halfMUC-p12.pddl
18552 18552 0.0 6120 6120 0.0
p36-airport5MUC-p2.pddl
2582 2582 0.0 313 313 0.0
p37-airport5MUC-p3.pddl
3218 3218 0.0 400 400 0.0
p38-airport5MUC-p3.pddl
3377 3377 0.0 489 489 0.0
p39-airport5MUC-p4.pddl
4771 4771 0.0 680 680 0.0
p40-airport5MUC-p4.pddl
4333 4333 0.0 723 723 0.0
p41-airport5MUC-p4.pddl
3757 3757 0.0 680 680 0.0
p42-airport5MUC-p5.pddl
5965 5965 0.0 1076 1076 0.0
p43-airport5MUC-p5.pddl
4713 4713 0.0 944 944 0.0
p44-airport5MUC-p5.pddl
6194 6194 0.0 1163 1163 0.0
p45-airport5MUC-p6.pddl
6770 6770 0.0 1438 1438 0.0
p46-airport5MUC-p6.pddl
6399 6399 0.0 1344 1344 0.0
p47-airport5MUC-p8.pddl
9727 9727 0.0 2360 2360 0.0
p48-airport5MUC-p9.pddl
10398 10398 0.0 2676 2676 0.0
p49-airport5MUC-p10.pddl
12996 12996 0.0 3528 3528 0.0
p50-airport5MUC-p15.pddl
20411 20411 0.0 7021 7021 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
78 78 0.0 42 42 0.0
pfile01-002.pddl
84 84 0.0 42 42 0.0
pfile01-003.pddl
84 84 0.0 42 42 0.0
pfile01-004.pddl
80 80 0.0 42 42 0.0
pfile02-005.pddl
80 80 0.0 56 56 0.0
pfile02-006.pddl
85 85 0.0 56 56 0.0
pfile02-007.pddl
85 85 0.0 56 56 0.0
pfile02-008.pddl
85 85 0.0 56 56 0.0
pfile03-009.pddl
96 96 0.0 70 70 0.0
pfile03-010.pddl
95 95 0.0 70 70 0.0
pfile03-011.pddl
96 96 0.0 70 70 0.0
pfile03-012.pddl
95 95 0.0 70 70 0.0
pfile04-013.pddl
114 114 0.0 88 88 0.0
pfile04-014.pddl
128 128 0.0 98 98 0.0
pfile04-015.pddl
121 121 0.0 88 88 0.0
pfile04-016.pddl
121 121 0.0 88 88 0.0
pfile05-017.pddl
137 137 0.0 112 112 0.0
pfile05-018.pddl
145 145 0.0 112 112 0.0
pfile05-019.pddl
137 137 0.0 112 112 0.0
pfile05-020.pddl
137 137 0.0 112 112 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
85 85 0.0 56 56 0.0
p435-2.pddl
84 84 0.0 56 56 0.0
p435-3.pddl
85 85 0.0 56 56 0.0
p536-1.pddl
96 96 0.0 70 70 0.0
p536-2.pddl
95 95 0.0 70 70 0.0
p536-3.pddl
96 96 0.0 70 70 0.0
p638-1.pddl
121 121 0.0 88 88 0.0
p638-2.pddl
128 128 0.0 98 98 0.0
p638-3.pddl
121 121 0.0 98 98 0.0
p739-1.pddl
130 130 0.0 102 102 0.0
p739-2.pddl
130 130 0.0 102 102 0.0
p739-3.pddl
130 130 0.0 102 102 0.0
p839-1.pddl
143 143 0.0 112 112 0.0
p839-2.pddl
143 143 0.0 112 112 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
blocks
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
24 24 0.0 15 15 0.0
probBLOCKS-4-1.pddl
31 31 0.0 18 18 0.0
probBLOCKS-4-2.pddl
38 38 0.0 18 18 0.0
probBLOCKS-5-0.pddl
42 42 0.0 24 24 0.0
probBLOCKS-5-1.pddl
30 30 0.0 21 21 0.0
probBLOCKS-5-2.pddl
81 81 0.0 39 39 0.0
probBLOCKS-6-0.pddl
85 85 0.0 44 44 0.0
probBLOCKS-6-1.pddl
51 51 0.0 29 29 0.0
probBLOCKS-6-2.pddl
111 111 0.0 56 56 0.0
probBLOCKS-7-0.pddl
151 151 0.0 80 80 0.0
probBLOCKS-7-1.pddl
82 82 0.0 54 54 0.0
probBLOCKS-7-2.pddl
80 80 0.0 49 49 0.0
probBLOCKS-8-0.pddl
69 69 0.0 50 50 0.0
probBLOCKS-8-1.pddl
55 55 0.0 39 39 0.0
probBLOCKS-8-2.pddl
101 101 0.0 54 54 0.0
probBLOCKS-9-0.pddl
148 148 0.0 94 94 0.0
probBLOCKS-9-1.pddl
191 191 0.0 114 114 0.0
probBLOCKS-9-2.pddl
208 208 0.0 114 114 0.0
probBLOCKS-10-0.pddl
239 239 0.0 117 117 0.0
probBLOCKS-10-1.pddl
217 217 0.0 113 113 0.0
probBLOCKS-10-2.pddl
253 253 0.0 134 134 0.0
probBLOCKS-11-0.pddl
158 158 0.0 91 91 0.0
probBLOCKS-11-1.pddl
175 175 0.0 86 86 0.0
probBLOCKS-11-2.pddl
172 172 0.0 121 121 0.0
probBLOCKS-12-0.pddl
226 226 0.0 129 129 0.0
probBLOCKS-12-1.pddl
344 344 0.0 177 177 0.0
probBLOCKS-13-0.pddl
333 333 0.0 172 172 0.0
probBLOCKS-13-1.pddl
409 409 0.0 218 218 0.0
probBLOCKS-14-0.pddl
270 270 0.0 163 163 0.0
probBLOCKS-14-1.pddl
252 252 0.0 131 131 0.0
probBLOCKS-15-0.pddl
207 207 0.0 121 121 0.0
probBLOCKS-15-1.pddl
423 423 0.0 269 269 0.0
probBLOCKS-16-1.pddl
508 508 0.0 269 269 0.0
probBLOCKS-16-2.pddl
434 434 0.0 245 245 0.0
probBLOCKS-17-0.pddl
336 336 0.0 180 180 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
childsnack-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
12 12 0.0 0 0 0.0
child-snack_pfile01.pddl
12 12 0.0 0 0 0.0
child-snack_pfile02-2.pddl
14 14 0.0 0 0 0.0
child-snack_pfile02.pddl
14 14 0.0 0 0 0.0
child-snack_pfile03-2.pddl
16 16 0.0 0 0 0.0
child-snack_pfile03.pddl
16 16 0.0 0 0 0.0
child-snack_pfile04-2.pddl
18 18 0.0 0 0 0.0
child-snack_pfile04.pddl
18 18 0.0 0 0 0.0
child-snack_pfile05-2.pddl
20 20 0.0 0 0 0.0
child-snack_pfile05.pddl
20 20 0.0 0 0 0.0
child-snack_pfile06-2.pddl
22 22 0.0 0 0 0.0
child-snack_pfile06.pddl
22 22 0.0 0 0 0.0
child-snack_pfile07-2.pddl
24 24 0.0 0 0 0.0
child-snack_pfile07.pddl
24 24 0.0 0 0 0.0
child-snack_pfile08-2.pddl
26 26 0.0 0 0 0.0
child-snack_pfile08.pddl
26 26 0.0 0 0 0.0
child-snack_pfile09-2.pddl
28 28 0.0 0 0 0.0
child-snack_pfile09.pddl
28 28 0.0 0 0 0.0
child-snack_pfile10-2.pddl
30 30 0.0 0 0 0.0
child-snack_pfile10.pddl
30 30 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
data-network-opt18-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
3 3 0.0 9 9 0.0
p02.pddl
3 3 0.0 4 4 0.0
p03.pddl
6 6 0.0 18 18 0.0
p04.pddl
9 9 0.0 27 27 0.0
p05.pddl
11 11 0.0 17 17 0.0
p06.pddl
6 6 0.0 10 10 0.0
p07.pddl
9 9 0.0 13 13 0.0
p08.pddl
11 11 0.0 22 22 0.0
p09.pddl
3 3 0.0 6 6 0.0
p10.pddl
6 6 0.0 7 7 0.0
p11.pddl
3 3 0.0 4 4 0.0
p12.pddl
3 3 0.0 6 6 0.0
p13.pddl
6 6 0.0 9 9 0.0
p14.pddl
18 18 0.0 19 19 0.0
p15.pddl
3 3 0.0 6 6 0.0
p16.pddl
6 6 0.0 17 17 0.0
p17.pddl
6 6 0.0 6 6 0.0
p18.pddl
9 9 0.0 15 15 0.0
p19.pddl
9 9 0.0 25 25 0.0
p20.pddl
9 9 0.0 13 13 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
depot
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
43 43 0.0 19 19 0.0
p02.pddl
67 67 0.0 36 36 0.0
p03.pddl
137 137 0.0 82 82 0.0
p04.pddl
128 128 0.0 68 68 0.0
p05.pddl
203 203 0.0 144 144 0.0
p06.pddl
331 331 0.0 256 256 0.0
p07.pddl
81 81 0.0 44 44 0.0
p08.pddl
172 172 0.0 83 83 0.0
p09.pddl
325 325 0.0 207 207 0.0
p10.pddl
93 93 0.0 47 47 0.0
p11.pddl
195 195 0.0 137 137 0.0
p12.pddl
293 293 0.0 214 214 0.0
p13.pddl
121 121 0.0 56 56 0.0
p14.pddl
85 85 0.0 44 44 0.0
p15.pddl
223 223 0.0 163 163 0.0
p16.pddl
94 94 0.0 49 49 0.0
p17.pddl
73 73 0.0 45 45 0.0
p18.pddl
243 243 0.0 154 154 0.0
p19.pddl
125 125 0.0 71 71 0.0
p20.pddl
214 214 0.0 165 165 0.0
p21.pddl
45 45 0.0 48 48 0.0
p22.pddl
157 157 0.0 179 179 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
driverlog
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
9 9 0.0 3 3 0.0
p02.pddl
19 19 0.0 9 9 0.0
p03.pddl
18 18 0.0 4 4 0.0
p04.pddl
15 15 0.0 7 7 0.0
p05.pddl
26 26 0.0 9 9 0.0
p06.pddl
13 13 0.0 7 7 0.0
p07.pddl
18 18 0.0 7 7 0.0
p08.pddl
23 23 0.0 9 9 0.0
p09.pddl
26 26 0.0 9 9 0.0
p10.pddl
21 21 0.0 6 6 0.0
p11.pddl
26 26 0.0 7 7 0.0
p12.pddl
34 34 0.0 11 11 0.0
p13.pddl
36 36 0.0 10 10 0.0
p14.pddl
42 42 0.0 11 11 0.0
p15.pddl
47 47 0.0 11 11 0.0
p16.pddl
21 21 0.0 24 24 0.0
p17.pddl
24 24 0.0 27 27 0.0
p18.pddl
23 23 0.0 27 27 0.0
p19.pddl
31 31 0.0 36 36 0.0
p20.pddl
30 30 0.0 32 32 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt08-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
25 25 0.0 13 13 0.0
p02.pddl
13 13 0.0 8 8 0.0
p03.pddl
36 36 0.0 21 21 0.0
p04.pddl
34 34 0.0 19 19 0.0
p05.pddl
42 42 0.0 25 25 0.0
p06.pddl
51 51 0.0 29 29 0.0
p07.pddl
41 41 0.0 26 26 0.0
p08.pddl
28 28 0.0 11 11 0.0
p09.pddl
62 62 0.0 26 26 0.0
p10.pddl
53 53 0.0 27 27 0.0
p11.pddl
42 42 0.0 18 18 0.0
p12.pddl
31 31 0.0 22 22 0.0
p13.pddl
25 25 0.0 19 19 0.0
p14.pddl
62 62 0.0 38 38 0.0
p15.pddl
52 52 0.0 33 33 0.0
p16.pddl
63 63 0.0 39 39 0.0
p17.pddl
46 46 0.0 30 30 0.0
p18.pddl
60 60 0.0 42 42 0.0
p19.pddl
85 85 0.0 41 41 0.0
p20.pddl
62 62 0.0 42 42 0.0
p21.pddl
26 26 0.0 17 17 0.0
p22.pddl
13 13 0.0 8 8 0.0
p23.pddl
39 39 0.0 22 22 0.0
p24.pddl
48 48 0.0 24 24 0.0
p25.pddl
41 41 0.0 30 30 0.0
p26.pddl
38 38 0.0 35 35 0.0
p27.pddl
69 69 0.0 36 36 0.0
p28.pddl
40 40 0.0 31 31 0.0
p29.pddl
52 52 0.0 22 22 0.0
p30.pddl
70 70 0.0 32 32 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
42 42 0.0 18 18 0.0
p02.pddl
26 26 0.0 17 17 0.0
p03.pddl
31 31 0.0 22 22 0.0
p04.pddl
36 36 0.0 21 21 0.0
p05.pddl
25 25 0.0 19 19 0.0
p06.pddl
34 34 0.0 19 19 0.0
p07.pddl
38 38 0.0 35 35 0.0
p08.pddl
42 42 0.0 25 25 0.0
p09.pddl
13 13 0.0 8 8 0.0
p10.pddl
62 62 0.0 38 38 0.0
p11.pddl
40 40 0.0 31 31 0.0
p12.pddl
51 51 0.0 29 29 0.0
p13.pddl
41 41 0.0 26 26 0.0
p14.pddl
28 28 0.0 11 11 0.0
p15.pddl
62 62 0.0 26 26 0.0
p16.pddl
52 52 0.0 33 33 0.0
p17.pddl
46 46 0.0 30 30 0.0
p18.pddl
60 60 0.0 42 42 0.0
p19.pddl
39 39 0.0 22 22 0.0
p20.pddl
48 48 0.0 24 24 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
20 20 0.0 13 13 0.0
opt-p01-002.pddl
23 23 0.0 14 14 0.0
opt-p02-003.pddl
21 21 0.0 15 15 0.0
opt-p02-004.pddl
23 23 0.0 16 16 0.0
opt-p03-005.pddl
35 35 0.0 20 20 0.0
opt-p03-006.pddl
34 34 0.0 20 20 0.0
opt-p04-007.pddl
34 34 0.0 22 22 0.0
opt-p04-008.pddl
32 32 0.0 21 21 0.0
opt-p05-009.pddl
40 40 0.0 26 26 0.0
opt-p05-010.pddl
42 42 0.0 26 26 0.0
opt-p06-011.pddl
50 50 0.0 30 30 0.0
opt-p06-012.pddl
49 49 0.0 30 30 0.0
opt-p07-013.pddl
52 52 0.0 32 32 0.0
opt-p07-014.pddl
46 46 0.0 31 31 0.0
opt-p08-015.pddl
52 52 0.0 38 38 0.0
opt-p08-016.pddl
52 52 0.0 38 38 0.0
opt-p09-017.pddl
57 57 0.0 43 43 0.0
opt-p09-018.pddl
59 59 0.0 44 44 0.0
opt-p10-019.pddl
56 56 0.0 44 44 0.0
opt-p10-020.pddl
60 60 0.0 45 45 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
24 24 0.0 16 16 0.0
p01-4-4-2.pddl
36 36 0.0 22 22 0.0
p01-5-3-2.pddl
34 34 0.0 20 20 0.0
p01-5-4-2.pddl
38 38 0.0 25 25 0.0
p01-5-5-2.pddl
48 48 0.0 31 31 0.0
p01-6-4-2.pddl
49 49 0.0 30 30 0.0
p01-6-5-2.pddl
61 61 0.0 37 37 0.0
p02-4-4-2.pddl
32 32 0.0 21 21 0.0
p02-5-3-2.pddl
33 33 0.0 20 20 0.0
p02-5-4-2.pddl
39 39 0.0 25 25 0.0
p02-5-5-2.pddl
51 51 0.0 32 32 0.0
p02-6-4-2.pddl
46 46 0.0 29 29 0.0
p02-6-5-2.pddl
61 61 0.0 37 37 0.0
p03-4-3-2.pddl
29 29 0.0 17 17 0.0
p03-4-4-2.pddl
36 36 0.0 22 22 0.0
p03-5-3-2.pddl
33 33 0.0 20 20 0.0
p03-5-4-2.pddl
42 42 0.0 26 26 0.0
p03-5-5-2.pddl
50 50 0.0 32 32 0.0
p03-6-4-2.pddl
46 46 0.0 29 29 0.0
p03-6-5-2.pddl
61 61 0.0 37 37 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
freecell
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
29 29 0.0 34 34 0.0
p02.pddl
55 55 0.0 54 54 0.0
p03.pddl
124 124 0.0 79 79 0.0
p04.pddl
192 192 0.0 107 107 0.0
p05.pddl
325 325 0.0 145 145 0.0
p06.pddl
397 397 0.0 164 164 0.0
p07.pddl
447 447 0.0 170 170 0.0
p08.pddl
533 533 0.0 183 183 0.0
p09.pddl
547 547 0.0 185 185 0.0
p10.pddl
625 625 0.0 194 194 0.0
p11.pddl
709 709 0.0 210 210 0.0
p12.pddl
721 721 0.0 225 225 0.0
p13.pddl
803 803 0.0 228 228 0.0
p14.pddl
699 699 0.0 216 216 0.0
p15.pddl
941 941 0.0 250 250 0.0
p16.pddl
962 962 0.0 254 254 0.0
p17.pddl
1118 1118 0.0 274 274 0.0
p18.pddl
1195 1195 0.0 274 274 0.0
p19.pddl
1454 1454 0.0 311 311 0.0
p20.pddl
1426 1426 0.0 328 328 0.0
probfreecell-2-1.pddl
16 16 0.0 31 31 0.0
probfreecell-2-2.pddl
28 28 0.0 32 32 0.0
probfreecell-2-3.pddl
34 34 0.0 36 36 0.0
probfreecell-2-4.pddl
23 23 0.0 30 30 0.0
probfreecell-2-5.pddl
22 22 0.0 30 30 0.0
probfreecell-3-1.pddl
46 46 0.0 49 49 0.0
probfreecell-3-2.pddl
57 57 0.0 50 50 0.0
probfreecell-3-3.pddl
56 56 0.0 52 52 0.0
probfreecell-3-4.pddl
50 50 0.0 50 50 0.0
probfreecell-3-5.pddl
43 43 0.0 50 50 0.0
probfreecell-4-1.pddl
92 92 0.0 71 71 0.0
probfreecell-4-2.pddl
107 107 0.0 75 75 0.0
probfreecell-4-3.pddl
112 112 0.0 68 68 0.0
probfreecell-4-4.pddl
101 101 0.0 70 70 0.0
probfreecell-4-5.pddl
74 74 0.0 72 72 0.0
probfreecell-5-1.pddl
142 142 0.0 85 85 0.0
probfreecell-5-2.pddl
171 171 0.0 94 94 0.0
probfreecell-5-3.pddl
176 176 0.0 92 92 0.0
probfreecell-5-4.pddl
160 160 0.0 90 90 0.0
probfreecell-5-5.pddl
160 160 0.0 98 98 0.0
probfreecell-6-1.pddl
223 223 0.0 111 111 0.0
probfreecell-6-2.pddl
255 255 0.0 122 122 0.0
probfreecell-6-3.pddl
251 251 0.0 115 115 0.0
probfreecell-6-4.pddl
241 241 0.0 113 113 0.0
probfreecell-6-5.pddl
243 243 0.0 120 120 0.0
probfreecell-7-1.pddl
361 361 0.0 146 146 0.0
probfreecell-7-2.pddl
353 353 0.0 147 147 0.0
probfreecell-7-3.pddl
344 344 0.0 146 146 0.0
probfreecell-7-4.pddl
351 351 0.0 139 139 0.0
probfreecell-7-5.pddl
352 352 0.0 138 138 0.0
probfreecell-8-1.pddl
495 495 0.0 172 172 0.0
probfreecell-8-2.pddl
477 477 0.0 174 174 0.0
probfreecell-8-3.pddl
458 458 0.0 172 172 0.0
probfreecell-8-4.pddl
482 482 0.0 169 169 0.0
probfreecell-8-5.pddl
472 472 0.0 158 158 0.0
probfreecell-9-1.pddl
628 628 0.0 200 200 0.0
probfreecell-9-2.pddl
614 614 0.0 194 194 0.0
probfreecell-9-3.pddl
605 605 0.0 202 202 0.0
probfreecell-9-4.pddl
633 633 0.0 201 201 0.0
probfreecell-9-5.pddl
615 615 0.0 180 180 0.0
probfreecell-10-1.pddl
801 801 0.0 230 230 0.0
probfreecell-10-2.pddl
776 776 0.0 214 214 0.0
probfreecell-10-3.pddl
762 762 0.0 229 229 0.0
probfreecell-10-4.pddl
816 816 0.0 229 229 0.0
probfreecell-10-5.pddl
804 804 0.0 220 220 0.0
probfreecell-11-1.pddl
997 997 0.0 265 265 0.0
probfreecell-11-2.pddl
958 958 0.0 251 251 0.0
probfreecell-11-3.pddl
954 954 0.0 271 271 0.0
probfreecell-11-4.pddl
1026 1026 0.0 265 265 0.0
probfreecell-11-5.pddl
1017 1017 0.0 246 246 0.0
probfreecell-12-1.pddl
1204 1204 0.0 301 301 0.0
probfreecell-12-2.pddl
1146 1146 0.0 269 269 0.0
probfreecell-12-3.pddl
1160 1160 0.0 298 298 0.0
probfreecell-12-4.pddl
1249 1249 0.0 293 293 0.0
probfreecell-12-5.pddl
1252 1252 0.0 284 284 0.0
probfreecell-13-1.pddl
1427 1427 0.0 325 325 0.0
probfreecell-13-2.pddl
1367 1367 0.0 288 288 0.0
probfreecell-13-3.pddl
1393 1393 0.0 326 326 0.0
probfreecell-13-4.pddl
1495 1495 0.0 325 325 0.0
probfreecell-13-5.pddl
1492 1492 0.0 310 310 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
ged-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
1 1 0.0 2 2 0.0
d-1-3.pddl
6 6 0.0 15 15 0.0
d-1-4.pddl
1 1 0.0 2 2 0.0
d-1-8.pddl
7 7 0.0 20 20 0.0
d-2-1.pddl
1 1 0.0 2 2 0.0
d-2-3.pddl
5 5 0.0 13 13 0.0
d-2-4.pddl
4 4 0.0 11 11 0.0
d-2-8.pddl
8 8 0.0 22 22 0.0
d-3-1.pddl
6 6 0.0 15 15 0.0
d-3-2.pddl
5 5 0.0 13 13 0.0
d-3-4.pddl
8 8 0.0 21 21 0.0
d-4-2.pddl
4 4 0.0 11 11 0.0
d-4-3.pddl
8 8 0.0 21 21 0.0
d-4-8.pddl
8 8 0.0 22 22 0.0
d-7-5.pddl
7 7 0.0 20 20 0.0
d-7-6.pddl
5 5 0.0 15 15 0.0
d-8-1.pddl
7 7 0.0 20 20 0.0
d-8-2.pddl
8 8 0.0 22 22 0.0
d-8-4.pddl
8 8 0.0 22 22 0.0
d-8-9.pddl
10 10 0.0 27 27 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
grid
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
33 33 0.0 12 12 0.0
prob02.pddl
41 41 0.0 16 16 0.0
prob03.pddl
62 62 0.0 35 35 0.0
prob04.pddl
45 45 0.0 20 20 0.0
prob05.pddl
115 115 0.0 59 59 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
gripper
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
21 21 0.0 12 12 0.0
prob02.pddl
31 31 0.0 18 18 0.0
prob03.pddl
41 41 0.0 24 24 0.0
prob04.pddl
51 51 0.0 30 30 0.0
prob05.pddl
61 61 0.0 36 36 0.0
prob06.pddl
71 71 0.0 42 42 0.0
prob07.pddl
81 81 0.0 48 48 0.0
prob08.pddl
91 91 0.0 54 54 0.0
prob09.pddl
101 101 0.0 60 60 0.0
prob10.pddl
111 111 0.0 66 66 0.0
prob11.pddl
121 121 0.0 72 72 0.0
prob12.pddl
131 131 0.0 78 78 0.0
prob13.pddl
141 141 0.0 84 84 0.0
prob14.pddl
151 151 0.0 90 90 0.0
prob15.pddl
161 161 0.0 96 96 0.0
prob16.pddl
171 171 0.0 102 102 0.0
prob17.pddl
181 181 0.0 108 108 0.0
prob18.pddl
191 191 0.0 114 114 0.0
prob19.pddl
201 201 0.0 120 120 0.0
prob20.pddl
211 211 0.0 126 126 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
hiking-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
23 23 0.0 11 11 0.0
ptesting-1-2-4.pddl
40 40 0.0 15 15 0.0
ptesting-1-2-5.pddl
69 69 0.0 19 19 0.0
ptesting-1-2-7.pddl
124 124 0.0 27 27 0.0
ptesting-1-2-8.pddl
160 160 0.0 31 31 0.0
ptesting-2-2-3.pddl
28 28 0.0 12 12 0.0
ptesting-2-2-4.pddl
58 58 0.0 18 18 0.0
ptesting-2-2-5.pddl
96 96 0.0 24 24 0.0
ptesting-2-2-6.pddl
147 147 0.0 30 30 0.0
ptesting-2-2-7.pddl
196 196 0.0 36 36 0.0
ptesting-2-2-8.pddl
265 265 0.0 42 42 0.0
ptesting-2-3-4.pddl
52 52 0.0 18 18 0.0
ptesting-2-3-5.pddl
100 100 0.0 24 24 0.0
ptesting-2-3-6.pddl
142 142 0.0 30 30 0.0
ptesting-2-3-7.pddl
184 184 0.0 36 36 0.0
ptesting-2-4-3.pddl
28 28 0.0 12 12 0.0
ptesting-2-4-4.pddl
52 52 0.0 18 18 0.0
ptesting-2-4-5.pddl
88 88 0.0 24 24 0.0
ptesting-2-4-6.pddl
147 147 0.0 30 30 0.0
ptesting-2-4-7.pddl
196 196 0.0 36 36 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics00
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
81 81 0.0 32 32 0.0
probLOGISTICS-4-1.pddl
65 65 0.0 28 28 0.0
probLOGISTICS-4-2.pddl
54 54 0.0 20 20 0.0
probLOGISTICS-5-0.pddl
109 109 0.0 44 44 0.0
probLOGISTICS-5-1.pddl
53 53 0.0 24 24 0.0
probLOGISTICS-5-2.pddl
17 17 0.0 12 12 0.0
probLOGISTICS-6-0.pddl
91 91 0.0 40 40 0.0
probLOGISTICS-6-1.pddl
47 47 0.0 20 20 0.0
probLOGISTICS-6-2.pddl
92 92 0.0 40 40 0.0
probLOGISTICS-6-9.pddl
93 93 0.0 36 36 0.0
probLOGISTICS-7-0.pddl
141 141 0.0 57 57 0.0
probLOGISTICS-7-1.pddl
179 179 0.0 70 70 0.0
probLOGISTICS-8-0.pddl
119 119 0.0 49 49 0.0
probLOGISTICS-8-1.pddl
189 189 0.0 73 73 0.0
probLOGISTICS-9-0.pddl
148 148 0.0 58 58 0.0
probLOGISTICS-9-1.pddl
116 116 0.0 49 49 0.0
probLOGISTICS-10-0.pddl
182 182 0.0 71 71 0.0
probLOGISTICS-10-1.pddl
153 153 0.0 68 68 0.0
probLOGISTICS-11-0.pddl
207 207 0.0 81 81 0.0
probLOGISTICS-11-1.pddl
262 262 0.0 102 102 0.0
probLOGISTICS-12-0.pddl
157 157 0.0 67 67 0.0
probLOGISTICS-12-1.pddl
303 303 0.0 115 115 0.0
probLOGISTICS-13-0.pddl
259 259 0.0 83 83 0.0
probLOGISTICS-13-1.pddl
217 217 0.0 69 69 0.0
probLOGISTICS-14-0.pddl
204 204 0.0 68 68 0.0
probLOGISTICS-14-1.pddl
260 260 0.0 83 83 0.0
probLOGISTICS-15-0.pddl
257 257 0.0 88 88 0.0
probLOGISTICS-15-1.pddl
212 212 0.0 75 75 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics98
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
75 75 0.0 21 21 0.0
prob02.pddl
70 70 0.0 21 21 0.0
prob03.pddl
158 158 0.0 48 48 0.0
prob04.pddl
115 115 0.0 38 38 0.0
prob05.pddl
55 55 0.0 24 24 0.0
prob06.pddl
174 174 0.0 42 42 0.0
prob07.pddl
48 48 0.0 22 22 0.0
prob08.pddl
105 105 0.0 23 23 0.0
prob09.pddl
208 208 0.0 37 37 0.0
prob10.pddl
308 308 0.0 83 83 0.0
prob11.pddl
29 29 0.0 10 10 0.0
prob12.pddl
58 58 0.0 15 15 0.0
prob13.pddl
138 138 0.0 59 59 0.0
prob14.pddl
75 75 0.0 35 35 0.0
prob15.pddl
213 213 0.0 81 81 0.0
prob16.pddl
63 63 0.0 20 20 0.0
prob17.pddl
30 30 0.0 16 16 0.0
prob18.pddl
388 388 0.0 153 153 0.0
prob19.pddl
236 236 0.0 48 48 0.0
prob20.pddl
351 351 0.0 120 120 0.0
prob21.pddl
198 198 0.0 41 41 0.0
prob22.pddl
498 498 0.0 141 141 0.0
prob23.pddl
243 243 0.0 48 48 0.0
prob24.pddl
33 33 0.0 12 12 0.0
prob25.pddl
499 499 0.0 179 179 0.0
prob26.pddl
447 447 0.0 89 89 0.0
prob27.pddl
321 321 0.0 79 79 0.0
prob28.pddl
411 411 0.0 87 87 0.0
prob29.pddl
641 641 0.0 225 225 0.0
prob30.pddl
251 251 0.0 39 39 0.0
prob31.pddl
27 27 0.0 13 13 0.0
prob32.pddl
50 50 0.0 18 18 0.0
prob33.pddl
60 60 0.0 29 29 0.0
prob34.pddl
109 109 0.0 15 15 0.0
prob35.pddl
82 82 0.0 34 34 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
miconic
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
7 7 0.0 3 3 0.0
s1-1.pddl
6 6 0.0 3 3 0.0
s1-2.pddl
7 7 0.0 3 3 0.0
s1-3.pddl
7 7 0.0 3 3 0.0
s1-4.pddl
7 7 0.0 3 3 0.0
s2-0.pddl
15 15 0.0 8 8 0.0
s2-1.pddl
13 13 0.0 6 6 0.0
s2-2.pddl
13 13 0.0 6 6 0.0
s2-3.pddl
15 15 0.0 8 8 0.0
s2-4.pddl
14 14 0.0 7 7 0.0
s3-0.pddl
22 22 0.0 12 12 0.0
s3-1.pddl
22 22 0.0 12 12 0.0
s3-2.pddl
21 21 0.0 9 9 0.0
s3-3.pddl
20 20 0.0 10 10 0.0
s3-4.pddl
20 20 0.0 9 9 0.0
s4-0.pddl
30 30 0.0 16 16 0.0
s4-1.pddl
27 27 0.0 14 14 0.0
s4-2.pddl
30 30 0.0 15 15 0.0
s4-3.pddl
30 30 0.0 15 15 0.0
s4-4.pddl
31 31 0.0 16 16 0.0
s5-0.pddl
37 37 0.0 20 20 0.0
s5-1.pddl
35 35 0.0 17 17 0.0
s5-2.pddl
33 33 0.0 17 17 0.0
s5-3.pddl
37 37 0.0 20 20 0.0
s5-4.pddl
37 37 0.0 19 19 0.0
s6-0.pddl
42 42 0.0 23 23 0.0
s6-1.pddl
42 42 0.0 23 23 0.0
s6-2.pddl
43 43 0.0 23 23 0.0
s6-3.pddl
42 42 0.0 22 22 0.0
s6-4.pddl
44 44 0.0 23 23 0.0
s7-0.pddl
51 51 0.0 28 28 0.0
s7-1.pddl
52 52 0.0 28 28 0.0
s7-2.pddl
49 49 0.0 27 27 0.0
s7-3.pddl
48 48 0.0 26 26 0.0
s7-4.pddl
52 52 0.0 27 27 0.0
s8-0.pddl
59 59 0.0 32 32 0.0
s8-1.pddl
57 57 0.0 31 31 0.0
s8-2.pddl
57 57 0.0 31 31 0.0
s8-3.pddl
58 58 0.0 30 30 0.0
s8-4.pddl
58 58 0.0 31 31 0.0
s9-0.pddl
66 66 0.0 35 35 0.0
s9-1.pddl
64 64 0.0 34 34 0.0
s9-2.pddl
64 64 0.0 34 34 0.0
s9-3.pddl
67 67 0.0 35 35 0.0
s9-4.pddl
61 61 0.0 34 34 0.0
s10-0.pddl
72 72 0.0 39 39 0.0
s10-1.pddl
69 69 0.0 37 37 0.0
s10-2.pddl
70 70 0.0 38 38 0.0
s10-3.pddl
74 74 0.0 40 40 0.0
s10-4.pddl
71 71 0.0 38 38 0.0
s11-0.pddl
79 79 0.0 42 42 0.0
s11-1.pddl
77 77 0.0 43 43 0.0
s11-2.pddl
81 81 0.0 43 43 0.0
s11-3.pddl
81 81 0.0 44 44 0.0
s11-4.pddl
78 78 0.0 43 43 0.0
s12-0.pddl
88 88 0.0 48 48 0.0
s12-1.pddl
88 88 0.0 48 48 0.0
s12-2.pddl
85 85 0.0 45 45 0.0
s12-3.pddl
85 85 0.0 46 46 0.0
s12-4.pddl
89 89 0.0 48 48 0.0
s13-0.pddl
95 95 0.0 51 51 0.0
s13-1.pddl
93 93 0.0 52 52 0.0
s13-2.pddl
98 98 0.0 52 52 0.0
s13-3.pddl
95 95 0.0 52 52 0.0
s13-4.pddl
92 92 0.0 51 51 0.0
s14-0.pddl
100 100 0.0 55 55 0.0
s14-1.pddl
103 103 0.0 56 56 0.0
s14-2.pddl
104 104 0.0 55 55 0.0
s14-3.pddl
97 97 0.0 55 55 0.0
s14-4.pddl
100 100 0.0 55 55 0.0
s15-0.pddl
105 105 0.0 59 59 0.0
s15-1.pddl
109 109 0.0 57 57 0.0
s15-2.pddl
109 109 0.0 58 58 0.0
s15-3.pddl
110 110 0.0 60 60 0.0
s15-4.pddl
105 105 0.0 58 58 0.0
s16-0.pddl
117 117 0.0 64 64 0.0
s16-1.pddl
115 115 0.0 63 63 0.0
s16-2.pddl
118 118 0.0 63 63 0.0
s16-3.pddl
113 113 0.0 61 61 0.0
s16-4.pddl
116 116 0.0 63 63 0.0
s17-0.pddl
123 123 0.0 67 67 0.0
s17-1.pddl
121 121 0.0 67 67 0.0
s17-2.pddl
121 121 0.0 67 67 0.0
s17-3.pddl
127 127 0.0 67 67 0.0
s17-4.pddl
121 121 0.0 67 67 0.0
s18-0.pddl
131 131 0.0 72 72 0.0
s18-1.pddl
129 129 0.0 71 71 0.0
s18-2.pddl
130 130 0.0 72 72 0.0
s18-3.pddl
131 131 0.0 71 71 0.0
s18-4.pddl
127 127 0.0 70 70 0.0
s19-0.pddl
138 138 0.0 76 76 0.0
s19-1.pddl
141 141 0.0 76 76 0.0
s19-2.pddl
137 137 0.0 75 75 0.0
s19-3.pddl
139 139 0.0 75 75 0.0
s19-4.pddl
138 138 0.0 75 75 0.0
s20-0.pddl
143 143 0.0 80 80 0.0
s20-1.pddl
145 145 0.0 79 79 0.0
s20-2.pddl
141 141 0.0 78 78 0.0
s20-3.pddl
143 143 0.0 80 80 0.0
s20-4.pddl
143 143 0.0 78 78 0.0
s21-0.pddl
153 153 0.0 83 83 0.0
s21-1.pddl
152 152 0.0 83 83 0.0
s21-2.pddl
152 152 0.0 83 83 0.0
s21-3.pddl
149 149 0.0 82 82 0.0
s21-4.pddl
152 152 0.0 82 82 0.0
s22-0.pddl
160 160 0.0 87 87 0.0
s22-1.pddl
157 157 0.0 87 87 0.0
s22-2.pddl
159 159 0.0 88 88 0.0
s22-3.pddl
162 162 0.0 86 86 0.0
s22-4.pddl
159 159 0.0 87 87 0.0
s23-0.pddl
167 167 0.0 91 91 0.0
s23-1.pddl
166 166 0.0 91 91 0.0
s23-2.pddl
165 165 0.0 92 92 0.0
s23-3.pddl
163 163 0.0 92 92 0.0
s23-4.pddl
166 166 0.0 92 92 0.0
s24-0.pddl
175 175 0.0 96 96 0.0
s24-1.pddl
174 174 0.0 96 96 0.0
s24-2.pddl
173 173 0.0 94 94 0.0
s24-3.pddl
174 174 0.0 94 94 0.0
s24-4.pddl
172 172 0.0 94 94 0.0
s25-0.pddl
181 181 0.0 100 100 0.0
s25-1.pddl
185 185 0.0 100 100 0.0
s25-2.pddl
177 177 0.0 99 99 0.0
s25-3.pddl
183 183 0.0 98 98 0.0
s25-4.pddl
181 181 0.0 98 98 0.0
s26-0.pddl
187 187 0.0 103 103 0.0
s26-1.pddl
187 187 0.0 104 104 0.0
s26-2.pddl
194 194 0.0 104 104 0.0
s26-3.pddl
192 192 0.0 104 104 0.0
s26-4.pddl
185 185 0.0 102 102 0.0
s27-0.pddl
195 195 0.0 106 106 0.0
s27-1.pddl
198 198 0.0 107 107 0.0
s27-2.pddl
194 194 0.0 107 107 0.0
s27-3.pddl
197 197 0.0 108 108 0.0
s27-4.pddl
195 195 0.0 106 106 0.0
s28-0.pddl
206 206 0.0 110 110 0.0
s28-1.pddl
204 204 0.0 112 112 0.0
s28-2.pddl
205 205 0.0 111 111 0.0
s28-3.pddl
198 198 0.0 111 111 0.0
s28-4.pddl
204 204 0.0 112 112 0.0
s29-0.pddl
208 208 0.0 114 114 0.0
s29-1.pddl
206 206 0.0 115 115 0.0
s29-2.pddl
211 211 0.0 116 116 0.0
s29-3.pddl
212 212 0.0 115 115 0.0
s29-4.pddl
215 215 0.0 116 116 0.0
s30-0.pddl
214 214 0.0 119 119 0.0
s30-1.pddl
217 217 0.0 119 119 0.0
s30-2.pddl
216 216 0.0 118 118 0.0
s30-3.pddl
220 220 0.0 119 119 0.0
s30-4.pddl
217 217 0.0 118 118 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
movie
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
8 8 0.0 0 0 0.0
prob02.pddl
8 8 0.0 0 0 0.0
prob03.pddl
8 8 0.0 0 0 0.0
prob04.pddl
8 8 0.0 0 0 0.0
prob05.pddl
8 8 0.0 0 0 0.0
prob06.pddl
8 8 0.0 0 0 0.0
prob07.pddl
8 8 0.0 0 0 0.0
prob08.pddl
8 8 0.0 0 0 0.0
prob09.pddl
8 8 0.0 0 0 0.0
prob10.pddl
8 8 0.0 0 0 0.0
prob11.pddl
8 8 0.0 0 0 0.0
prob12.pddl
8 8 0.0 0 0 0.0
prob13.pddl
8 8 0.0 0 0 0.0
prob14.pddl
8 8 0.0 0 0 0.0
prob15.pddl
8 8 0.0 0 0 0.0
prob16.pddl
8 8 0.0 0 0 0.0
prob17.pddl
8 8 0.0 0 0 0.0
prob18.pddl
8 8 0.0 0 0 0.0
prob19.pddl
8 8 0.0 0 0 0.0
prob20.pddl
8 8 0.0 0 0 0.0
prob21.pddl
8 8 0.0 0 0 0.0
prob22.pddl
8 8 0.0 0 0 0.0
prob23.pddl
8 8 0.0 0 0 0.0
prob24.pddl
8 8 0.0 0 0 0.0
prob25.pddl
8 8 0.0 0 0 0.0
prob26.pddl
8 8 0.0 0 0 0.0
prob27.pddl
8 8 0.0 0 0 0.0
prob28.pddl
8 8 0.0 0 0 0.0
prob29.pddl
8 8 0.0 0 0 0.0
prob30.pddl
8 8 0.0 0 0 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mprime
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
14 14 0.0 7 7 0.0
prob02.pddl
10 10 0.0 2 2 0.0
prob03.pddl
6 6 0.0 1 1 0.0
prob04.pddl
24 24 0.0 10 10 0.0
prob05.pddl
10 10 0.0 2 2 0.0
prob06.pddl
2 2 0.0 2 2 0.0
prob07.pddl
7 7 0.0 1 1 0.0
prob08.pddl
1 1 0.0 1 1 0.0
prob09.pddl
8 8 0.0 2 2 0.0
prob10.pddl
1 1 0.0 1 1 0.0
prob11.pddl
20 20 0.0 15 15 0.0
prob12.pddl
4 4 0.0 1 1 0.0
prob13.pddl
2 2 0.0 2 2 0.0
prob14.pddl
2 2 0.0 2 2 0.0
prob15.pddl
1 1 0.0 1 1 0.0
prob16.pddl
2 2 0.0 2 2 0.0
prob17.pddl
1 1 0.0 1 1 0.0
prob18.pddl
1 1 0.0 1 1 0.0
prob19.pddl
1 1 0.0 1 1 0.0
prob20.pddl
1 1 0.0 1 1 0.0
prob21.pddl
1 1 0.0 1 1 0.0
prob22.pddl
1 1 0.0 1 1 0.0
prob23.pddl
1 1 0.0 1 1 0.0
prob24.pddl
5 5 0.0 2 2 0.0
prob25.pddl
6 6 0.0 1 1 0.0
prob26.pddl
1 1 0.0 1 1 0.0
prob27.pddl
8 8 0.0 2 2 0.0
prob28.pddl
20 20 0.0 16 16 0.0
prob29.pddl
4 4 0.0 1 1 0.0
prob30.pddl
2 2 0.0 2 2 0.0
prob31.pddl
1 1 0.0 1 1 0.0
prob32.pddl
8 8 0.0 1 1 0.0
prob33.pddl
1 1 0.0 4 4 0.0
prob34.pddl
1 1 0.0 1 1 0.0
prob35.pddl
4 4 0.0 1 1 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mystery
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
15 15 0.0 7 7 0.0
prob02.pddl
10 10 0.0 2 2 0.0
prob03.pddl
6 6 0.0 1 1 0.0
prob04.pddl
31 31 0.0 12 12 0.0
prob05.pddl
18 18 0.0 6 6 0.0
prob06.pddl
2 2 0.0 2 2 0.0
prob07.pddl
1 1 0.0 None None -
prob08.pddl
1 1 0.0 3 3 0.0
prob09.pddl
8 8 0.0 2 2 0.0
prob10.pddl
1 1 0.0 1 1 0.0
prob11.pddl
20 20 0.0 15 15 0.0
prob12.pddl
6 6 0.0 1 1 0.0
prob13.pddl
17 17 0.0 5 5 0.0
prob14.pddl
2 2 0.0 6 6 0.0
prob15.pddl
1 1 0.0 1 1 0.0
prob16.pddl
14 14 0.0 12 12 0.0
prob17.pddl
1 1 0.0 1 1 0.0
prob18.pddl
1 1 0.0 None None -
prob19.pddl
1 1 0.0 1 1 0.0
prob20.pddl
1 1 0.0 1 1 0.0
prob21.pddl
6 6 0.0 1 1 0.0
prob22.pddl
3 3 0.0 3 3 0.0
prob23.pddl
19 19 0.0 4 4 0.0
prob24.pddl
37 37 0.0 19 19 0.0
prob25.pddl
6 6 0.0 1 1 0.0
prob26.pddl
3 3 0.0 1 1 0.0
prob27.pddl
8 8 0.0 2 2 0.0
prob28.pddl
20 20 0.0 16 16 0.0
prob29.pddl
6 6 0.0 1 1 0.0
prob30.pddl
2 2 0.0 2 2 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
nomystery-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
23 23 0.0 18 18 0.0
p02.pddl
26 26 0.0 22 22 0.0
p03.pddl
38 38 0.0 30 30 0.0
p04.pddl
41 41 0.0 35 35 0.0
p05.pddl
49 49 0.0 42 42 0.0
p06.pddl
69 69 0.0 52 52 0.0
p07.pddl
90 90 0.0 62 62 0.0
p08.pddl
81 81 0.0 65 65 0.0
p09.pddl
86 86 0.0 66 66 0.0
p10.pddl
82 82 0.0 70 70 0.0
p11.pddl
23 23 0.0 18 18 0.0
p12.pddl
26 26 0.0 22 22 0.0
p13.pddl
38 38 0.0 30 30 0.0
p14.pddl
41 41 0.0 35 35 0.0
p15.pddl
49 49 0.0 42 42 0.0
p16.pddl
69 69 0.0 52 52 0.0
p17.pddl
90 90 0.0 62 62 0.0
p18.pddl
81 81 0.0 65 65 0.0
p19.pddl
86 86 0.0 66 66 0.0
p20.pddl
82 82 0.0 70 70 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt08-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
38 38 0.0 42 42 0.0
p02.pddl
40 40 0.0 42 42 0.0
p03.pddl
46 46 0.0 48 48 0.0
p04.pddl
58 58 0.0 64 64 0.0
p05.pddl
82 82 0.0 100 100 0.0
p06.pddl
80 80 0.0 90 90 0.0
p07.pddl
102 102 0.0 126 126 0.0
p08.pddl
120 120 0.0 152 152 0.0
p09.pddl
112 112 0.0 132 132 0.0
p10.pddl
126 126 0.0 150 150 0.0
p11.pddl
134 134 0.0 160 160 0.0
p12.pddl
138 138 0.0 162 162 0.0
p13.pddl
146 146 0.0 172 172 0.0
p14.pddl
166 166 0.0 200 200 0.0
p15.pddl
166 166 0.0 198 198 0.0
p16.pddl
190 190 0.0 232 232 0.0
p17.pddl
198 198 0.0 242 242 0.0
p18.pddl
206 206 0.0 248 248 0.0
p19.pddl
216 216 0.0 264 264 0.0
p20.pddl
214 214 0.0 254 254 0.0
p21.pddl
210 210 0.0 242 242 0.0
p22.pddl
274 274 0.0 340 340 0.0
p23.pddl
258 258 0.0 314 314 0.0
p24.pddl
262 262 0.0 318 318 0.0
p25.pddl
292 292 0.0 362 362 0.0
p26.pddl
282 282 0.0 344 344 0.0
p27.pddl
348 348 0.0 450 450 0.0
p28.pddl
302 302 0.0 366 366 0.0
p29.pddl
352 352 0.0 444 444 0.0
p30.pddl
320 320 0.0 388 388 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
80 80 0.0 90 90 0.0
p02.pddl
102 102 0.0 126 126 0.0
p03.pddl
120 120 0.0 152 152 0.0
p04.pddl
112 112 0.0 132 132 0.0
p05.pddl
126 126 0.0 150 150 0.0
p06.pddl
134 134 0.0 160 160 0.0
p07.pddl
138 138 0.0 162 162 0.0
p08.pddl
146 146 0.0 172 172 0.0
p09.pddl
166 166 0.0 200 200 0.0
p10.pddl
274 274 0.0 340 340 0.0
p11.pddl
166 166 0.0 198 198 0.0
p12.pddl
190 190 0.0 232 232 0.0
p13.pddl
198 198 0.0 242 242 0.0
p14.pddl
206 206 0.0 248 248 0.0
p15.pddl
216 216 0.0 264 264 0.0
p16.pddl
210 210 0.0 242 242 0.0
p17.pddl
214 214 0.0 254 254 0.0
p18.pddl
258 258 0.0 314 314 0.0
p19.pddl
262 262 0.0 318 318 0.0
p20.pddl
292 292 0.0 362 362 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
154 154 0.0 172 172 0.0
p20_2.pddl
176 176 0.0 208 208 0.0
p20_3.pddl
296 296 0.0 402 402 0.0
p25_1.pddl
208 208 0.0 242 242 0.0
p25_3.pddl
434 434 0.0 614 614 0.0
p30_1.pddl
244 244 0.0 284 284 0.0
p30_2.pddl
266 266 0.0 318 318 0.0
p30_3.pddl
616 616 0.0 896 896 0.0
p35_1.pddl
296 296 0.0 344 344 0.0
p35_2.pddl
320 320 0.0 384 384 0.0
p35_3.pddl
778 778 0.0 1148 1148 0.0
p40_1.pddl
328 328 0.0 376 376 0.0
p40_2.pddl
362 362 0.0 436 436 0.0
p40_3.pddl
902 902 0.0 1336 1336 0.0
p45_1.pddl
378 378 0.0 444 444 0.0
p45_2.pddl
462 462 0.0 580 580 0.0
p45_3.pddl
1260 1260 0.0 1940 1940 0.0
p50_1.pddl
428 428 0.0 504 504 0.0
p50_2.pddl
504 504 0.0 628 628 0.0
p50_3.pddl
1368 1368 0.0 2094 2094 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
75 75 0.0 75 75 0.0
p02.pddl
73 73 0.0 71 71 0.0
p03.pddl
75 75 0.0 75 75 0.0
p04.pddl
75 75 0.0 75 75 0.0
p05.pddl
75 75 0.0 75 75 0.0
p06.pddl
208 208 0.0 236 236 0.0
p07.pddl
212 212 0.0 244 244 0.0
p08.pddl
546 546 0.0 557 557 0.0
p09.pddl
598 598 0.0 631 631 0.0
p10.pddl
452 452 0.0 504 504 0.0
p11.pddl
452 452 0.0 504 504 0.0
p12.pddl
590 590 0.0 720 720 0.0
p13.pddl
758 758 0.0 996 996 0.0
p14.pddl
728 728 0.0 936 936 0.0
p15.pddl
766 766 0.0 952 952 0.0
p16.pddl
786 786 0.0 992 992 0.0
p17.pddl
951 951 0.0 1123 1123 0.0
p18.pddl
1311 1311 0.0 1338 1338 0.0
p19.pddl
551 551 0.0 632 632 0.0
p20.pddl
676 676 0.0 752 752 0.0
p21.pddl
668 668 0.0 736 736 0.0
p22.pddl
912 912 0.0 1134 1134 0.0
p23.pddl
1160 1160 0.0 1540 1540 0.0
p24.pddl
7445 7445 0.0 9597 9597 0.0
p25.pddl
6452 6452 0.0 8310 8310 0.0
p26.pddl
1427 1427 0.0 1791 1791 0.0
p27.pddl
2632 2632 0.0 3497 3497 0.0
p28.pddl
30347 30347 0.0 39293 39293 0.0
p29.pddl
25319 25319 0.0 33245 33245 0.0
p30.pddl
4355 4355 0.0 6155 6155 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-opt18-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
18 18 0.0 12 12 0.0
p02.pddl
16 16 0.0 10 10 0.0
p03.pddl
44 44 0.0 40 40 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
16 16 0.0 12 12 0.0
p08.pddl
None None - None None -
p09.pddl
11 11 0.0 10 10 0.0
p10.pddl
12 12 0.0 10 10 0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
24 24 0.0 12 12 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-split-opt18-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
17 17 0.0 14 14 0.0
p02.pddl
17 17 0.0 14 14 0.0
p03.pddl
762 762 0.0 166 166 0.0
p04.pddl
228 228 0.0 42 42 0.0
p05.pddl
4 4 0.0 2 2 0.0
p06.pddl
20 20 0.0 36 36 0.0
p07.pddl
142 142 0.0 52 52 0.0
p08.pddl
10 10 0.0 14 14 0.0
p09.pddl
2 2 0.0 2 2 0.0
p10.pddl
2 2 0.0 2 2 0.0
p11.pddl
14 14 0.0 6 6 0.0
p12.pddl
6 6 0.0 4 4 0.0
p13.pddl
8 8 0.0 6 6 0.0
p14.pddl
18 18 0.0 20 20 0.0
p15.pddl
20 20 0.0 20 20 0.0
p16.pddl
4 4 0.0 42 42 0.0
p17.pddl
3 3 0.0 64 64 0.0
p18.pddl
14 14 0.0 14 14 0.0
p19.pddl
3 3 0.0 2 2 0.0
p20.pddl
8 8 0.0 10 10 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-08-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
58 58 0.0 14 14 0.0
p02.pddl
142 142 0.0 35 35 0.0
p03.pddl
364 364 0.0 117 117 0.0
p04.pddl
331 331 0.0 86 86 0.0
p05.pddl
448 448 0.0 120 120 0.0
p06.pddl
588 588 0.0 163 163 0.0
p07.pddl
697 697 0.0 185 185 0.0
p08.pddl
866 866 0.0 241 241 0.0
p09.pddl
1041 1041 0.0 291 291 0.0
p10.pddl
1211 1211 0.0 350 350 0.0
p11.pddl
85 85 0.0 22 22 0.0
p12.pddl
170 170 0.0 48 48 0.0
p13.pddl
270 270 0.0 78 78 0.0
p14.pddl
381 381 0.0 112 112 0.0
p15.pddl
521 521 0.0 157 157 0.0
p16.pddl
651 651 0.0 192 192 0.0
p17.pddl
806 806 0.0 238 238 0.0
p18.pddl
973 973 0.0 288 288 0.0
p19.pddl
1181 1181 0.0 356 356 0.0
p20.pddl
1372 1372 0.0 407 407 0.0
p21.pddl
74 74 0.0 22 22 0.0
p22.pddl
160 160 0.0 53 53 0.0
p23.pddl
254 254 0.0 85 85 0.0
p24.pddl
377 377 0.0 126 126 0.0
p25.pddl
523 523 0.0 183 183 0.0
p26.pddl
655 655 0.0 223 223 0.0
p27.pddl
810 810 0.0 271 271 0.0
p28.pddl
991 991 0.0 340 340 0.0
p29.pddl
1212 1212 0.0 428 428 0.0
p30.pddl
1376 1376 0.0 472 472 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
160 160 0.0 53 53 0.0
p02.pddl
142 142 0.0 35 35 0.0
p03.pddl
170 170 0.0 48 48 0.0
p04.pddl
331 331 0.0 86 86 0.0
p05.pddl
254 254 0.0 85 85 0.0
p06.pddl
588 588 0.0 163 163 0.0
p07.pddl
448 448 0.0 120 120 0.0
p08.pddl
377 377 0.0 126 126 0.0
p09.pddl
270 270 0.0 78 78 0.0
p10.pddl
523 523 0.0 183 183 0.0
p11.pddl
655 655 0.0 223 223 0.0
p12.pddl
381 381 0.0 112 112 0.0
p13.pddl
697 697 0.0 185 185 0.0
p14.pddl
866 866 0.0 241 241 0.0
p15.pddl
1041 1041 0.0 291 291 0.0
p16.pddl
1211 1211 0.0 350 350 0.0
p17.pddl
521 521 0.0 157 157 0.0
p18.pddl
651 651 0.0 192 192 0.0
p19.pddl
806 806 0.0 238 238 0.0
p20.pddl
810 810 0.0 271 271 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parking-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
61 61 0.0 55 55 0.0
pfile03-012.pddl
90 90 0.0 96 96 0.0
pfile04-013.pddl
108 108 0.0 88 88 0.0
pfile04-014.pddl
99 99 0.0 101 101 0.0
pfile04-015.pddl
95 95 0.0 102 102 0.0
pfile04-016.pddl
88 88 0.0 96 96 0.0
pfile05-017.pddl
108 108 0.0 116 116 0.0
pfile05-018.pddl
99 99 0.0 108 108 0.0
pfile05-019.pddl
122 122 0.0 126 126 0.0
pfile05-020.pddl
120 120 0.0 108 108 0.0
pfile06-021.pddl
119 119 0.0 111 111 0.0
pfile06-022.pddl
136 136 0.0 121 121 0.0
pfile06-023.pddl
115 115 0.0 111 111 0.0
pfile06-024.pddl
127 127 0.0 117 117 0.0
pfile07-025.pddl
152 152 0.0 162 162 0.0
pfile07-026.pddl
130 130 0.0 153 153 0.0
pfile07-027.pddl
153 153 0.0 138 138 0.0
pfile07-028.pddl
154 154 0.0 140 140 0.0
pfile08-029.pddl
156 156 0.0 162 162 0.0
pfile08-030.pddl
167 167 0.0 154 154 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parking-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
89 89 0.0 97 97 0.0
p_12_7-02.pddl
75 75 0.0 84 84 0.0
p_12_7-03.pddl
77 77 0.0 83 83 0.0
p_12_7-04.pddl
75 75 0.0 86 86 0.0
p_14_8-01.pddl
97 97 0.0 91 91 0.0
p_14_8-02.pddl
107 107 0.0 97 97 0.0
p_14_8-03.pddl
105 105 0.0 96 96 0.0
p_14_8-04.pddl
98 98 0.0 91 91 0.0
p_16_9-01.pddl
106 106 0.0 99 99 0.0
p_16_9-02.pddl
99 99 0.0 96 96 0.0
p_16_9-03.pddl
103 103 0.0 118 118 0.0
p_16_9-04.pddl
121 121 0.0 110 110 0.0
p_18_10-01.pddl
139 139 0.0 125 125 0.0
p_18_10-02.pddl
120 120 0.0 135 135 0.0
p_18_10-03.pddl
121 121 0.0 133 133 0.0
p_18_10-04.pddl
120 120 0.0 107 107 0.0
p_20_11-01.pddl
143 143 0.0 155 155 0.0
p_20_11-02.pddl
131 131 0.0 145 145 0.0
p_20_11-03.pddl
153 153 0.0 159 159 0.0
p_20_11-04.pddl
145 145 0.0 153 153 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pathways-noneg
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
2 2 0.0 1 1 0.0
p02.pddl
40 40 0.0 21 21 0.0
p03.pddl
6 6 0.0 17 17 0.0
p04.pddl
8 8 0.0 28 28 0.0
p05.pddl
12 12 0.0 21 21 0.0
p06.pddl
89 89 0.0 68 68 0.0
p07.pddl
33 33 0.0 43 43 0.0
p08.pddl
67 67 0.0 139 139 0.0
p09.pddl
35 35 0.0 138 138 0.0
p10.pddl
187 187 0.0 206 206 0.0
p11.pddl
65 65 0.0 43 43 0.0
p12.pddl
49 49 0.0 207 207 0.0
p13.pddl
171 171 0.0 170 170 0.0
p14.pddl
42 42 0.0 92 92 0.0
p15.pddl
319 319 0.0 194 194 0.0
p16.pddl
195 195 0.0 228 228 0.0
p17.pddl
116 116 0.0 401 401 0.0
p18.pddl
74 74 0.0 240 240 0.0
p19.pddl
186 186 0.0 267 267 0.0
p20.pddl
182 182 0.0 245 245 0.0
p21.pddl
100 100 0.0 353 353 0.0
p22.pddl
212 212 0.0 246 246 0.0
p23.pddl
96 96 0.0 104 104 0.0
p24.pddl
318 318 0.0 477 477 0.0
p25.pddl
273 273 0.0 288 288 0.0
p26.pddl
269 269 0.0 331 331 0.0
p27.pddl
523 523 0.0 573 573 0.0
p28.pddl
282 282 0.0 258 258 0.0
p29.pddl
188 188 0.0 297 297 0.0
p30.pddl
497 497 0.0 614 614 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-08-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
48 48 0.0 47 47 0.0
p02.pddl
6 6 0.0 10 10 0.0
p03.pddl
7 7 0.0 12 12 0.0
p04.pddl
11 11 0.0 18 18 0.0
p05.pddl
14 14 0.0 23 23 0.0
p06.pddl
13 13 0.0 22 22 0.0
p07.pddl
32 32 0.0 45 45 0.0
p08.pddl
11 11 0.0 22 22 0.0
p09.pddl
17 17 0.0 26 26 0.0
p10.pddl
17 17 0.0 28 28 0.0
p11.pddl
14 14 0.0 24 24 0.0
p12.pddl
15 15 0.0 26 26 0.0
p13.pddl
17 17 0.0 26 26 0.0
p14.pddl
18 18 0.0 28 28 0.0
p15.pddl
19 19 0.0 32 32 0.0
p16.pddl
25 25 0.0 32 32 0.0
p17.pddl
18 18 0.0 34 34 0.0
p18.pddl
22 22 0.0 34 34 0.0
p19.pddl
21 21 0.0 34 34 0.0
p20.pddl
17 17 0.0 32 32 0.0
p21.pddl
19 19 0.0 32 32 0.0
p22.pddl
21 21 0.0 36 36 0.0
p23.pddl
19 19 0.0 34 34 0.0
p24.pddl
22 22 0.0 36 36 0.0
p25.pddl
20 20 0.0 36 36 0.0
p26.pddl
22 22 0.0 42 42 0.0
p27.pddl
26 26 0.0 44 44 0.0
p28.pddl
32 32 0.0 48 48 0.0
p29.pddl
32 32 0.0 54 54 0.0
p30.pddl
70 70 0.0 98 98 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
27 27 0.0 38 38 0.0
p02.pddl
18 18 0.0 34 34 0.0
p03.pddl
22 22 0.0 34 34 0.0
p04.pddl
21 21 0.0 34 34 0.0
p05.pddl
24 24 0.0 30 30 0.0
p06.pddl
19 19 0.0 34 34 0.0
p07.pddl
17 17 0.0 30 30 0.0
p08.pddl
17 17 0.0 32 32 0.0
p09.pddl
18 18 0.0 32 32 0.0
p10.pddl
19 19 0.0 32 32 0.0
p11.pddl
21 21 0.0 36 36 0.0
p12.pddl
27 27 0.0 38 38 0.0
p13.pddl
19 19 0.0 34 34 0.0
p14.pddl
22 22 0.0 36 36 0.0
p15.pddl
20 20 0.0 36 36 0.0
p16.pddl
22 22 0.0 42 42 0.0
p17.pddl
26 26 0.0 44 44 0.0
p18.pddl
32 32 0.0 48 48 0.0
p19.pddl
32 32 0.0 54 54 0.0
p20.pddl
70 70 0.0 98 98 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
petri-net-alignment-opt18-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
13590 13590 0.0 245 245 0.0
p02.pddl
23860 23860 0.0 310 310 0.0
p03.pddl
35361 35361 0.0 363 363 0.0
p04.pddl
37593 37593 0.0 372 372 0.0
p05.pddl
22005 22005 0.0 300 300 0.0
p06.pddl
37846 37846 0.0 373 373 0.0
p07.pddl
33445 33445 0.0 355 355 0.0
p08.pddl
38100 38100 0.0 374 374 0.0
p09.pddl
35605 35605 0.0 364 364 0.0
p10.pddl
62668 62668 0.0 457 457 0.0
p11.pddl
45618 45618 0.0 402 402 0.0
p12.pddl
86316 86316 0.0 521 521 0.0
p13.pddl
62331 62331 0.0 456 456 0.0
p14.pddl
65055 65055 0.0 464 464 0.0
p15.pddl
60661 60661 0.0 451 451 0.0
p16.pddl
75840 75840 0.0 494 494 0.0
p17.pddl
82351 82351 0.0 511 511 0.0
p18.pddl
75840 75840 0.0 494 494 0.0
p19.pddl
81960 81960 0.0 510 510 0.0
p20.pddl
87121 87121 0.0 523 523 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-notankage
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
11 11 0.0 6 6 0.0
p02-net1-b6-g4.pddl
17 17 0.0 11 11 0.0
p03-net1-b8-g3.pddl
19 19 0.0 8 8 0.0
p04-net1-b8-g5.pddl
23 23 0.0 10 10 0.0
p05-net1-b10-g4.pddl
19 19 0.0 9 9 0.0
p06-net1-b10-g6.pddl
25 25 0.0 12 12 0.0
p07-net1-b12-g5.pddl
23 23 0.0 11 11 0.0
p08-net1-b12-g7.pddl
31 31 0.0 15 15 0.0
p09-net1-b14-g6.pddl
45 45 0.0 18 18 0.0
p10-net1-b14-g8.pddl
60 60 0.0 24 24 0.0
p11-net2-b10-g2.pddl
12 12 0.0 16 16 0.0
p12-net2-b10-g4.pddl
23 23 0.0 31 31 0.0
p13-net2-b12-g3.pddl
16 16 0.0 19 19 0.0
p14-net2-b12-g5.pddl
25 25 0.0 40 40 0.0
p15-net2-b14-g4.pddl
22 22 0.0 27 27 0.0
p16-net2-b14-g6.pddl
35 35 0.0 44 44 0.0
p17-net2-b16-g5.pddl
22 22 0.0 26 26 0.0
p18-net2-b16-g7.pddl
33 33 0.0 45 45 0.0
p19-net2-b18-g6.pddl
29 29 0.0 36 36 0.0
p20-net2-b18-g8.pddl
37 37 0.0 55 55 0.0
p21-net3-b12-g2.pddl
11 11 0.0 13 13 0.0
p22-net3-b12-g4.pddl
33 33 0.0 29 29 0.0
p23-net3-b14-g3.pddl
14 14 0.0 17 17 0.0
p24-net3-b14-g5.pddl
24 24 0.0 30 30 0.0
p25-net3-b16-g5.pddl
36 36 0.0 41 41 0.0
p26-net3-b16-g7.pddl
44 44 0.0 51 51 0.0
p27-net3-b18-g6.pddl
32 32 0.0 45 45 0.0
p28-net3-b18-g7.pddl
46 46 0.0 54 54 0.0
p29-net3-b20-g6.pddl
41 41 0.0 47 47 0.0
p30-net3-b20-g8.pddl
50 50 0.0 59 59 0.0
p31-net4-b14-g3.pddl
18 18 0.0 7 7 0.0
p32-net4-b14-g5.pddl
35 35 0.0 15 15 0.0
p33-net4-b16-g5.pddl
24 24 0.0 13 13 0.0
p34-net4-b16-g6.pddl
30 30 0.0 15 15 0.0
p35-net4-b18-g4.pddl
23 23 0.0 8 8 0.0
p36-net4-b18-g6.pddl
37 37 0.0 16 16 0.0
p37-net4-b20-g5.pddl
19 19 0.0 10 10 0.0
p38-net4-b20-g7.pddl
25 25 0.0 12 12 0.0
p39-net4-b22-g7.pddl
32 32 0.0 20 20 0.0
p40-net4-b22-g8.pddl
36 36 0.0 21 21 0.0
p41-net5-b22-g2.pddl
8 8 0.0 5 5 0.0
p42-net5-b22-g4.pddl
37 37 0.0 20 20 0.0
p43-net5-b24-g3.pddl
27 27 0.0 17 17 0.0
p44-net5-b24-g5.pddl
29 29 0.0 23 23 0.0
p45-net5-b26-g4.pddl
24 24 0.0 25 25 0.0
p46-net5-b26-g6.pddl
35 35 0.0 36 36 0.0
p47-net5-b28-g5.pddl
30 30 0.0 29 29 0.0
p48-net5-b28-g7.pddl
53 53 0.0 35 35 0.0
p49-net5-b30-g6.pddl
31 31 0.0 14 14 0.0
p50-net5-b30-g8.pddl
51 51 0.0 27 27 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-tankage
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
23 23 0.0 13 13 0.0
p02-net1-b6-g4-t50.pddl
32 32 0.0 22 22 0.0
p03-net1-b8-g3-t80.pddl
28 28 0.0 16 16 0.0
p04-net1-b8-g5-t80.pddl
32 32 0.0 18 18 0.0
p05-net1-b10-g4-t50.pddl
37 37 0.0 21 21 0.0
p06-net1-b10-g6-t50.pddl
46 46 0.0 27 27 0.0
p07-net1-b12-g5-t80.pddl
27 27 0.0 16 16 0.0
p08-net1-b12-g7-t80.pddl
35 35 0.0 22 22 0.0
p09-net1-b14-g6-t50.pddl
54 54 0.0 33 33 0.0
p10-net1-b14-g8-t50.pddl
79 79 0.0 44 44 0.0
p11-net2-b10-g2-t30.pddl
16 16 0.0 19 19 0.0
p12-net2-b10-g4-t60.pddl
25 25 0.0 35 35 0.0
p13-net2-b12-g3-t70.pddl
18 18 0.0 23 23 0.0
p14-net2-b12-g5-t30.pddl
39 39 0.0 44 44 0.0
p15-net2-b14-g4-t30.pddl
26 26 0.0 27 27 0.0
p16-net2-b14-g6-t80.pddl
34 34 0.0 44 44 0.0
p17-net2-b16-g5-t20.pddl
32 32 0.0 33 33 0.0
p18-net2-b16-g7-t60.pddl
35 35 0.0 45 45 0.0
p19-net2-b18-g6-t60.pddl
31 31 0.0 38 38 0.0
p20-net2-b18-g8-t90.pddl
37 37 0.0 55 55 0.0
p21-net3-b12-g2-t60.pddl
10 10 0.0 13 13 0.0
p22-net3-b12-g4-t60.pddl
33 33 0.0 31 31 0.0
p23-net3-b14-g3-t60.pddl
23 23 0.0 26 26 0.0
p24-net3-b14-g5-t60.pddl
33 33 0.0 39 39 0.0
p25-net3-b16-g5-t60.pddl
43 43 0.0 43 43 0.0
p26-net3-b16-g7-t70.pddl
55 55 0.0 55 55 0.0
p27-net3-b18-g6-t70.pddl
33 33 0.0 46 46 0.0
p28-net3-b18-g7-t70.pddl
55 55 0.0 61 61 0.0
p29-net3-b20-g6-t70.pddl
41 41 0.0 48 48 0.0
p30-net3-b20-g8-t70.pddl
53 53 0.0 61 61 0.0
p31-net4-b14-g3-t20.pddl
34 34 0.0 13 13 0.0
p32-net4-b14-g5-t30.pddl
48 48 0.0 25 25 0.0
p33-net4-b16-g5-t60.pddl
31 31 0.0 20 20 0.0
p34-net4-b16-g6-t60.pddl
40 40 0.0 18 18 0.0
p35-net4-b18-g4-t90.pddl
26 26 0.0 9 9 0.0
p36-net4-b18-g6-t90.pddl
42 42 0.0 18 18 0.0
p37-net4-b20-g5-t60.pddl
18 18 0.0 11 11 0.0
p38-net4-b20-g7-t60.pddl
23 23 0.0 13 13 0.0
p39-net4-b22-g7-t50.pddl
39 39 0.0 23 23 0.0
p40-net4-b22-g8-t50.pddl
43 43 0.0 24 24 0.0
p41-net5-b22-g2-t20.pddl
10 10 0.0 7 7 0.0
p42-net5-b22-g4-t50.pddl
43 43 0.0 22 22 0.0
p43-net5-b24-g3-t80.pddl
34 34 0.0 23 23 0.0
p44-net5-b24-g5-t80.pddl
36 36 0.0 29 29 0.0
p45-net5-b26-g4-t50.pddl
26 26 0.0 26 26 0.0
p46-net5-b26-g6-t50.pddl
37 37 0.0 37 37 0.0
p47-net5-b28-g5-t50.pddl
45 45 0.0 33 33 0.0
p48-net5-b28-g7-t50.pddl
70 70 0.0 40 40 0.0
p49-net5-b30-g6-t50.pddl
31 31 0.0 17 17 0.0
p50-net5-b30-g8-t50.pddl
57 57 0.0 32 32 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
psr-small
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
3 3 0.0 2 2 0.0
p02-s5-n1-l3-f30.pddl
3 3 0.0 2 2 0.0
p03-s7-n1-l3-f70.pddl
3 3 0.0 2 2 0.0
p04-s8-n1-l4-f10.pddl
3 3 0.0 2 2 0.0
p05-s9-n1-l4-f30.pddl
3 3 0.0 2 2 0.0
p06-s10-n1-l4-f50.pddl
3 3 0.0 2 2 0.0
p07-s11-n1-l4-f70.pddl
3 3 0.0 2 2 0.0
p08-s12-n1-l5-f10.pddl
3 3 0.0 2 2 0.0
p09-s13-n1-l5-f30.pddl
3 3 0.0 2 2 0.0
p10-s17-n2-l2-f30.pddl
6 6 0.0 7 7 0.0
p11-s18-n2-l2-f50.pddl
6 6 0.0 4 4 0.0
p12-s21-n2-l3-f30.pddl
6 6 0.0 4 4 0.0
p13-s22-n2-l3-f50.pddl
9 9 0.0 10 10 0.0
p14-s23-n2-l3-f70.pddl
5 5 0.0 4 4 0.0
p15-s24-n2-l4-f10.pddl
9 9 0.0 7 7 0.0
p16-s29-n2-l5-f30.pddl
9 9 0.0 6 6 0.0
p17-s30-n2-l5-f50.pddl
5 5 0.0 4 4 0.0
p18-s31-n2-l5-f70.pddl
5 5 0.0 4 4 0.0
p19-s33-n3-l2-f30.pddl
22 22 0.0 11 11 0.0
p20-s34-n3-l2-f50.pddl
8 8 0.0 6 6 0.0
p21-s35-n3-l2-f70.pddl
7 7 0.0 6 6 0.0
p22-s37-n3-l3-f30.pddl
14 14 0.0 14 14 0.0
p23-s38-n3-l3-f50.pddl
7 7 0.0 6 6 0.0
p24-s39-n3-l3-f70.pddl
7 7 0.0 6 6 0.0
p25-s40-n3-l4-f10.pddl
13 13 0.0 11 11 0.0
p26-s41-n3-l4-f30.pddl
8 8 0.0 6 6 0.0
p27-s42-n3-l4-f50.pddl
8 8 0.0 6 6 0.0
p28-s43-n3-l4-f70.pddl
7 7 0.0 6 6 0.0
p29-s45-n3-l5-f30.pddl
19 19 0.0 25 25 0.0
p30-s46-n3-l5-f50.pddl
8 8 0.0 6 6 0.0
p31-s49-n4-l2-f30.pddl
18 18 0.0 14 14 0.0
p32-s50-n4-l2-f50.pddl
10 10 0.0 8 8 0.0
p33-s51-n4-l2-f70.pddl
13 13 0.0 9 9 0.0
p34-s55-n4-l3-f70.pddl
10 10 0.0 8 8 0.0
p35-s57-n5-l2-f30.pddl
19 19 0.0 15 15 0.0
p36-s65-n6-l2-f30.pddl
39 39 0.0 20 20 0.0
p37-s67-n6-l2-f70.pddl
19 19 0.0 23 23 0.0
p38-s78-n3-l3-f50.pddl
10 10 0.0 11 11 0.0
p39-s79-n3-l3-f70.pddl
8 8 0.0 6 6 0.0
p40-s80-n3-l4-f10.pddl
15 15 0.0 12 12 0.0
p41-s81-n3-l4-f30.pddl
7 7 0.0 6 6 0.0
p42-s82-n3-l4-f50.pddl
11 11 0.0 7 7 0.0
p43-s83-n3-l4-f70.pddl
12 12 0.0 14 14 0.0
p44-s89-n4-l2-f30.pddl
18 18 0.0 24 24 0.0
p45-s94-n4-l3-f50.pddl
10 10 0.0 8 8 0.0
p46-s97-n5-l2-f30.pddl
21 21 0.0 16 16 0.0
p47-s98-n5-l2-f50.pddl
9 9 0.0 8 8 0.0
p48-s101-n5-l3-f30.pddl
18 18 0.0 19 19 0.0
p49-s105-n6-l2-f30.pddl
29 29 0.0 36 36 0.0
p50-s107-n6-l2-f70.pddl
14 14 0.0 12 12 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
rovers
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
22 22 0.0 13 13 0.0
p02.pddl
17 17 0.0 11 11 0.0
p03.pddl
20 20 0.0 10 10 0.0
p04.pddl
16 16 0.0 9 9 0.0
p05.pddl
41 41 0.0 20 20 0.0
p06.pddl
68 68 0.0 41 41 0.0
p07.pddl
21 21 0.0 5 5 0.0
p08.pddl
33 33 0.0 5 5 0.0
p09.pddl
46 46 0.0 19 19 0.0
p10.pddl
40 40 0.0 8 8 0.0
p11.pddl
53 53 0.0 27 27 0.0
p12.pddl
23 23 0.0 3 3 0.0
p13.pddl
53 53 0.0 9 9 0.0
p14.pddl
43 43 0.0 17 17 0.0
p15.pddl
54 54 0.0 20 20 0.0
p16.pddl
50 50 0.0 8 8 0.0
p17.pddl
64 64 0.0 26 26 0.0
p18.pddl
41 41 0.0 7 7 0.0
p19.pddl
66 66 0.0 9 9 0.0
p20.pddl
80 80 0.0 15 15 0.0
p21.pddl
33 33 0.0 11 11 0.0
p22.pddl
57 57 0.0 11 11 0.0
p23.pddl
25 25 0.0 13 13 0.0
p24.pddl
66 66 0.0 19 19 0.0
p25.pddl
13 13 0.0 7 7 0.0
p26.pddl
17 17 0.0 11 11 0.0
p27.pddl
56 56 0.0 16 16 0.0
p28.pddl
45 45 0.0 14 14 0.0
p29.pddl
31 31 0.0 10 10 0.0
p30.pddl
25 25 0.0 19 19 0.0
p31.pddl
77 77 0.0 19 19 0.0
p32.pddl
35 35 0.0 29 29 0.0
p33.pddl
59 59 0.0 37 37 0.0
p34.pddl
32 32 0.0 22 22 0.0
p35.pddl
74 74 0.0 52 52 0.0
p36.pddl
59 59 0.0 28 28 0.0
p37.pddl
58 58 0.0 46 46 0.0
p38.pddl
55 55 0.0 39 39 0.0
p39.pddl
81 81 0.0 52 52 0.0
p40.pddl
69 69 0.0 48 48 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
satellite
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
22 22 0.0 17 17 0.0
p02-pfile2.pddl
22 22 0.0 17 17 0.0
p03-pfile3.pddl
14 14 0.0 1 1 0.0
p04-pfile4.pddl
34 34 0.0 13 13 0.0
p05-pfile5.pddl
11 11 0.0 1 1 0.0
p06-pfile6.pddl
31 31 0.0 11 11 0.0
p07-pfile7.pddl
24 24 0.0 2 2 0.0
p08-pfile8.pddl
25 25 0.0 0 0 0.0
p09-pfile9.pddl
29 29 0.0 3 3 0.0
p10-pfile10.pddl
35 35 0.0 1 1 0.0
p11-pfile11.pddl
43 43 0.0 3 3 0.0
p12-pfile12.pddl
70 70 0.0 25 25 0.0
p13-pfile13.pddl
67 67 0.0 3 3 0.0
p14-pfile14.pddl
27 27 0.0 3 3 0.0
p15-pfile15.pddl
49 49 0.0 5 5 0.0
p16-pfile16.pddl
23 23 0.0 4 4 0.0
p17-pfile17.pddl
20 20 0.0 3 3 0.0
p18-pfile18.pddl
48 48 0.0 0 0 0.0
p19-pfile19.pddl
43 43 0.0 1 1 0.0
p20-pfile20.pddl
85 85 0.0 0 0 0.0
p21-HC-pfile1.pddl
37 37 0.0 3 3 0.0
p22-HC-pfile2.pddl
71 71 0.0 2 2 0.0
p23-HC-pfile3.pddl
51 51 0.0 4 4 0.0
p24-HC-pfile4.pddl
70 70 0.0 4 4 0.0
p25-HC-pfile5.pddl
64 64 0.0 4 4 0.0
p26-HC-pfile6.pddl
68 68 0.0 4 4 0.0
p27-HC-pfile7.pddl
111 111 0.0 1 1 0.0
p28-HC-pfile8.pddl
94 94 0.0 1 1 0.0
p29-HC-pfile9.pddl
93 93 0.0 6 6 0.0
p30-HC-pfile10.pddl
114 114 0.0 6 6 0.0
p31-HC-pfile11.pddl
133 133 0.0 3 3 0.0
p32-HC-pfile12.pddl
182 182 0.0 4 4 0.0
p33-HC-pfile13.pddl
231 231 0.0 5 5 0.0
p34-HC-pfile14.pddl
390 390 0.0 1 1 0.0
p35-HC-pfile15.pddl
343 343 0.0 3 3 0.0
p36-HC-pfile16.pddl
178 178 0.0 3 3 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-08-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
6 6 0.0 6 6 0.0
p02.pddl
6 6 0.0 11 11 0.0
p03.pddl
21 21 0.0 21 21 0.0
p04.pddl
8 8 0.0 8 8 0.0
p05.pddl
8 8 0.0 15 15 0.0
p06.pddl
29 29 0.0 29 29 0.0
p07.pddl
10 10 0.0 10 10 0.0
p08.pddl
10 10 0.0 19 19 0.0
p09.pddl
29 29 0.0 37 37 0.0
p10.pddl
12 12 0.0 12 12 0.0
p11.pddl
12 12 0.0 23 23 0.0
p12.pddl
35 35 0.0 45 45 0.0
p13.pddl
14 14 0.0 14 14 0.0
p14.pddl
14 14 0.0 27 27 0.0
p15.pddl
41 41 0.0 53 53 0.0
p16.pddl
16 16 0.0 16 16 0.0
p17.pddl
16 16 0.0 31 31 0.0
p18.pddl
47 47 0.0 61 61 0.0
p19.pddl
18 18 0.0 18 18 0.0
p20.pddl
18 18 0.0 35 35 0.0
p21.pddl
53 53 0.0 69 69 0.0
p22.pddl
36 36 0.0 38 38 0.0
p23.pddl
36 36 0.0 38 38 0.0
p24.pddl
36 36 0.0 38 38 0.0
p25.pddl
22 22 0.0 44 44 0.0
p26.pddl
24 24 0.0 56 56 0.0
p27.pddl
66 66 0.0 80 80 0.0
p28.pddl
33 33 0.0 66 66 0.0
p29.pddl
37 37 0.0 86 86 0.0
p30.pddl
109 109 0.0 126 126 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
36 36 0.0 38 38 0.0
p02.pddl
6 6 0.0 11 11 0.0
p03.pddl
21 21 0.0 21 21 0.0
p04.pddl
8 8 0.0 8 8 0.0
p05.pddl
10 10 0.0 10 10 0.0
p06.pddl
8 8 0.0 15 15 0.0
p07.pddl
18 18 0.0 18 18 0.0
p08.pddl
12 12 0.0 12 12 0.0
p09.pddl
14 14 0.0 14 14 0.0
p10.pddl
16 16 0.0 16 16 0.0
p11.pddl
22 22 0.0 44 44 0.0
p12.pddl
29 29 0.0 29 29 0.0
p13.pddl
66 66 0.0 80 80 0.0
p14.pddl
24 24 0.0 56 56 0.0
p15.pddl
10 10 0.0 19 19 0.0
p16.pddl
12 12 0.0 23 23 0.0
p17.pddl
14 14 0.0 27 27 0.0
p18.pddl
16 16 0.0 31 31 0.0
p19.pddl
18 18 0.0 35 35 0.0
p20.pddl
33 33 0.0 66 66 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
snake-opt18-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
31 31 0.0 34 34 0.0
p02.pddl
13 13 0.0 22 22 0.0
p03.pddl
22 22 0.0 40 40 0.0
p04.pddl
16 16 0.0 26 26 0.0
p05.pddl
12 12 0.0 35 35 0.0
p06.pddl
12 12 0.0 28 28 0.0
p07.pddl
14 14 0.0 30 30 0.0
p08.pddl
13 13 0.0 20 20 0.0
p09.pddl
17 17 0.0 30 30 0.0
p10.pddl
14 14 0.0 30 30 0.0
p11.pddl
19 19 0.0 30 30 0.0
p12.pddl
14 14 0.0 30 30 0.0
p13.pddl
14 14 0.0 30 30 0.0
p14.pddl
15 15 0.0 40 40 0.0
p15.pddl
12 12 0.0 22 22 0.0
p16.pddl
14 14 0.0 40 40 0.0
p17.pddl
17 17 0.0 30 30 0.0
p18.pddl
14 14 0.0 20 20 0.0
p19.pddl
14 14 0.0 30 30 0.0
p20.pddl
14 14 0.0 26 26 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt08-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
132 132 0.0 42 42 0.0
p02.pddl
2 2 0.0 33 33 0.0
p03.pddl
1 1 0.0 16 16 0.0
p04.pddl
299 299 0.0 95 95 0.0
p05.pddl
8 8 0.0 16 16 0.0
p06.pddl
24 24 0.0 12 12 0.0
p07.pddl
8 8 0.0 29 29 0.0
p08.pddl
88 88 0.0 48 48 0.0
p09.pddl
89 89 0.0 52 52 0.0
p10.pddl
112 112 0.0 74 74 0.0
p11.pddl
5 5 0.0 49 49 0.0
p12.pddl
33 33 0.0 29 29 0.0
p13.pddl
20 20 0.0 20 20 0.0
p14.pddl
6 6 0.0 17 17 0.0
p15.pddl
4 4 0.0 185 185 0.0
p16.pddl
226 226 0.0 76 76 0.0
p17.pddl
31 31 0.0 21 21 0.0
p18.pddl
4 4 0.0 102 102 0.0
p19.pddl
4 4 0.0 98 98 0.0
p20.pddl
15 15 0.0 7 7 0.0
p21.pddl
4 4 0.0 3 3 0.0
p22.pddl
359 359 0.0 101 101 0.0
p23.pddl
5 5 0.0 44 44 0.0
p24.pddl
87 87 0.0 53 53 0.0
p25.pddl
253 253 0.0 104 104 0.0
p26.pddl
86 86 0.0 55 55 0.0
p27.pddl
7 7 0.0 55 55 0.0
p28.pddl
31 31 0.0 65 65 0.0
p29.pddl
12 12 0.0 24 24 0.0
p30.pddl
12 12 0.0 24 24 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
24 24 0.0 12 12 0.0
p02.pddl
31 31 0.0 21 21 0.0
p03.pddl
6 6 0.0 17 17 0.0
p04.pddl
299 299 0.0 95 95 0.0
p05.pddl
226 226 0.0 76 76 0.0
p06.pddl
5 5 0.0 49 49 0.0
p07.pddl
112 112 0.0 74 74 0.0
p08.pddl
89 89 0.0 52 52 0.0
p09.pddl
8 8 0.0 29 29 0.0
p10.pddl
8 8 0.0 16 16 0.0
p11.pddl
20 20 0.0 20 20 0.0
p12.pddl
15 15 0.0 7 7 0.0
p13.pddl
88 88 0.0 48 48 0.0
p14.pddl
33 33 0.0 29 29 0.0
p15.pddl
4 4 0.0 102 102 0.0
p16.pddl
4 4 0.0 185 185 0.0
p17.pddl
4 4 0.0 98 98 0.0
p18.pddl
4 4 0.0 3 3 0.0
p19.pddl
359 359 0.0 101 101 0.0
p20.pddl
5 5 0.0 44 44 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
spider-opt18-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1029 1029 0.0 423 423 0.0
p02.pddl
1517 1517 0.0 726 726 0.0
p03.pddl
2085 2085 0.0 905 905 0.0
p04.pddl
3144 3144 0.0 1619 1619 0.0
p05.pddl
3362 3362 0.0 1749 1749 0.0
p06.pddl
4447 4447 0.0 2343 2343 0.0
p07.pddl
690 690 0.0 301 301 0.0
p08.pddl
861 861 0.0 388 388 0.0
p09.pddl
1333 1333 0.0 497 497 0.0
p10.pddl
1801 1801 0.0 703 703 0.0
p11.pddl
2174 2174 0.0 1030 1030 0.0
p12.pddl
2143 2143 0.0 989 989 0.0
p13.pddl
2693 2693 0.0 1210 1210 0.0
p14.pddl
619 619 0.0 247 247 0.0
p15.pddl
1109 1109 0.0 462 462 0.0
p16.pddl
1088 1088 0.0 419 419 0.0
p17.pddl
1474 1474 0.0 577 577 0.0
p18.pddl
1610 1610 0.0 756 756 0.0
p19.pddl
1782 1782 0.0 772 772 0.0
p20.pddl
2185 2185 0.0 924 924 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
storage
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
10 10 0.0 6 6 0.0
p02.pddl
9 9 0.0 3 3 0.0
p03.pddl
9 9 0.0 3 3 0.0
p04.pddl
20 20 0.0 14 14 0.0
p05.pddl
14 14 0.0 4 4 0.0
p06.pddl
14 14 0.0 4 4 0.0
p07.pddl
46 46 0.0 21 21 0.0
p08.pddl
20 20 0.0 6 6 0.0
p09.pddl
15 15 0.0 6 6 0.0
p10.pddl
58 58 0.0 28 28 0.0
p11.pddl
20 20 0.0 8 8 0.0
p12.pddl
20 20 0.0 8 8 0.0
p13.pddl
44 44 0.0 38 38 0.0
p14.pddl
37 37 0.0 10 10 0.0
p15.pddl
25 25 0.0 10 10 0.0
p16.pddl
30 30 0.0 12 12 0.0
p17.pddl
35 35 0.0 14 14 0.0
p18.pddl
49 49 0.0 16 16 0.0
p19.pddl
45 45 0.0 24 24 0.0
p20.pddl
50 50 0.0 20 20 0.0
p21.pddl
67 67 0.0 22 22 0.0
p22.pddl
60 60 0.0 24 24 0.0
p23.pddl
79 79 0.0 26 26 0.0
p24.pddl
70 70 0.0 28 28 0.0
p25.pddl
91 91 0.0 30 30 0.0
p26.pddl
16 16 0.0 32 32 0.0
p27.pddl
17 17 0.0 34 34 0.0
p28.pddl
18 18 0.0 36 36 0.0
p29.pddl
19 19 0.0 38 38 0.0
p30.pddl
20 20 0.0 40 40 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
termes-opt18-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
23 23 0.0 6 6 0.0
p02.pddl
36 36 0.0 16 16 0.0
p03.pddl
33 33 0.0 7 7 0.0
p04.pddl
45 45 0.0 13 13 0.0
p05.pddl
40 40 0.0 8 8 0.0
p06.pddl
71 71 0.0 16 16 0.0
p07.pddl
81 81 0.0 16 16 0.0
p08.pddl
79 79 0.0 21 21 0.0
p09.pddl
81 81 0.0 10 10 0.0
p10.pddl
71 71 0.0 18 18 0.0
p11.pddl
42 42 0.0 18 18 0.0
p12.pddl
34 34 0.0 24 24 0.0
p13.pddl
66 66 0.0 23 23 0.0
p14.pddl
54 54 0.0 26 26 0.0
p15.pddl
81 81 0.0 23 23 0.0
p16.pddl
82 82 0.0 28 28 0.0
p17.pddl
65 65 0.0 30 30 0.0
p18.pddl
48 48 0.0 32 32 0.0
p19.pddl
50 50 0.0 29 29 0.0
p20.pddl
67 67 0.0 37 37 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tetris-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
21 21 0.0 10 10 0.0
p01-8.pddl
14 14 0.0 9 9 0.0
p01-10.pddl
21 21 0.0 10 10 0.0
p02-4.pddl
8 8 0.0 4 4 0.0
p02-6.pddl
14 14 0.0 8 8 0.0
p02-8.pddl
19 19 0.0 11 11 0.0
p02-10.pddl
23 23 0.0 12 12 0.0
p03-4.pddl
9 9 0.0 5 5 0.0
p03-6.pddl
14 14 0.0 7 7 0.0
p03-8.pddl
15 15 0.0 10 10 0.0
p03-10.pddl
21 21 0.0 14 14 0.0
p04-6.pddl
17 17 0.0 8 8 0.0
p04-8.pddl
23 23 0.0 14 14 0.0
p04-10.pddl
26 26 0.0 13 13 0.0
p05-6.pddl
12 12 0.0 7 7 0.0
p05-8.pddl
17 17 0.0 12 12 0.0
p05-10.pddl
16 16 0.0 12 12 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
8 8 0.0 8 8 0.0
p02.pddl
50 50 0.0 67 67 0.0
p03.pddl
36 36 0.0 34 34 0.0
p04.pddl
50 50 0.0 87 87 0.0
p05.pddl
50 50 0.0 65 65 0.0
p06.pddl
64 64 0.0 78 78 0.0
p07.pddl
36 36 0.0 34 34 0.0
p08.pddl
50 50 0.0 59 59 0.0
p09.pddl
36 36 0.0 46 46 0.0
p10.pddl
64 64 0.0 48 48 0.0
p11.pddl
50 50 0.0 38 38 0.0
p12.pddl
64 64 0.0 48 48 0.0
p13.pddl
50 50 0.0 38 38 0.0
p14.pddl
31 31 0.0 34 34 0.0
p15.pddl
22 22 0.0 26 26 0.0
p16.pddl
40 40 0.0 44 44 0.0
p17.pddl
31 31 0.0 43 43 0.0
p18.pddl
42 42 0.0 54 54 0.0
p19.pddl
40 40 0.0 36 36 0.0
p20.pddl
51 51 0.0 82 82 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
45 45 0.0 44 44 0.0
p02.pddl
48 48 0.0 44 44 0.0
p03.pddl
48 48 0.0 54 54 0.0
p04.pddl
15 15 0.0 18 18 0.0
p05.pddl
39 39 0.0 38 38 0.0
p06.pddl
44 44 0.0 56 56 0.0
p07.pddl
36 36 0.0 52 52 0.0
p08.pddl
41 41 0.0 36 36 0.0
p09.pddl
29 29 0.0 32 32 0.0
p10.pddl
38 38 0.0 54 54 0.0
p11.pddl
50 50 0.0 38 38 0.0
p12.pddl
64 64 0.0 48 48 0.0
p13.pddl
50 50 0.0 38 38 0.0
p14.pddl
31 31 0.0 34 34 0.0
p15.pddl
22 22 0.0 26 26 0.0
p16.pddl
40 40 0.0 44 44 0.0
p17.pddl
31 31 0.0 43 43 0.0
p18.pddl
42 42 0.0 54 54 0.0
p19.pddl
40 40 0.0 36 36 0.0
p20.pddl
51 51 0.0 82 82 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tpp
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
12 12 0.0 8 8 0.0
p02.pddl
23 23 0.0 16 16 0.0
p03.pddl
34 34 0.0 24 24 0.0
p04.pddl
45 45 0.0 32 32 0.0
p05.pddl
56 56 0.0 20 20 0.0
p06.pddl
62 62 0.0 22 22 0.0
p07.pddl
84 84 0.0 28 28 0.0
p08.pddl
100 100 0.0 33 33 0.0
p09.pddl
19 19 0.0 32 32 0.0
p10.pddl
22 22 0.0 34 34 0.0
p11.pddl
28 28 0.0 27 27 0.0
p12.pddl
25 25 0.0 27 27 0.0
p13.pddl
19 19 0.0 16 16 0.0
p14.pddl
33 33 0.0 22 22 0.0
p15.pddl
40 40 0.0 26 26 0.0
p16.pddl
58 58 0.0 28 28 0.0
p17.pddl
38 38 0.0 23 23 0.0
p18.pddl
36 36 0.0 22 22 0.0
p19.pddl
58 58 0.0 31 31 0.0
p20.pddl
71 71 0.0 36 36 0.0
p21.pddl
84 84 0.0 36 36 0.0
p22.pddl
56 56 0.0 27 27 0.0
p23.pddl
77 77 0.0 35 35 0.0
p24.pddl
69 69 0.0 35 35 0.0
p25.pddl
95 95 0.0 43 43 0.0
p26.pddl
101 101 0.0 44 44 0.0
p27.pddl
111 111 0.0 48 48 0.0
p28.pddl
122 122 0.0 50 50 0.0
p29.pddl
139 139 0.0 61 61 0.0
p30.pddl
131 131 0.0 58 58 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt08-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
8 8 0.0 2 2 0.0
p02.pddl
13 13 0.0 3 3 0.0
p03.pddl
21 21 0.0 4 4 0.0
p04.pddl
34 34 0.0 5 5 0.0
p05.pddl
37 37 0.0 6 6 0.0
p06.pddl
41 41 0.0 7 7 0.0
p07.pddl
51 51 0.0 8 8 0.0
p08.pddl
59 59 0.0 9 9 0.0
p09.pddl
57 57 0.0 10 10 0.0
p10.pddl
68 68 0.0 11 11 0.0
p11.pddl
14 14 0.0 2 2 0.0
p12.pddl
25 25 0.0 3 3 0.0
p13.pddl
27 27 0.0 4 4 0.0
p14.pddl
43 43 0.0 5 5 0.0
p15.pddl
40 40 0.0 6 6 0.0
p16.pddl
56 56 0.0 7 7 0.0
p17.pddl
60 60 0.0 8 8 0.0
p18.pddl
62 62 0.0 9 9 0.0
p19.pddl
67 67 0.0 10 10 0.0
p20.pddl
78 78 0.0 11 11 0.0
p21.pddl
11 11 0.0 2 2 0.0
p22.pddl
17 17 0.0 3 3 0.0
p23.pddl
24 24 0.0 4 4 0.0
p24.pddl
28 28 0.0 5 5 0.0
p25.pddl
52 52 0.0 6 6 0.0
p26.pddl
39 39 0.0 7 7 0.0
p27.pddl
46 46 0.0 8 8 0.0
p28.pddl
67 67 0.0 9 9 0.0
p29.pddl
55 55 0.0 10 10 0.0
p30.pddl
66 66 0.0 11 11 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
24 24 0.0 4 4 0.0
p02.pddl
21 21 0.0 4 4 0.0
p03.pddl
25 25 0.0 3 3 0.0
p04.pddl
27 27 0.0 4 4 0.0
p05.pddl
28 28 0.0 5 5 0.0
p06.pddl
34 34 0.0 5 5 0.0
p07.pddl
45 45 0.0 6 6 0.0
p08.pddl
33 33 0.0 6 6 0.0
p09.pddl
42 42 0.0 7 7 0.0
p10.pddl
49 49 0.0 7 7 0.0
p11.pddl
51 51 0.0 8 8 0.0
p12.pddl
50 50 0.0 8 8 0.0
p13.pddl
66 66 0.0 8 8 0.0
p14.pddl
57 57 0.0 8 8 0.0
p15.pddl
64 64 0.0 9 9 0.0
p16.pddl
56 56 0.0 9 9 0.0
p17.pddl
37 37 0.0 6 6 0.0
p18.pddl
43 43 0.0 5 5 0.0
p19.pddl
52 52 0.0 6 6 0.0
p20.pddl
41 41 0.0 7 7 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
17 17 0.0 4 4 0.0
p02.pddl
23 23 0.0 4 4 0.0
p03.pddl
32 32 0.0 5 5 0.0
p04.pddl
28 28 0.0 5 5 0.0
p05.pddl
36 36 0.0 6 6 0.0
p06.pddl
44 44 0.0 6 6 0.0
p07.pddl
39 39 0.0 4 4 0.0
p08.pddl
40 40 0.0 4 4 0.0
p09.pddl
30 30 0.0 5 5 0.0
p10.pddl
47 47 0.0 5 5 0.0
p11.pddl
35 35 0.0 6 6 0.0
p12.pddl
46 46 0.0 6 6 0.0
p13.pddl
31 31 0.0 4 4 0.0
p14.pddl
28 28 0.0 4 4 0.0
p15.pddl
33 33 0.0 5 5 0.0
p16.pddl
31 31 0.0 5 5 0.0
p17.pddl
36 36 0.0 6 6 0.0
p18.pddl
43 43 0.0 6 6 0.0
p19.pddl
49 49 0.0 7 7 0.0
p20.pddl
49 49 0.0 7 7 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
trucks-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
18 18 0.0 23 23 0.0
p02.pddl
21 21 0.0 29 29 0.0
p03.pddl
29 29 0.0 37 37 0.0
p04.pddl
41 41 0.0 44 44 0.0
p05.pddl
48 48 0.0 50 50 0.0
p06.pddl
57 57 0.0 59 59 0.0
p07.pddl
33 33 0.0 44 44 0.0
p08.pddl
49 49 0.0 50 50 0.0
p09.pddl
52 52 0.0 57 57 0.0
p10.pddl
55 55 0.0 69 69 0.0
p11.pddl
68 68 0.0 73 73 0.0
p12.pddl
72 72 0.0 81 81 0.0
p13.pddl
74 74 0.0 71 71 0.0
p14.pddl
70 70 0.0 72 72 0.0
p15.pddl
73 73 0.0 86 86 0.0
p16.pddl
71 71 0.0 90 90 0.0
p17.pddl
98 98 0.0 98 98 0.0
p18.pddl
99 99 0.0 103 103 0.0
p19.pddl
96 96 0.0 94 94 0.0
p20.pddl
84 84 0.0 100 100 0.0
p21.pddl
95 95 0.0 105 105 0.0
p22.pddl
113 113 0.0 119 119 0.0
p23.pddl
131 131 0.0 126 126 0.0
p24.pddl
121 121 0.0 129 129 0.0
p25.pddl
79 79 0.0 114 114 0.0
p26.pddl
98 98 0.0 118 118 0.0
p27.pddl
124 124 0.0 135 135 0.0
p28.pddl
132 132 0.0 144 144 0.0
p29.pddl
112 112 0.0 150 150 0.0
p30.pddl
119 119 0.0 158 158 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
5 5 0.0 3 3 0.0
problem02-half.pddl
1 1 0.0 1 1 0.0
problem03-full.pddl
10 10 0.0 8 8 0.0
problem03-half.pddl
6 6 0.0 4 4 0.0
problem04-full.pddl
20 20 0.0 15 15 0.0
problem04-half.pddl
11 11 0.0 7 7 0.0
problem05-full.pddl
33 33 0.0 24 24 0.0
problem05-half.pddl
21 21 0.0 14 14 0.0
problem06-full.pddl
45 45 0.0 35 35 0.0
problem06-half.pddl
23 23 0.0 15 15 0.0
problem07-full.pddl
62 62 0.0 48 48 0.0
problem07-half.pddl
44 44 0.0 32 32 0.0
problem08-full.pddl
82 82 0.0 63 63 0.0
problem08-half.pddl
46 46 0.0 32 32 0.0
problem09-full.pddl
105 105 0.0 80 80 0.0
problem09-half.pddl
65 65 0.0 49 49 0.0
problem10-full.pddl
127 127 0.0 99 99 0.0
problem10-half.pddl
67 67 0.0 47 47 0.0
problem11-full.pddl
151 151 0.0 120 120 0.0
problem11-half.pddl
81 81 0.0 57 57 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt14-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
33 33 0.0 24 24 0.0
p-1-6.pddl
45 45 0.0 35 35 0.0
p-1-7.pddl
62 62 0.0 48 48 0.0
p-1-8.pddl
82 82 0.0 63 63 0.0
p-1-9.pddl
105 105 0.0 80 80 0.0
p-1-10.pddl
127 127 0.0 99 99 0.0
p-1-11.pddl
151 151 0.0 120 120 0.0
p-1-12.pddl
183 183 0.0 143 143 0.0
p-1-13.pddl
210 210 0.0 168 168 0.0
p-1-14.pddl
247 247 0.0 195 195 0.0
p-1-15.pddl
277 277 0.0 224 224 0.0
p-1-16.pddl
319 319 0.0 255 255 0.0
p-1-17.pddl
361 361 0.0 288 288 0.0
p-1-18.pddl
404 404 0.0 323 323 0.0
p-05-5.pddl
24 24 0.0 17 17 0.0
p-05-6.pddl
24 24 0.0 17 17 0.0
p-05-7.pddl
33 33 0.0 23 23 0.0
p-05-8.pddl
45 45 0.0 30 30 0.0
p-05-9.pddl
56 56 0.0 41 41 0.0
p-05-10.pddl
65 65 0.0 45 45 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt08-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
52 52 0.0 33 33 0.0
p02.pddl
42 42 0.0 38 38 0.0
p03.pddl
79 79 0.0 44 44 0.0
p04.pddl
50 50 0.0 36 36 0.0
p05.pddl
81 81 0.0 56 56 0.0
p06.pddl
112 112 0.0 58 58 0.0
p07.pddl
107 107 0.0 78 78 0.0
p08.pddl
94 94 0.0 78 78 0.0
p09.pddl
99 99 0.0 91 91 0.0
p10.pddl
109 109 0.0 86 86 0.0
p11.pddl
48 48 0.0 31 31 0.0
p12.pddl
59 59 0.0 38 38 0.0
p13.pddl
61 61 0.0 44 44 0.0
p14.pddl
68 68 0.0 42 42 0.0
p15.pddl
68 68 0.0 50 50 0.0
p16.pddl
65 65 0.0 53 53 0.0
p17.pddl
99 99 0.0 71 71 0.0
p18.pddl
106 106 0.0 72 72 0.0
p19.pddl
86 86 0.0 69 69 0.0
p20.pddl
115 115 0.0 91 91 0.0
p21.pddl
30 30 0.0 27 27 0.0
p22.pddl
48 48 0.0 25 25 0.0
p23.pddl
72 72 0.0 42 42 0.0
p24.pddl
64 64 0.0 46 46 0.0
p25.pddl
125 125 0.0 76 76 0.0
p26.pddl
89 89 0.0 57 57 0.0
p27.pddl
101 101 0.0 64 64 0.0
p28.pddl
113 113 0.0 68 68 0.0
p29.pddl
155 155 0.0 100 100 0.0
p30.pddl
220 220 0.0 124 124 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt11-strips
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
72 72 0.0 42 42 0.0
p02.pddl
59 59 0.0 38 38 0.0
p03.pddl
61 61 0.0 44 44 0.0
p04.pddl
79 79 0.0 44 44 0.0
p05.pddl
64 64 0.0 46 46 0.0
p06.pddl
50 50 0.0 36 36 0.0
p07.pddl
68 68 0.0 42 42 0.0
p08.pddl
125 125 0.0 76 76 0.0
p09.pddl
81 81 0.0 56 56 0.0
p10.pddl
68 68 0.0 50 50 0.0
p11.pddl
89 89 0.0 57 57 0.0
p12.pddl
65 65 0.0 53 53 0.0
p13.pddl
112 112 0.0 58 58 0.0
p14.pddl
101 101 0.0 64 64 0.0
p15.pddl
99 99 0.0 71 71 0.0
p16.pddl
107 107 0.0 78 78 0.0
p17.pddl
113 113 0.0 68 68 0.0
p18.pddl
106 106 0.0 72 72 0.0
p19.pddl
94 94 0.0 78 78 0.0
p20.pddl
155 155 0.0 100 100 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
zenotravel
Show table
edges
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 2 2 0.0
p02.pddl
9 9 0.0 8 8 0.0
p03.pddl
9 9 0.0 2 2 0.0
p04.pddl
10 10 0.0 4 4 0.0
p05.pddl
21 21 0.0 4 4 0.0
p06.pddl
18 18 0.0 4 4 0.0
p07.pddl
19 19 0.0 4 4 0.0
p08.pddl
18 18 0.0 5 5 0.0
p09.pddl
36 36 0.0 7 7 0.0
p10.pddl
38 38 0.0 10 10 0.0
p11.pddl
23 23 0.0 6 6 0.0
p12.pddl
34 34 0.0 7 7 0.0
p13.pddl
47 47 0.0 9 9 0.0
p14.pddl
12 12 0.0 15 15 0.0
p15.pddl
12 12 0.0 12 12 0.0
p16.pddl
15 15 0.0 17 17 0.0
p17.pddl
21 21 0.0 23 23 0.0
p18.pddl
19 19 0.0 20 20 0.0
p19.pddl
24 24 0.0 26 26 0.0
p20.pddl
25 25 0.0 25 25 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
error
error-exitcode-248
Show table
error-search-out-of-memory
Show table
error-search-out-of-time
Show table
error-search-unsolvable-incomplete
Show table
error-segfault
Show table
error-translate-out-of-memory
Show table
agricola-opt18-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
airport
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
success
success
- success
success
-
p02-airport1-p1.pddl
success
success
- success
success
-
p03-airport1-p2.pddl
success
success
- success
success
-
p04-airport2-p1.pddl
success
success
- success
success
-
p05-airport2-p1.pddl
success
success
- success
success
-
p06-airport2-p2.pddl
success
success
- success
success
-
p07-airport2-p2.pddl
success
success
- success
success
-
p08-airport2-p3.pddl
success
success
- success
success
-
p09-airport2-p4.pddl
success
success
- success
success
-
p10-airport3-p1.pddl
success
success
- success
success
-
p11-airport3-p1.pddl
success
success
- success
success
-
p12-airport3-p2.pddl
success
success
- success
success
-
p13-airport3-p2.pddl
success
success
- success
success
-
p14-airport3-p3.pddl
success
success
- success
success
-
p15-airport3-p3.pddl
success
success
- success
success
-
p16-airport3-p4.pddl
success
success
- success
success
-
p17-airport3-p5.pddl
success
success
- success
success
-
p18-airport3-p6.pddl
success
success
- success
success
-
p19-airport3-p6.pddl
success
success
- success
success
-
p20-airport3-p7.pddl
success
success
- success
success
-
p21-airport4halfMUC-p2.pddl
success
success
- success
success
-
p22-airport4halfMUC-p3.pddl
success
success
- success
success
-
p23-airport4halfMUC-p4.pddl
success
success
- success
success
-
p24-airport4halfMUC-p4.pddl
success
success
- success
success
-
p25-airport4halfMUC-p5.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p26-airport4halfMUC-p6.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p27-airport4halfMUC-p6.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p28-airport4halfMUC-p7.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p29-airport4halfMUC-p8.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p30-airport4halfMUC-p8.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p31-airport4halfMUC-p9.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p32-airport4halfMUC-p10.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p33-airport4halfMUC-p10.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p34-airport4halfMUC-p11.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p35-airport4halfMUC-p12.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p36-airport5MUC-p2.pddl
success
success
- success
success
-
p37-airport5MUC-p3.pddl
success
success
- success
success
-
p38-airport5MUC-p3.pddl
success
success
- success
success
-
p39-airport5MUC-p4.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p40-airport5MUC-p4.pddl
success
success
- success
success
-
p41-airport5MUC-p4.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p42-airport5MUC-p5.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p43-airport5MUC-p5.pddl
success
success
- success
success
-
p44-airport5MUC-p5.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p45-airport5MUC-p6.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p46-airport5MUC-p6.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p47-airport5MUC-p8.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p48-airport5MUC-p9.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p49-airport5MUC-p10.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p50-airport5MUC-p15.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
barman-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
success
success
- success
success
-
pfile01-002.pddl
success
success
- success
success
-
pfile01-003.pddl
success
success
- success
success
-
pfile01-004.pddl
success
success
- success
success
-
pfile02-005.pddl
success
success
- success
success
-
pfile02-006.pddl
success
success
- success
success
-
pfile02-007.pddl
success
success
- success
success
-
pfile02-008.pddl
success
success
- success
success
-
pfile03-009.pddl
success
success
- success
success
-
pfile03-010.pddl
success
success
- success
success
-
pfile03-011.pddl
success
success
- success
success
-
pfile03-012.pddl
success
success
- success
success
-
pfile04-013.pddl
success
success
- success
success
-
pfile04-014.pddl
success
success
- success
success
-
pfile04-015.pddl
success
success
- success
success
-
pfile04-016.pddl
success
success
- success
success
-
pfile05-017.pddl
success
success
- success
success
-
pfile05-018.pddl
success
success
- success
success
-
pfile05-019.pddl
success
success
- success
success
-
pfile05-020.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
barman-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
success
success
- success
success
-
p435-2.pddl
success
success
- success
success
-
p435-3.pddl
success
success
- success
success
-
p536-1.pddl
success
success
- success
success
-
p536-2.pddl
success
success
- success
success
-
p536-3.pddl
success
success
- success
success
-
p638-1.pddl
success
success
- success
success
-
p638-2.pddl
success
success
- success
success
-
p638-3.pddl
success
success
- success
success
-
p739-1.pddl
success
success
- success
success
-
p739-2.pddl
success
success
- success
success
-
p739-3.pddl
success
success
- success
success
-
p839-1.pddl
success
success
- success
success
-
p839-2.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
blocks
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
success
success
- success
success
-
probBLOCKS-4-1.pddl
success
success
- success
success
-
probBLOCKS-4-2.pddl
success
success
- success
success
-
probBLOCKS-5-0.pddl
success
success
- success
success
-
probBLOCKS-5-1.pddl
success
success
- success
success
-
probBLOCKS-5-2.pddl
success
success
- success
success
-
probBLOCKS-6-0.pddl
success
success
- success
success
-
probBLOCKS-6-1.pddl
success
success
- success
success
-
probBLOCKS-6-2.pddl
success
success
- success
success
-
probBLOCKS-7-0.pddl
success
success
- success
success
-
probBLOCKS-7-1.pddl
success
success
- success
success
-
probBLOCKS-7-2.pddl
success
success
- success
success
-
probBLOCKS-8-0.pddl
success
success
- success
success
-
probBLOCKS-8-1.pddl
success
success
- success
success
-
probBLOCKS-8-2.pddl
success
success
- success
success
-
probBLOCKS-9-0.pddl
success
success
- success
success
-
probBLOCKS-9-1.pddl
success
success
- success
success
-
probBLOCKS-9-2.pddl
success
success
- success
success
-
probBLOCKS-10-0.pddl
success
success
- success
success
-
probBLOCKS-10-1.pddl
success
success
- success
success
-
probBLOCKS-10-2.pddl
success
success
- success
success
-
probBLOCKS-11-0.pddl
success
success
- success
success
-
probBLOCKS-11-1.pddl
success
success
- success
success
-
probBLOCKS-11-2.pddl
success
success
- success
success
-
probBLOCKS-12-0.pddl
success
success
- success
success
-
probBLOCKS-12-1.pddl
success
success
- success
success
-
probBLOCKS-13-0.pddl
success
success
- success
success
-
probBLOCKS-13-1.pddl
success
success
- success
success
-
probBLOCKS-14-0.pddl
success
success
- success
success
-
probBLOCKS-14-1.pddl
success
success
- success
success
-
probBLOCKS-15-0.pddl
success
success
- success
success
-
probBLOCKS-15-1.pddl
success
success
- success
success
-
probBLOCKS-16-1.pddl
success
success
- success
success
-
probBLOCKS-16-2.pddl
success
success
- success
success
-
probBLOCKS-17-0.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
childsnack-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
success
success
- success
success
-
child-snack_pfile01.pddl
success
success
- success
success
-
child-snack_pfile02-2.pddl
success
success
- success
success
-
child-snack_pfile02.pddl
success
success
- success
success
-
child-snack_pfile03-2.pddl
success
success
- success
success
-
child-snack_pfile03.pddl
success
success
- success
success
-
child-snack_pfile04-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile04.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile05-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile05.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile06-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile06.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile07-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile07.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile08-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile08.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile09-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile09.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile10-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
child-snack_pfile10.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
data-network-opt18-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
depot
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p19.pddl
success
success
- success
success
-
p20.pddl
search-out-of-memory
search-out-of-memory
- success
success
-
p21.pddl
success
success
- success
success
-
p22.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
driverlog
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
elevators-opt08-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
p21.pddl
success
success
- success
success
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- success
success
-
p24.pddl
success
success
- success
success
-
p25.pddl
success
success
- success
success
-
p26.pddl
success
success
- success
success
-
p27.pddl
success
success
- success
success
-
p28.pddl
success
success
- success
success
-
p29.pddl
success
success
- success
success
-
p30.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
elevators-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
floortile-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
success
success
- success
success
-
opt-p01-002.pddl
success
success
- success
success
-
opt-p02-003.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
opt-p02-004.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
opt-p03-005.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
opt-p03-006.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
opt-p04-007.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
opt-p04-008.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
opt-p05-009.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
opt-p05-010.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
opt-p06-011.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
opt-p06-012.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
opt-p07-013.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
opt-p07-014.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
opt-p08-015.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
opt-p08-016.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
opt-p09-017.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
opt-p09-018.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
opt-p10-019.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
opt-p10-020.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
floortile-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p01-4-4-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p01-5-3-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p01-5-4-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p01-5-5-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p01-6-4-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p01-6-5-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p02-4-4-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p02-5-3-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p02-5-4-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p02-5-5-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p02-6-4-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p02-6-5-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p03-4-3-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p03-4-4-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p03-5-3-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p03-5-4-2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p03-5-5-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p03-6-4-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p03-6-5-2.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
freecell
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
probfreecell-2-1.pddl
success
success
- success
success
-
probfreecell-2-2.pddl
success
success
- success
success
-
probfreecell-2-3.pddl
success
success
- success
success
-
probfreecell-2-4.pddl
success
success
- success
success
-
probfreecell-2-5.pddl
success
success
- success
success
-
probfreecell-3-1.pddl
success
success
- success
success
-
probfreecell-3-2.pddl
success
success
- success
success
-
probfreecell-3-3.pddl
success
success
- success
success
-
probfreecell-3-4.pddl
success
success
- success
success
-
probfreecell-3-5.pddl
success
success
- success
success
-
probfreecell-4-1.pddl
success
success
- success
success
-
probfreecell-4-2.pddl
success
success
- success
success
-
probfreecell-4-3.pddl
success
success
- success
success
-
probfreecell-4-4.pddl
success
success
- success
success
-
probfreecell-4-5.pddl
success
success
- success
success
-
probfreecell-5-1.pddl
success
success
- success
success
-
probfreecell-5-2.pddl
success
success
- success
success
-
probfreecell-5-3.pddl
success
success
- success
success
-
probfreecell-5-4.pddl
success
success
- success
success
-
probfreecell-5-5.pddl
success
success
- success
success
-
probfreecell-6-1.pddl
success
success
- success
success
-
probfreecell-6-2.pddl
success
success
- success
success
-
probfreecell-6-3.pddl
success
success
- success
success
-
probfreecell-6-4.pddl
success
success
- success
success
-
probfreecell-6-5.pddl
success
success
- success
success
-
probfreecell-7-1.pddl
success
success
- success
success
-
probfreecell-7-2.pddl
success
success
- success
success
-
probfreecell-7-3.pddl
success
success
- success
success
-
probfreecell-7-4.pddl
success
success
- success
success
-
probfreecell-7-5.pddl
success
success
- success
success
-
probfreecell-8-1.pddl
success
success
- success
success
-
probfreecell-8-2.pddl
success
success
- success
success
-
probfreecell-8-3.pddl
success
success
- success
success
-
probfreecell-8-4.pddl
success
success
- success
success
-
probfreecell-8-5.pddl
success
success
- success
success
-
probfreecell-9-1.pddl
success
success
- success
success
-
probfreecell-9-2.pddl
success
success
- success
success
-
probfreecell-9-3.pddl
success
success
- success
success
-
probfreecell-9-4.pddl
success
success
- success
success
-
probfreecell-9-5.pddl
success
success
- success
success
-
probfreecell-10-1.pddl
success
success
- success
success
-
probfreecell-10-2.pddl
success
success
- success
success
-
probfreecell-10-3.pddl
success
success
- success
success
-
probfreecell-10-4.pddl
success
success
- success
success
-
probfreecell-10-5.pddl
success
success
- success
success
-
probfreecell-11-1.pddl
success
success
- success
success
-
probfreecell-11-2.pddl
success
success
- success
success
-
probfreecell-11-3.pddl
success
success
- success
success
-
probfreecell-11-4.pddl
success
success
- success
success
-
probfreecell-11-5.pddl
search-out-of-time
search-out-of-time
- success
success
-
probfreecell-12-1.pddl
success
success
- success
success
-
probfreecell-12-2.pddl
success
success
- success
success
-
probfreecell-12-3.pddl
success
success
- success
success
-
probfreecell-12-4.pddl
success
success
- success
success
-
probfreecell-12-5.pddl
success
success
- success
success
-
probfreecell-13-1.pddl
success
success
- success
success
-
probfreecell-13-2.pddl
success
success
- success
success
-
probfreecell-13-3.pddl
success
success
- success
success
-
probfreecell-13-4.pddl
success
success
- success
success
-
probfreecell-13-5.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
ged-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
success
success
- success
success
-
d-1-3.pddl
success
success
- success
success
-
d-1-4.pddl
success
success
- success
success
-
d-1-8.pddl
success
success
- success
success
-
d-2-1.pddl
success
success
- success
success
-
d-2-3.pddl
success
success
- success
success
-
d-2-4.pddl
success
success
- success
success
-
d-2-8.pddl
success
success
- success
success
-
d-3-1.pddl
success
success
- success
success
-
d-3-2.pddl
success
success
- success
success
-
d-3-4.pddl
success
success
- success
success
-
d-4-2.pddl
success
success
- success
success
-
d-4-3.pddl
success
success
- success
success
-
d-4-8.pddl
success
success
- success
success
-
d-7-5.pddl
success
success
- success
success
-
d-7-6.pddl
success
success
- success
success
-
d-8-1.pddl
success
success
- success
success
-
d-8-2.pddl
success
success
- success
success
-
d-8-4.pddl
success
success
- success
success
-
d-8-9.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
grid
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
success
success
- success
success
-
prob02.pddl
success
success
- success
success
-
prob03.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob04.pddl
success
success
- success
success
-
prob05.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
gripper
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
success
success
- success
success
-
prob02.pddl
success
success
- success
success
-
prob03.pddl
success
success
- success
success
-
prob04.pddl
success
success
- success
success
-
prob05.pddl
success
success
- success
success
-
prob06.pddl
success
success
- success
success
-
prob07.pddl
success
success
- success
success
-
prob08.pddl
success
success
- success
success
-
prob09.pddl
success
success
- success
success
-
prob10.pddl
success
success
- success
success
-
prob11.pddl
success
success
- success
success
-
prob12.pddl
success
success
- success
success
-
prob13.pddl
success
success
- success
success
-
prob14.pddl
success
success
- success
success
-
prob15.pddl
success
success
- success
success
-
prob16.pddl
success
success
- success
success
-
prob17.pddl
success
success
- success
success
-
prob18.pddl
success
success
- success
success
-
prob19.pddl
success
success
- success
success
-
prob20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
hiking-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
success
success
- success
success
-
ptesting-1-2-4.pddl
success
success
- success
success
-
ptesting-1-2-5.pddl
success
success
- success
success
-
ptesting-1-2-7.pddl
success
success
- success
success
-
ptesting-1-2-8.pddl
success
success
- success
success
-
ptesting-2-2-3.pddl
success
success
- success
success
-
ptesting-2-2-4.pddl
success
success
- success
success
-
ptesting-2-2-5.pddl
success
success
- success
success
-
ptesting-2-2-6.pddl
success
success
- success
success
-
ptesting-2-2-7.pddl
success
success
- success
success
-
ptesting-2-2-8.pddl
success
success
- success
success
-
ptesting-2-3-4.pddl
success
success
- success
success
-
ptesting-2-3-5.pddl
success
success
- success
success
-
ptesting-2-3-6.pddl
success
success
- success
success
-
ptesting-2-3-7.pddl
success
success
- success
success
-
ptesting-2-4-3.pddl
success
success
- success
success
-
ptesting-2-4-4.pddl
success
success
- success
success
-
ptesting-2-4-5.pddl
success
success
- success
success
-
ptesting-2-4-6.pddl
success
success
- success
success
-
ptesting-2-4-7.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
logistics00
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
success
success
- success
success
-
probLOGISTICS-4-1.pddl
success
success
- success
success
-
probLOGISTICS-4-2.pddl
success
success
- success
success
-
probLOGISTICS-5-0.pddl
success
success
- success
success
-
probLOGISTICS-5-1.pddl
success
success
- success
success
-
probLOGISTICS-5-2.pddl
success
success
- success
success
-
probLOGISTICS-6-0.pddl
success
success
- success
success
-
probLOGISTICS-6-1.pddl
success
success
- success
success
-
probLOGISTICS-6-2.pddl
success
success
- success
success
-
probLOGISTICS-6-9.pddl
success
success
- success
success
-
probLOGISTICS-7-0.pddl
success
success
- success
success
-
probLOGISTICS-7-1.pddl
success
success
- success
success
-
probLOGISTICS-8-0.pddl
success
success
- success
success
-
probLOGISTICS-8-1.pddl
success
success
- success
success
-
probLOGISTICS-9-0.pddl
success
success
- success
success
-
probLOGISTICS-9-1.pddl
success
success
- success
success
-
probLOGISTICS-10-0.pddl
success
success
- success
success
-
probLOGISTICS-10-1.pddl
success
success
- success
success
-
probLOGISTICS-11-0.pddl
success
success
- success
success
-
probLOGISTICS-11-1.pddl
success
success
- success
success
-
probLOGISTICS-12-0.pddl
success
success
- success
success
-
probLOGISTICS-12-1.pddl
success
success
- success
success
-
probLOGISTICS-13-0.pddl
success
success
- success
success
-
probLOGISTICS-13-1.pddl
success
success
- success
success
-
probLOGISTICS-14-0.pddl
success
success
- success
success
-
probLOGISTICS-14-1.pddl
success
success
- success
success
-
probLOGISTICS-15-0.pddl
success
success
- success
success
-
probLOGISTICS-15-1.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
logistics98
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
success
success
- success
success
-
prob02.pddl
success
success
- success
success
-
prob03.pddl
success
success
- success
success
-
prob04.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob05.pddl
success
success
- success
success
-
prob06.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob07.pddl
success
success
- success
success
-
prob08.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob09.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob10.pddl
success
success
- success
success
-
prob11.pddl
success
success
- success
success
-
prob12.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob13.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob14.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob15.pddl
success
success
- success
success
-
prob16.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob18.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob19.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob20.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob21.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob22.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob23.pddl
success
success
- success
success
-
prob24.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob25.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob26.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob27.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob28.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob29.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob30.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob31.pddl
success
success
- success
success
-
prob32.pddl
success
success
- success
success
-
prob33.pddl
success
success
- success
success
-
prob34.pddl
success
success
- success
success
-
prob35.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
miconic
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
success
success
- success
success
-
s1-1.pddl
success
success
- success
success
-
s1-2.pddl
success
success
- success
success
-
s1-3.pddl
success
success
- success
success
-
s1-4.pddl
success
success
- success
success
-
s2-0.pddl
success
success
- success
success
-
s2-1.pddl
success
success
- success
success
-
s2-2.pddl
success
success
- success
success
-
s2-3.pddl
success
success
- success
success
-
s2-4.pddl
success
success
- success
success
-
s3-0.pddl
success
success
- success
success
-
s3-1.pddl
success
success
- success
success
-
s3-2.pddl
success
success
- success
success
-
s3-3.pddl
success
success
- success
success
-
s3-4.pddl
success
success
- success
success
-
s4-0.pddl
success
success
- success
success
-
s4-1.pddl
success
success
- success
success
-
s4-2.pddl
success
success
- success
success
-
s4-3.pddl
success
success
- success
success
-
s4-4.pddl
success
success
- success
success
-
s5-0.pddl
success
success
- success
success
-
s5-1.pddl
success
success
- success
success
-
s5-2.pddl
success
success
- success
success
-
s5-3.pddl
success
success
- success
success
-
s5-4.pddl
success
success
- success
success
-
s6-0.pddl
success
success
- success
success
-
s6-1.pddl
success
success
- success
success
-
s6-2.pddl
success
success
- success
success
-
s6-3.pddl
success
success
- success
success
-
s6-4.pddl
success
success
- success
success
-
s7-0.pddl
success
success
- success
success
-
s7-1.pddl
success
success
- success
success
-
s7-2.pddl
success
success
- success
success
-
s7-3.pddl
success
success
- success
success
-
s7-4.pddl
success
success
- success
success
-
s8-0.pddl
success
success
- success
success
-
s8-1.pddl
success
success
- success
success
-
s8-2.pddl
success
success
- success
success
-
s8-3.pddl
success
success
- success
success
-
s8-4.pddl
success
success
- success
success
-
s9-0.pddl
success
success
- success
success
-
s9-1.pddl
success
success
- success
success
-
s9-2.pddl
success
success
- success
success
-
s9-3.pddl
success
success
- success
success
-
s9-4.pddl
success
success
- success
success
-
s10-0.pddl
success
success
- success
success
-
s10-1.pddl
success
success
- success
success
-
s10-2.pddl
success
success
- success
success
-
s10-3.pddl
success
success
- success
success
-
s10-4.pddl
success
success
- success
success
-
s11-0.pddl
success
success
- success
success
-
s11-1.pddl
success
success
- success
success
-
s11-2.pddl
success
success
- success
success
-
s11-3.pddl
success
success
- success
success
-
s11-4.pddl
success
success
- success
success
-
s12-0.pddl
success
success
- success
success
-
s12-1.pddl
success
success
- success
success
-
s12-2.pddl
success
success
- success
success
-
s12-3.pddl
success
success
- success
success
-
s12-4.pddl
success
success
- success
success
-
s13-0.pddl
success
success
- success
success
-
s13-1.pddl
success
success
- success
success
-
s13-2.pddl
success
success
- success
success
-
s13-3.pddl
success
success
- success
success
-
s13-4.pddl
success
success
- success
success
-
s14-0.pddl
success
success
- success
success
-
s14-1.pddl
success
success
- success
success
-
s14-2.pddl
success
success
- success
success
-
s14-3.pddl
success
success
- success
success
-
s14-4.pddl
success
success
- success
success
-
s15-0.pddl
success
success
- success
success
-
s15-1.pddl
success
success
- success
success
-
s15-2.pddl
success
success
- success
success
-
s15-3.pddl
success
success
- success
success
-
s15-4.pddl
success
success
- success
success
-
s16-0.pddl
success
success
- success
success
-
s16-1.pddl
success
success
- success
success
-
s16-2.pddl
success
success
- success
success
-
s16-3.pddl
success
success
- success
success
-
s16-4.pddl
success
success
- success
success
-
s17-0.pddl
success
success
- success
success
-
s17-1.pddl
success
success
- success
success
-
s17-2.pddl
success
success
- success
success
-
s17-3.pddl
success
success
- success
success
-
s17-4.pddl
success
success
- success
success
-
s18-0.pddl
success
success
- success
success
-
s18-1.pddl
success
success
- success
success
-
s18-2.pddl
success
success
- success
success
-
s18-3.pddl
success
success
- success
success
-
s18-4.pddl
success
success
- success
success
-
s19-0.pddl
success
success
- success
success
-
s19-1.pddl
success
success
- success
success
-
s19-2.pddl
success
success
- success
success
-
s19-3.pddl
success
success
- success
success
-
s19-4.pddl
success
success
- success
success
-
s20-0.pddl
success
success
- success
success
-
s20-1.pddl
success
success
- success
success
-
s20-2.pddl
success
success
- success
success
-
s20-3.pddl
success
success
- success
success
-
s20-4.pddl
success
success
- success
success
-
s21-0.pddl
success
success
- success
success
-
s21-1.pddl
success
success
- success
success
-
s21-2.pddl
success
success
- success
success
-
s21-3.pddl
success
success
- success
success
-
s21-4.pddl
success
success
- success
success
-
s22-0.pddl
success
success
- success
success
-
s22-1.pddl
success
success
- success
success
-
s22-2.pddl
success
success
- success
success
-
s22-3.pddl
success
success
- success
success
-
s22-4.pddl
success
success
- success
success
-
s23-0.pddl
success
success
- success
success
-
s23-1.pddl
success
success
- success
success
-
s23-2.pddl
success
success
- success
success
-
s23-3.pddl
success
success
- success
success
-
s23-4.pddl
success
success
- success
success
-
s24-0.pddl
success
success
- success
success
-
s24-1.pddl
success
success
- success
success
-
s24-2.pddl
success
success
- success
success
-
s24-3.pddl
success
success
- success
success
-
s24-4.pddl
success
success
- success
success
-
s25-0.pddl
success
success
- success
success
-
s25-1.pddl
success
success
- success
success
-
s25-2.pddl
success
success
- success
success
-
s25-3.pddl
success
success
- success
success
-
s25-4.pddl
success
success
- success
success
-
s26-0.pddl
success
success
- success
success
-
s26-1.pddl
success
success
- success
success
-
s26-2.pddl
success
success
- success
success
-
s26-3.pddl
success
success
- success
success
-
s26-4.pddl
success
success
- success
success
-
s27-0.pddl
success
success
- success
success
-
s27-1.pddl
success
success
- success
success
-
s27-2.pddl
success
success
- success
success
-
s27-3.pddl
success
success
- success
success
-
s27-4.pddl
success
success
- success
success
-
s28-0.pddl
success
success
- success
success
-
s28-1.pddl
success
success
- success
success
-
s28-2.pddl
success
success
- success
success
-
s28-3.pddl
success
success
- success
success
-
s28-4.pddl
success
success
- success
success
-
s29-0.pddl
success
success
- success
success
-
s29-1.pddl
success
success
- success
success
-
s29-2.pddl
success
success
- success
success
-
s29-3.pddl
success
success
- success
success
-
s29-4.pddl
success
success
- success
success
-
s30-0.pddl
success
success
- success
success
-
s30-1.pddl
success
success
- success
success
-
s30-2.pddl
success
success
- success
success
-
s30-3.pddl
success
success
- success
success
-
s30-4.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
movie
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
success
success
- success
success
-
prob02.pddl
success
success
- success
success
-
prob03.pddl
success
success
- success
success
-
prob04.pddl
success
success
- success
success
-
prob05.pddl
success
success
- success
success
-
prob06.pddl
success
success
- success
success
-
prob07.pddl
success
success
- success
success
-
prob08.pddl
success
success
- success
success
-
prob09.pddl
success
success
- success
success
-
prob10.pddl
success
success
- success
success
-
prob11.pddl
success
success
- success
success
-
prob12.pddl
success
success
- success
success
-
prob13.pddl
success
success
- success
success
-
prob14.pddl
success
success
- success
success
-
prob15.pddl
success
success
- success
success
-
prob16.pddl
success
success
- success
success
-
prob17.pddl
success
success
- success
success
-
prob18.pddl
success
success
- success
success
-
prob19.pddl
success
success
- success
success
-
prob20.pddl
success
success
- success
success
-
prob21.pddl
success
success
- success
success
-
prob22.pddl
success
success
- success
success
-
prob23.pddl
success
success
- success
success
-
prob24.pddl
success
success
- success
success
-
prob25.pddl
success
success
- success
success
-
prob26.pddl
success
success
- success
success
-
prob27.pddl
success
success
- success
success
-
prob28.pddl
success
success
- success
success
-
prob29.pddl
success
success
- success
success
-
prob30.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
mprime
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
success
success
- success
success
-
prob02.pddl
success
success
- success
success
-
prob03.pddl
success
success
- success
success
-
prob04.pddl
success
success
- success
success
-
prob05.pddl
success
success
- success
success
-
prob06.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob07.pddl
success
success
- success
success
-
prob08.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob09.pddl
success
success
- success
success
-
prob10.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob11.pddl
success
success
- success
success
-
prob12.pddl
success
success
- success
success
-
prob13.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob14.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob15.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob16.pddl
success
success
- success
success
-
prob17.pddl
success
success
- success
success
-
prob18.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob19.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob20.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob21.pddl
success
success
- success
success
-
prob22.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob23.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob24.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob25.pddl
success
success
- success
success
-
prob26.pddl
success
success
- success
success
-
prob27.pddl
success
success
- success
success
-
prob28.pddl
success
success
- success
success
-
prob29.pddl
success
success
- success
success
-
prob30.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob31.pddl
success
success
- success
success
-
prob32.pddl
success
success
- success
success
-
prob33.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob34.pddl
success
success
- success
success
-
prob35.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
mystery
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
success
success
- success
success
-
prob02.pddl
success
success
- success
success
-
prob03.pddl
success
success
- success
success
-
prob04.pddl
search-unsolvable-incomplete
search-unsolvable-incomplete
- search-unsolvable-incomplete
search-unsolvable-incomplete
-
prob05.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
prob06.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob07.pddl
search-unsolvable-incomplete
search-unsolvable-incomplete
- exitcode-248
exitcode-248
-
prob08.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
prob09.pddl
success
success
- success
success
-
prob10.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob11.pddl
success
success
- success
success
-
prob12.pddl
search-unsolvable-incomplete
search-unsolvable-incomplete
- search-unsolvable-incomplete
search-unsolvable-incomplete
-
prob13.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob14.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
prob15.pddl
success
success
- success
success
-
prob16.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
prob17.pddl
success
success
- success
success
-
prob18.pddl
search-unsolvable-incomplete
search-unsolvable-incomplete
- exitcode-248
exitcode-248
-
prob19.pddl
success
success
- success
success
-
prob20.pddl
success
success
- success
success
-
prob21.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
prob22.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
prob23.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
prob24.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
prob25.pddl
success
success
- success
success
-
prob26.pddl
success
success
- success
success
-
prob27.pddl
success
success
- success
success
-
prob28.pddl
success
success
- success
success
-
prob29.pddl
success
success
- success
success
-
prob30.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
nomystery-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p07.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p08.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p18.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p19.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p20.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
openstacks-opt08-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
p21.pddl
success
success
- success
success
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- success
success
-
p24.pddl
success
success
- success
success
-
p25.pddl
success
success
- success
success
-
p26.pddl
success
success
- success
success
-
p27.pddl
success
success
- success
success
-
p28.pddl
success
success
- success
success
-
p29.pddl
success
success
- success
success
-
p30.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
openstacks-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
openstacks-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
success
success
- success
success
-
p20_2.pddl
success
success
- success
success
-
p20_3.pddl
success
success
- success
success
-
p25_1.pddl
success
success
- success
success
-
p25_3.pddl
success
success
- success
success
-
p30_1.pddl
success
success
- success
success
-
p30_2.pddl
success
success
- success
success
-
p30_3.pddl
success
success
- success
success
-
p35_1.pddl
success
success
- success
success
-
p35_2.pddl
success
success
- success
success
-
p35_3.pddl
success
success
- success
success
-
p40_1.pddl
success
success
- success
success
-
p40_2.pddl
success
success
- success
success
-
p40_3.pddl
success
success
- success
success
-
p45_1.pddl
success
success
- success
success
-
p45_2.pddl
success
success
- success
success
-
p45_3.pddl
success
success
- success
success
-
p50_1.pddl
success
success
- success
success
-
p50_2.pddl
success
success
- success
success
-
p50_3.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
openstacks-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
p21.pddl
success
success
- success
success
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- success
success
-
p24.pddl
success
success
- success
success
-
p25.pddl
success
success
- success
success
-
p26.pddl
success
success
- success
success
-
p27.pddl
success
success
- success
success
-
p28.pddl
success
success
- success
success
-
p29.pddl
success
success
- success
success
-
p30.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
organic-synthesis-opt18-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
p05.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
p06.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
p07.pddl
success
success
- success
success
-
p08.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
segfault
translate-out-of-memory
- segfault
translate-out-of-memory
-
p12.pddl
segfault
segfault
- translate-out-of-memory
translate-out-of-memory
-
p13.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
p14.pddl
success
success
- success
success
-
p15.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
p16.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
p17.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
p18.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
p19.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
p20.pddl
translate-out-of-memory
translate-out-of-memory
- translate-out-of-memory
translate-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
organic-synthesis-split-opt18-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p12.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p13.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p14.pddl
success
success
- success
success
-
p15.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p16.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p18.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p19.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p20.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
parcprinter-08-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p16.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p18.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p19.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p20.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p21.pddl
success
success
- success
success
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- success
success
-
p24.pddl
success
success
- success
success
-
p25.pddl
success
success
- success
success
-
p26.pddl
success
success
- success
success
-
p27.pddl
success
success
- success
success
-
p28.pddl
success
success
- success
success
-
p29.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p30.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
parcprinter-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p18.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p19.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
parking-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile03-012.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile04-013.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile04-014.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile04-015.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile04-016.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile05-017.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile05-018.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile05-019.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile05-020.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile06-021.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile06-022.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile06-023.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile06-024.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile07-025.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile07-026.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile07-027.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile07-028.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile08-029.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
pfile08-030.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
parking-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_12_7-02.pddl
success
success
- success
success
-
p_12_7-03.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_12_7-04.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_14_8-01.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_14_8-02.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_14_8-03.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_14_8-04.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_16_9-01.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_16_9-02.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_16_9-03.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_16_9-04.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_18_10-01.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_18_10-02.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_18_10-03.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_18_10-04.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_20_11-01.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_20_11-02.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_20_11-03.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p_20_11-04.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
pathways-noneg
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p09.pddl
success
success
- success
success
-
p10.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p13.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p14.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p15.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p16.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p18.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p19.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p20.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p21.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p22.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p23.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p24.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p25.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p26.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p27.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p28.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p29.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p30.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
pegsol-08-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
p21.pddl
success
success
- success
success
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- success
success
-
p24.pddl
success
success
- success
success
-
p25.pddl
success
success
- success
success
-
p26.pddl
success
success
- success
success
-
p27.pddl
success
success
- success
success
-
p28.pddl
success
success
- success
success
-
p29.pddl
success
success
- success
success
-
p30.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
pegsol-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
petri-net-alignment-opt18-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
pipesworld-notankage
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
success
success
- success
success
-
p02-net1-b6-g4.pddl
success
success
- success
success
-
p03-net1-b8-g3.pddl
success
success
- success
success
-
p04-net1-b8-g5.pddl
success
success
- success
success
-
p05-net1-b10-g4.pddl
success
success
- success
success
-
p06-net1-b10-g6.pddl
success
success
- success
success
-
p07-net1-b12-g5.pddl
success
success
- success
success
-
p08-net1-b12-g7.pddl
success
success
- success
success
-
p09-net1-b14-g6.pddl
success
success
- success
success
-
p10-net1-b14-g8.pddl
success
success
- success
success
-
p11-net2-b10-g2.pddl
success
success
- success
success
-
p12-net2-b10-g4.pddl
success
success
- success
success
-
p13-net2-b12-g3.pddl
success
success
- success
success
-
p14-net2-b12-g5.pddl
success
success
- success
success
-
p15-net2-b14-g4.pddl
success
success
- success
success
-
p16-net2-b14-g6.pddl
success
success
- success
success
-
p17-net2-b16-g5.pddl
success
success
- success
success
-
p18-net2-b16-g7.pddl
success
success
- success
success
-
p19-net2-b18-g6.pddl
success
success
- success
success
-
p20-net2-b18-g8.pddl
success
success
- success
success
-
p21-net3-b12-g2.pddl
success
success
- success
success
-
p22-net3-b12-g4.pddl
success
success
- success
success
-
p23-net3-b14-g3.pddl
success
success
- success
success
-
p24-net3-b14-g5.pddl
success
success
- success
success
-
p25-net3-b16-g5.pddl
success
success
- success
success
-
p26-net3-b16-g7.pddl
success
success
- success
success
-
p27-net3-b18-g6.pddl
success
success
- success
success
-
p28-net3-b18-g7.pddl
success
success
- success
success
-
p29-net3-b20-g6.pddl
success
success
- success
success
-
p30-net3-b20-g8.pddl
success
success
- success
success
-
p31-net4-b14-g3.pddl
success
success
- success
success
-
p32-net4-b14-g5.pddl
success
success
- success
success
-
p33-net4-b16-g5.pddl
success
success
- success
success
-
p34-net4-b16-g6.pddl
success
success
- success
success
-
p35-net4-b18-g4.pddl
success
success
- success
success
-
p36-net4-b18-g6.pddl
success
success
- success
success
-
p37-net4-b20-g5.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p38-net4-b20-g7.pddl
success
success
- success
success
-
p39-net4-b22-g7.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p40-net4-b22-g8.pddl
success
success
- success
success
-
p41-net5-b22-g2.pddl
success
success
- success
success
-
p42-net5-b22-g4.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p43-net5-b24-g3.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p44-net5-b24-g5.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p45-net5-b26-g4.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p46-net5-b26-g6.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p47-net5-b28-g5.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p48-net5-b28-g7.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p49-net5-b30-g6.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p50-net5-b30-g8.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
pipesworld-tankage
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
success
success
- success
success
-
p02-net1-b6-g4-t50.pddl
success
success
- success
success
-
p03-net1-b8-g3-t80.pddl
success
success
- success
success
-
p04-net1-b8-g5-t80.pddl
success
success
- success
success
-
p05-net1-b10-g4-t50.pddl
success
success
- success
success
-
p06-net1-b10-g6-t50.pddl
success
success
- success
success
-
p07-net1-b12-g5-t80.pddl
success
success
- success
success
-
p08-net1-b12-g7-t80.pddl
success
success
- success
success
-
p09-net1-b14-g6-t50.pddl
success
success
- success
success
-
p10-net1-b14-g8-t50.pddl
success
success
- success
success
-
p11-net2-b10-g2-t30.pddl
success
success
- success
success
-
p12-net2-b10-g4-t60.pddl
success
success
- success
success
-
p13-net2-b12-g3-t70.pddl
success
success
- success
success
-
p14-net2-b12-g5-t30.pddl
success
success
- success
success
-
p15-net2-b14-g4-t30.pddl
success
success
- success
success
-
p16-net2-b14-g6-t80.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p17-net2-b16-g5-t20.pddl
success
success
- success
success
-
p18-net2-b16-g7-t60.pddl
success
success
- success
success
-
p19-net2-b18-g6-t60.pddl
success
success
- success
success
-
p20-net2-b18-g8-t90.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p21-net3-b12-g2-t60.pddl
success
success
- success
success
-
p22-net3-b12-g4-t60.pddl
success
success
- success
success
-
p23-net3-b14-g3-t60.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p24-net3-b14-g5-t60.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p25-net3-b16-g5-t60.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p26-net3-b16-g7-t70.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p27-net3-b18-g6-t70.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p28-net3-b18-g7-t70.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p29-net3-b20-g6-t70.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p30-net3-b20-g8-t70.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p31-net4-b14-g3-t20.pddl
success
success
- success
success
-
p32-net4-b14-g5-t30.pddl
success
success
- success
success
-
p33-net4-b16-g5-t60.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p34-net4-b16-g6-t60.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p35-net4-b18-g4-t90.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p36-net4-b18-g6-t90.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p37-net4-b20-g5-t60.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p38-net4-b20-g7-t60.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p39-net4-b22-g7-t50.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p40-net4-b22-g8-t50.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p41-net5-b22-g2-t20.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p42-net5-b22-g4-t50.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p43-net5-b24-g3-t80.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p44-net5-b24-g5-t80.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p45-net5-b26-g4-t50.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p46-net5-b26-g6-t50.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p47-net5-b28-g5-t50.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p48-net5-b28-g7-t50.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p49-net5-b30-g6-t50.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p50-net5-b30-g8-t50.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
psr-small
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
success
success
- success
success
-
p02-s5-n1-l3-f30.pddl
success
success
- success
success
-
p03-s7-n1-l3-f70.pddl
success
success
- success
success
-
p04-s8-n1-l4-f10.pddl
success
success
- success
success
-
p05-s9-n1-l4-f30.pddl
success
success
- success
success
-
p06-s10-n1-l4-f50.pddl
success
success
- success
success
-
p07-s11-n1-l4-f70.pddl
success
success
- success
success
-
p08-s12-n1-l5-f10.pddl
success
success
- success
success
-
p09-s13-n1-l5-f30.pddl
success
success
- success
success
-
p10-s17-n2-l2-f30.pddl
success
success
- success
success
-
p11-s18-n2-l2-f50.pddl
success
success
- success
success
-
p12-s21-n2-l3-f30.pddl
success
success
- success
success
-
p13-s22-n2-l3-f50.pddl
success
success
- success
success
-
p14-s23-n2-l3-f70.pddl
success
success
- success
success
-
p15-s24-n2-l4-f10.pddl
success
success
- success
success
-
p16-s29-n2-l5-f30.pddl
success
success
- success
success
-
p17-s30-n2-l5-f50.pddl
success
success
- success
success
-
p18-s31-n2-l5-f70.pddl
success
success
- success
success
-
p19-s33-n3-l2-f30.pddl
success
success
- success
success
-
p20-s34-n3-l2-f50.pddl
success
success
- success
success
-
p21-s35-n3-l2-f70.pddl
success
success
- success
success
-
p22-s37-n3-l3-f30.pddl
success
success
- success
success
-
p23-s38-n3-l3-f50.pddl
success
success
- success
success
-
p24-s39-n3-l3-f70.pddl
success
success
- success
success
-
p25-s40-n3-l4-f10.pddl
success
success
- success
success
-
p26-s41-n3-l4-f30.pddl
success
success
- success
success
-
p27-s42-n3-l4-f50.pddl
success
success
- success
success
-
p28-s43-n3-l4-f70.pddl
success
success
- success
success
-
p29-s45-n3-l5-f30.pddl
success
success
- success
success
-
p30-s46-n3-l5-f50.pddl
success
success
- success
success
-
p31-s49-n4-l2-f30.pddl
success
success
- success
success
-
p32-s50-n4-l2-f50.pddl
success
success
- success
success
-
p33-s51-n4-l2-f70.pddl
success
success
- success
success
-
p34-s55-n4-l3-f70.pddl
success
success
- success
success
-
p35-s57-n5-l2-f30.pddl
success
success
- success
success
-
p36-s65-n6-l2-f30.pddl
success
success
- success
success
-
p37-s67-n6-l2-f70.pddl
success
success
- success
success
-
p38-s78-n3-l3-f50.pddl
success
success
- success
success
-
p39-s79-n3-l3-f70.pddl
success
success
- success
success
-
p40-s80-n3-l4-f10.pddl
success
success
- success
success
-
p41-s81-n3-l4-f30.pddl
success
success
- success
success
-
p42-s82-n3-l4-f50.pddl
success
success
- success
success
-
p43-s83-n3-l4-f70.pddl
success
success
- success
success
-
p44-s89-n4-l2-f30.pddl
success
success
- success
success
-
p45-s94-n4-l3-f50.pddl
success
success
- success
success
-
p46-s97-n5-l2-f30.pddl
success
success
- success
success
-
p47-s98-n5-l2-f50.pddl
success
success
- success
success
-
p48-s101-n5-l3-f30.pddl
success
success
- success
success
-
p49-s105-n6-l2-f30.pddl
success
success
- success
success
-
p50-s107-n6-l2-f70.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
rovers
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p20.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p21.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p24.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p25.pddl
success
success
- success
success
-
p26.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p27.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p28.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p29.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p30.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p31.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p32.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p33.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p34.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p35.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p36.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p37.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p38.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p39.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p40.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
satellite
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
success
success
- success
success
-
p02-pfile2.pddl
success
success
- success
success
-
p03-pfile3.pddl
success
success
- success
success
-
p04-pfile4.pddl
success
success
- success
success
-
p05-pfile5.pddl
success
success
- success
success
-
p06-pfile6.pddl
success
success
- success
success
-
p07-pfile7.pddl
success
success
- success
success
-
p08-pfile8.pddl
success
success
- success
success
-
p09-pfile9.pddl
success
success
- success
success
-
p10-pfile10.pddl
success
success
- success
success
-
p11-pfile11.pddl
success
success
- success
success
-
p12-pfile12.pddl
success
success
- success
success
-
p13-pfile13.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p14-pfile14.pddl
success
success
- success
success
-
p15-pfile15.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p16-pfile16.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p17-pfile17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p18-pfile18.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p19-pfile19.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p20-pfile20.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p21-HC-pfile1.pddl
success
success
- success
success
-
p22-HC-pfile2.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p23-HC-pfile3.pddl
success
success
- success
success
-
p24-HC-pfile4.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p25-HC-pfile5.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p26-HC-pfile6.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p27-HC-pfile7.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p28-HC-pfile8.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p29-HC-pfile9.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p30-HC-pfile10.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p31-HC-pfile11.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p32-HC-pfile12.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p33-HC-pfile13.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p34-HC-pfile14.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p35-HC-pfile15.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p36-HC-pfile16.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
scanalyzer-08-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
p21.pddl
success
success
- success
success
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- success
success
-
p24.pddl
success
success
- success
success
-
p25.pddl
success
success
- success
success
-
p26.pddl
success
success
- success
success
-
p27.pddl
success
success
- success
success
-
p28.pddl
success
success
- success
success
-
p29.pddl
success
success
- success
success
-
p30.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
scanalyzer-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
snake-opt18-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
search-out-of-time
search-out-of-time
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p14.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p18.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p19.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
sokoban-opt08-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
p21.pddl
success
success
- success
success
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- success
success
-
p24.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p25.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p26.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p27.pddl
success
success
- success
success
-
p28.pddl
success
success
- success
success
-
p29.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p30.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
sokoban-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
spider-opt18-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
storage
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p19.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p20.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p21.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p22.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p23.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p24.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p25.pddl
search-out-of-memory
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p26.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p27.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p28.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p29.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
p30.pddl
search-out-of-time
search-out-of-time
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
termes-opt18-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p10.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
tetris-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
success
success
- success
success
-
p01-8.pddl
success
success
- success
success
-
p01-10.pddl
success
success
- success
success
-
p02-4.pddl
success
success
- success
success
-
p02-6.pddl
success
success
- success
success
-
p02-8.pddl
success
success
- success
success
-
p02-10.pddl
success
success
- success
success
-
p03-4.pddl
success
success
- success
success
-
p03-6.pddl
success
success
- success
success
-
p03-8.pddl
success
success
- success
success
-
p03-10.pddl
success
success
- success
success
-
p04-6.pddl
success
success
- success
success
-
p04-8.pddl
success
success
- success
success
-
p04-10.pddl
success
success
- success
success
-
p05-6.pddl
success
success
- success
success
-
p05-8.pddl
success
success
- success
success
-
p05-10.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
tidybot-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
search-out-of-time
search-out-of-time
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
tidybot-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
search-out-of-time
search-out-of-time
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
tpp
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
p21.pddl
success
success
- success
success
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- success
success
-
p24.pddl
success
success
- success
success
-
p25.pddl
success
success
- success
success
-
p26.pddl
success
success
- success
success
-
p27.pddl
success
success
- success
success
-
p28.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p29.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p30.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
transport-opt08-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
p21.pddl
success
success
- success
success
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- success
success
-
p24.pddl
success
success
- success
success
-
p25.pddl
success
success
- success
success
-
p26.pddl
success
success
- success
success
-
p27.pddl
success
success
- success
success
-
p28.pddl
success
success
- success
success
-
p29.pddl
success
success
- success
success
-
p30.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
transport-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
transport-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
trucks-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p09.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p10.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p11.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p12.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p13.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p14.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p15.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p16.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p18.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p19.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p20.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p21.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p22.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p23.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p24.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p25.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p26.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p27.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p28.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p29.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
p30.pddl
search-out-of-memory
search-out-of-memory
- search-out-of-memory
search-out-of-memory
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
visitall-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
success
success
- success
success
-
problem02-half.pddl
success
success
- success
success
-
problem03-full.pddl
success
success
- success
success
-
problem03-half.pddl
success
success
- success
success
-
problem04-full.pddl
success
success
- success
success
-
problem04-half.pddl
success
success
- success
success
-
problem05-full.pddl
success
success
- success
success
-
problem05-half.pddl
success
success
- success
success
-
problem06-full.pddl
success
success
- success
success
-
problem06-half.pddl
success
success
- success
success
-
problem07-full.pddl
success
success
- success
success
-
problem07-half.pddl
success
success
- success
success
-
problem08-full.pddl
success
success
- success
success
-
problem08-half.pddl
success
success
- success
success
-
problem09-full.pddl
success
success
- success
success
-
problem09-half.pddl
success
success
- success
success
-
problem10-full.pddl
success
success
- success
success
-
problem10-half.pddl
success
success
- success
success
-
problem11-full.pddl
success
success
- success
success
-
problem11-half.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
visitall-opt14-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
success
success
- success
success
-
p-1-6.pddl
success
success
- success
success
-
p-1-7.pddl
success
success
- success
success
-
p-1-8.pddl
success
success
- success
success
-
p-1-9.pddl
success
success
- success
success
-
p-1-10.pddl
success
success
- success
success
-
p-1-11.pddl
success
success
- success
success
-
p-1-12.pddl
success
success
- success
success
-
p-1-13.pddl
success
success
- success
success
-
p-1-14.pddl
success
success
- success
success
-
p-1-15.pddl
success
success
- success
success
-
p-1-16.pddl
success
success
- success
success
-
p-1-17.pddl
success
success
- success
success
-
p-1-18.pddl
success
success
- success
success
-
p-05-5.pddl
success
success
- success
success
-
p-05-6.pddl
success
success
- success
success
-
p-05-7.pddl
success
success
- success
success
-
p-05-8.pddl
success
success
- success
success
-
p-05-9.pddl
success
success
- success
success
-
p-05-10.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
woodworking-opt08-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p09.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
p21.pddl
success
success
- success
success
-
p22.pddl
success
success
- success
success
-
p23.pddl
success
success
- success
success
-
p24.pddl
success
success
- success
success
-
p25.pddl
success
success
- success
success
-
p26.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p27.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p28.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p29.pddl
success
success
- success
success
-
p30.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
woodworking-opt11-strips
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p12.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- search-out-of-memory
search-out-of-memory
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
zenotravel
Show table
error
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
success
success
- success
success
-
p02.pddl
success
success
- success
success
-
p03.pddl
success
success
- success
success
-
p04.pddl
success
success
- success
success
-
p05.pddl
success
success
- success
success
-
p06.pddl
success
success
- success
success
-
p07.pddl
success
success
- success
success
-
p08.pddl
success
success
- success
success
-
p09.pddl
success
success
- success
success
-
p10.pddl
success
success
- success
success
-
p11.pddl
success
success
- success
success
-
p12.pddl
success
success
- success
success
-
p13.pddl
success
success
- success
success
-
p14.pddl
success
success
- success
success
-
p15.pddl
success
success
- success
success
-
p16.pddl
success
success
- success
success
-
p17.pddl
success
success
- success
success
-
p18.pddl
success
success
- success
success
-
p19.pddl
success
success
- success
success
-
p20.pddl
success
success
- success
success
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
evaluations
Show table
Only instances where all algorithms have a value for "evaluations" are considered. Each table entry gives the geometric mean of "evaluations" for that domain. The bottom row reports the geometric mean across all domains.
agricola-opt18-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
236 236 0.0 139641 139641 0.0
p02.pddl
1132 1132 0.0 152426 152426 0.0
p03.pddl
342 342 0.0 162103 162103 0.0
p04.pddl
407 407 0.0 170039 170039 0.0
p05.pddl
301 301 0.0 135138 135138 0.0
p06.pddl
271 271 0.0 254292 254292 0.0
p07.pddl
1619 1619 0.0 150353 150353 0.0
p08.pddl
338 338 0.0 201798 201798 0.0
p09.pddl
333 333 0.0 211320 211320 0.0
p10.pddl
1663 1663 0.0 121733 121733 0.0
p11.pddl
443 443 0.0 180430 180430 0.0
p12.pddl
690 690 0.0 168255 168255 0.0
p13.pddl
520 520 0.0 128801 128801 0.0
p14.pddl
399 399 0.0 150603 150603 0.0
p15.pddl
1440 1440 0.0 213152 213152 0.0
p16.pddl
431 431 0.0 189633 189633 0.0
p17.pddl
520 520 0.0 180217 180217 0.0
p18.pddl
3527 3527 0.0 191705 191705 0.0
p19.pddl
457 457 0.0 141120 141120 0.0
p20.pddl
707 707 0.0 185811 185811 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
airport
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
18 18 0.0 10 10 0.0
p02-airport1-p1.pddl
23 23 0.0 16 16 0.0
p03-airport1-p2.pddl
52 52 0.0 40 40 0.0
p04-airport2-p1.pddl
42 42 0.0 22 22 0.0
p05-airport2-p1.pddl
51 51 0.0 29 29 0.0
p06-airport2-p2.pddl
114 114 0.0 109 109 0.0
p07-airport2-p2.pddl
107 107 0.0 117 117 0.0
p08-airport2-p3.pddl
977 977 0.0 535 535 0.0
p09-airport2-p4.pddl
1380 1380 0.0 10370 10370 0.0
p10-airport3-p1.pddl
38 38 0.0 21 21 0.0
p11-airport3-p1.pddl
51 51 0.0 29 29 0.0
p12-airport3-p2.pddl
219 219 0.0 103 103 0.0
p13-airport3-p2.pddl
114 114 0.0 103 103 0.0
p14-airport3-p3.pddl
7185 7185 0.0 247 247 0.0
p15-airport3-p3.pddl
939 939 0.0 426 426 0.0
p16-airport3-p4.pddl
49639 49639 0.0 14027 14027 0.0
p17-airport3-p5.pddl
14445 14445 0.0 261197 261197 0.0
p18-airport3-p6.pddl
47254 47254 0.0 2112925 2112925 0.0
p19-airport3-p6.pddl
16924 16924 0.0 3261849 3261849 0.0
p20-airport3-p7.pddl
106872 106872 0.0 18085814 18085814 0.0
p21-airport4halfMUC-p2.pddl
991 991 0.0 298 298 0.0
p22-airport4halfMUC-p3.pddl
117999 117999 0.0 687 687 0.0
p23-airport4halfMUC-p4.pddl
172167 172167 0.0 1021 1021 0.0
p24-airport4halfMUC-p4.pddl
134778 134778 0.0 1092 1092 0.0
p25-airport4halfMUC-p5.pddl
163868 163868 0.0 None None -
p26-airport4halfMUC-p6.pddl
None None - None None -
p27-airport4halfMUC-p6.pddl
152057 152057 0.0 None None -
p28-airport4halfMUC-p7.pddl
None None - None None -
p29-airport4halfMUC-p8.pddl
None None - None None -
p30-airport4halfMUC-p8.pddl
None None - None None -
p31-airport4halfMUC-p9.pddl
None None - None None -
p32-airport4halfMUC-p10.pddl
None None - None None -
p33-airport4halfMUC-p10.pddl
None None - None None -
p34-airport4halfMUC-p11.pddl
None None - None None -
p35-airport4halfMUC-p12.pddl
None None - None None -
p36-airport5MUC-p2.pddl
245 245 0.0 928 928 0.0
p37-airport5MUC-p3.pddl
93650 93650 0.0 882803 882803 0.0
p38-airport5MUC-p3.pddl
126491 126491 0.0 103347 103347 0.0
p39-airport5MUC-p4.pddl
136603 136603 0.0 None None -
p40-airport5MUC-p4.pddl
17206 17206 0.0 869773 869773 0.0
p41-airport5MUC-p4.pddl
121916 121916 0.0 None None -
p42-airport5MUC-p5.pddl
None None - None None -
p43-airport5MUC-p5.pddl
138738 138738 0.0 192627 192627 0.0
p44-airport5MUC-p5.pddl
169948 169948 0.0 None None -
p45-airport5MUC-p6.pddl
None None - None None -
p46-airport5MUC-p6.pddl
None None - None None -
p47-airport5MUC-p8.pddl
None None - None None -
p48-airport5MUC-p9.pddl
None None - None None -
p49-airport5MUC-p10.pddl
None None - None None -
p50-airport5MUC-p15.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
1876 1876 0.0 24868 24868 0.0
pfile01-002.pddl
898 898 0.0 19095 19095 0.0
pfile01-003.pddl
904 904 0.0 19045 19045 0.0
pfile01-004.pddl
914 914 0.0 19095 19095 0.0
pfile02-005.pddl
2010 2010 0.0 83075 83075 0.0
pfile02-006.pddl
1449 1449 0.0 805836 805836 0.0
pfile02-007.pddl
1845 1845 0.0 82682 82682 0.0
pfile02-008.pddl
1758 1758 0.0 104229 104229 0.0
pfile03-009.pddl
2654 2654 0.0 310793 310793 0.0
pfile03-010.pddl
4652 4652 0.0 312819 312819 0.0
pfile03-011.pddl
2890 2890 0.0 340527 340527 0.0
pfile03-012.pddl
4322 4322 0.0 340902 340902 0.0
pfile04-013.pddl
5158 5158 0.0 1269596 1269596 0.0
pfile04-014.pddl
5258 5258 0.0 2980322 2980322 0.0
pfile04-015.pddl
7490 7490 0.0 1446961 1446961 0.0
pfile04-016.pddl
7608 7608 0.0 1269098 1269098 0.0
pfile05-017.pddl
6074 6074 0.0 2188426 2188426 0.0
pfile05-018.pddl
6116 6116 0.0 2672606 2672606 0.0
pfile05-019.pddl
6368 6368 0.0 4102600 4102600 0.0
pfile05-020.pddl
5310 5310 0.0 5785853 5785853 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
1985 1985 0.0 805390 805390 0.0
p435-2.pddl
3052 3052 0.0 83968 83968 0.0
p435-3.pddl
1969 1969 0.0 806520 806520 0.0
p536-1.pddl
2788 2788 0.0 7057049 7057049 0.0
p536-2.pddl
4724 4724 0.0 313221 313221 0.0
p536-3.pddl
2652 2652 0.0 310822 310822 0.0
p638-1.pddl
4184 4184 0.0 1270178 1270178 0.0
p638-2.pddl
3106 3106 0.0 2497382 2497382 0.0
p638-3.pddl
5612 5612 0.0 1428078 1428078 0.0
p739-1.pddl
5232 5232 0.0 3682571 3682571 0.0
p739-2.pddl
9492 9492 0.0 4259091 4259091 0.0
p739-3.pddl
6638 6638 0.0 4255704 4255704 0.0
p839-1.pddl
9066 9066 0.0 7547107 7547107 0.0
p839-2.pddl
8242 8242 0.0 6692227 6692227 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
blocks
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
24 24 0.0 14 14 0.0
probBLOCKS-4-1.pddl
26 26 0.0 51 51 0.0
probBLOCKS-4-2.pddl
22 22 0.0 16 16 0.0
probBLOCKS-5-0.pddl
34 34 0.0 49 49 0.0
probBLOCKS-5-1.pddl
36 36 0.0 119 119 0.0
probBLOCKS-5-2.pddl
72 72 0.0 184 184 0.0
probBLOCKS-6-0.pddl
42 42 0.0 252 252 0.0
probBLOCKS-6-1.pddl
50 50 0.0 34 34 0.0
probBLOCKS-6-2.pddl
106 106 0.0 129 129 0.0
probBLOCKS-7-0.pddl
88 88 0.0 1020 1020 0.0
probBLOCKS-7-1.pddl
172 172 0.0 1034 1034 0.0
probBLOCKS-7-2.pddl
166 166 0.0 635 635 0.0
probBLOCKS-8-0.pddl
128 128 0.0 473 473 0.0
probBLOCKS-8-1.pddl
114 114 0.0 1738 1738 0.0
probBLOCKS-8-2.pddl
92 92 0.0 272 272 0.0
probBLOCKS-9-0.pddl
376 376 0.0 2539 2539 0.0
probBLOCKS-9-1.pddl
432 432 0.0 2720 2720 0.0
probBLOCKS-9-2.pddl
180 180 0.0 2252 2252 0.0
probBLOCKS-10-0.pddl
346 346 0.0 347 347 0.0
probBLOCKS-10-1.pddl
354 354 0.0 8714 8714 0.0
probBLOCKS-10-2.pddl
428 428 0.0 4642 4642 0.0
probBLOCKS-11-0.pddl
194 194 0.0 3898 3898 0.0
probBLOCKS-11-1.pddl
410 410 0.0 12259 12259 0.0
probBLOCKS-11-2.pddl
270 270 0.0 2223 2223 0.0
probBLOCKS-12-0.pddl
460 460 0.0 5954 5954 0.0
probBLOCKS-12-1.pddl
468 468 0.0 11313 11313 0.0
probBLOCKS-13-0.pddl
1260 1260 0.0 7260 7260 0.0
probBLOCKS-13-1.pddl
986 986 0.0 7735 7735 0.0
probBLOCKS-14-0.pddl
396 396 0.0 4905 4905 0.0
probBLOCKS-14-1.pddl
590 590 0.0 10102 10102 0.0
probBLOCKS-15-0.pddl
2230 2230 0.0 16412 16412 0.0
probBLOCKS-15-1.pddl
708 708 0.0 146056 146056 0.0
probBLOCKS-16-1.pddl
952 952 0.0 29857 29857 0.0
probBLOCKS-16-2.pddl
5874 5874 0.0 24508 24508 0.0
probBLOCKS-17-0.pddl
6496 6496 0.0 1011732 1011732 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
childsnack-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
328 328 0.0 1173540 1173540 0.0
child-snack_pfile01.pddl
229 229 0.0 1269442 1269442 0.0
child-snack_pfile02-2.pddl
371 371 0.0 5556312 5556312 0.0
child-snack_pfile02.pddl
287 287 0.0 6581086 6581086 0.0
child-snack_pfile03-2.pddl
965 965 0.0 25918333 25918333 0.0
child-snack_pfile03.pddl
709 709 0.0 26000865 26000865 0.0
child-snack_pfile04-2.pddl
600 600 0.0 None None -
child-snack_pfile04.pddl
760 760 0.0 None None -
child-snack_pfile05-2.pddl
903 903 0.0 None None -
child-snack_pfile05.pddl
793 793 0.0 None None -
child-snack_pfile06-2.pddl
758 758 0.0 None None -
child-snack_pfile06.pddl
865 865 0.0 None None -
child-snack_pfile07-2.pddl
925 925 0.0 None None -
child-snack_pfile07.pddl
1327 1327 0.0 None None -
child-snack_pfile08-2.pddl
1146 1146 0.0 None None -
child-snack_pfile08.pddl
None None - None None -
child-snack_pfile09-2.pddl
None None - None None -
child-snack_pfile09.pddl
None None - None None -
child-snack_pfile10-2.pddl
None None - None None -
child-snack_pfile10.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
data-network-opt18-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
78 78 0.0 193 193 0.0
p02.pddl
20 20 0.0 150 150 0.0
p03.pddl
30 30 0.0 1358 1358 0.0
p04.pddl
34 34 0.0 430 430 0.0
p05.pddl
44 44 0.0 2860 2860 0.0
p06.pddl
30 30 0.0 2435 2435 0.0
p07.pddl
298 298 0.0 4366820 4366820 0.0
p08.pddl
8642 8642 0.0 6398 6398 0.0
p09.pddl
78 78 0.0 1128 1128 0.0
p10.pddl
30 30 0.0 425 425 0.0
p11.pddl
26 26 0.0 1463 1463 0.0
p12.pddl
26 26 0.0 1662 1662 0.0
p13.pddl
26 26 0.0 623 623 0.0
p14.pddl
2824 2824 0.0 2648 2648 0.0
p15.pddl
32 32 0.0 4147 4147 0.0
p16.pddl
364 364 0.0 38388 38388 0.0
p17.pddl
28 28 0.0 5542 5542 0.0
p18.pddl
11566 11566 0.0 2118382 2118382 0.0
p19.pddl
62 62 0.0 166728 166728 0.0
p20.pddl
3060 3060 0.0 8911700 8911700 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
depot
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
40 40 0.0 129 129 0.0
p02.pddl
88 88 0.0 229 229 0.0
p03.pddl
7074 7074 0.0 13522 13522 0.0
p04.pddl
3576 3576 0.0 963 963 0.0
p05.pddl
139630 139630 0.0 1438 1438 0.0
p06.pddl
14274392 14274392 0.0 3076 3076 0.0
p07.pddl
1064 1064 0.0 209847 209847 0.0
p08.pddl
13182 13182 0.0 8646 8646 0.0
p09.pddl
58270 58270 0.0 1408238 1408238 0.0
p10.pddl
16066 16066 0.0 6996 6996 0.0
p11.pddl
31712 31712 0.0 9573 9573 0.0
p12.pddl
57930 57930 0.0 None None -
p13.pddl
200 200 0.0 1023 1023 0.0
p14.pddl
1046 1046 0.0 3020909 3020909 0.0
p15.pddl
548058 548058 0.0 29415212 29415212 0.0
p16.pddl
276 276 0.0 3418178 3418178 0.0
p17.pddl
192 192 0.0 81819 81819 0.0
p18.pddl
1282 1282 0.0 None None -
p19.pddl
26370 26370 0.0 44081255 44081255 0.0
p20.pddl
None None - 288990 288990 0.0
p21.pddl
394 394 0.0 15284618 15284618 0.0
p22.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
driverlog
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
22 22 0.0 68 68 0.0
p02.pddl
9472 9472 0.0 844 844 0.0
p03.pddl
52 52 0.0 489 489 0.0
p04.pddl
8670 8670 0.0 2457 2457 0.0
p05.pddl
9388 9388 0.0 17367 17367 0.0
p06.pddl
1128 1128 0.0 390 390 0.0
p07.pddl
86 86 0.0 1599 1599 0.0
p08.pddl
11762 11762 0.0 3903 3903 0.0
p09.pddl
1202 1202 0.0 1979 1979 0.0
p10.pddl
138 138 0.0 2980 2980 0.0
p11.pddl
256 256 0.0 2557 2557 0.0
p12.pddl
13606 13606 0.0 3999 3999 0.0
p13.pddl
6744 6744 0.0 5600 5600 0.0
p14.pddl
362 362 0.0 10620 10620 0.0
p15.pddl
498 498 0.0 108416 108416 0.0
p16.pddl
76416 76416 0.0 548312 548312 0.0
p17.pddl
2958 2958 0.0 None None -
p18.pddl
82566 82566 0.0 2165486 2165486 0.0
p19.pddl
89846 89846 0.0 8696479 8696479 0.0
p20.pddl
39300 39300 0.0 2964949 2964949 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt08-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
132 132 0.0 1682 1682 0.0
p02.pddl
32 32 0.0 1208 1208 0.0
p03.pddl
112 112 0.0 974 974 0.0
p04.pddl
134 134 0.0 12916 12916 0.0
p05.pddl
168 168 0.0 4083 4083 0.0
p06.pddl
250 250 0.0 13142 13142 0.0
p07.pddl
254 254 0.0 3564 3564 0.0
p08.pddl
110 110 0.0 9241 9241 0.0
p09.pddl
442 442 0.0 17972 17972 0.0
p10.pddl
322 322 0.0 17880 17880 0.0
p11.pddl
110 110 0.0 2733 2733 0.0
p12.pddl
134 134 0.0 3492 3492 0.0
p13.pddl
110 110 0.0 1300 1300 0.0
p14.pddl
198 198 0.0 7310 7310 0.0
p15.pddl
202 202 0.0 2307 2307 0.0
p16.pddl
358 358 0.0 24929 24929 0.0
p17.pddl
382 382 0.0 2896 2896 0.0
p18.pddl
214 214 0.0 9066 9066 0.0
p19.pddl
392 392 0.0 7775 7775 0.0
p20.pddl
252 252 0.0 7847 7847 0.0
p21.pddl
94 94 0.0 13986 13986 0.0
p22.pddl
74 74 0.0 40745 40745 0.0
p23.pddl
130 130 0.0 21564 21564 0.0
p24.pddl
234 234 0.0 73377 73377 0.0
p25.pddl
190 190 0.0 13849 13849 0.0
p26.pddl
84 84 0.0 5248 5248 0.0
p27.pddl
430 430 0.0 15314 15314 0.0
p28.pddl
230 230 0.0 21851 21851 0.0
p29.pddl
416 416 0.0 26630 26630 0.0
p30.pddl
464 464 0.0 183835 183835 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
110 110 0.0 2733 2733 0.0
p02.pddl
94 94 0.0 13986 13986 0.0
p03.pddl
134 134 0.0 3492 3492 0.0
p04.pddl
112 112 0.0 974 974 0.0
p05.pddl
110 110 0.0 1300 1300 0.0
p06.pddl
134 134 0.0 12916 12916 0.0
p07.pddl
84 84 0.0 5248 5248 0.0
p08.pddl
168 168 0.0 4083 4083 0.0
p09.pddl
74 74 0.0 40745 40745 0.0
p10.pddl
198 198 0.0 7310 7310 0.0
p11.pddl
230 230 0.0 21851 21851 0.0
p12.pddl
250 250 0.0 13142 13142 0.0
p13.pddl
254 254 0.0 3564 3564 0.0
p14.pddl
110 110 0.0 9241 9241 0.0
p15.pddl
442 442 0.0 17972 17972 0.0
p16.pddl
202 202 0.0 2307 2307 0.0
p17.pddl
382 382 0.0 2896 2896 0.0
p18.pddl
214 214 0.0 9066 9066 0.0
p19.pddl
130 130 0.0 21564 21564 0.0
p20.pddl
234 234 0.0 73377 73377 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
4194 4194 0.0 690567 690567 0.0
opt-p01-002.pddl
209 209 0.0 422081 422081 0.0
opt-p02-003.pddl
1891096 1891096 0.0 None None -
opt-p02-004.pddl
1028219 1028219 0.0 None None -
opt-p03-005.pddl
1482914 1482914 0.0 None None -
opt-p03-006.pddl
10281063 10281063 0.0 None None -
opt-p04-007.pddl
16409493 16409493 0.0 None None -
opt-p04-008.pddl
41092929 41092929 0.0 None None -
opt-p05-009.pddl
8928256 8928256 0.0 None None -
opt-p05-010.pddl
None None - None None -
opt-p06-011.pddl
None None - None None -
opt-p06-012.pddl
None None - None None -
opt-p07-013.pddl
None None - None None -
opt-p07-014.pddl
None None - None None -
opt-p08-015.pddl
None None - None None -
opt-p08-016.pddl
None None - None None -
opt-p09-017.pddl
None None - None None -
opt-p09-018.pddl
None None - None None -
opt-p10-019.pddl
None None - None None -
opt-p10-020.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
1305916 1305916 0.0 None None -
p01-4-4-2.pddl
23066149 23066149 0.0 None None -
p01-5-3-2.pddl
17779476 17779476 0.0 None None -
p01-5-4-2.pddl
None None - None None -
p01-5-5-2.pddl
None None - None None -
p01-6-4-2.pddl
None None - None None -
p01-6-5-2.pddl
None None - None None -
p02-4-4-2.pddl
27342613 27342613 0.0 None None -
p02-5-3-2.pddl
8781052 8781052 0.0 None None -
p02-5-4-2.pddl
None None - None None -
p02-5-5-2.pddl
None None - None None -
p02-6-4-2.pddl
None None - None None -
p02-6-5-2.pddl
None None - None None -
p03-4-3-2.pddl
1564839 1564839 0.0 None None -
p03-4-4-2.pddl
19885195 19885195 0.0 None None -
p03-5-3-2.pddl
9772134 9772134 0.0 None None -
p03-5-4-2.pddl
20311366 20311366 0.0 None None -
p03-5-5-2.pddl
None None - None None -
p03-6-4-2.pddl
None None - None None -
p03-6-5-2.pddl
None None - None None -
Sum of diffs
0.00
None
Arithmetic mean of diffs
0.00
None
freecell
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
18 18 0.0 49 49 0.0
p02.pddl
32 32 0.0 94 94 0.0
p03.pddl
40 40 0.0 151 151 0.0
p04.pddl
138 138 0.0 205 205 0.0
p05.pddl
82 82 0.0 231 231 0.0
p06.pddl
158 158 0.0 308 308 0.0
p07.pddl
2276 2276 0.0 2809 2809 0.0
p08.pddl
166 166 0.0 439 439 0.0
p09.pddl
188 188 0.0 394 394 0.0
p10.pddl
1061 1061 0.0 730 730 0.0
p11.pddl
6042 6042 0.0 3746 3746 0.0
p12.pddl
180 180 0.0 412 412 0.0
p13.pddl
6535 6535 0.0 874 874 0.0
p14.pddl
294 294 0.0 1463 1463 0.0
p15.pddl
657 657 0.0 757 757 0.0
p16.pddl
574 574 0.0 1784 1784 0.0
p17.pddl
431 431 0.0 728 728 0.0
p18.pddl
2404 2404 0.0 35630 35630 0.0
p19.pddl
27971 27971 0.0 34023 34023 0.0
p20.pddl
1157 1157 0.0 21798 21798 0.0
probfreecell-2-1.pddl
20 20 0.0 54 54 0.0
probfreecell-2-2.pddl
18 18 0.0 75 75 0.0
probfreecell-2-3.pddl
18 18 0.0 66 66 0.0
probfreecell-2-4.pddl
18 18 0.0 77 77 0.0
probfreecell-2-5.pddl
20 20 0.0 64 64 0.0
probfreecell-3-1.pddl
30 30 0.0 105 105 0.0
probfreecell-3-2.pddl
28 28 0.0 137 137 0.0
probfreecell-3-3.pddl
28 28 0.0 126 126 0.0
probfreecell-3-4.pddl
26 26 0.0 149 149 0.0
probfreecell-3-5.pddl
30 30 0.0 132 132 0.0
probfreecell-4-1.pddl
44 44 0.0 192 192 0.0
probfreecell-4-2.pddl
36 36 0.0 190 190 0.0
probfreecell-4-3.pddl
38 38 0.0 185 185 0.0
probfreecell-4-4.pddl
40 40 0.0 221 221 0.0
probfreecell-4-5.pddl
40 40 0.0 196 196 0.0
probfreecell-5-1.pddl
72 72 0.0 337 337 0.0
probfreecell-5-2.pddl
56 56 0.0 290 290 0.0
probfreecell-5-3.pddl
52 52 0.0 250 250 0.0
probfreecell-5-4.pddl
56 56 0.0 305 305 0.0
probfreecell-5-5.pddl
60 60 0.0 274 274 0.0
probfreecell-6-1.pddl
92 92 0.0 366 366 0.0
probfreecell-6-2.pddl
60 60 0.0 356 356 0.0
probfreecell-6-3.pddl
70 70 0.0 366 366 0.0
probfreecell-6-4.pddl
74 74 0.0 371 371 0.0
probfreecell-6-5.pddl
102 102 0.0 402 402 0.0
probfreecell-7-1.pddl
148 148 0.0 488 488 0.0
probfreecell-7-2.pddl
74 74 0.0 375 375 0.0
probfreecell-7-3.pddl
144 144 0.0 505 505 0.0
probfreecell-7-4.pddl
172 172 0.0 509 509 0.0
probfreecell-7-5.pddl
132 132 0.0 558 558 0.0
probfreecell-8-1.pddl
312 312 0.0 444 444 0.0
probfreecell-8-2.pddl
148 148 0.0 552 552 0.0
probfreecell-8-3.pddl
182 182 0.0 491 491 0.0
probfreecell-8-4.pddl
168 168 0.0 541 541 0.0
probfreecell-8-5.pddl
290 290 0.0 719 719 0.0
probfreecell-9-1.pddl
328 328 0.0 734 734 0.0
probfreecell-9-2.pddl
228 228 0.0 750 750 0.0
probfreecell-9-3.pddl
192 192 0.0 597 597 0.0
probfreecell-9-4.pddl
290 290 0.0 637 637 0.0
probfreecell-9-5.pddl
336 336 0.0 902 902 0.0
probfreecell-10-1.pddl
3698 3698 0.0 3049 3049 0.0
probfreecell-10-2.pddl
294 294 0.0 1503 1503 0.0
probfreecell-10-3.pddl
386 386 0.0 6068 6068 0.0
probfreecell-10-4.pddl
459 459 0.0 5147 5147 0.0
probfreecell-10-5.pddl
1206 1206 0.0 1124 1124 0.0
probfreecell-11-1.pddl
543 543 0.0 18240 18240 0.0
probfreecell-11-2.pddl
760 760 0.0 42843 42843 0.0
probfreecell-11-3.pddl
540 540 0.0 8584 8584 0.0
probfreecell-11-4.pddl
593 593 0.0 1224 1224 0.0
probfreecell-11-5.pddl
None None - 1506 1506 0.0
probfreecell-12-1.pddl
34627 34627 0.0 28694 28694 0.0
probfreecell-12-2.pddl
1527 1527 0.0 7921 7921 0.0
probfreecell-12-3.pddl
360 360 0.0 4582 4582 0.0
probfreecell-12-4.pddl
962 962 0.0 11105 11105 0.0
probfreecell-12-5.pddl
1318962 1318962 0.0 16142 16142 0.0
probfreecell-13-1.pddl
70760 70760 0.0 24870 24870 0.0
probfreecell-13-2.pddl
33276 33276 0.0 28115 28115 0.0
probfreecell-13-3.pddl
907 907 0.0 6081 6081 0.0
probfreecell-13-4.pddl
9039 9039 0.0 5536 5536 0.0
probfreecell-13-5.pddl
1095254 1095254 0.0 584701 584701 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
ged-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
6 6 0.0 7 7 0.0
d-1-3.pddl
26 26 0.0 65 65 0.0
d-1-4.pddl
6 6 0.0 7 7 0.0
d-1-8.pddl
52 52 0.0 95 95 0.0
d-2-1.pddl
6 6 0.0 7 7 0.0
d-2-3.pddl
26 26 0.0 47 47 0.0
d-2-4.pddl
32 32 0.0 33 33 0.0
d-2-8.pddl
56 56 0.0 131 131 0.0
d-3-1.pddl
30 30 0.0 65 65 0.0
d-3-2.pddl
28 28 0.0 47 47 0.0
d-3-4.pddl
68 68 0.0 121 121 0.0
d-4-2.pddl
30 30 0.0 33 33 0.0
d-4-3.pddl
64 64 0.0 122 122 0.0
d-4-8.pddl
56 56 0.0 131 131 0.0
d-7-5.pddl
62 62 0.0 99 99 0.0
d-7-6.pddl
54 54 0.0 74 74 0.0
d-8-1.pddl
54 54 0.0 101 101 0.0
d-8-2.pddl
54 54 0.0 137 137 0.0
d-8-4.pddl
60 60 0.0 135 135 0.0
d-8-9.pddl
172 172 0.0 211 211 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
grid
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
38 38 0.0 116 116 0.0
prob02.pddl
118 118 0.0 2258 2258 0.0
prob03.pddl
454 454 0.0 None None -
prob04.pddl
252 252 0.0 2282 2282 0.0
prob05.pddl
1182 1182 0.0 2060964 2060964 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
gripper
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
34 34 0.0 66 66 0.0
prob02.pddl
52 52 0.0 167 167 0.0
prob03.pddl
70 70 0.0 336 336 0.0
prob04.pddl
88 88 0.0 589 589 0.0
prob05.pddl
106 106 0.0 942 942 0.0
prob06.pddl
124 124 0.0 1411 1411 0.0
prob07.pddl
142 142 0.0 2012 2012 0.0
prob08.pddl
160 160 0.0 2761 2761 0.0
prob09.pddl
178 178 0.0 3674 3674 0.0
prob10.pddl
196 196 0.0 4767 4767 0.0
prob11.pddl
214 214 0.0 6056 6056 0.0
prob12.pddl
232 232 0.0 7557 7557 0.0
prob13.pddl
250 250 0.0 9286 9286 0.0
prob14.pddl
268 268 0.0 11259 11259 0.0
prob15.pddl
286 286 0.0 13492 13492 0.0
prob16.pddl
304 304 0.0 16001 16001 0.0
prob17.pddl
322 322 0.0 18802 18802 0.0
prob18.pddl
340 340 0.0 21911 21911 0.0
prob19.pddl
358 358 0.0 25344 25344 0.0
prob20.pddl
376 376 0.0 29117 29117 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
hiking-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
277 277 0.0 540 540 0.0
ptesting-1-2-4.pddl
1684 1684 0.0 2593 2593 0.0
ptesting-1-2-5.pddl
5669 5669 0.0 7829 7829 0.0
ptesting-1-2-7.pddl
22663 22663 0.0 47660 47660 0.0
ptesting-1-2-8.pddl
38798 38798 0.0 96286 96286 0.0
ptesting-2-2-3.pddl
40 40 0.0 9791 9791 0.0
ptesting-2-2-4.pddl
5670 5670 0.0 92260 92260 0.0
ptesting-2-2-5.pddl
13756 13756 0.0 253324 253324 0.0
ptesting-2-2-6.pddl
22811 22811 0.0 334572 334572 0.0
ptesting-2-2-7.pddl
48110 48110 0.0 977545 977545 0.0
ptesting-2-2-8.pddl
51375 51375 0.0 968823 968823 0.0
ptesting-2-3-4.pddl
7892 7892 0.0 91446 91446 0.0
ptesting-2-3-5.pddl
15233 15233 0.0 310922 310922 0.0
ptesting-2-3-6.pddl
27491 27491 0.0 920370 920370 0.0
ptesting-2-3-7.pddl
51977 51977 0.0 1063015 1063015 0.0
ptesting-2-4-3.pddl
34 34 0.0 24453 24453 0.0
ptesting-2-4-4.pddl
8275 8275 0.0 140868 140868 0.0
ptesting-2-4-5.pddl
22567 22567 0.0 442931 442931 0.0
ptesting-2-4-6.pddl
26114 26114 0.0 1088481 1088481 0.0
ptesting-2-4-7.pddl
47390 47390 0.0 2665275 2665275 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics00
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
70 70 0.0 180 180 0.0
probLOGISTICS-4-1.pddl
80 80 0.0 135 135 0.0
probLOGISTICS-4-2.pddl
60 60 0.0 96 96 0.0
probLOGISTICS-5-0.pddl
116 116 0.0 242 242 0.0
probLOGISTICS-5-1.pddl
56 56 0.0 143 143 0.0
probLOGISTICS-5-2.pddl
24 24 0.0 50 50 0.0
probLOGISTICS-6-0.pddl
106 106 0.0 231 231 0.0
probLOGISTICS-6-1.pddl
58 58 0.0 132 132 0.0
probLOGISTICS-6-2.pddl
112 112 0.0 233 233 0.0
probLOGISTICS-6-9.pddl
124 124 0.0 213 213 0.0
probLOGISTICS-7-0.pddl
204 204 0.0 566 566 0.0
probLOGISTICS-7-1.pddl
350 350 0.0 734 734 0.0
probLOGISTICS-8-0.pddl
148 148 0.0 492 492 0.0
probLOGISTICS-8-1.pddl
260 260 0.0 828 828 0.0
probLOGISTICS-9-0.pddl
206 206 0.0 738 738 0.0
probLOGISTICS-9-1.pddl
136 136 0.0 532 532 0.0
probLOGISTICS-10-0.pddl
374 374 0.0 1159 1159 0.0
probLOGISTICS-10-1.pddl
258 258 0.0 1139 1139 0.0
probLOGISTICS-11-0.pddl
326 326 0.0 1465 1465 0.0
probLOGISTICS-11-1.pddl
586 586 0.0 1700 1700 0.0
probLOGISTICS-12-0.pddl
302 302 0.0 1181 1181 0.0
probLOGISTICS-12-1.pddl
636 636 0.0 2384 2384 0.0
probLOGISTICS-13-0.pddl
1084 1084 0.0 25821 25821 0.0
probLOGISTICS-13-1.pddl
886 886 0.0 23302 23302 0.0
probLOGISTICS-14-0.pddl
604 604 0.0 29319 29319 0.0
probLOGISTICS-14-1.pddl
840 840 0.0 40352 40352 0.0
probLOGISTICS-15-0.pddl
1254 1254 0.0 41695 41695 0.0
probLOGISTICS-15-1.pddl
736 736 0.0 56998 56998 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics98
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
174 174 0.0 17222 17222 0.0
prob02.pddl
302 302 0.0 251816 251816 0.0
prob03.pddl
406 406 0.0 6902005 6902005 0.0
prob04.pddl
942 942 0.0 None None -
prob05.pddl
122 122 0.0 5185 5185 0.0
prob06.pddl
1920 1920 0.0 None None -
prob07.pddl
382 382 0.0 1405732 1405732 0.0
prob08.pddl
382 382 0.0 None None -
prob09.pddl
2556 2556 0.0 None None -
prob10.pddl
3384 3384 0.0 29579787 29579787 0.0
prob11.pddl
176 176 0.0 1760353 1760353 0.0
prob12.pddl
426 426 0.0 None None -
prob13.pddl
1244 1244 0.0 None None -
prob14.pddl
2904 2904 0.0 None None -
prob15.pddl
2216 2216 0.0 1814234 1814234 0.0
prob16.pddl
618 618 0.0 None None -
prob17.pddl
328 328 0.0 None None -
prob18.pddl
10480 10480 0.0 None None -
prob19.pddl
5924 5924 0.0 None None -
prob20.pddl
10174 10174 0.0 None None -
prob21.pddl
3148 3148 0.0 None None -
prob22.pddl
76634 76634 0.0 None None -
prob23.pddl
3416 3416 0.0 37407313 37407313 0.0
prob24.pddl
494 494 0.0 None None -
prob25.pddl
14486 14486 0.0 None None -
prob26.pddl
19680 19680 0.0 None None -
prob27.pddl
12034 12034 0.0 None None -
prob28.pddl
94824 94824 0.0 None None -
prob29.pddl
31800 31800 0.0 None None -
prob30.pddl
8754 8754 0.0 None None -
prob31.pddl
42 42 0.0 1720 1720 0.0
prob32.pddl
92 92 0.0 1053 1053 0.0
prob33.pddl
114 114 0.0 4598 4598 0.0
prob34.pddl
806 806 0.0 502107 502107 0.0
prob35.pddl
126 126 0.0 37942 37942 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
miconic
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
10 10 0.0 5 5 0.0
s1-1.pddl
8 8 0.0 5 5 0.0
s1-2.pddl
10 10 0.0 5 5 0.0
s1-3.pddl
10 10 0.0 5 5 0.0
s1-4.pddl
10 10 0.0 5 5 0.0
s2-0.pddl
20 20 0.0 20 20 0.0
s2-1.pddl
20 20 0.0 18 18 0.0
s2-2.pddl
20 20 0.0 18 18 0.0
s2-3.pddl
16 16 0.0 18 18 0.0
s2-4.pddl
26 26 0.0 18 18 0.0
s3-0.pddl
38 38 0.0 40 40 0.0
s3-1.pddl
42 42 0.0 39 39 0.0
s3-2.pddl
40 40 0.0 40 40 0.0
s3-3.pddl
34 34 0.0 39 39 0.0
s3-4.pddl
36 36 0.0 40 40 0.0
s4-0.pddl
44 44 0.0 71 71 0.0
s4-1.pddl
42 42 0.0 71 71 0.0
s4-2.pddl
74 74 0.0 70 70 0.0
s4-3.pddl
84 84 0.0 67 67 0.0
s4-4.pddl
86 86 0.0 66 66 0.0
s5-0.pddl
98 98 0.0 107 107 0.0
s5-1.pddl
98 98 0.0 105 105 0.0
s5-2.pddl
68 68 0.0 111 111 0.0
s5-3.pddl
58 58 0.0 119 119 0.0
s5-4.pddl
106 106 0.0 105 105 0.0
s6-0.pddl
120 120 0.0 169 169 0.0
s6-1.pddl
70 70 0.0 162 162 0.0
s6-2.pddl
132 132 0.0 156 156 0.0
s6-3.pddl
104 104 0.0 159 159 0.0
s6-4.pddl
128 128 0.0 169 169 0.0
s7-0.pddl
106 106 0.0 229 229 0.0
s7-1.pddl
180 180 0.0 222 222 0.0
s7-2.pddl
88 88 0.0 230 230 0.0
s7-3.pddl
136 136 0.0 209 209 0.0
s7-4.pddl
166 166 0.0 199 199 0.0
s8-0.pddl
134 134 0.0 288 288 0.0
s8-1.pddl
186 186 0.0 324 324 0.0
s8-2.pddl
222 222 0.0 298 298 0.0
s8-3.pddl
216 216 0.0 267 267 0.0
s8-4.pddl
168 168 0.0 270 270 0.0
s9-0.pddl
254 254 0.0 355 355 0.0
s9-1.pddl
262 262 0.0 369 369 0.0
s9-2.pddl
248 248 0.0 378 378 0.0
s9-3.pddl
218 218 0.0 339 339 0.0
s9-4.pddl
176 176 0.0 385 385 0.0
s10-0.pddl
288 288 0.0 465 465 0.0
s10-1.pddl
252 252 0.0 482 482 0.0
s10-2.pddl
288 288 0.0 488 488 0.0
s10-3.pddl
208 208 0.0 445 445 0.0
s10-4.pddl
258 258 0.0 466 466 0.0
s11-0.pddl
350 350 0.0 600 600 0.0
s11-1.pddl
264 264 0.0 563 563 0.0
s11-2.pddl
410 410 0.0 518 518 0.0
s11-3.pddl
338 338 0.0 535 535 0.0
s11-4.pddl
318 318 0.0 548 548 0.0
s12-0.pddl
224 224 0.0 653 653 0.0
s12-1.pddl
402 402 0.0 711 711 0.0
s12-2.pddl
398 398 0.0 707 707 0.0
s12-3.pddl
362 362 0.0 688 688 0.0
s12-4.pddl
464 464 0.0 625 625 0.0
s13-0.pddl
518 518 0.0 788 788 0.0
s13-1.pddl
424 424 0.0 740 740 0.0
s13-2.pddl
510 510 0.0 706 706 0.0
s13-3.pddl
382 382 0.0 757 757 0.0
s13-4.pddl
374 374 0.0 787 787 0.0
s14-0.pddl
386 386 0.0 859 859 0.0
s14-1.pddl
528 528 0.0 906 906 0.0
s14-2.pddl
528 528 0.0 905 905 0.0
s14-3.pddl
420 420 0.0 1002 1002 0.0
s14-4.pddl
484 484 0.0 913 913 0.0
s15-0.pddl
478 478 0.0 1046 1046 0.0
s15-1.pddl
768 768 0.0 1084 1084 0.0
s15-2.pddl
658 658 0.0 998 998 0.0
s15-3.pddl
600 600 0.0 1058 1058 0.0
s15-4.pddl
592 592 0.0 1040 1040 0.0
s16-0.pddl
640 640 0.0 1167 1167 0.0
s16-1.pddl
618 618 0.0 1148 1148 0.0
s16-2.pddl
816 816 0.0 1149 1149 0.0
s16-3.pddl
680 680 0.0 1203 1203 0.0
s16-4.pddl
688 688 0.0 1129 1129 0.0
s17-0.pddl
800 800 0.0 1321 1321 0.0
s17-1.pddl
646 646 0.0 1323 1323 0.0
s17-2.pddl
782 782 0.0 1444 1444 0.0
s17-3.pddl
872 872 0.0 1226 1226 0.0
s17-4.pddl
642 642 0.0 1323 1323 0.0
s18-0.pddl
788 788 0.0 1585 1585 0.0
s18-1.pddl
732 732 0.0 1534 1534 0.0
s18-2.pddl
828 828 0.0 1551 1551 0.0
s18-3.pddl
932 932 0.0 1554 1554 0.0
s18-4.pddl
816 816 0.0 1516 1516 0.0
s19-0.pddl
1008 1008 0.0 1836 1836 0.0
s19-1.pddl
912 912 0.0 1648 1648 0.0
s19-2.pddl
1004 1004 0.0 1619 1619 0.0
s19-3.pddl
1074 1074 0.0 1645 1645 0.0
s19-4.pddl
972 972 0.0 1676 1676 0.0
s20-0.pddl
978 978 0.0 1883 1883 0.0
s20-1.pddl
1052 1052 0.0 1845 1845 0.0
s20-2.pddl
966 966 0.0 1903 1903 0.0
s20-3.pddl
922 922 0.0 2017 2017 0.0
s20-4.pddl
950 950 0.0 1895 1895 0.0
s21-0.pddl
1226 1226 0.0 1950 1950 0.0
s21-1.pddl
1148 1148 0.0 2201 2201 0.0
s21-2.pddl
836 836 0.0 2095 2095 0.0
s21-3.pddl
992 992 0.0 2010 2010 0.0
s21-4.pddl
860 860 0.0 2094 2094 0.0
s22-0.pddl
1382 1382 0.0 2222 2222 0.0
s22-1.pddl
1298 1298 0.0 2384 2384 0.0
s22-2.pddl
1270 1270 0.0 2388 2388 0.0
s22-3.pddl
1286 1286 0.0 2146 2146 0.0
s22-4.pddl
1176 1176 0.0 2174 2174 0.0
s23-0.pddl
1478 1478 0.0 2521 2521 0.0
s23-1.pddl
1266 1266 0.0 2402 2402 0.0
s23-2.pddl
1160 1160 0.0 2578 2578 0.0
s23-3.pddl
1172 1172 0.0 2507 2507 0.0
s23-4.pddl
1242 1242 0.0 2439 2439 0.0
s24-0.pddl
1272 1272 0.0 2664 2664 0.0
s24-1.pddl
1396 1396 0.0 2714 2714 0.0
s24-2.pddl
1484 1484 0.0 2648 2648 0.0
s24-3.pddl
1420 1420 0.0 2684 2684 0.0
s24-4.pddl
1460 1460 0.0 2714 2714 0.0
s25-0.pddl
1494 1494 0.0 3024 3024 0.0
s25-1.pddl
1790 1790 0.0 2903 2903 0.0
s25-2.pddl
1338 1338 0.0 3129 3129 0.0
s25-3.pddl
1716 1716 0.0 2934 2934 0.0
s25-4.pddl
1744 1744 0.0 2961 2961 0.0
s26-0.pddl
1808 1808 0.0 3117 3117 0.0
s26-1.pddl
1604 1604 0.0 3267 3267 0.0
s26-2.pddl
2026 2026 0.0 3109 3109 0.0
s26-3.pddl
1810 1810 0.0 3102 3102 0.0
s26-4.pddl
1470 1470 0.0 3288 3288 0.0
s27-0.pddl
2052 2052 0.0 3318 3318 0.0
s27-1.pddl
1724 1724 0.0 3480 3480 0.0
s27-2.pddl
2056 2056 0.0 3490 3490 0.0
s27-3.pddl
1804 1804 0.0 3460 3460 0.0
s27-4.pddl
1880 1880 0.0 3543 3543 0.0
s28-0.pddl
2242 2242 0.0 3719 3719 0.0
s28-1.pddl
1972 1972 0.0 3644 3644 0.0
s28-2.pddl
2186 2186 0.0 3580 3580 0.0
s28-3.pddl
1598 1598 0.0 3978 3978 0.0
s28-4.pddl
1962 1962 0.0 3537 3537 0.0
s29-0.pddl
1974 1974 0.0 3923 3923 0.0
s29-1.pddl
1838 1838 0.0 4019 4019 0.0
s29-2.pddl
2148 2148 0.0 4092 4092 0.0
s29-3.pddl
2438 2438 0.0 4063 4063 0.0
s29-4.pddl
2542 2542 0.0 3911 3911 0.0
s30-0.pddl
1954 1954 0.0 4206 4206 0.0
s30-1.pddl
2184 2184 0.0 4327 4327 0.0
s30-2.pddl
2084 2084 0.0 4361 4361 0.0
s30-3.pddl
2526 2526 0.0 4104 4104 0.0
s30-4.pddl
2310 2310 0.0 4113 4113 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
movie
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
18 18 0.0 29 29 0.0
prob02.pddl
18 18 0.0 29 29 0.0
prob03.pddl
18 18 0.0 29 29 0.0
prob04.pddl
18 18 0.0 29 29 0.0
prob05.pddl
18 18 0.0 29 29 0.0
prob06.pddl
18 18 0.0 29 29 0.0
prob07.pddl
18 18 0.0 29 29 0.0
prob08.pddl
18 18 0.0 29 29 0.0
prob09.pddl
18 18 0.0 29 29 0.0
prob10.pddl
18 18 0.0 29 29 0.0
prob11.pddl
18 18 0.0 29 29 0.0
prob12.pddl
18 18 0.0 29 29 0.0
prob13.pddl
18 18 0.0 29 29 0.0
prob14.pddl
18 18 0.0 29 29 0.0
prob15.pddl
18 18 0.0 29 29 0.0
prob16.pddl
18 18 0.0 29 29 0.0
prob17.pddl
18 18 0.0 29 29 0.0
prob18.pddl
18 18 0.0 29 29 0.0
prob19.pddl
18 18 0.0 29 29 0.0
prob20.pddl
18 18 0.0 29 29 0.0
prob21.pddl
18 18 0.0 29 29 0.0
prob22.pddl
18 18 0.0 29 29 0.0
prob23.pddl
18 18 0.0 29 29 0.0
prob24.pddl
18 18 0.0 29 29 0.0
prob25.pddl
18 18 0.0 29 29 0.0
prob26.pddl
18 18 0.0 29 29 0.0
prob27.pddl
18 18 0.0 29 29 0.0
prob28.pddl
18 18 0.0 29 29 0.0
prob29.pddl
18 18 0.0 29 29 0.0
prob30.pddl
18 18 0.0 29 29 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mprime
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
16 16 0.0 259 259 0.0
prob02.pddl
72 72 0.0 1777077 1777077 0.0
prob03.pddl
16 16 0.0 128245 128245 0.0
prob04.pddl
28 28 0.0 1634 1634 0.0
prob05.pddl
46 46 0.0 2003555 2003555 0.0
prob06.pddl
860 860 0.0 None None -
prob07.pddl
24 24 0.0 84999 84999 0.0
prob08.pddl
64 64 0.0 None None -
prob09.pddl
80 80 0.0 134168 134168 0.0
prob10.pddl
38 38 0.0 None None -
prob11.pddl
32 32 0.0 281 281 0.0
prob12.pddl
74 74 0.0 966261 966261 0.0
prob13.pddl
152 152 0.0 None None -
prob14.pddl
122 122 0.0 None None -
prob15.pddl
118 118 0.0 None None -
prob16.pddl
26 26 0.0 950028 950028 0.0
prob17.pddl
16 16 0.0 11132987 11132987 0.0
prob18.pddl
416 416 0.0 None None -
prob19.pddl
194 194 0.0 None None -
prob20.pddl
86 86 0.0 None None -
prob21.pddl
684 684 0.0 8157312 8157312 0.0
prob22.pddl
172 172 0.0 None None -
prob23.pddl
168 168 0.0 None None -
prob24.pddl
56 56 0.0 None None -
prob25.pddl
14 14 0.0 931 931 0.0
prob26.pddl
28 28 0.0 11944555 11944555 0.0
prob27.pddl
26 26 0.0 24996 24996 0.0
prob28.pddl
30 30 0.0 242 242 0.0
prob29.pddl
16 16 0.0 59906 59906 0.0
prob30.pddl
46 46 0.0 None None -
prob31.pddl
36 36 0.0 38578 38578 0.0
prob32.pddl
30 30 0.0 364694 364694 0.0
prob33.pddl
302 302 0.0 None None -
prob34.pddl
20 20 0.0 56055 56055 0.0
prob35.pddl
24 24 0.0 21988 21988 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mystery
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
16 16 0.0 21 21 0.0
prob02.pddl
1049 1049 0.0 197688 197688 0.0
prob03.pddl
14 14 0.0 2395 2395 0.0
prob04.pddl
22248778 22248778 0.0 38254137 38254137 0.0
prob05.pddl
None None - None None -
prob06.pddl
56105 56105 0.0 None None -
prob07.pddl
1 1 0.0 None None -
prob08.pddl
None None - None None -
prob09.pddl
7501531 7501531 0.0 12449 12449 0.0
prob10.pddl
36 36 0.0 None None -
prob11.pddl
31 31 0.0 33 33 0.0
prob12.pddl
1699224 1699224 0.0 2102777 2102777 0.0
prob13.pddl
207 207 0.0 None None -
prob14.pddl
122 122 0.0 None None -
prob15.pddl
126 126 0.0 5289649 5289649 0.0
prob16.pddl
None None - None None -
prob17.pddl
16 16 0.0 58446 58446 0.0
prob18.pddl
1 1 0.0 None None -
prob19.pddl
1460 1460 0.0 703188 703188 0.0
prob20.pddl
64 64 0.0 15967487 15967487 0.0
prob21.pddl
None None - None None -
prob22.pddl
None None - None None -
prob23.pddl
None None - None None -
prob24.pddl
None None - None None -
prob25.pddl
14 14 0.0 216 216 0.0
prob26.pddl
20 20 0.0 50091 50091 0.0
prob27.pddl
24 24 0.0 1115 1115 0.0
prob28.pddl
30 30 0.0 41 41 0.0
prob29.pddl
20 20 0.0 1147 1147 0.0
prob30.pddl
64 64 0.0 171905 171905 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
nomystery-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
91 91 0.0 1022 1022 0.0
p02.pddl
56 56 0.0 77 77 0.0
p03.pddl
65 65 0.0 110 110 0.0
p04.pddl
127 127 0.0 236407 236407 0.0
p05.pddl
204 204 0.0 18123484 18123484 0.0
p06.pddl
241 241 0.0 None None -
p07.pddl
184 184 0.0 None None -
p08.pddl
264 264 0.0 None None -
p09.pddl
254 254 0.0 659 659 0.0
p10.pddl
384 384 0.0 None None -
p11.pddl
320 320 0.0 344 344 0.0
p12.pddl
4852 4852 0.0 13472 13472 0.0
p13.pddl
260 260 0.0 33679 33679 0.0
p14.pddl
15130 15130 0.0 393405 393405 0.0
p15.pddl
597 597 0.0 327105 327105 0.0
p16.pddl
None None - None None -
p17.pddl
4051 4051 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
969 969 0.0 None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt08-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
38 38 0.0 52 52 0.0
p02.pddl
42 42 0.0 60 60 0.0
p03.pddl
48 48 0.0 79 79 0.0
p04.pddl
56 56 0.0 99 99 0.0
p05.pddl
64 64 0.0 138 138 0.0
p06.pddl
70 70 0.0 143 143 0.0
p07.pddl
82 82 0.0 173 173 0.0
p08.pddl
90 90 0.0 206 206 0.0
p09.pddl
90 90 0.0 240 240 0.0
p10.pddl
106 106 0.0 246 246 0.0
p11.pddl
108 108 0.0 294 294 0.0
p12.pddl
110 110 0.0 314 314 0.0
p13.pddl
122 122 0.0 337 337 0.0
p14.pddl
128 128 0.0 384 384 0.0
p15.pddl
136 136 0.0 435 435 0.0
p16.pddl
144 144 0.0 427 427 0.0
p17.pddl
152 152 0.0 490 490 0.0
p18.pddl
154 154 0.0 581 581 0.0
p19.pddl
164 164 0.0 609 609 0.0
p20.pddl
160 160 0.0 574 574 0.0
p21.pddl
172 172 0.0 684 684 0.0
p22.pddl
190 190 0.0 713 713 0.0
p23.pddl
184 184 0.0 780 780 0.0
p24.pddl
194 194 0.0 785 785 0.0
p25.pddl
200 200 0.0 899 899 0.0
p26.pddl
214 214 0.0 938 938 0.0
p27.pddl
228 228 0.0 987 987 0.0
p28.pddl
224 224 0.0 1009 1009 0.0
p29.pddl
234 234 0.0 1135 1135 0.0
p30.pddl
242 242 0.0 1168 1168 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
70 70 0.0 143 143 0.0
p02.pddl
82 82 0.0 173 173 0.0
p03.pddl
90 90 0.0 206 206 0.0
p04.pddl
90 90 0.0 240 240 0.0
p05.pddl
106 106 0.0 246 246 0.0
p06.pddl
108 108 0.0 294 294 0.0
p07.pddl
110 110 0.0 314 314 0.0
p08.pddl
122 122 0.0 337 337 0.0
p09.pddl
128 128 0.0 384 384 0.0
p10.pddl
190 190 0.0 713 713 0.0
p11.pddl
136 136 0.0 435 435 0.0
p12.pddl
144 144 0.0 427 427 0.0
p13.pddl
152 152 0.0 490 490 0.0
p14.pddl
154 154 0.0 581 581 0.0
p15.pddl
164 164 0.0 609 609 0.0
p16.pddl
172 172 0.0 684 684 0.0
p17.pddl
160 160 0.0 574 574 0.0
p18.pddl
184 184 0.0 780 780 0.0
p19.pddl
194 194 0.0 785 785 0.0
p20.pddl
200 200 0.0 899 899 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
136 136 0.0 426 426 0.0
p20_2.pddl
144 144 0.0 476 476 0.0
p20_3.pddl
154 154 0.0 460 460 0.0
p25_1.pddl
174 174 0.0 673 673 0.0
p25_3.pddl
194 194 0.0 732 732 0.0
p30_1.pddl
200 200 0.0 897 897 0.0
p30_2.pddl
206 206 0.0 961 961 0.0
p30_3.pddl
228 228 0.0 1074 1074 0.0
p35_1.pddl
236 236 0.0 1186 1186 0.0
p35_2.pddl
242 242 0.0 1314 1314 0.0
p35_3.pddl
272 272 0.0 1409 1409 0.0
p40_1.pddl
268 268 0.0 1512 1512 0.0
p40_2.pddl
278 278 0.0 1490 1490 0.0
p40_3.pddl
308 308 0.0 1737 1737 0.0
p45_1.pddl
306 306 0.0 1802 1802 0.0
p45_2.pddl
328 328 0.0 1985 1985 0.0
p45_3.pddl
352 352 0.0 2258 2258 0.0
p50_1.pddl
332 332 0.0 2273 2273 0.0
p50_2.pddl
354 354 0.0 2416 2416 0.0
p50_3.pddl
392 392 0.0 2706 2706 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
52 52 0.0 84 84 0.0
p02.pddl
52 52 0.0 84 84 0.0
p03.pddl
52 52 0.0 84 84 0.0
p04.pddl
52 52 0.0 85 85 0.0
p05.pddl
52 52 0.0 85 85 0.0
p06.pddl
100 100 0.0 268 268 0.0
p07.pddl
102 102 0.0 261 261 0.0
p08.pddl
194 194 0.0 858 858 0.0
p09.pddl
194 194 0.0 833 833 0.0
p10.pddl
202 202 0.0 978 978 0.0
p11.pddl
202 202 0.0 947 947 0.0
p12.pddl
202 202 0.0 909 909 0.0
p13.pddl
202 202 0.0 933 933 0.0
p14.pddl
202 202 0.0 911 911 0.0
p15.pddl
204 204 0.0 866 866 0.0
p16.pddl
206 206 0.0 876 876 0.0
p17.pddl
252 252 0.0 1243 1243 0.0
p18.pddl
398 398 0.0 3637 3637 0.0
p19.pddl
254 254 0.0 1402 1402 0.0
p20.pddl
302 302 0.0 1856 1856 0.0
p21.pddl
302 302 0.0 1892 1892 0.0
p22.pddl
302 302 0.0 1965 1965 0.0
p23.pddl
302 302 0.0 1916 1916 0.0
p24.pddl
502 502 0.0 4905 4905 0.0
p25.pddl
502 502 0.0 4784 4784 0.0
p26.pddl
508 508 0.0 4833 4833 0.0
p27.pddl
754 754 0.0 10456 10456 0.0
p28.pddl
1002 1002 0.0 18619 18619 0.0
p29.pddl
1002 1002 0.0 17923 17923 0.0
p30.pddl
1010 1010 0.0 18202 18202 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-opt18-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
4 4 0.0 2 2 0.0
p02.pddl
5 5 0.0 3 3 0.0
p03.pddl
6 6 0.0 10 10 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
6 6 0.0 7 7 0.0
p08.pddl
None None - None None -
p09.pddl
6 6 0.0 4 4 0.0
p10.pddl
6 6 0.0 4 4 0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
8 8 0.0 11 11 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-split-opt18-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
30 30 0.0 81 81 0.0
p02.pddl
51 51 0.0 675 675 0.0
p03.pddl
593 593 0.0 153032 153032 0.0
p04.pddl
185 185 0.0 249278 249278 0.0
p05.pddl
453 453 0.0 76647 76647 0.0
p06.pddl
240 240 0.0 4002830 4002830 0.0
p07.pddl
46 46 0.0 44 44 0.0
p08.pddl
840 840 0.0 11593177 11593177 0.0
p09.pddl
179 179 0.0 42943 42943 0.0
p10.pddl
175 175 0.0 70165 70165 0.0
p11.pddl
3496 3496 0.0 None None -
p12.pddl
5731 5731 0.0 None None -
p13.pddl
8088 8088 0.0 None None -
p14.pddl
203 203 0.0 2671 2671 0.0
p15.pddl
None None - None None -
p16.pddl
6481 6481 0.0 None None -
p17.pddl
16424 16424 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
6056 6056 0.0 None None -
p20.pddl
549508 549508 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-08-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
18 18 0.0 19 19 0.0
p02.pddl
32 32 0.0 40 40 0.0
p03.pddl
48 48 0.0 62 62 0.0
p04.pddl
61 61 0.0 173 173 0.0
p05.pddl
76 76 0.0 262 262 0.0
p06.pddl
92 92 0.0 285 285 0.0
p07.pddl
103 103 0.0 610 610 0.0
p08.pddl
120 120 0.0 774 774 0.0
p09.pddl
135 135 0.0 996 996 0.0
p10.pddl
151 151 0.0 800 800 0.0
p11.pddl
20 20 0.0 15 15 0.0
p12.pddl
38 38 0.0 260 260 0.0
p13.pddl
57 57 0.0 30781 30781 0.0
p14.pddl
78 78 0.0 1267492 1267492 0.0
p15.pddl
196 196 0.0 None None -
p16.pddl
120 120 0.0 None None -
p17.pddl
137 137 0.0 None None -
p18.pddl
162 162 0.0 None None -
p19.pddl
678 678 0.0 None None -
p20.pddl
324 324 0.0 None None -
p21.pddl
18 18 0.0 14 14 0.0
p22.pddl
32 32 0.0 43 43 0.0
p23.pddl
46 46 0.0 88 88 0.0
p24.pddl
61 61 0.0 146 146 0.0
p25.pddl
143 143 0.0 679366 679366 0.0
p26.pddl
91 91 0.0 327 327 0.0
p27.pddl
104 104 0.0 411 411 0.0
p28.pddl
121 121 0.0 592 592 0.0
p29.pddl
404 404 0.0 None None -
p30.pddl
205 205 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
32 32 0.0 43 43 0.0
p02.pddl
32 32 0.0 40 40 0.0
p03.pddl
38 38 0.0 260 260 0.0
p04.pddl
61 61 0.0 173 173 0.0
p05.pddl
46 46 0.0 88 88 0.0
p06.pddl
92 92 0.0 285 285 0.0
p07.pddl
76 76 0.0 262 262 0.0
p08.pddl
61 61 0.0 146 146 0.0
p09.pddl
57 57 0.0 30781 30781 0.0
p10.pddl
143 143 0.0 679366 679366 0.0
p11.pddl
91 91 0.0 327 327 0.0
p12.pddl
78 78 0.0 1267492 1267492 0.0
p13.pddl
103 103 0.0 610 610 0.0
p14.pddl
120 120 0.0 774 774 0.0
p15.pddl
135 135 0.0 996 996 0.0
p16.pddl
151 151 0.0 800 800 0.0
p17.pddl
196 196 0.0 None None -
p18.pddl
120 120 0.0 None None -
p19.pddl
137 137 0.0 None None -
p20.pddl
104 104 0.0 411 411 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parking-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
167 167 0.0 None None -
pfile03-012.pddl
747 747 0.0 None None -
pfile04-013.pddl
843 843 0.0 None None -
pfile04-014.pddl
1227 1227 0.0 None None -
pfile04-015.pddl
546 546 0.0 None None -
pfile04-016.pddl
835 835 0.0 None None -
pfile05-017.pddl
563 563 0.0 None None -
pfile05-018.pddl
497 497 0.0 None None -
pfile05-019.pddl
1530 1530 0.0 None None -
pfile05-020.pddl
1232 1232 0.0 None None -
pfile06-021.pddl
1206 1206 0.0 None None -
pfile06-022.pddl
1190 1190 0.0 None None -
pfile06-023.pddl
974 974 0.0 None None -
pfile06-024.pddl
3076 3076 0.0 None None -
pfile07-025.pddl
3070 3070 0.0 None None -
pfile07-026.pddl
1199 1199 0.0 None None -
pfile07-027.pddl
868 868 0.0 None None -
pfile07-028.pddl
2970 2970 0.0 None None -
pfile08-029.pddl
2378 2378 0.0 None None -
pfile08-030.pddl
1714 1714 0.0 None None -
Sum of diffs
0.00
None
Arithmetic mean of diffs
0.00
None
parking-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
372 372 0.0 None None -
p_12_7-02.pddl
432 432 0.0 830052 830052 0.0
p_12_7-03.pddl
825 825 0.0 None None -
p_12_7-04.pddl
663 663 0.0 None None -
p_14_8-01.pddl
518 518 0.0 None None -
p_14_8-02.pddl
787 787 0.0 None None -
p_14_8-03.pddl
1517 1517 0.0 None None -
p_14_8-04.pddl
739 739 0.0 None None -
p_16_9-01.pddl
966 966 0.0 None None -
p_16_9-02.pddl
698 698 0.0 None None -
p_16_9-03.pddl
446 446 0.0 None None -
p_16_9-04.pddl
499 499 0.0 None None -
p_18_10-01.pddl
1748 1748 0.0 None None -
p_18_10-02.pddl
927 927 0.0 None None -
p_18_10-03.pddl
434 434 0.0 None None -
p_18_10-04.pddl
344 344 0.0 None None -
p_20_11-01.pddl
2292 2292 0.0 None None -
p_20_11-02.pddl
1412 1412 0.0 None None -
p_20_11-03.pddl
2005 2005 0.0 None None -
p_20_11-04.pddl
4003 4003 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pathways-noneg
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
22 22 0.0 1718 1718 0.0
p02.pddl
28 28 0.0 99 99 0.0
p03.pddl
115 115 0.0 2556 2556 0.0
p04.pddl
46 46 0.0 8385 8385 0.0
p05.pddl
90 90 0.0 358961 358961 0.0
p06.pddl
368 368 0.0 6377335 6377335 0.0
p07.pddl
520 520 0.0 39206403 39206403 0.0
p08.pddl
980 980 0.0 None None -
p09.pddl
630 630 0.0 6265752 6265752 0.0
p10.pddl
None None - None None -
p11.pddl
886 886 0.0 21549731 21549731 0.0
p12.pddl
1267 1267 0.0 None None -
p13.pddl
1018 1018 0.0 None None -
p14.pddl
1516 1516 0.0 None None -
p15.pddl
830 830 0.0 None None -
p16.pddl
None None - None None -
p17.pddl
1808 1808 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
4054 4054 0.0 None None -
p24.pddl
3846 3846 0.0 None None -
p25.pddl
3206 3206 0.0 None None -
p26.pddl
4850 4850 0.0 None None -
p27.pddl
5690 5690 0.0 None None -
p28.pddl
2846 2846 0.0 None None -
p29.pddl
7138 7138 0.0 None None -
p30.pddl
9876 9876 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-08-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
17 17 0.0 11 11 0.0
p02.pddl
30 30 0.0 45 45 0.0
p03.pddl
66 66 0.0 71 71 0.0
p04.pddl
142 142 0.0 133 133 0.0
p05.pddl
101 101 0.0 73 73 0.0
p06.pddl
221 221 0.0 103 103 0.0
p07.pddl
75 75 0.0 26 26 0.0
p08.pddl
266 266 0.0 263 263 0.0
p09.pddl
134 134 0.0 379 379 0.0
p10.pddl
3779 3779 0.0 973 973 0.0
p11.pddl
1089 1089 0.0 1903 1903 0.0
p12.pddl
1252 1252 0.0 393 393 0.0
p13.pddl
304 304 0.0 15888 15888 0.0
p14.pddl
419 419 0.0 12646 12646 0.0
p15.pddl
398 398 0.0 2005 2005 0.0
p16.pddl
655 655 0.0 6414 6414 0.0
p17.pddl
26799 26799 0.0 32330 32330 0.0
p18.pddl
4632 4632 0.0 337 337 0.0
p19.pddl
765 765 0.0 11615 11615 0.0
p20.pddl
1496 1496 0.0 584 584 0.0
p21.pddl
614 614 0.0 21777 21777 0.0
p22.pddl
1766 1766 0.0 6958 6958 0.0
p23.pddl
1235 1235 0.0 40941 40941 0.0
p24.pddl
2400 2400 0.0 17193 17193 0.0
p25.pddl
1833 1833 0.0 12593 12593 0.0
p26.pddl
1113 1113 0.0 40192 40192 0.0
p27.pddl
91385 91385 0.0 1243 1243 0.0
p28.pddl
249637 249637 0.0 953144 953144 0.0
p29.pddl
14638233 14638233 0.0 178488 178488 0.0
p30.pddl
258902 258902 0.0 16125631 16125631 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
175 175 0.0 38 38 0.0
p02.pddl
26799 26799 0.0 32330 32330 0.0
p03.pddl
4632 4632 0.0 337 337 0.0
p04.pddl
765 765 0.0 11615 11615 0.0
p05.pddl
831 831 0.0 52800 52800 0.0
p06.pddl
239 239 0.0 1514 1514 0.0
p07.pddl
1784 1784 0.0 576 576 0.0
p08.pddl
1496 1496 0.0 584 584 0.0
p09.pddl
5019 5019 0.0 8748 8748 0.0
p10.pddl
614 614 0.0 21777 21777 0.0
p11.pddl
1766 1766 0.0 6958 6958 0.0
p12.pddl
1654 1654 0.0 12292 12292 0.0
p13.pddl
1235 1235 0.0 40941 40941 0.0
p14.pddl
2400 2400 0.0 17193 17193 0.0
p15.pddl
1833 1833 0.0 12593 12593 0.0
p16.pddl
1113 1113 0.0 40192 40192 0.0
p17.pddl
91385 91385 0.0 1243 1243 0.0
p18.pddl
249637 249637 0.0 953144 953144 0.0
p19.pddl
14638233 14638233 0.0 178488 178488 0.0
p20.pddl
258902 258902 0.0 16125631 16125631 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
petri-net-alignment-opt18-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
506 506 0.0 1101 1101 0.0
p02.pddl
656 656 0.0 1445 1445 0.0
p03.pddl
758 758 0.0 1701 1701 0.0
p04.pddl
764 764 0.0 1763 1763 0.0
p05.pddl
632 632 0.0 1389 1389 0.0
p06.pddl
762 762 0.0 1739 1739 0.0
p07.pddl
730 730 0.0 1602 1602 0.0
p08.pddl
764 764 0.0 1748 1748 0.0
p09.pddl
766 766 0.0 1693 1693 0.0
p10.pddl
944 944 0.0 2189 2189 0.0
p11.pddl
840 840 0.0 1897 1897 0.0
p12.pddl
1062 1062 0.0 2509 2509 0.0
p13.pddl
928 928 0.0 2141 2141 0.0
p14.pddl
964 964 0.0 2198 2198 0.0
p15.pddl
938 938 0.0 2143 2143 0.0
p16.pddl
1024 1024 0.0 2357 2357 0.0
p17.pddl
1058 1058 0.0 2424 2424 0.0
p18.pddl
1024 1024 0.0 2344 2344 0.0
p19.pddl
1036 1036 0.0 2441 2441 0.0
p20.pddl
1082 1082 0.0 2515 2515 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-notankage
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
12 12 0.0 25 25 0.0
p02-net1-b6-g4.pddl
1226 1226 0.0 72 72 0.0
p03-net1-b8-g3.pddl
208 208 0.0 125 125 0.0
p04-net1-b8-g5.pddl
1228 1228 0.0 111 111 0.0
p05-net1-b10-g4.pddl
516 516 0.0 159 159 0.0
p06-net1-b10-g6.pddl
5710 5710 0.0 160 160 0.0
p07-net1-b12-g5.pddl
24 24 0.0 164 164 0.0
p08-net1-b12-g7.pddl
28 28 0.0 177 177 0.0
p09-net1-b14-g6.pddl
56 56 0.0 166 166 0.0
p10-net1-b14-g8.pddl
64 64 0.0 247 247 0.0
p11-net2-b10-g2.pddl
20840 20840 0.0 6094 6094 0.0
p12-net2-b10-g4.pddl
19122 19122 0.0 11577 11577 0.0
p13-net2-b12-g3.pddl
126 126 0.0 34707 34707 0.0
p14-net2-b12-g5.pddl
8508 8508 0.0 11857 11857 0.0
p15-net2-b14-g4.pddl
2014 2014 0.0 31196 31196 0.0
p16-net2-b14-g6.pddl
50808 50808 0.0 566334 566334 0.0
p17-net2-b16-g5.pddl
31640 31640 0.0 11444 11444 0.0
p18-net2-b16-g7.pddl
53812 53812 0.0 17851 17851 0.0
p19-net2-b18-g6.pddl
280 280 0.0 2367 2367 0.0
p20-net2-b18-g8.pddl
88660 88660 0.0 48205 48205 0.0
p21-net3-b12-g2.pddl
68 68 0.0 892 892 0.0
p22-net3-b12-g4.pddl
107202 107202 0.0 121952 121952 0.0
p23-net3-b14-g3.pddl
676 676 0.0 33864 33864 0.0
p24-net3-b14-g5.pddl
43140 43140 0.0 407104 407104 0.0
p25-net3-b16-g5.pddl
554 554 0.0 356870 356870 0.0
p26-net3-b16-g7.pddl
70606 70606 0.0 45599 45599 0.0
p27-net3-b18-g6.pddl
75280 75280 0.0 6767820 6767820 0.0
p28-net3-b18-g7.pddl
70444 70444 0.0 4364956 4364956 0.0
p29-net3-b20-g6.pddl
15222 15222 0.0 2798415 2798415 0.0
p30-net3-b20-g8.pddl
69856 69856 0.0 192296 192296 0.0
p31-net4-b14-g3.pddl
222 222 0.0 59115 59115 0.0
p32-net4-b14-g5.pddl
28116 28116 0.0 31794 31794 0.0
p33-net4-b16-g5.pddl
11128 11128 0.0 92686 92686 0.0
p34-net4-b16-g6.pddl
60680 60680 0.0 199269 199269 0.0
p35-net4-b18-g4.pddl
24194 24194 0.0 7115734 7115734 0.0
p36-net4-b18-g6.pddl
646 646 0.0 25121945 25121945 0.0
p37-net4-b20-g5.pddl
4200 4200 0.0 None None -
p38-net4-b20-g7.pddl
53724 53724 0.0 6344276 6344276 0.0
p39-net4-b22-g7.pddl
470 470 0.0 None None -
p40-net4-b22-g8.pddl
9104 9104 0.0 22024289 22024289 0.0
p41-net5-b22-g2.pddl
976 976 0.0 1081018 1081018 0.0
p42-net5-b22-g4.pddl
None None - None None -
p43-net5-b24-g3.pddl
None None - None None -
p44-net5-b24-g5.pddl
None None - None None -
p45-net5-b26-g4.pddl
None None - None None -
p46-net5-b26-g6.pddl
None None - None None -
p47-net5-b28-g5.pddl
None None - None None -
p48-net5-b28-g7.pddl
None None - None None -
p49-net5-b30-g6.pddl
824 824 0.0 None None -
p50-net5-b30-g8.pddl
68278 68278 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-tankage
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
16 16 0.0 25 25 0.0
p02-net1-b6-g4-t50.pddl
1722 1722 0.0 168 168 0.0
p03-net1-b8-g3-t80.pddl
64 64 0.0 546 546 0.0
p04-net1-b8-g5-t80.pddl
508 508 0.0 535 535 0.0
p05-net1-b10-g4-t50.pddl
198 198 0.0 303 303 0.0
p06-net1-b10-g6-t50.pddl
144 144 0.0 325 325 0.0
p07-net1-b12-g5-t80.pddl
38 38 0.0 234 234 0.0
p08-net1-b12-g7-t80.pddl
74 74 0.0 469 469 0.0
p09-net1-b14-g6-t50.pddl
28050 28050 0.0 129291 129291 0.0
p10-net1-b14-g8-t50.pddl
150 150 0.0 9917 9917 0.0
p11-net2-b10-g2-t30.pddl
887 887 0.0 55085 55085 0.0
p12-net2-b10-g4-t60.pddl
460 460 0.0 111516 111516 0.0
p13-net2-b12-g3-t70.pddl
196 196 0.0 6435582 6435582 0.0
p14-net2-b12-g5-t30.pddl
1413 1413 0.0 265203 265203 0.0
p15-net2-b14-g4-t30.pddl
3016 3016 0.0 755870 755870 0.0
p16-net2-b14-g6-t80.pddl
4904 4904 0.0 None None -
p17-net2-b16-g5-t20.pddl
13275 13275 0.0 1073507 1073507 0.0
p18-net2-b16-g7-t60.pddl
14280 14280 0.0 5158742 5158742 0.0
p19-net2-b18-g6-t60.pddl
324 324 0.0 4205917 4205917 0.0
p20-net2-b18-g8-t90.pddl
6522 6522 0.0 None None -
p21-net3-b12-g2-t60.pddl
104 104 0.0 161274 161274 0.0
p22-net3-b12-g4-t60.pddl
5796318 5796318 0.0 3789985 3789985 0.0
p23-net3-b14-g3-t60.pddl
15404 15404 0.0 None None -
p24-net3-b14-g5-t60.pddl
4239 4239 0.0 None None -
p25-net3-b16-g5-t60.pddl
590 590 0.0 None None -
p26-net3-b16-g7-t70.pddl
54594 54594 0.0 None None -
p27-net3-b18-g6-t70.pddl
866 866 0.0 None None -
p28-net3-b18-g7-t70.pddl
2874598 2874598 0.0 None None -
p29-net3-b20-g6-t70.pddl
2122 2122 0.0 None None -
p30-net3-b20-g8-t70.pddl
14030 14030 0.0 None None -
p31-net4-b14-g3-t20.pddl
560762 560762 0.0 141976 141976 0.0
p32-net4-b14-g5-t30.pddl
20954 20954 0.0 9031051 9031051 0.0
p33-net4-b16-g5-t60.pddl
1530 1530 0.0 None None -
p34-net4-b16-g6-t60.pddl
2712 2712 0.0 None None -
p35-net4-b18-g4-t90.pddl
872 872 0.0 None None -
p36-net4-b18-g6-t90.pddl
38898 38898 0.0 None None -
p37-net4-b20-g5-t60.pddl
716 716 0.0 None None -
p38-net4-b20-g7-t60.pddl
6646 6646 0.0 None None -
p39-net4-b22-g7-t50.pddl
1164 1164 0.0 None None -
p40-net4-b22-g8-t50.pddl
848 848 0.0 None None -
p41-net5-b22-g2-t20.pddl
172 172 0.0 None None -
p42-net5-b22-g4-t50.pddl
None None - None None -
p43-net5-b24-g3-t80.pddl
None None - None None -
p44-net5-b24-g5-t80.pddl
None None - None None -
p45-net5-b26-g4-t50.pddl
None None - None None -
p46-net5-b26-g6-t50.pddl
None None - None None -
p47-net5-b28-g5-t50.pddl
None None - None None -
p48-net5-b28-g7-t50.pddl
None None - None None -
p49-net5-b30-g6-t50.pddl
3486 3486 0.0 None None -
p50-net5-b30-g8-t50.pddl
41344 41344 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
psr-small
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
20 20 0.0 10 10 0.0
p02-s5-n1-l3-f30.pddl
74 74 0.0 33 33 0.0
p03-s7-n1-l3-f70.pddl
58 58 0.0 29 29 0.0
p04-s8-n1-l4-f10.pddl
46 46 0.0 24 24 0.0
p05-s9-n1-l4-f30.pddl
78 78 0.0 37 37 0.0
p06-s10-n1-l4-f50.pddl
20 20 0.0 10 10 0.0
p07-s11-n1-l4-f70.pddl
74 74 0.0 37 37 0.0
p08-s12-n1-l5-f10.pddl
22 22 0.0 18 18 0.0
p09-s13-n1-l5-f30.pddl
22 22 0.0 14 14 0.0
p10-s17-n2-l2-f30.pddl
258 258 0.0 52 52 0.0
p11-s18-n2-l2-f50.pddl
222 222 0.0 110 110 0.0
p12-s21-n2-l3-f30.pddl
100 100 0.0 55 55 0.0
p13-s22-n2-l3-f50.pddl
84 84 0.0 65 65 0.0
p14-s23-n2-l3-f70.pddl
26 26 0.0 17 17 0.0
p15-s24-n2-l4-f10.pddl
178 178 0.0 24418 24418 0.0
p16-s29-n2-l5-f30.pddl
1210 1210 0.0 2821 2821 0.0
p17-s30-n2-l5-f50.pddl
26 26 0.0 15 15 0.0
p18-s31-n2-l5-f70.pddl
94 94 0.0 45 45 0.0
p19-s33-n3-l2-f30.pddl
1966 1966 0.0 5991 5991 0.0
p20-s34-n3-l2-f50.pddl
84 84 0.0 60 60 0.0
p21-s35-n3-l2-f70.pddl
42 42 0.0 23 23 0.0
p22-s37-n3-l3-f30.pddl
4588 4588 0.0 1158 1158 0.0
p23-s38-n3-l3-f50.pddl
78 78 0.0 34 34 0.0
p24-s39-n3-l3-f70.pddl
42 42 0.0 23 23 0.0
p25-s40-n3-l4-f10.pddl
54 54 0.0 154832 154832 0.0
p26-s41-n3-l4-f30.pddl
84 84 0.0 66 66 0.0
p27-s42-n3-l4-f50.pddl
212 212 0.0 113 113 0.0
p28-s43-n3-l4-f70.pddl
98 98 0.0 39 39 0.0
p29-s45-n3-l5-f30.pddl
1724 1724 0.0 460 460 0.0
p30-s46-n3-l5-f50.pddl
338 338 0.0 195 195 0.0
p31-s49-n4-l2-f30.pddl
330 330 0.0 70266 70266 0.0
p32-s50-n4-l2-f50.pddl
410 410 0.0 300 300 0.0
p33-s51-n4-l2-f70.pddl
392 392 0.0 2528 2528 0.0
p34-s55-n4-l3-f70.pddl
230 230 0.0 149 149 0.0
p35-s57-n5-l2-f30.pddl
1330 1330 0.0 300336 300336 0.0
p36-s65-n6-l2-f30.pddl
1532 1532 0.0 1103482 1103482 0.0
p37-s67-n6-l2-f70.pddl
422 422 0.0 218 218 0.0
p38-s78-n3-l3-f50.pddl
130 130 0.0 66 66 0.0
p39-s79-n3-l3-f70.pddl
304 304 0.0 164 164 0.0
p40-s80-n3-l4-f10.pddl
906 906 0.0 5585312 5585312 0.0
p41-s81-n3-l4-f30.pddl
42 42 0.0 25 25 0.0
p42-s82-n3-l4-f50.pddl
1910 1910 0.0 1888 1888 0.0
p43-s83-n3-l4-f70.pddl
370 370 0.0 201 201 0.0
p44-s89-n4-l2-f30.pddl
698 698 0.0 262 262 0.0
p45-s94-n4-l3-f50.pddl
212 212 0.0 102 102 0.0
p46-s97-n5-l2-f30.pddl
1012 1012 0.0 86306 86306 0.0
p47-s98-n5-l2-f50.pddl
314 314 0.0 261 261 0.0
p48-s101-n5-l3-f30.pddl
1272 1272 0.0 1668 1668 0.0
p49-s105-n6-l2-f30.pddl
3322 3322 0.0 6266 6266 0.0
p50-s107-n6-l2-f70.pddl
648 648 0.0 201 201 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
rovers
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
34 34 0.0 59 59 0.0
p02.pddl
20 20 0.0 51 51 0.0
p03.pddl
42 42 0.0 163 163 0.0
p04.pddl
18 18 0.0 60 60 0.0
p05.pddl
104 104 0.0 493 493 0.0
p06.pddl
378 378 0.0 691 691 0.0
p07.pddl
96 96 0.0 5088 5088 0.0
p08.pddl
112 112 0.0 8263 8263 0.0
p09.pddl
142 142 0.0 68243 68243 0.0
p10.pddl
278 278 0.0 149293 149293 0.0
p11.pddl
200 200 0.0 26180 26180 0.0
p12.pddl
66 66 0.0 10281 10281 0.0
p13.pddl
480 480 0.0 39154 39154 0.0
p14.pddl
222 222 0.0 81444 81444 0.0
p15.pddl
818 818 0.0 126788 126788 0.0
p16.pddl
502 502 0.0 122662 122662 0.0
p17.pddl
256 256 0.0 1948644 1948644 0.0
p18.pddl
306 306 0.0 23900475 23900475 0.0
p19.pddl
1000 1000 0.0 None None -
p20.pddl
1494 1494 0.0 None None -
p21.pddl
1146 1146 0.0 None None -
p22.pddl
1338 1338 0.0 17896902 17896902 0.0
p23.pddl
1484 1484 0.0 None None -
p24.pddl
3006 3006 0.0 None None -
p25.pddl
198 198 0.0 734731 734731 0.0
p26.pddl
868 868 0.0 None None -
p27.pddl
1870 1870 0.0 None None -
p28.pddl
1880 1880 0.0 None None -
p29.pddl
766 766 0.0 None None -
p30.pddl
2120 2120 0.0 None None -
p31.pddl
3452 3452 0.0 None None -
p32.pddl
6388 6388 0.0 None None -
p33.pddl
13486 13486 0.0 None None -
p34.pddl
4886 4886 0.0 None None -
p35.pddl
20582 20582 0.0 None None -
p36.pddl
11634 11634 0.0 None None -
p37.pddl
35276 35276 0.0 None None -
p38.pddl
18416 18416 0.0 None None -
p39.pddl
16736 16736 0.0 None None -
p40.pddl
28844 28844 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
satellite
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
24 24 0.0 48 48 0.0
p02-pfile2.pddl
38 38 0.0 76 76 0.0
p03-pfile3.pddl
24 24 0.0 793 793 0.0
p04-pfile4.pddl
56 56 0.0 1874 1874 0.0
p05-pfile5.pddl
80 80 0.0 52878 52878 0.0
p06-pfile6.pddl
74 74 0.0 19359 19359 0.0
p07-pfile7.pddl
46 46 0.0 184758 184758 0.0
p08-pfile8.pddl
120 120 0.0 1461070 1461070 0.0
p09-pfile9.pddl
158 158 0.0 2737614 2737614 0.0
p10-pfile10.pddl
178 178 0.0 8877236 8877236 0.0
p11-pfile11.pddl
100 100 0.0 3482163 3482163 0.0
p12-pfile12.pddl
116 116 0.0 19996153 19996153 0.0
p13-pfile13.pddl
958 958 0.0 None None -
p14-pfile14.pddl
228 228 0.0 24670028 24670028 0.0
p15-pfile15.pddl
556 556 0.0 None None -
p16-pfile16.pddl
150 150 0.0 None None -
p17-pfile17.pddl
594 594 0.0 None None -
p18-pfile18.pddl
244 244 0.0 None None -
p19-pfile19.pddl
570 570 0.0 None None -
p20-pfile20.pddl
2610 2610 0.0 None None -
p21-HC-pfile1.pddl
426 426 0.0 6013714 6013714 0.0
p22-HC-pfile2.pddl
546 546 0.0 None None -
p23-HC-pfile3.pddl
1600 1600 0.0 5813721 5813721 0.0
p24-HC-pfile4.pddl
3026 3026 0.0 None None -
p25-HC-pfile5.pddl
3936 3936 0.0 None None -
p26-HC-pfile6.pddl
1950 1950 0.0 None None -
p27-HC-pfile7.pddl
1390 1390 0.0 None None -
p28-HC-pfile8.pddl
9402 9402 0.0 None None -
p29-HC-pfile9.pddl
2812 2812 0.0 None None -
p30-HC-pfile10.pddl
11312 11312 0.0 None None -
p31-HC-pfile11.pddl
6068 6068 0.0 None None -
p32-HC-pfile12.pddl
19324 19324 0.0 None None -
p33-HC-pfile13.pddl
35680 35680 0.0 None None -
p34-HC-pfile14.pddl
584 584 0.0 None None -
p35-HC-pfile15.pddl
11986 11986 0.0 None None -
p36-HC-pfile16.pddl
1984 1984 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-08-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
32 32 0.0 146 146 0.0
p02.pddl
100 100 0.0 231 231 0.0
p03.pddl
158 158 0.0 262 262 0.0
p04.pddl
58 58 0.0 385 385 0.0
p05.pddl
206 206 0.0 804 804 0.0
p06.pddl
362 362 0.0 923 923 0.0
p07.pddl
92 92 0.0 824 824 0.0
p08.pddl
358 358 0.0 2200 2200 0.0
p09.pddl
640 640 0.0 2507 2507 0.0
p10.pddl
134 134 0.0 1544 1544 0.0
p11.pddl
560 560 0.0 5106 5106 0.0
p12.pddl
1022 1022 0.0 5755 5755 0.0
p13.pddl
184 184 0.0 2638 2638 0.0
p14.pddl
816 816 0.0 10521 10521 0.0
p15.pddl
1520 1520 0.0 11732 11732 0.0
p16.pddl
242 242 0.0 4211 4211 0.0
p17.pddl
1130 1130 0.0 19816 19816 0.0
p18.pddl
2148 2148 0.0 21887 21887 0.0
p19.pddl
308 308 0.0 6380 6380 0.0
p20.pddl
1506 1506 0.0 34794 34794 0.0
p21.pddl
2920 2920 0.0 38113 38113 0.0
p22.pddl
12 12 0.0 12 12 0.0
p23.pddl
12 12 0.0 12 12 0.0
p24.pddl
12 12 0.0 12 12 0.0
p25.pddl
30 30 0.0 105 105 0.0
p26.pddl
282 282 0.0 228 228 0.0
p27.pddl
302 302 0.0 7336 7336 0.0
p28.pddl
58 58 0.0 445 445 0.0
p29.pddl
2844 2844 0.0 1342 1342 0.0
p30.pddl
662 662 0.0 5141 5141 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
12 12 0.0 12 12 0.0
p02.pddl
100 100 0.0 231 231 0.0
p03.pddl
158 158 0.0 262 262 0.0
p04.pddl
58 58 0.0 385 385 0.0
p05.pddl
92 92 0.0 824 824 0.0
p06.pddl
206 206 0.0 804 804 0.0
p07.pddl
308 308 0.0 6380 6380 0.0
p08.pddl
134 134 0.0 1544 1544 0.0
p09.pddl
184 184 0.0 2638 2638 0.0
p10.pddl
242 242 0.0 4211 4211 0.0
p11.pddl
30 30 0.0 105 105 0.0
p12.pddl
362 362 0.0 923 923 0.0
p13.pddl
302 302 0.0 7336 7336 0.0
p14.pddl
282 282 0.0 228 228 0.0
p15.pddl
358 358 0.0 2200 2200 0.0
p16.pddl
560 560 0.0 5106 5106 0.0
p17.pddl
816 816 0.0 10521 10521 0.0
p18.pddl
1130 1130 0.0 19816 19816 0.0
p19.pddl
1506 1506 0.0 34794 34794 0.0
p20.pddl
58 58 0.0 445 445 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
snake-opt18-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1963 1963 0.0 14936 14936 0.0
p02.pddl
9573 9573 0.0 231700 231700 0.0
p03.pddl
106131 106131 0.0 818555 818555 0.0
p04.pddl
42 42 0.0 44 44 0.0
p05.pddl
100 100 0.0 399 399 0.0
p06.pddl
3533 3533 0.0 330654 330654 0.0
p07.pddl
3277805 3277805 0.0 13261296 13261296 0.0
p08.pddl
None None - 50193064 50193064 0.0
p09.pddl
142 142 0.0 1884 1884 0.0
p10.pddl
905 905 0.0 17476 17476 0.0
p11.pddl
3519 3519 0.0 716647 716647 0.0
p12.pddl
748812 748812 0.0 14420204 14420204 0.0
p13.pddl
102094 102094 0.0 None None -
p14.pddl
None None - None None -
p15.pddl
510 510 0.0 41848 41848 0.0
p16.pddl
94444 94444 0.0 11253204 11253204 0.0
p17.pddl
1492662 1492662 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
8437 8437 0.0 153834 153834 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt08-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
320 320 0.0 2137 2137 0.0
p02.pddl
416 416 0.0 421 421 0.0
p03.pddl
188 188 0.0 400 400 0.0
p04.pddl
1621 1621 0.0 7738 7738 0.0
p05.pddl
428 428 0.0 None None -
p06.pddl
612 612 0.0 15318 15318 0.0
p07.pddl
2336 2336 0.0 66557 66557 0.0
p08.pddl
68762 68762 0.0 4302193 4302193 0.0
p09.pddl
9055 9055 0.0 1058982 1058982 0.0
p10.pddl
24097 24097 0.0 516584 516584 0.0
p11.pddl
152801 152801 0.0 265502 265502 0.0
p12.pddl
27212 27212 0.0 5920823 5920823 0.0
p13.pddl
1355015 1355015 0.0 6044071 6044071 0.0
p14.pddl
3895 3895 0.0 57070 57070 0.0
p15.pddl
171331 171331 0.0 2441893 2441893 0.0
p16.pddl
59056 59056 0.0 171796 171796 0.0
p17.pddl
11627 11627 0.0 107091 107091 0.0
p18.pddl
103706 103706 0.0 5961935 5961935 0.0
p19.pddl
203559 203559 0.0 13165445 13165445 0.0
p20.pddl
3345 3345 0.0 2775 2775 0.0
p21.pddl
3868 3868 0.0 4369 4369 0.0
p22.pddl
117051 117051 0.0 7717763 7717763 0.0
p23.pddl
8544 8544 0.0 726598 726598 0.0
p24.pddl
333971 333971 0.0 None None -
p25.pddl
14396585 14396585 0.0 None None -
p26.pddl
99474 99474 0.0 None None -
p27.pddl
26918 26918 0.0 35090 35090 0.0
p28.pddl
4993876 4993876 0.0 14454795 14454795 0.0
p29.pddl
229 229 0.0 None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
612 612 0.0 15318 15318 0.0
p02.pddl
11627 11627 0.0 107091 107091 0.0
p03.pddl
3895 3895 0.0 57070 57070 0.0
p04.pddl
1621 1621 0.0 7738 7738 0.0
p05.pddl
59056 59056 0.0 171796 171796 0.0
p06.pddl
152801 152801 0.0 265502 265502 0.0
p07.pddl
24097 24097 0.0 516584 516584 0.0
p08.pddl
9055 9055 0.0 1058982 1058982 0.0
p09.pddl
2336 2336 0.0 66557 66557 0.0
p10.pddl
428 428 0.0 None None -
p11.pddl
1355015 1355015 0.0 6044071 6044071 0.0
p12.pddl
3345 3345 0.0 2775 2775 0.0
p13.pddl
68762 68762 0.0 4302193 4302193 0.0
p14.pddl
27212 27212 0.0 5920823 5920823 0.0
p15.pddl
103706 103706 0.0 5961935 5961935 0.0
p16.pddl
171331 171331 0.0 2441893 2441893 0.0
p17.pddl
203559 203559 0.0 13165445 13165445 0.0
p18.pddl
3868 3868 0.0 4369 4369 0.0
p19.pddl
117051 117051 0.0 7717763 7717763 0.0
p20.pddl
8544 8544 0.0 726598 726598 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
spider-opt18-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
184 184 0.0 164 164 0.0
p02.pddl
3743 3743 0.0 4362 4362 0.0
p03.pddl
708 708 0.0 2629 2629 0.0
p04.pddl
626 626 0.0 8755 8755 0.0
p05.pddl
7191 7191 0.0 29591 29591 0.0
p06.pddl
19904 19904 0.0 3593958 3593958 0.0
p07.pddl
365 365 0.0 370 370 0.0
p08.pddl
311 311 0.0 335 335 0.0
p09.pddl
19917 19917 0.0 27436 27436 0.0
p10.pddl
84728 84728 0.0 520618 520618 0.0
p11.pddl
2326 2326 0.0 32403 32403 0.0
p12.pddl
6703 6703 0.0 1318399 1318399 0.0
p13.pddl
44030 44030 0.0 83660 83660 0.0
p14.pddl
140 140 0.0 148 148 0.0
p15.pddl
203 203 0.0 174 174 0.0
p16.pddl
307 307 0.0 967 967 0.0
p17.pddl
683 683 0.0 565 565 0.0
p18.pddl
1155 1155 0.0 731685 731685 0.0
p19.pddl
900 900 0.0 12894 12894 0.0
p20.pddl
1913 1913 0.0 12662 12662 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
storage
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
8 8 0.0 6 6 0.0
p02.pddl
8 8 0.0 8 8 0.0
p03.pddl
8 8 0.0 10 10 0.0
p04.pddl
62 62 0.0 41 41 0.0
p05.pddl
42 42 0.0 140 140 0.0
p06.pddl
50 50 0.0 278 278 0.0
p07.pddl
160 160 0.0 171 171 0.0
p08.pddl
322 322 0.0 1787 1787 0.0
p09.pddl
292 292 0.0 3108 3108 0.0
p10.pddl
382 382 0.0 1206 1206 0.0
p11.pddl
5742 5742 0.0 12489 12489 0.0
p12.pddl
3770 3770 0.0 83115 83115 0.0
p13.pddl
20194 20194 0.0 1852 1852 0.0
p14.pddl
37108 37108 0.0 8635 8635 0.0
p15.pddl
9508 9508 0.0 59388 59388 0.0
p16.pddl
10926 10926 0.0 662054 662054 0.0
p17.pddl
14604 14604 0.0 10176439 10176439 0.0
p18.pddl
1378456 1378456 0.0 None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
323332 323332 0.0 None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
termes-opt18-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1670 1670 0.0 17505 17505 0.0
p02.pddl
21792 21792 0.0 22290 22290 0.0
p03.pddl
24162 24162 0.0 161726 161726 0.0
p04.pddl
19078 19078 0.0 143133 143133 0.0
p05.pddl
1382918 1382918 0.0 1869155 1869155 0.0
p06.pddl
401258 401258 0.0 3704931 3704931 0.0
p07.pddl
4005820 4005820 0.0 35195825 35195825 0.0
p08.pddl
5030578 5030578 0.0 8171920 8171920 0.0
p09.pddl
None None - None None -
p10.pddl
19375364 19375364 0.0 None None -
p11.pddl
2830 2830 0.0 85805 85805 0.0
p12.pddl
6594 6594 0.0 5989 5989 0.0
p13.pddl
13476 13476 0.0 126218 126218 0.0
p14.pddl
9288 9288 0.0 42690 42690 0.0
p15.pddl
207642 207642 0.0 265546 265546 0.0
p16.pddl
113568 113568 0.0 462798 462798 0.0
p17.pddl
59586 59586 0.0 80466 80466 0.0
p18.pddl
2776 2776 0.0 7827 7827 0.0
p19.pddl
45196 45196 0.0 24738 24738 0.0
p20.pddl
62260 62260 0.0 142835 142835 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tetris-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
16954 16954 0.0 488 488 0.0
p01-8.pddl
10880 10880 0.0 690 690 0.0
p01-10.pddl
2264536 2264536 0.0 131129 131129 0.0
p02-4.pddl
686 686 0.0 35 35 0.0
p02-6.pddl
9122 9122 0.0 299 299 0.0
p02-8.pddl
7650 7650 0.0 4998 4998 0.0
p02-10.pddl
250216 250216 0.0 22584 22584 0.0
p03-4.pddl
4262 4262 0.0 127 127 0.0
p03-6.pddl
12196 12196 0.0 1294 1294 0.0
p03-8.pddl
8382 8382 0.0 1022 1022 0.0
p03-10.pddl
14762 14762 0.0 3783 3783 0.0
p04-6.pddl
16790 16790 0.0 1474 1474 0.0
p04-8.pddl
35536 35536 0.0 1874 1874 0.0
p04-10.pddl
28924 28924 0.0 2623 2623 0.0
p05-6.pddl
5156 5156 0.0 380 380 0.0
p05-8.pddl
691094 691094 0.0 1555 1555 0.0
p05-10.pddl
9750 9750 0.0 3826 3826 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
12 12 0.0 23 23 0.0
p02.pddl
1960 1960 0.0 290 290 0.0
p03.pddl
164 164 0.0 123 123 0.0
p04.pddl
602 602 0.0 585 585 0.0
p05.pddl
1984 1984 0.0 4495 4495 0.0
p06.pddl
400 400 0.0 953 953 0.0
p07.pddl
1258 1258 0.0 128 128 0.0
p08.pddl
4940998 4940998 0.0 6941 6941 0.0
p09.pddl
13114 13114 0.0 393 393 0.0
p10.pddl
198 198 0.0 4469 4469 0.0
p11.pddl
1000 1000 0.0 1330 1330 0.0
p12.pddl
456 456 0.0 3920 3920 0.0
p13.pddl
7696 7696 0.0 3717 3717 0.0
p14.pddl
402 402 0.0 588 588 0.0
p15.pddl
None None - 4687 4687 0.0
p16.pddl
348 348 0.0 1473 1473 0.0
p17.pddl
5398 5398 0.0 72826 72826 0.0
p18.pddl
15586 15586 0.0 13194 13194 0.0
p19.pddl
816 816 0.0 3085 3085 0.0
p20.pddl
1338 1338 0.0 31843 31843 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1384 1384 0.0 1689375 1689375 0.0
p02.pddl
1482 1482 0.0 12111 12111 0.0
p03.pddl
384 384 0.0 1200 1200 0.0
p04.pddl
192 192 0.0 4760 4760 0.0
p05.pddl
3600 3600 0.0 110304 110304 0.0
p06.pddl
8034 8034 0.0 146696 146696 0.0
p07.pddl
638 638 0.0 1301 1301 0.0
p08.pddl
182 182 0.0 385 385 0.0
p09.pddl
382 382 0.0 5546 5546 0.0
p10.pddl
996 996 0.0 39344 39344 0.0
p11.pddl
1000 1000 0.0 1330 1330 0.0
p12.pddl
456 456 0.0 3920 3920 0.0
p13.pddl
7696 7696 0.0 3717 3717 0.0
p14.pddl
402 402 0.0 588 588 0.0
p15.pddl
None None - 4687 4687 0.0
p16.pddl
348 348 0.0 1473 1473 0.0
p17.pddl
5398 5398 0.0 72826 72826 0.0
p18.pddl
15586 15586 0.0 13194 13194 0.0
p19.pddl
816 816 0.0 3085 3085 0.0
p20.pddl
1338 1338 0.0 31843 31843 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tpp
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
14 14 0.0 7 7 0.0
p02.pddl
24 24 0.0 16 16 0.0
p03.pddl
34 34 0.0 28 28 0.0
p04.pddl
44 44 0.0 43 43 0.0
p05.pddl
58 58 0.0 360 360 0.0
p06.pddl
144 144 0.0 4246 4246 0.0
p07.pddl
280 280 0.0 8150 8150 0.0
p08.pddl
414 414 0.0 14800 14800 0.0
p09.pddl
606 606 0.0 21144 21144 0.0
p10.pddl
1092 1092 0.0 40249 40249 0.0
p11.pddl
1250 1250 0.0 69210 69210 0.0
p12.pddl
1158 1158 0.0 117646 117646 0.0
p13.pddl
632 632 0.0 76860 76860 0.0
p14.pddl
1066 1066 0.0 154822 154822 0.0
p15.pddl
1582 1582 0.0 127562 127562 0.0
p16.pddl
2146 2146 0.0 762583 762583 0.0
p17.pddl
2574 2574 0.0 8546092 8546092 0.0
p18.pddl
1290 1290 0.0 2805738 2805738 0.0
p19.pddl
3926 3926 0.0 6062301 6062301 0.0
p20.pddl
4680 4680 0.0 15674327 15674327 0.0
p21.pddl
3130 3130 0.0 1641183 1641183 0.0
p22.pddl
1642 1642 0.0 1853218 1853218 0.0
p23.pddl
3108 3108 0.0 4481222 4481222 0.0
p24.pddl
9044 9044 0.0 3304664 3304664 0.0
p25.pddl
4274 4274 0.0 11013376 11013376 0.0
p26.pddl
4048 4048 0.0 12230627 12230627 0.0
p27.pddl
5324 5324 0.0 11028043 11028043 0.0
p28.pddl
5414 5414 0.0 None None -
p29.pddl
11444 11444 0.0 None None -
p30.pddl
8838 8838 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt08-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
22 22 0.0 67 67 0.0
p02.pddl
48 48 0.0 357 357 0.0
p03.pddl
98 98 0.0 847 847 0.0
p04.pddl
158 158 0.0 1133 1133 0.0
p05.pddl
180 180 0.0 2876 2876 0.0
p06.pddl
312 312 0.0 21740 21740 0.0
p07.pddl
472 472 0.0 82889 82889 0.0
p08.pddl
360 360 0.0 99085 99085 0.0
p09.pddl
686 686 0.0 193121 193121 0.0
p10.pddl
694 694 0.0 428427 428427 0.0
p11.pddl
30 30 0.0 145 145 0.0
p12.pddl
50 50 0.0 567 567 0.0
p13.pddl
96 96 0.0 3404 3404 0.0
p14.pddl
160 160 0.0 6781 6781 0.0
p15.pddl
958 958 0.0 10095 10095 0.0
p16.pddl
650 650 0.0 256439 256439 0.0
p17.pddl
1622 1622 0.0 927009 927009 0.0
p18.pddl
2236 2236 0.0 1467790 1467790 0.0
p19.pddl
2106 2106 0.0 3553100 3553100 0.0
p20.pddl
3088 3088 0.0 7692807 7692807 0.0
p21.pddl
44 44 0.0 68 68 0.0
p22.pddl
66 66 0.0 295 295 0.0
p23.pddl
110 110 0.0 937 937 0.0
p24.pddl
72 72 0.0 1387 1387 0.0
p25.pddl
250 250 0.0 4824 4824 0.0
p26.pddl
238 238 0.0 24726 24726 0.0
p27.pddl
296 296 0.0 17190 17190 0.0
p28.pddl
1098 1098 0.0 263704 263704 0.0
p29.pddl
598 598 0.0 205873 205873 0.0
p30.pddl
616 616 0.0 219234 219234 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
110 110 0.0 937 937 0.0
p02.pddl
98 98 0.0 847 847 0.0
p03.pddl
50 50 0.0 567 567 0.0
p04.pddl
96 96 0.0 3404 3404 0.0
p05.pddl
72 72 0.0 1387 1387 0.0
p06.pddl
158 158 0.0 1133 1133 0.0
p07.pddl
184 184 0.0 2432 2432 0.0
p08.pddl
204 204 0.0 19643 19643 0.0
p09.pddl
370 370 0.0 7491 7491 0.0
p10.pddl
472 472 0.0 26560 26560 0.0
p11.pddl
680 680 0.0 12127 12127 0.0
p12.pddl
522 522 0.0 63387 63387 0.0
p13.pddl
396 396 0.0 6742 6742 0.0
p14.pddl
352 352 0.0 29698 29698 0.0
p15.pddl
420 420 0.0 5441 5441 0.0
p16.pddl
796 796 0.0 47009 47009 0.0
p17.pddl
180 180 0.0 2876 2876 0.0
p18.pddl
160 160 0.0 6781 6781 0.0
p19.pddl
250 250 0.0 4824 4824 0.0
p20.pddl
312 312 0.0 21740 21740 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
80 80 0.0 395 395 0.0
p02.pddl
90 90 0.0 2056 2056 0.0
p03.pddl
94 94 0.0 2403 2403 0.0
p04.pddl
114 114 0.0 11724 11724 0.0
p05.pddl
204 204 0.0 80027 80027 0.0
p06.pddl
336 336 0.0 28542 28542 0.0
p07.pddl
160 160 0.0 4286 4286 0.0
p08.pddl
248 248 0.0 12556 12556 0.0
p09.pddl
258 258 0.0 24442 24442 0.0
p10.pddl
312 312 0.0 343585 343585 0.0
p11.pddl
732 732 0.0 876536 876536 0.0
p12.pddl
892 892 0.0 1562424 1562424 0.0
p13.pddl
110 110 0.0 3082 3082 0.0
p14.pddl
150 150 0.0 3053 3053 0.0
p15.pddl
164 164 0.0 11317 11317 0.0
p16.pddl
202 202 0.0 403898 403898 0.0
p17.pddl
624 624 0.0 658520 658520 0.0
p18.pddl
470 470 0.0 973332 973332 0.0
p19.pddl
790 790 0.0 331278 331278 0.0
p20.pddl
790 790 0.0 331278 331278 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
trucks-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
136 136 0.0 272 272 0.0
p02.pddl
168 168 0.0 13503 13503 0.0
p03.pddl
209 209 0.0 260252 260252 0.0
p04.pddl
13208 13208 0.0 853 853 0.0
p05.pddl
264 264 0.0 1028 1028 0.0
p06.pddl
466 466 0.0 1369 1369 0.0
p07.pddl
6141 6141 0.0 7786485 7786485 0.0
p08.pddl
970 970 0.0 None None -
p09.pddl
4336 4336 0.0 None None -
p10.pddl
417265 417265 0.0 None None -
p11.pddl
45368 45368 0.0 None None -
p12.pddl
640268 640268 0.0 None None -
p13.pddl
4337789 4337789 0.0 None None -
p14.pddl
192742 192742 0.0 None None -
p15.pddl
3150161 3150161 0.0 None None -
p16.pddl
13050214 13050214 0.0 None None -
p17.pddl
4866960 4866960 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
None None - None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
8 8 0.0 7 7 0.0
problem02-half.pddl
6 6 0.0 3 3 0.0
problem03-full.pddl
30 30 0.0 23 23 0.0
problem03-half.pddl
18 18 0.0 16 16 0.0
problem04-full.pddl
62 62 0.0 47 47 0.0
problem04-half.pddl
44 44 0.0 31 31 0.0
problem05-full.pddl
92 92 0.0 79 79 0.0
problem05-half.pddl
72 72 0.0 76 76 0.0
problem06-full.pddl
204 204 0.0 118 118 0.0
problem06-half.pddl
112 112 0.0 100 100 0.0
problem07-full.pddl
196 196 0.0 185 185 0.0
problem07-half.pddl
186 186 0.0 176 176 0.0
problem08-full.pddl
328 328 0.0 222 222 0.0
problem08-half.pddl
262 262 0.0 186 186 0.0
problem09-full.pddl
400 400 0.0 287 287 0.0
problem09-half.pddl
546 546 0.0 367 367 0.0
problem10-full.pddl
514 514 0.0 358 358 0.0
problem10-half.pddl
468 468 0.0 331 331 0.0
problem11-full.pddl
956 956 0.0 483 483 0.0
problem11-half.pddl
456 456 0.0 488 488 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt14-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
92 92 0.0 79 79 0.0
p-1-6.pddl
204 204 0.0 118 118 0.0
p-1-7.pddl
196 196 0.0 185 185 0.0
p-1-8.pddl
328 328 0.0 222 222 0.0
p-1-9.pddl
400 400 0.0 287 287 0.0
p-1-10.pddl
514 514 0.0 358 358 0.0
p-1-11.pddl
956 956 0.0 483 483 0.0
p-1-12.pddl
800 800 0.0 530 530 0.0
p-1-13.pddl
1482 1482 0.0 642 642 0.0
p-1-14.pddl
1816 1816 0.0 739 739 0.0
p-1-15.pddl
2096 2096 0.0 919 919 0.0
p-1-16.pddl
2632 2632 0.0 984 984 0.0
p-1-17.pddl
2502 2502 0.0 1184 1184 0.0
p-1-18.pddl
3298 3298 0.0 1317 1317 0.0
p-05-5.pddl
94 94 0.0 81 81 0.0
p-05-6.pddl
114 114 0.0 119 119 0.0
p-05-7.pddl
234 234 0.0 148 148 0.0
p-05-8.pddl
288 288 0.0 198 198 0.0
p-05-9.pddl
360 360 0.0 283 283 0.0
p-05-10.pddl
422 422 0.0 290 290 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt08-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
20 20 0.0 133 133 0.0
p02.pddl
582 582 0.0 134 134 0.0
p03.pddl
72 72 0.0 357 357 0.0
p04.pddl
61 61 0.0 None None -
p05.pddl
5848 5848 0.0 1289 1289 0.0
p06.pddl
48 48 0.0 50616 50616 0.0
p07.pddl
92 92 0.0 1899 1899 0.0
p08.pddl
58 58 0.0 None None -
p09.pddl
14552 14552 0.0 None None -
p10.pddl
114 114 0.0 404462 404462 0.0
p11.pddl
18 18 0.0 138 138 0.0
p12.pddl
30 30 0.0 234 234 0.0
p13.pddl
30 30 0.0 670 670 0.0
p14.pddl
5819 5819 0.0 326 326 0.0
p15.pddl
8056 8056 0.0 571 571 0.0
p16.pddl
6462 6462 0.0 None None -
p17.pddl
7188 7188 0.0 32569 32569 0.0
p18.pddl
54 54 0.0 84117 84117 0.0
p19.pddl
98 98 0.0 1398 1398 0.0
p20.pddl
10034 10034 0.0 231037 231037 0.0
p21.pddl
182 182 0.0 40 40 0.0
p22.pddl
20 20 0.0 103 103 0.0
p23.pddl
26 26 0.0 150 150 0.0
p24.pddl
6538 6538 0.0 16755808 16755808 0.0
p25.pddl
9080 9080 0.0 635 635 0.0
p26.pddl
41 41 0.0 None None -
p27.pddl
7851 7851 0.0 None None -
p28.pddl
14229 14229 0.0 None None -
p29.pddl
70 70 0.0 1785 1785 0.0
p30.pddl
14192 14192 0.0 2702019 2702019 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt11-strips
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
26 26 0.0 150 150 0.0
p02.pddl
30 30 0.0 234 234 0.0
p03.pddl
30 30 0.0 670 670 0.0
p04.pddl
72 72 0.0 357 357 0.0
p05.pddl
6538 6538 0.0 16755808 16755808 0.0
p06.pddl
61 61 0.0 None None -
p07.pddl
5819 5819 0.0 326 326 0.0
p08.pddl
9080 9080 0.0 635 635 0.0
p09.pddl
5848 5848 0.0 1289 1289 0.0
p10.pddl
8056 8056 0.0 571 571 0.0
p11.pddl
41 41 0.0 None None -
p12.pddl
6462 6462 0.0 None None -
p13.pddl
48 48 0.0 50616 50616 0.0
p14.pddl
7851 7851 0.0 None None -
p15.pddl
7188 7188 0.0 32569 32569 0.0
p16.pddl
92 92 0.0 1899 1899 0.0
p17.pddl
14229 14229 0.0 None None -
p18.pddl
54 54 0.0 84117 84117 0.0
p19.pddl
58 58 0.0 None None -
p20.pddl
70 70 0.0 1785 1785 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
zenotravel
Show table
evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
6 6 0.0 6 6 0.0
p02.pddl
26 26 0.0 23 23 0.0
p03.pddl
28 28 0.0 644 644 0.0
p04.pddl
46 46 0.0 858 858 0.0
p05.pddl
64 64 0.0 1103 1103 0.0
p06.pddl
52 52 0.0 2529 2529 0.0
p07.pddl
102 102 0.0 1997 1997 0.0
p08.pddl
112 112 0.0 8337 8337 0.0
p09.pddl
186 186 0.0 8849 8849 0.0
p10.pddl
218 218 0.0 15077 15077 0.0
p11.pddl
90 90 0.0 23454 23454 0.0
p12.pddl
168 168 0.0 18025 18025 0.0
p13.pddl
284 284 0.0 48098 48098 0.0
p14.pddl
510 510 0.0 1363674 1363674 0.0
p15.pddl
1436 1436 0.0 491809 491809 0.0
p16.pddl
632 632 0.0 2563644 2563644 0.0
p17.pddl
1620 1620 0.0 12614002 12614002 0.0
p18.pddl
2204 2204 0.0 1956299 1956299 0.0
p19.pddl
2522 2522 0.0 2162132 2162132 0.0
p20.pddl
5408 5408 0.0 3463234 3463234 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
expansions
Show table
Only instances where all algorithms have a value for "expansions" are considered. Each table entry gives the geometric mean of "expansions" for that domain. The bottom row reports the geometric mean across all domains.
agricola-opt18-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
112 112 0.0 127106 127106 0.0
p02.pddl
510 510 0.0 139194 139194 0.0
p03.pddl
160 160 0.0 146321 146321 0.0
p04.pddl
193 193 0.0 167027 167027 0.0
p05.pddl
144 144 0.0 120861 120861 0.0
p06.pddl
128 128 0.0 230461 230461 0.0
p07.pddl
723 723 0.0 146215 146215 0.0
p08.pddl
164 164 0.0 184870 184870 0.0
p09.pddl
162 162 0.0 191559 191559 0.0
p10.pddl
752 752 0.0 112257 112257 0.0
p11.pddl
210 210 0.0 161931 161931 0.0
p12.pddl
325 325 0.0 161117 161117 0.0
p13.pddl
244 244 0.0 118268 118268 0.0
p14.pddl
190 190 0.0 135764 135764 0.0
p15.pddl
648 648 0.0 207755 207755 0.0
p16.pddl
206 206 0.0 172310 172310 0.0
p17.pddl
250 250 0.0 161679 161679 0.0
p18.pddl
1472 1472 0.0 185486 185486 0.0
p19.pddl
217 217 0.0 129029 129029 0.0
p20.pddl
331 331 0.0 170438 170438 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
airport
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
8 8 0.0 9 9 0.0
p02-airport1-p1.pddl
9 9 0.0 10 10 0.0
p03-airport1-p2.pddl
22 22 0.0 21 21 0.0
p04-airport2-p1.pddl
20 20 0.0 21 21 0.0
p05-airport2-p1.pddl
23 23 0.0 22 22 0.0
p06-airport2-p2.pddl
51 51 0.0 42 42 0.0
p07-airport2-p2.pddl
49 49 0.0 56 56 0.0
p08-airport2-p3.pddl
332 332 0.0 392 392 0.0
p09-airport2-p4.pddl
433 433 0.0 10151 10151 0.0
p10-airport3-p1.pddl
18 18 0.0 19 19 0.0
p11-airport3-p1.pddl
23 23 0.0 22 22 0.0
p12-airport3-p2.pddl
77 77 0.0 40 40 0.0
p13-airport3-p2.pddl
53 53 0.0 45 45 0.0
p14-airport3-p3.pddl
2308 2308 0.0 61 61 0.0
p15-airport3-p3.pddl
258 258 0.0 286 286 0.0
p16-airport3-p4.pddl
14707 14707 0.0 13784 13784 0.0
p17-airport3-p5.pddl
3613 3613 0.0 260855 260855 0.0
p18-airport3-p6.pddl
10751 10751 0.0 2112469 2112469 0.0
p19-airport3-p6.pddl
4805 4805 0.0 3261404 3261404 0.0
p20-airport3-p7.pddl
25218 25218 0.0 18085322 18085322 0.0
p21-airport4halfMUC-p2.pddl
329 329 0.0 102 102 0.0
p22-airport4halfMUC-p3.pddl
35747 35747 0.0 149 149 0.0
p23-airport4halfMUC-p4.pddl
50202 50202 0.0 169 169 0.0
p24-airport4halfMUC-p4.pddl
30581 30581 0.0 163 163 0.0
p25-airport4halfMUC-p5.pddl
38027 38027 0.0 None None -
p26-airport4halfMUC-p6.pddl
None None - None None -
p27-airport4halfMUC-p6.pddl
29963 29963 0.0 None None -
p28-airport4halfMUC-p7.pddl
None None - None None -
p29-airport4halfMUC-p8.pddl
None None - None None -
p30-airport4halfMUC-p8.pddl
None None - None None -
p31-airport4halfMUC-p9.pddl
None None - None None -
p32-airport4halfMUC-p10.pddl
None None - None None -
p33-airport4halfMUC-p10.pddl
None None - None None -
p34-airport4halfMUC-p11.pddl
None None - None None -
p35-airport4halfMUC-p12.pddl
None None - None None -
p36-airport5MUC-p2.pddl
118 118 0.0 623 623 0.0
p37-airport5MUC-p3.pddl
28978 28978 0.0 854122 854122 0.0
p38-airport5MUC-p3.pddl
39874 39874 0.0 101612 101612 0.0
p39-airport5MUC-p4.pddl
37822 37822 0.0 None None -
p40-airport5MUC-p4.pddl
5171 5171 0.0 834553 834553 0.0
p41-airport5MUC-p4.pddl
33984 33984 0.0 None None -
p42-airport5MUC-p5.pddl
None None - None None -
p43-airport5MUC-p5.pddl
40556 40556 0.0 141488 141488 0.0
p44-airport5MUC-p5.pddl
47313 47313 0.0 None None -
p45-airport5MUC-p6.pddl
None None - None None -
p46-airport5MUC-p6.pddl
None None - None None -
p47-airport5MUC-p8.pddl
None None - None None -
p48-airport5MUC-p9.pddl
None None - None None -
p49-airport5MUC-p10.pddl
None None - None None -
p50-airport5MUC-p15.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
937 937 0.0 12485 12485 0.0
pfile01-002.pddl
444 444 0.0 9497 9497 0.0
pfile01-003.pddl
447 447 0.0 9477 9477 0.0
pfile01-004.pddl
452 452 0.0 9497 9497 0.0
pfile02-005.pddl
1003 1003 0.0 40248 40248 0.0
pfile02-006.pddl
722 722 0.0 762955 762955 0.0
pfile02-007.pddl
917 917 0.0 40108 40108 0.0
pfile02-008.pddl
878 878 0.0 51521 51521 0.0
pfile03-009.pddl
1318 1318 0.0 146867 146867 0.0
pfile03-010.pddl
2325 2325 0.0 147798 147798 0.0
pfile03-011.pddl
1444 1444 0.0 161064 161064 0.0
pfile03-012.pddl
2160 2160 0.0 161182 161182 0.0
pfile04-013.pddl
2578 2578 0.0 543501 543501 0.0
pfile04-014.pddl
2628 2628 0.0 1308730 1308730 0.0
pfile04-015.pddl
3744 3744 0.0 619605 619605 0.0
pfile04-016.pddl
3803 3803 0.0 543260 543260 0.0
pfile05-017.pddl
3036 3036 0.0 920164 920164 0.0
pfile05-018.pddl
3057 3057 0.0 1125164 1125164 0.0
pfile05-019.pddl
3183 3183 0.0 1738176 1738176 0.0
pfile05-020.pddl
2654 2654 0.0 2456022 2456022 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
986 986 0.0 762810 762810 0.0
p435-2.pddl
1525 1525 0.0 40762 40762 0.0
p435-3.pddl
978 978 0.0 763344 763344 0.0
p536-1.pddl
1385 1385 0.0 6871545 6871545 0.0
p536-2.pddl
2361 2361 0.0 147941 147941 0.0
p536-3.pddl
1317 1317 0.0 146879 146879 0.0
p638-1.pddl
2091 2091 0.0 543568 543568 0.0
p638-2.pddl
1552 1552 0.0 1100065 1100065 0.0
p638-3.pddl
2805 2805 0.0 619424 619424 0.0
p739-1.pddl
2615 2615 0.0 1530890 1530890 0.0
p739-2.pddl
4745 4745 0.0 1766964 1766964 0.0
p739-3.pddl
3318 3318 0.0 1765920 1765920 0.0
p839-1.pddl
4532 4532 0.0 3185078 3185078 0.0
p839-2.pddl
4120 4120 0.0 2833038 2833038 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
blocks
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
11 11 0.0 7 7 0.0
probBLOCKS-4-1.pddl
12 12 0.0 40 40 0.0
probBLOCKS-4-2.pddl
10 10 0.0 9 9 0.0
probBLOCKS-5-0.pddl
16 16 0.0 35 35 0.0
probBLOCKS-5-1.pddl
17 17 0.0 83 83 0.0
probBLOCKS-5-2.pddl
35 35 0.0 130 130 0.0
probBLOCKS-6-0.pddl
20 20 0.0 161 161 0.0
probBLOCKS-6-1.pddl
24 24 0.0 13 13 0.0
probBLOCKS-6-2.pddl
52 52 0.0 79 79 0.0
probBLOCKS-7-0.pddl
43 43 0.0 645 645 0.0
probBLOCKS-7-1.pddl
85 85 0.0 682 682 0.0
probBLOCKS-7-2.pddl
82 82 0.0 382 382 0.0
probBLOCKS-8-0.pddl
63 63 0.0 272 272 0.0
probBLOCKS-8-1.pddl
56 56 0.0 1083 1083 0.0
probBLOCKS-8-2.pddl
45 45 0.0 127 127 0.0
probBLOCKS-9-0.pddl
187 187 0.0 1593 1593 0.0
probBLOCKS-9-1.pddl
215 215 0.0 1670 1670 0.0
probBLOCKS-9-2.pddl
89 89 0.0 1311 1311 0.0
probBLOCKS-10-0.pddl
172 172 0.0 208 208 0.0
probBLOCKS-10-1.pddl
176 176 0.0 4643 4643 0.0
probBLOCKS-10-2.pddl
213 213 0.0 2730 2730 0.0
probBLOCKS-11-0.pddl
96 96 0.0 2267 2267 0.0
probBLOCKS-11-1.pddl
204 204 0.0 6409 6409 0.0
probBLOCKS-11-2.pddl
134 134 0.0 1179 1179 0.0
probBLOCKS-12-0.pddl
229 229 0.0 2873 2873 0.0
probBLOCKS-12-1.pddl
233 233 0.0 6486 6486 0.0
probBLOCKS-13-0.pddl
629 629 0.0 3625 3625 0.0
probBLOCKS-13-1.pddl
492 492 0.0 3851 3851 0.0
probBLOCKS-14-0.pddl
197 197 0.0 2308 2308 0.0
probBLOCKS-14-1.pddl
294 294 0.0 4969 4969 0.0
probBLOCKS-15-0.pddl
1114 1114 0.0 9426 9426 0.0
probBLOCKS-15-1.pddl
353 353 0.0 77284 77284 0.0
probBLOCKS-16-1.pddl
475 475 0.0 13757 13757 0.0
probBLOCKS-16-2.pddl
2936 2936 0.0 12805 12805 0.0
probBLOCKS-17-0.pddl
3247 3247 0.0 523601 523601 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
childsnack-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
155 155 0.0 145774 145774 0.0
child-snack_pfile01.pddl
108 108 0.0 164424 164424 0.0
child-snack_pfile02-2.pddl
175 175 0.0 481578 481578 0.0
child-snack_pfile02.pddl
136 136 0.0 643137 643137 0.0
child-snack_pfile03-2.pddl
423 423 0.0 1750207 1750207 0.0
child-snack_pfile03.pddl
324 324 0.0 1774369 1774369 0.0
child-snack_pfile04-2.pddl
292 292 0.0 None None -
child-snack_pfile04.pddl
353 353 0.0 None None -
child-snack_pfile05-2.pddl
415 415 0.0 None None -
child-snack_pfile05.pddl
387 387 0.0 None None -
child-snack_pfile06-2.pddl
370 370 0.0 None None -
child-snack_pfile06.pddl
418 418 0.0 None None -
child-snack_pfile07-2.pddl
452 452 0.0 None None -
child-snack_pfile07.pddl
605 605 0.0 None None -
child-snack_pfile08-2.pddl
547 547 0.0 None None -
child-snack_pfile08.pddl
None None - None None -
child-snack_pfile09-2.pddl
None None - None None -
child-snack_pfile09.pddl
None None - None None -
child-snack_pfile10-2.pddl
None None - None None -
child-snack_pfile10.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
data-network-opt18-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
38 38 0.0 47 47 0.0
p02.pddl
9 9 0.0 50 50 0.0
p03.pddl
14 14 0.0 285 285 0.0
p04.pddl
16 16 0.0 48 48 0.0
p05.pddl
21 21 0.0 464 464 0.0
p06.pddl
14 14 0.0 432 432 0.0
p07.pddl
148 148 0.0 1558845 1558845 0.0
p08.pddl
4320 4320 0.0 1166 1166 0.0
p09.pddl
38 38 0.0 352 352 0.0
p10.pddl
14 14 0.0 83 83 0.0
p11.pddl
12 12 0.0 397 397 0.0
p12.pddl
12 12 0.0 375 375 0.0
p13.pddl
12 12 0.0 115 115 0.0
p14.pddl
1411 1411 0.0 264 264 0.0
p15.pddl
15 15 0.0 795 795 0.0
p16.pddl
181 181 0.0 5144 5144 0.0
p17.pddl
13 13 0.0 1159 1159 0.0
p18.pddl
5782 5782 0.0 350288 350288 0.0
p19.pddl
30 30 0.0 14260 14260 0.0
p20.pddl
1529 1529 0.0 1532833 1532833 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
depot
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
19 19 0.0 46 46 0.0
p02.pddl
43 43 0.0 48 48 0.0
p03.pddl
3536 3536 0.0 6464 6464 0.0
p04.pddl
1787 1787 0.0 188 188 0.0
p05.pddl
69814 69814 0.0 292 292 0.0
p06.pddl
7137195 7137195 0.0 437 437 0.0
p07.pddl
531 531 0.0 105116 105116 0.0
p08.pddl
6590 6590 0.0 1952 1952 0.0
p09.pddl
29134 29134 0.0 386794 386794 0.0
p10.pddl
8032 8032 0.0 1346 1346 0.0
p11.pddl
15855 15855 0.0 1252 1252 0.0
p12.pddl
28964 28964 0.0 None None -
p13.pddl
99 99 0.0 137 137 0.0
p14.pddl
522 522 0.0 1012677 1012677 0.0
p15.pddl
274028 274028 0.0 4742476 4742476 0.0
p16.pddl
137 137 0.0 783477 783477 0.0
p17.pddl
95 95 0.0 6754 6754 0.0
p18.pddl
640 640 0.0 None None -
p19.pddl
13184 13184 0.0 8848417 8848417 0.0
p20.pddl
None None - 24939 24939 0.0
p21.pddl
196 196 0.0 977490 977490 0.0
p22.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
driverlog
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
10 10 0.0 11 11 0.0
p02.pddl
4735 4735 0.0 274 274 0.0
p03.pddl
25 25 0.0 167 167 0.0
p04.pddl
4334 4334 0.0 503 503 0.0
p05.pddl
4693 4693 0.0 3683 3683 0.0
p06.pddl
563 563 0.0 39 39 0.0
p07.pddl
42 42 0.0 131 131 0.0
p08.pddl
5880 5880 0.0 361 361 0.0
p09.pddl
600 600 0.0 357 357 0.0
p10.pddl
68 68 0.0 536 536 0.0
p11.pddl
127 127 0.0 352 352 0.0
p12.pddl
6802 6802 0.0 658 658 0.0
p13.pddl
3371 3371 0.0 624 624 0.0
p14.pddl
180 180 0.0 1874 1874 0.0
p15.pddl
248 248 0.0 9756 9756 0.0
p16.pddl
38207 38207 0.0 59081 59081 0.0
p17.pddl
1478 1478 0.0 None None -
p18.pddl
41282 41282 0.0 199908 199908 0.0
p19.pddl
44922 44922 0.0 632933 632933 0.0
p20.pddl
19649 19649 0.0 84243 84243 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt08-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
65 65 0.0 608 608 0.0
p02.pddl
15 15 0.0 207 207 0.0
p03.pddl
55 55 0.0 277 277 0.0
p04.pddl
66 66 0.0 3229 3229 0.0
p05.pddl
83 83 0.0 1124 1124 0.0
p06.pddl
124 124 0.0 2644 2644 0.0
p07.pddl
126 126 0.0 906 906 0.0
p08.pddl
54 54 0.0 1575 1575 0.0
p09.pddl
220 220 0.0 3760 3760 0.0
p10.pddl
160 160 0.0 2125 2125 0.0
p11.pddl
54 54 0.0 828 828 0.0
p12.pddl
66 66 0.0 916 916 0.0
p13.pddl
54 54 0.0 384 384 0.0
p14.pddl
98 98 0.0 1425 1425 0.0
p15.pddl
100 100 0.0 543 543 0.0
p16.pddl
178 178 0.0 5266 5266 0.0
p17.pddl
190 190 0.0 619 619 0.0
p18.pddl
106 106 0.0 2353 2353 0.0
p19.pddl
195 195 0.0 1761 1761 0.0
p20.pddl
125 125 0.0 1318 1318 0.0
p21.pddl
46 46 0.0 4366 4366 0.0
p22.pddl
36 36 0.0 7698 7698 0.0
p23.pddl
64 64 0.0 6515 6515 0.0
p24.pddl
116 116 0.0 18544 18544 0.0
p25.pddl
94 94 0.0 3375 3375 0.0
p26.pddl
41 41 0.0 528 528 0.0
p27.pddl
214 214 0.0 3439 3439 0.0
p28.pddl
114 114 0.0 3901 3901 0.0
p29.pddl
207 207 0.0 4899 4899 0.0
p30.pddl
231 231 0.0 28300 28300 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54 54 0.0 828 828 0.0
p02.pddl
46 46 0.0 4366 4366 0.0
p03.pddl
66 66 0.0 916 916 0.0
p04.pddl
55 55 0.0 277 277 0.0
p05.pddl
54 54 0.0 384 384 0.0
p06.pddl
66 66 0.0 3229 3229 0.0
p07.pddl
41 41 0.0 528 528 0.0
p08.pddl
83 83 0.0 1124 1124 0.0
p09.pddl
36 36 0.0 7698 7698 0.0
p10.pddl
98 98 0.0 1425 1425 0.0
p11.pddl
114 114 0.0 3901 3901 0.0
p12.pddl
124 124 0.0 2644 2644 0.0
p13.pddl
126 126 0.0 906 906 0.0
p14.pddl
54 54 0.0 1575 1575 0.0
p15.pddl
220 220 0.0 3760 3760 0.0
p16.pddl
100 100 0.0 543 543 0.0
p17.pddl
190 190 0.0 619 619 0.0
p18.pddl
106 106 0.0 2353 2353 0.0
p19.pddl
64 64 0.0 6515 6515 0.0
p20.pddl
116 116 0.0 18544 18544 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
1622 1622 0.0 690368 690368 0.0
opt-p01-002.pddl
92 92 0.0 421830 421830 0.0
opt-p02-003.pddl
574614 574614 0.0 None None -
opt-p02-004.pddl
315224 315224 0.0 None None -
opt-p03-005.pddl
438905 438905 0.0 None None -
opt-p03-006.pddl
2992068 2992068 0.0 None None -
opt-p04-007.pddl
4895439 4895439 0.0 None None -
opt-p04-008.pddl
12166240 12166240 0.0 None None -
opt-p05-009.pddl
2676923 2676923 0.0 None None -
opt-p05-010.pddl
None None - None None -
opt-p06-011.pddl
None None - None None -
opt-p06-012.pddl
None None - None None -
opt-p07-013.pddl
None None - None None -
opt-p07-014.pddl
None None - None None -
opt-p08-015.pddl
None None - None None -
opt-p08-016.pddl
None None - None None -
opt-p09-017.pddl
None None - None None -
opt-p09-018.pddl
None None - None None -
opt-p10-019.pddl
None None - None None -
opt-p10-020.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
400465 400465 0.0 None None -
p01-4-4-2.pddl
6796275 6796275 0.0 None None -
p01-5-3-2.pddl
5150629 5150629 0.0 None None -
p01-5-4-2.pddl
None None - None None -
p01-5-5-2.pddl
None None - None None -
p01-6-4-2.pddl
None None - None None -
p01-6-5-2.pddl
None None - None None -
p02-4-4-2.pddl
8019451 8019451 0.0 None None -
p02-5-3-2.pddl
2565445 2565445 0.0 None None -
p02-5-4-2.pddl
None None - None None -
p02-5-5-2.pddl
None None - None None -
p02-6-4-2.pddl
None None - None None -
p02-6-5-2.pddl
None None - None None -
p03-4-3-2.pddl
474785 474785 0.0 None None -
p03-4-4-2.pddl
5874972 5874972 0.0 None None -
p03-5-3-2.pddl
2873703 2873703 0.0 None None -
p03-5-4-2.pddl
5933151 5933151 0.0 None None -
p03-5-5-2.pddl
None None - None None -
p03-6-4-2.pddl
None None - None None -
p03-6-5-2.pddl
None None - None None -
Sum of diffs
0.00
None
Arithmetic mean of diffs
0.00
None
freecell
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
8 8 0.0 9 9 0.0
p02.pddl
15 15 0.0 15 15 0.0
p03.pddl
19 19 0.0 24 24 0.0
p04.pddl
68 68 0.0 40 40 0.0
p05.pddl
40 40 0.0 35 35 0.0
p06.pddl
78 78 0.0 46 46 0.0
p07.pddl
1055 1055 0.0 2223 2223 0.0
p08.pddl
82 82 0.0 62 62 0.0
p09.pddl
93 93 0.0 63 63 0.0
p10.pddl
511 511 0.0 97 97 0.0
p11.pddl
2890 2890 0.0 2865 2865 0.0
p12.pddl
86 86 0.0 57 57 0.0
p13.pddl
3167 3167 0.0 175 175 0.0
p14.pddl
146 146 0.0 336 336 0.0
p15.pddl
309 309 0.0 85 85 0.0
p16.pddl
280 280 0.0 358 358 0.0
p17.pddl
212 212 0.0 101 101 0.0
p18.pddl
1086 1086 0.0 34695 34695 0.0
p19.pddl
13535 13535 0.0 29371 29371 0.0
p20.pddl
556 556 0.0 15883 15883 0.0
probfreecell-2-1.pddl
9 9 0.0 10 10 0.0
probfreecell-2-2.pddl
8 8 0.0 9 9 0.0
probfreecell-2-3.pddl
8 8 0.0 9 9 0.0
probfreecell-2-4.pddl
8 8 0.0 9 9 0.0
probfreecell-2-5.pddl
9 9 0.0 10 10 0.0
probfreecell-3-1.pddl
14 14 0.0 15 15 0.0
probfreecell-3-2.pddl
13 13 0.0 14 14 0.0
probfreecell-3-3.pddl
13 13 0.0 14 14 0.0
probfreecell-3-4.pddl
12 12 0.0 13 13 0.0
probfreecell-3-5.pddl
14 14 0.0 15 15 0.0
probfreecell-4-1.pddl
21 21 0.0 21 21 0.0
probfreecell-4-2.pddl
17 17 0.0 18 18 0.0
probfreecell-4-3.pddl
18 18 0.0 19 19 0.0
probfreecell-4-4.pddl
19 19 0.0 19 19 0.0
probfreecell-4-5.pddl
19 19 0.0 20 20 0.0
probfreecell-5-1.pddl
35 35 0.0 28 28 0.0
probfreecell-5-2.pddl
27 27 0.0 24 24 0.0
probfreecell-5-3.pddl
25 25 0.0 27 27 0.0
probfreecell-5-4.pddl
27 27 0.0 27 27 0.0
probfreecell-5-5.pddl
29 29 0.0 27 27 0.0
probfreecell-6-1.pddl
45 45 0.0 34 34 0.0
probfreecell-6-2.pddl
29 29 0.0 31 31 0.0
probfreecell-6-3.pddl
34 34 0.0 32 32 0.0
probfreecell-6-4.pddl
36 36 0.0 34 34 0.0
probfreecell-6-5.pddl
50 50 0.0 38 38 0.0
probfreecell-7-1.pddl
73 73 0.0 42 42 0.0
probfreecell-7-2.pddl
36 36 0.0 38 38 0.0
probfreecell-7-3.pddl
71 71 0.0 41 41 0.0
probfreecell-7-4.pddl
85 85 0.0 64 64 0.0
probfreecell-7-5.pddl
65 65 0.0 71 71 0.0
probfreecell-8-1.pddl
155 155 0.0 70 70 0.0
probfreecell-8-2.pddl
73 73 0.0 45 45 0.0
probfreecell-8-3.pddl
90 90 0.0 45 45 0.0
probfreecell-8-4.pddl
83 83 0.0 59 59 0.0
probfreecell-8-5.pddl
144 144 0.0 67 67 0.0
probfreecell-9-1.pddl
163 163 0.0 83 83 0.0
probfreecell-9-2.pddl
113 113 0.0 79 79 0.0
probfreecell-9-3.pddl
95 95 0.0 52 52 0.0
probfreecell-9-4.pddl
144 144 0.0 73 73 0.0
probfreecell-9-5.pddl
167 167 0.0 120 120 0.0
probfreecell-10-1.pddl
1774 1774 0.0 1865 1865 0.0
probfreecell-10-2.pddl
146 146 0.0 238 238 0.0
probfreecell-10-3.pddl
192 192 0.0 4907 4907 0.0
probfreecell-10-4.pddl
228 228 0.0 4268 4268 0.0
probfreecell-10-5.pddl
579 579 0.0 169 169 0.0
probfreecell-11-1.pddl
269 269 0.0 16220 16220 0.0
probfreecell-11-2.pddl
377 377 0.0 19432 19432 0.0
probfreecell-11-3.pddl
269 269 0.0 3370 3370 0.0
probfreecell-11-4.pddl
285 285 0.0 193 193 0.0
probfreecell-11-5.pddl
None None - 368 368 0.0
probfreecell-12-1.pddl
16698 16698 0.0 25465 25465 0.0
probfreecell-12-2.pddl
725 725 0.0 3231 3231 0.0
probfreecell-12-3.pddl
178 178 0.0 1801 1801 0.0
probfreecell-12-4.pddl
471 471 0.0 8460 8460 0.0
probfreecell-12-5.pddl
643313 643313 0.0 10874 10874 0.0
probfreecell-13-1.pddl
30937 30937 0.0 22121 22121 0.0
probfreecell-13-2.pddl
16552 16552 0.0 17704 17704 0.0
probfreecell-13-3.pddl
444 444 0.0 2342 2342 0.0
probfreecell-13-4.pddl
4450 4450 0.0 1724 1724 0.0
probfreecell-13-5.pddl
535483 535483 0.0 435623 435623 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
ged-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
2 2 0.0 2 2 0.0
d-1-3.pddl
12 12 0.0 13 13 0.0
d-1-4.pddl
2 2 0.0 2 2 0.0
d-1-8.pddl
25 25 0.0 24 24 0.0
d-2-1.pddl
2 2 0.0 2 2 0.0
d-2-3.pddl
12 12 0.0 12 12 0.0
d-2-4.pddl
15 15 0.0 11 11 0.0
d-2-8.pddl
27 27 0.0 25 25 0.0
d-3-1.pddl
14 14 0.0 13 13 0.0
d-3-2.pddl
13 13 0.0 12 12 0.0
d-3-4.pddl
33 33 0.0 29 29 0.0
d-4-2.pddl
14 14 0.0 11 11 0.0
d-4-3.pddl
31 31 0.0 29 29 0.0
d-4-8.pddl
27 27 0.0 25 25 0.0
d-7-5.pddl
30 30 0.0 28 28 0.0
d-7-6.pddl
26 26 0.0 24 24 0.0
d-8-1.pddl
26 26 0.0 30 30 0.0
d-8-2.pddl
26 26 0.0 31 31 0.0
d-8-4.pddl
29 29 0.0 29 29 0.0
d-8-9.pddl
85 85 0.0 51 51 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
grid
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
18 18 0.0 45 45 0.0
prob02.pddl
58 58 0.0 1052 1052 0.0
prob03.pddl
226 226 0.0 None None -
prob04.pddl
125 125 0.0 960 960 0.0
prob05.pddl
590 590 0.0 1083890 1083890 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
gripper
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
16 16 0.0 26 26 0.0
prob02.pddl
25 25 0.0 50 50 0.0
prob03.pddl
34 34 0.0 82 82 0.0
prob04.pddl
43 43 0.0 122 122 0.0
prob05.pddl
52 52 0.0 170 170 0.0
prob06.pddl
61 61 0.0 226 226 0.0
prob07.pddl
70 70 0.0 290 290 0.0
prob08.pddl
79 79 0.0 362 362 0.0
prob09.pddl
88 88 0.0 442 442 0.0
prob10.pddl
97 97 0.0 530 530 0.0
prob11.pddl
106 106 0.0 626 626 0.0
prob12.pddl
115 115 0.0 730 730 0.0
prob13.pddl
124 124 0.0 842 842 0.0
prob14.pddl
133 133 0.0 962 962 0.0
prob15.pddl
142 142 0.0 1090 1090 0.0
prob16.pddl
151 151 0.0 1226 1226 0.0
prob17.pddl
160 160 0.0 1370 1370 0.0
prob18.pddl
169 169 0.0 1522 1522 0.0
prob19.pddl
178 178 0.0 1682 1682 0.0
prob20.pddl
187 187 0.0 1850 1850 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
hiking-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
137 137 0.0 386 386 0.0
ptesting-1-2-4.pddl
839 839 0.0 1570 1570 0.0
ptesting-1-2-5.pddl
2828 2828 0.0 4322 4322 0.0
ptesting-1-2-7.pddl
11323 11323 0.0 24051 24051 0.0
ptesting-1-2-8.pddl
19389 19389 0.0 45779 45779 0.0
ptesting-2-2-3.pddl
19 19 0.0 3048 3048 0.0
ptesting-2-2-4.pddl
2822 2822 0.0 29358 29358 0.0
ptesting-2-2-5.pddl
6850 6850 0.0 63843 63843 0.0
ptesting-2-2-6.pddl
11375 11375 0.0 89377 89377 0.0
ptesting-2-2-7.pddl
24017 24017 0.0 181848 181848 0.0
ptesting-2-2-8.pddl
25666 25666 0.0 220382 220382 0.0
ptesting-2-3-4.pddl
3936 3936 0.0 29310 29310 0.0
ptesting-2-3-5.pddl
7595 7595 0.0 82922 82922 0.0
ptesting-2-3-6.pddl
13714 13714 0.0 178756 178756 0.0
ptesting-2-3-7.pddl
25959 25959 0.0 206655 206655 0.0
ptesting-2-4-3.pddl
16 16 0.0 6664 6664 0.0
ptesting-2-4-4.pddl
4128 4128 0.0 42682 42682 0.0
ptesting-2-4-5.pddl
11261 11261 0.0 104891 104891 0.0
ptesting-2-4-6.pddl
13037 13037 0.0 233507 233507 0.0
ptesting-2-4-7.pddl
23674 23674 0.0 425824 425824 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics00
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
34 34 0.0 38 38 0.0
probLOGISTICS-4-1.pddl
39 39 0.0 28 28 0.0
probLOGISTICS-4-2.pddl
29 29 0.0 27 27 0.0
probLOGISTICS-5-0.pddl
57 57 0.0 40 40 0.0
probLOGISTICS-5-1.pddl
27 27 0.0 27 27 0.0
probLOGISTICS-5-2.pddl
11 11 0.0 12 12 0.0
probLOGISTICS-6-0.pddl
52 52 0.0 38 38 0.0
probLOGISTICS-6-1.pddl
28 28 0.0 27 27 0.0
probLOGISTICS-6-2.pddl
55 55 0.0 41 41 0.0
probLOGISTICS-6-9.pddl
61 61 0.0 41 41 0.0
probLOGISTICS-7-0.pddl
101 101 0.0 73 73 0.0
probLOGISTICS-7-1.pddl
174 174 0.0 91 91 0.0
probLOGISTICS-8-0.pddl
73 73 0.0 60 60 0.0
probLOGISTICS-8-1.pddl
129 129 0.0 93 93 0.0
probLOGISTICS-9-0.pddl
102 102 0.0 87 87 0.0
probLOGISTICS-9-1.pddl
67 67 0.0 61 61 0.0
probLOGISTICS-10-0.pddl
186 186 0.0 113 113 0.0
probLOGISTICS-10-1.pddl
128 128 0.0 106 106 0.0
probLOGISTICS-11-0.pddl
162 162 0.0 138 138 0.0
probLOGISTICS-11-1.pddl
292 292 0.0 144 144 0.0
probLOGISTICS-12-0.pddl
150 150 0.0 111 111 0.0
probLOGISTICS-12-1.pddl
317 317 0.0 178 178 0.0
probLOGISTICS-13-0.pddl
541 541 0.0 2128 2128 0.0
probLOGISTICS-13-1.pddl
442 442 0.0 1994 1994 0.0
probLOGISTICS-14-0.pddl
301 301 0.0 2257 2257 0.0
probLOGISTICS-14-1.pddl
419 419 0.0 2972 2972 0.0
probLOGISTICS-15-0.pddl
626 626 0.0 2969 2969 0.0
probLOGISTICS-15-1.pddl
367 367 0.0 4176 4176 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics98
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
86 86 0.0 2268 2268 0.0
prob02.pddl
150 150 0.0 19678 19678 0.0
prob03.pddl
202 202 0.0 333860 333860 0.0
prob04.pddl
470 470 0.0 None None -
prob05.pddl
60 60 0.0 511 511 0.0
prob06.pddl
959 959 0.0 None None -
prob07.pddl
190 190 0.0 67263 67263 0.0
prob08.pddl
190 190 0.0 None None -
prob09.pddl
1277 1277 0.0 None None -
prob10.pddl
1691 1691 0.0 1032859 1032859 0.0
prob11.pddl
87 87 0.0 40853 40853 0.0
prob12.pddl
212 212 0.0 None None -
prob13.pddl
621 621 0.0 None None -
prob14.pddl
1451 1451 0.0 None None -
prob15.pddl
1107 1107 0.0 72263 72263 0.0
prob16.pddl
308 308 0.0 None None -
prob17.pddl
163 163 0.0 None None -
prob18.pddl
5239 5239 0.0 None None -
prob19.pddl
2961 2961 0.0 None None -
prob20.pddl
5086 5086 0.0 None None -
prob21.pddl
1573 1573 0.0 None None -
prob22.pddl
38316 38316 0.0 None None -
prob23.pddl
1707 1707 0.0 697593 697593 0.0
prob24.pddl
246 246 0.0 None None -
prob25.pddl
7242 7242 0.0 None None -
prob26.pddl
9839 9839 0.0 None None -
prob27.pddl
6016 6016 0.0 None None -
prob28.pddl
47411 47411 0.0 None None -
prob29.pddl
15899 15899 0.0 None None -
prob30.pddl
4376 4376 0.0 None None -
prob31.pddl
20 20 0.0 372 372 0.0
prob32.pddl
45 45 0.0 173 173 0.0
prob33.pddl
56 56 0.0 352 352 0.0
prob34.pddl
402 402 0.0 31573 31573 0.0
prob35.pddl
62 62 0.0 2413 2413 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
miconic
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
4 4 0.0 5 5 0.0
s1-1.pddl
3 3 0.0 4 4 0.0
s1-2.pddl
4 4 0.0 5 5 0.0
s1-3.pddl
4 4 0.0 5 5 0.0
s1-4.pddl
4 4 0.0 5 5 0.0
s2-0.pddl
9 9 0.0 12 12 0.0
s2-1.pddl
9 9 0.0 8 8 0.0
s2-2.pddl
9 9 0.0 8 8 0.0
s2-3.pddl
7 7 0.0 8 8 0.0
s2-4.pddl
12 12 0.0 10 10 0.0
s3-0.pddl
18 18 0.0 13 13 0.0
s3-1.pddl
20 20 0.0 16 16 0.0
s3-2.pddl
19 19 0.0 11 11 0.0
s3-3.pddl
16 16 0.0 11 11 0.0
s3-4.pddl
17 17 0.0 11 11 0.0
s4-0.pddl
21 21 0.0 23 23 0.0
s4-1.pddl
20 20 0.0 24 24 0.0
s4-2.pddl
36 36 0.0 24 24 0.0
s4-3.pddl
41 41 0.0 19 19 0.0
s4-4.pddl
42 42 0.0 25 25 0.0
s5-0.pddl
48 48 0.0 38 38 0.0
s5-1.pddl
48 48 0.0 24 24 0.0
s5-2.pddl
33 33 0.0 22 22 0.0
s5-3.pddl
28 28 0.0 33 33 0.0
s5-4.pddl
52 52 0.0 30 30 0.0
s6-0.pddl
59 59 0.0 36 36 0.0
s6-1.pddl
34 34 0.0 46 46 0.0
s6-2.pddl
65 65 0.0 42 42 0.0
s6-3.pddl
51 51 0.0 39 39 0.0
s6-4.pddl
63 63 0.0 49 49 0.0
s7-0.pddl
52 52 0.0 48 48 0.0
s7-1.pddl
89 89 0.0 61 61 0.0
s7-2.pddl
43 43 0.0 41 41 0.0
s7-3.pddl
67 67 0.0 56 56 0.0
s7-4.pddl
82 82 0.0 46 46 0.0
s8-0.pddl
66 66 0.0 53 53 0.0
s8-1.pddl
92 92 0.0 80 80 0.0
s8-2.pddl
110 110 0.0 52 52 0.0
s8-3.pddl
107 107 0.0 44 44 0.0
s8-4.pddl
83 83 0.0 46 46 0.0
s9-0.pddl
126 126 0.0 51 51 0.0
s9-1.pddl
130 130 0.0 45 45 0.0
s9-2.pddl
123 123 0.0 62 62 0.0
s9-3.pddl
108 108 0.0 58 58 0.0
s9-4.pddl
87 87 0.0 59 59 0.0
s10-0.pddl
143 143 0.0 72 72 0.0
s10-1.pddl
125 125 0.0 53 53 0.0
s10-2.pddl
143 143 0.0 74 74 0.0
s10-3.pddl
103 103 0.0 79 79 0.0
s10-4.pddl
128 128 0.0 80 80 0.0
s11-0.pddl
174 174 0.0 101 101 0.0
s11-1.pddl
131 131 0.0 96 96 0.0
s11-2.pddl
204 204 0.0 76 76 0.0
s11-3.pddl
168 168 0.0 103 103 0.0
s11-4.pddl
158 158 0.0 93 93 0.0
s12-0.pddl
111 111 0.0 79 79 0.0
s12-1.pddl
200 200 0.0 135 135 0.0
s12-2.pddl
198 198 0.0 115 115 0.0
s12-3.pddl
180 180 0.0 107 107 0.0
s12-4.pddl
231 231 0.0 90 90 0.0
s13-0.pddl
258 258 0.0 101 101 0.0
s13-1.pddl
211 211 0.0 137 137 0.0
s13-2.pddl
254 254 0.0 147 147 0.0
s13-3.pddl
190 190 0.0 124 124 0.0
s13-4.pddl
186 186 0.0 166 166 0.0
s14-0.pddl
192 192 0.0 129 129 0.0
s14-1.pddl
263 263 0.0 136 136 0.0
s14-2.pddl
263 263 0.0 138 138 0.0
s14-3.pddl
209 209 0.0 187 187 0.0
s14-4.pddl
241 241 0.0 156 156 0.0
s15-0.pddl
238 238 0.0 158 158 0.0
s15-1.pddl
383 383 0.0 114 114 0.0
s15-2.pddl
328 328 0.0 136 136 0.0
s15-3.pddl
299 299 0.0 161 161 0.0
s15-4.pddl
295 295 0.0 155 155 0.0
s16-0.pddl
319 319 0.0 190 190 0.0
s16-1.pddl
308 308 0.0 196 196 0.0
s16-2.pddl
407 407 0.0 192 192 0.0
s16-3.pddl
339 339 0.0 153 153 0.0
s16-4.pddl
343 343 0.0 180 180 0.0
s17-0.pddl
399 399 0.0 188 188 0.0
s17-1.pddl
322 322 0.0 185 185 0.0
s17-2.pddl
390 390 0.0 254 254 0.0
s17-3.pddl
435 435 0.0 155 155 0.0
s17-4.pddl
320 320 0.0 207 207 0.0
s18-0.pddl
393 393 0.0 230 230 0.0
s18-1.pddl
365 365 0.0 165 165 0.0
s18-2.pddl
413 413 0.0 198 198 0.0
s18-3.pddl
465 465 0.0 229 229 0.0
s18-4.pddl
407 407 0.0 158 158 0.0
s19-0.pddl
503 503 0.0 319 319 0.0
s19-1.pddl
455 455 0.0 280 280 0.0
s19-2.pddl
501 501 0.0 201 201 0.0
s19-3.pddl
536 536 0.0 173 173 0.0
s19-4.pddl
485 485 0.0 195 195 0.0
s20-0.pddl
488 488 0.0 232 232 0.0
s20-1.pddl
525 525 0.0 278 278 0.0
s20-2.pddl
482 482 0.0 225 225 0.0
s20-3.pddl
460 460 0.0 304 304 0.0
s20-4.pddl
474 474 0.0 293 293 0.0
s21-0.pddl
612 612 0.0 250 250 0.0
s21-1.pddl
573 573 0.0 370 370 0.0
s21-2.pddl
417 417 0.0 357 357 0.0
s21-3.pddl
495 495 0.0 285 285 0.0
s21-4.pddl
429 429 0.0 326 326 0.0
s22-0.pddl
690 690 0.0 236 236 0.0
s22-1.pddl
648 648 0.0 309 309 0.0
s22-2.pddl
634 634 0.0 341 341 0.0
s22-3.pddl
642 642 0.0 282 282 0.0
s22-4.pddl
587 587 0.0 337 337 0.0
s23-0.pddl
738 738 0.0 330 330 0.0
s23-1.pddl
632 632 0.0 275 275 0.0
s23-2.pddl
579 579 0.0 391 391 0.0
s23-3.pddl
585 585 0.0 337 337 0.0
s23-4.pddl
620 620 0.0 269 269 0.0
s24-0.pddl
635 635 0.0 351 351 0.0
s24-1.pddl
697 697 0.0 394 394 0.0
s24-2.pddl
741 741 0.0 334 334 0.0
s24-3.pddl
709 709 0.0 346 346 0.0
s24-4.pddl
729 729 0.0 441 441 0.0
s25-0.pddl
746 746 0.0 454 454 0.0
s25-1.pddl
894 894 0.0 382 382 0.0
s25-2.pddl
668 668 0.0 476 476 0.0
s25-3.pddl
857 857 0.0 402 402 0.0
s25-4.pddl
871 871 0.0 341 341 0.0
s26-0.pddl
903 903 0.0 434 434 0.0
s26-1.pddl
801 801 0.0 418 418 0.0
s26-2.pddl
1012 1012 0.0 503 503 0.0
s26-3.pddl
904 904 0.0 436 436 0.0
s26-4.pddl
734 734 0.0 549 549 0.0
s27-0.pddl
1025 1025 0.0 466 466 0.0
s27-1.pddl
861 861 0.0 444 444 0.0
s27-2.pddl
1027 1027 0.0 329 329 0.0
s27-3.pddl
901 901 0.0 527 527 0.0
s27-4.pddl
939 939 0.0 444 444 0.0
s28-0.pddl
1120 1120 0.0 509 509 0.0
s28-1.pddl
985 985 0.0 580 580 0.0
s28-2.pddl
1092 1092 0.0 458 458 0.0
s28-3.pddl
798 798 0.0 456 456 0.0
s28-4.pddl
980 980 0.0 457 457 0.0
s29-0.pddl
986 986 0.0 592 592 0.0
s29-1.pddl
918 918 0.0 493 493 0.0
s29-2.pddl
1073 1073 0.0 553 553 0.0
s29-3.pddl
1218 1218 0.0 441 441 0.0
s29-4.pddl
1270 1270 0.0 414 414 0.0
s30-0.pddl
976 976 0.0 576 576 0.0
s30-1.pddl
1091 1091 0.0 528 528 0.0
s30-2.pddl
1041 1041 0.0 499 499 0.0
s30-3.pddl
1262 1262 0.0 515 515 0.0
s30-4.pddl
1154 1154 0.0 440 440 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
movie
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
8 8 0.0 9 9 0.0
prob02.pddl
8 8 0.0 9 9 0.0
prob03.pddl
8 8 0.0 9 9 0.0
prob04.pddl
8 8 0.0 9 9 0.0
prob05.pddl
8 8 0.0 9 9 0.0
prob06.pddl
8 8 0.0 9 9 0.0
prob07.pddl
8 8 0.0 9 9 0.0
prob08.pddl
8 8 0.0 9 9 0.0
prob09.pddl
8 8 0.0 9 9 0.0
prob10.pddl
8 8 0.0 9 9 0.0
prob11.pddl
8 8 0.0 9 9 0.0
prob12.pddl
8 8 0.0 9 9 0.0
prob13.pddl
8 8 0.0 9 9 0.0
prob14.pddl
8 8 0.0 9 9 0.0
prob15.pddl
8 8 0.0 9 9 0.0
prob16.pddl
8 8 0.0 9 9 0.0
prob17.pddl
8 8 0.0 9 9 0.0
prob18.pddl
8 8 0.0 9 9 0.0
prob19.pddl
8 8 0.0 9 9 0.0
prob20.pddl
8 8 0.0 9 9 0.0
prob21.pddl
8 8 0.0 9 9 0.0
prob22.pddl
8 8 0.0 9 9 0.0
prob23.pddl
8 8 0.0 9 9 0.0
prob24.pddl
8 8 0.0 9 9 0.0
prob25.pddl
8 8 0.0 9 9 0.0
prob26.pddl
8 8 0.0 9 9 0.0
prob27.pddl
8 8 0.0 9 9 0.0
prob28.pddl
8 8 0.0 9 9 0.0
prob29.pddl
8 8 0.0 9 9 0.0
prob30.pddl
8 8 0.0 9 9 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mprime
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
7 7 0.0 28 28 0.0
prob02.pddl
35 35 0.0 167659 167659 0.0
prob03.pddl
7 7 0.0 9438 9438 0.0
prob04.pddl
13 13 0.0 139 139 0.0
prob05.pddl
22 22 0.0 433360 433360 0.0
prob06.pddl
429 429 0.0 None None -
prob07.pddl
11 11 0.0 20766 20766 0.0
prob08.pddl
31 31 0.0 None None -
prob09.pddl
39 39 0.0 20268 20268 0.0
prob10.pddl
18 18 0.0 None None -
prob11.pddl
15 15 0.0 9 9 0.0
prob12.pddl
36 36 0.0 199609 199609 0.0
prob13.pddl
75 75 0.0 None None -
prob14.pddl
60 60 0.0 None None -
prob15.pddl
58 58 0.0 None None -
prob16.pddl
12 12 0.0 73400 73400 0.0
prob17.pddl
7 7 0.0 373703 373703 0.0
prob18.pddl
207 207 0.0 None None -
prob19.pddl
96 96 0.0 None None -
prob20.pddl
42 42 0.0 None None -
prob21.pddl
341 341 0.0 1079125 1079125 0.0
prob22.pddl
85 85 0.0 None None -
prob23.pddl
83 83 0.0 None None -
prob24.pddl
27 27 0.0 None None -
prob25.pddl
6 6 0.0 217 217 0.0
prob26.pddl
13 13 0.0 1570670 1570670 0.0
prob27.pddl
12 12 0.0 2025 2025 0.0
prob28.pddl
14 14 0.0 28 28 0.0
prob29.pddl
7 7 0.0 6800 6800 0.0
prob30.pddl
22 22 0.0 None None -
prob31.pddl
17 17 0.0 4391 4391 0.0
prob32.pddl
14 14 0.0 113701 113701 0.0
prob33.pddl
150 150 0.0 None None -
prob34.pddl
9 9 0.0 5857 5857 0.0
prob35.pddl
11 11 0.0 5020 5020 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mystery
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
7 7 0.0 7 7 0.0
prob02.pddl
416 416 0.0 23215 23215 0.0
prob03.pddl
6 6 0.0 412 412 0.0
prob04.pddl
5898125 5898125 0.0 38254137 38254137 0.0
prob05.pddl
None None - None None -
prob06.pddl
24046 24046 0.0 None None -
prob07.pddl
0 0 0.0 None None -
prob08.pddl
None None - None None -
prob09.pddl
2340184 2340184 0.0 2561 2561 0.0
prob10.pddl
16 16 0.0 None None -
prob11.pddl
14 14 0.0 9 9 0.0
prob12.pddl
521382 521382 0.0 2102777 2102777 0.0
prob13.pddl
83 83 0.0 None None -
prob14.pddl
60 60 0.0 None None -
prob15.pddl
62 62 0.0 702316 702316 0.0
prob16.pddl
None None - None None -
prob17.pddl
7 7 0.0 5016 5016 0.0
prob18.pddl
0 0 0.0 None None -
prob19.pddl
717 717 0.0 137369 137369 0.0
prob20.pddl
31 31 0.0 2626120 2626120 0.0
prob21.pddl
None None - None None -
prob22.pddl
None None - None None -
prob23.pddl
None None - None None -
prob24.pddl
None None - None None -
prob25.pddl
6 6 0.0 66 66 0.0
prob26.pddl
9 9 0.0 13355 13355 0.0
prob27.pddl
11 11 0.0 185 185 0.0
prob28.pddl
14 14 0.0 12 12 0.0
prob29.pddl
9 9 0.0 266 266 0.0
prob30.pddl
31 31 0.0 30594 30594 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
nomystery-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
40 40 0.0 1000 1000 0.0
p02.pddl
27 27 0.0 22 22 0.0
p03.pddl
31 31 0.0 28 28 0.0
p04.pddl
62 62 0.0 236316 236316 0.0
p05.pddl
101 101 0.0 18123289 18123289 0.0
p06.pddl
117 117 0.0 None None -
p07.pddl
91 91 0.0 None None -
p08.pddl
129 129 0.0 None None -
p09.pddl
125 125 0.0 124 124 0.0
p10.pddl
191 191 0.0 None None -
p11.pddl
114 114 0.0 326 326 0.0
p12.pddl
1521 1521 0.0 13433 13433 0.0
p13.pddl
97 97 0.0 33617 33617 0.0
p14.pddl
4977 4977 0.0 393338 393338 0.0
p15.pddl
219 219 0.0 325729 325729 0.0
p16.pddl
None None - None None -
p17.pddl
1300 1300 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
354 354 0.0 None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt08-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
18 18 0.0 22 22 0.0
p02.pddl
20 20 0.0 26 26 0.0
p03.pddl
23 23 0.0 35 35 0.0
p04.pddl
27 27 0.0 42 42 0.0
p05.pddl
31 31 0.0 47 47 0.0
p06.pddl
34 34 0.0 48 48 0.0
p07.pddl
40 40 0.0 61 61 0.0
p08.pddl
44 44 0.0 79 79 0.0
p09.pddl
44 44 0.0 84 84 0.0
p10.pddl
52 52 0.0 84 84 0.0
p11.pddl
53 53 0.0 107 107 0.0
p12.pddl
54 54 0.0 103 103 0.0
p13.pddl
60 60 0.0 107 107 0.0
p14.pddl
63 63 0.0 115 115 0.0
p15.pddl
67 67 0.0 113 113 0.0
p16.pddl
71 71 0.0 136 136 0.0
p17.pddl
75 75 0.0 149 149 0.0
p18.pddl
76 76 0.0 163 163 0.0
p19.pddl
81 81 0.0 197 197 0.0
p20.pddl
79 79 0.0 159 159 0.0
p21.pddl
85 85 0.0 186 186 0.0
p22.pddl
94 94 0.0 220 220 0.0
p23.pddl
91 91 0.0 250 250 0.0
p24.pddl
96 96 0.0 239 239 0.0
p25.pddl
99 99 0.0 243 243 0.0
p26.pddl
106 106 0.0 261 261 0.0
p27.pddl
113 113 0.0 290 290 0.0
p28.pddl
111 111 0.0 272 272 0.0
p29.pddl
116 116 0.0 346 346 0.0
p30.pddl
120 120 0.0 375 375 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
34 34 0.0 48 48 0.0
p02.pddl
40 40 0.0 61 61 0.0
p03.pddl
44 44 0.0 79 79 0.0
p04.pddl
44 44 0.0 84 84 0.0
p05.pddl
52 52 0.0 84 84 0.0
p06.pddl
53 53 0.0 107 107 0.0
p07.pddl
54 54 0.0 103 103 0.0
p08.pddl
60 60 0.0 107 107 0.0
p09.pddl
63 63 0.0 115 115 0.0
p10.pddl
94 94 0.0 220 220 0.0
p11.pddl
67 67 0.0 113 113 0.0
p12.pddl
71 71 0.0 136 136 0.0
p13.pddl
75 75 0.0 149 149 0.0
p14.pddl
76 76 0.0 163 163 0.0
p15.pddl
81 81 0.0 197 197 0.0
p16.pddl
85 85 0.0 186 186 0.0
p17.pddl
79 79 0.0 159 159 0.0
p18.pddl
91 91 0.0 250 250 0.0
p19.pddl
96 96 0.0 239 239 0.0
p20.pddl
99 99 0.0 243 243 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
67 67 0.0 116 116 0.0
p20_2.pddl
71 71 0.0 154 154 0.0
p20_3.pddl
76 76 0.0 171 171 0.0
p25_1.pddl
86 86 0.0 198 198 0.0
p25_3.pddl
96 96 0.0 285 285 0.0
p30_1.pddl
99 99 0.0 263 263 0.0
p30_2.pddl
102 102 0.0 289 289 0.0
p30_3.pddl
113 113 0.0 418 418 0.0
p35_1.pddl
117 117 0.0 339 339 0.0
p35_2.pddl
120 120 0.0 348 348 0.0
p35_3.pddl
135 135 0.0 549 549 0.0
p40_1.pddl
133 133 0.0 359 359 0.0
p40_2.pddl
138 138 0.0 405 405 0.0
p40_3.pddl
153 153 0.0 603 603 0.0
p45_1.pddl
152 152 0.0 492 492 0.0
p45_2.pddl
163 163 0.0 580 580 0.0
p45_3.pddl
175 175 0.0 922 922 0.0
p50_1.pddl
165 165 0.0 600 600 0.0
p50_2.pddl
176 176 0.0 699 699 0.0
p50_3.pddl
195 195 0.0 1043 1043 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
25 25 0.0 34 34 0.0
p02.pddl
25 25 0.0 35 35 0.0
p03.pddl
25 25 0.0 34 34 0.0
p04.pddl
25 25 0.0 35 35 0.0
p05.pddl
25 25 0.0 35 35 0.0
p06.pddl
49 49 0.0 103 103 0.0
p07.pddl
50 50 0.0 104 104 0.0
p08.pddl
96 96 0.0 265 265 0.0
p09.pddl
96 96 0.0 288 288 0.0
p10.pddl
100 100 0.0 335 335 0.0
p11.pddl
100 100 0.0 337 337 0.0
p12.pddl
100 100 0.0 316 316 0.0
p13.pddl
100 100 0.0 358 358 0.0
p14.pddl
100 100 0.0 332 332 0.0
p15.pddl
101 101 0.0 314 314 0.0
p16.pddl
102 102 0.0 319 319 0.0
p17.pddl
125 125 0.0 436 436 0.0
p18.pddl
198 198 0.0 1111 1111 0.0
p19.pddl
126 126 0.0 480 480 0.0
p20.pddl
150 150 0.0 604 604 0.0
p21.pddl
150 150 0.0 619 619 0.0
p22.pddl
150 150 0.0 707 707 0.0
p23.pddl
150 150 0.0 693 693 0.0
p24.pddl
250 250 0.0 1476 1476 0.0
p25.pddl
250 250 0.0 1476 1476 0.0
p26.pddl
253 253 0.0 1701 1701 0.0
p27.pddl
376 376 0.0 3854 3854 0.0
p28.pddl
500 500 0.0 5451 5451 0.0
p29.pddl
500 500 0.0 5451 5451 0.0
p30.pddl
504 504 0.0 6768 6768 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-opt18-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1 1 0.0 2 2 0.0
p02.pddl
1 1 0.0 2 2 0.0
p03.pddl
2 2 0.0 3 3 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
2 2 0.0 3 3 0.0
p08.pddl
None None - None None -
p09.pddl
2 2 0.0 3 3 0.0
p10.pddl
2 2 0.0 3 3 0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
2 2 0.0 3 3 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-split-opt18-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
11 11 0.0 64 64 0.0
p02.pddl
18 18 0.0 642 642 0.0
p03.pddl
95 95 0.0 152531 152531 0.0
p04.pddl
38 38 0.0 248568 248568 0.0
p05.pddl
42 42 0.0 70952 70952 0.0
p06.pddl
67 67 0.0 3968768 3968768 0.0
p07.pddl
18 18 0.0 17 17 0.0
p08.pddl
172 172 0.0 11587219 11587219 0.0
p09.pddl
44 44 0.0 42942 42942 0.0
p10.pddl
44 44 0.0 70164 70164 0.0
p11.pddl
740 740 0.0 None None -
p12.pddl
575 575 0.0 None None -
p13.pddl
588 588 0.0 None None -
p14.pddl
68 68 0.0 2505 2505 0.0
p15.pddl
None None - None None -
p16.pddl
893 893 0.0 None None -
p17.pddl
1518 1518 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
598 598 0.0 None None -
p20.pddl
11674 11674 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-08-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
8 8 0.0 16 16 0.0
p02.pddl
15 15 0.0 21 21 0.0
p03.pddl
22 22 0.0 23 23 0.0
p04.pddl
29 29 0.0 58 58 0.0
p05.pddl
36 36 0.0 71 71 0.0
p06.pddl
43 43 0.0 59 59 0.0
p07.pddl
50 50 0.0 157 157 0.0
p08.pddl
57 57 0.0 150 150 0.0
p09.pddl
64 64 0.0 190 190 0.0
p10.pddl
71 71 0.0 112 112 0.0
p11.pddl
9 9 0.0 10 10 0.0
p12.pddl
18 18 0.0 117 117 0.0
p13.pddl
27 27 0.0 12519 12519 0.0
p14.pddl
37 37 0.0 444730 444730 0.0
p15.pddl
94 94 0.0 None None -
p16.pddl
57 57 0.0 None None -
p17.pddl
65 65 0.0 None None -
p18.pddl
77 77 0.0 None None -
p19.pddl
314 314 0.0 None None -
p20.pddl
147 147 0.0 None None -
p21.pddl
8 8 0.0 9 9 0.0
p22.pddl
15 15 0.0 16 16 0.0
p23.pddl
22 22 0.0 23 23 0.0
p24.pddl
29 29 0.0 30 30 0.0
p25.pddl
64 64 0.0 291851 291851 0.0
p26.pddl
43 43 0.0 44 44 0.0
p27.pddl
50 50 0.0 51 51 0.0
p28.pddl
57 57 0.0 58 58 0.0
p29.pddl
170 170 0.0 None None -
p30.pddl
94 94 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
15 15 0.0 16 16 0.0
p02.pddl
15 15 0.0 21 21 0.0
p03.pddl
18 18 0.0 117 117 0.0
p04.pddl
29 29 0.0 58 58 0.0
p05.pddl
22 22 0.0 23 23 0.0
p06.pddl
43 43 0.0 59 59 0.0
p07.pddl
36 36 0.0 71 71 0.0
p08.pddl
29 29 0.0 30 30 0.0
p09.pddl
27 27 0.0 12519 12519 0.0
p10.pddl
64 64 0.0 291851 291851 0.0
p11.pddl
43 43 0.0 44 44 0.0
p12.pddl
37 37 0.0 444730 444730 0.0
p13.pddl
50 50 0.0 157 157 0.0
p14.pddl
57 57 0.0 150 150 0.0
p15.pddl
64 64 0.0 190 190 0.0
p16.pddl
71 71 0.0 112 112 0.0
p17.pddl
94 94 0.0 None None -
p18.pddl
57 57 0.0 None None -
p19.pddl
65 65 0.0 None None -
p20.pddl
50 50 0.0 51 51 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parking-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
77 77 0.0 None None -
pfile03-012.pddl
348 348 0.0 None None -
pfile04-013.pddl
392 392 0.0 None None -
pfile04-014.pddl
557 557 0.0 None None -
pfile04-015.pddl
248 248 0.0 None None -
pfile04-016.pddl
364 364 0.0 None None -
pfile05-017.pddl
255 255 0.0 None None -
pfile05-018.pddl
226 226 0.0 None None -
pfile05-019.pddl
714 714 0.0 None None -
pfile05-020.pddl
534 534 0.0 None None -
pfile06-021.pddl
566 566 0.0 None None -
pfile06-022.pddl
552 552 0.0 None None -
pfile06-023.pddl
448 448 0.0 None None -
pfile06-024.pddl
1445 1445 0.0 None None -
pfile07-025.pddl
1431 1431 0.0 None None -
pfile07-026.pddl
538 538 0.0 None None -
pfile07-027.pddl
395 395 0.0 None None -
pfile07-028.pddl
1388 1388 0.0 None None -
pfile08-029.pddl
1128 1128 0.0 None None -
pfile08-030.pddl
820 820 0.0 None None -
Sum of diffs
0.00
None
Arithmetic mean of diffs
0.00
None
parking-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
165 165 0.0 None None -
p_12_7-02.pddl
198 198 0.0 91602 91602 0.0
p_12_7-03.pddl
347 347 0.0 None None -
p_12_7-04.pddl
283 283 0.0 None None -
p_14_8-01.pddl
236 236 0.0 None None -
p_14_8-02.pddl
332 332 0.0 None None -
p_14_8-03.pddl
701 701 0.0 None None -
p_14_8-04.pddl
347 347 0.0 None None -
p_16_9-01.pddl
460 460 0.0 None None -
p_16_9-02.pddl
318 318 0.0 None None -
p_16_9-03.pddl
208 208 0.0 None None -
p_16_9-04.pddl
227 227 0.0 None None -
p_18_10-01.pddl
797 797 0.0 None None -
p_18_10-02.pddl
438 438 0.0 None None -
p_18_10-03.pddl
195 195 0.0 None None -
p_18_10-04.pddl
162 162 0.0 None None -
p_20_11-01.pddl
1086 1086 0.0 None None -
p_20_11-02.pddl
669 669 0.0 None None -
p_20_11-03.pddl
944 944 0.0 None None -
p_20_11-04.pddl
1903 1903 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pathways-noneg
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
10 10 0.0 1644 1644 0.0
p02.pddl
13 13 0.0 17 17 0.0
p03.pddl
49 49 0.0 1144 1144 0.0
p04.pddl
22 22 0.0 4009 4009 0.0
p05.pddl
44 44 0.0 73335 73335 0.0
p06.pddl
183 183 0.0 1357171 1357171 0.0
p07.pddl
259 259 0.0 8211506 8211506 0.0
p08.pddl
489 489 0.0 None None -
p09.pddl
314 314 0.0 1280613 1280613 0.0
p10.pddl
None None - None None -
p11.pddl
442 442 0.0 3823379 3823379 0.0
p12.pddl
630 630 0.0 None None -
p13.pddl
508 508 0.0 None None -
p14.pddl
757 757 0.0 None None -
p15.pddl
414 414 0.0 None None -
p16.pddl
None None - None None -
p17.pddl
903 903 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
2026 2026 0.0 None None -
p24.pddl
1922 1922 0.0 None None -
p25.pddl
1602 1602 0.0 None None -
p26.pddl
2424 2424 0.0 None None -
p27.pddl
2844 2844 0.0 None None -
p28.pddl
1422 1422 0.0 None None -
p29.pddl
3568 3568 0.0 None None -
p30.pddl
4935 4935 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-08-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
7 7 0.0 8 8 0.0
p02.pddl
12 12 0.0 40 40 0.0
p03.pddl
21 21 0.0 48 48 0.0
p04.pddl
60 60 0.0 123 123 0.0
p05.pddl
44 44 0.0 60 60 0.0
p06.pddl
87 87 0.0 87 87 0.0
p07.pddl
33 33 0.0 16 16 0.0
p08.pddl
107 107 0.0 187 187 0.0
p09.pddl
57 57 0.0 348 348 0.0
p10.pddl
1532 1532 0.0 919 919 0.0
p11.pddl
460 460 0.0 1856 1856 0.0
p12.pddl
534 534 0.0 366 366 0.0
p13.pddl
134 134 0.0 15795 15795 0.0
p14.pddl
178 178 0.0 12571 12571 0.0
p15.pddl
176 176 0.0 1929 1929 0.0
p16.pddl
295 295 0.0 6394 6394 0.0
p17.pddl
11533 11533 0.0 32263 32263 0.0
p18.pddl
1938 1938 0.0 309 309 0.0
p19.pddl
322 322 0.0 11564 11564 0.0
p20.pddl
626 626 0.0 521 521 0.0
p21.pddl
267 267 0.0 21627 21627 0.0
p22.pddl
743 743 0.0 6918 6918 0.0
p23.pddl
495 495 0.0 40839 40839 0.0
p24.pddl
1022 1022 0.0 17092 17092 0.0
p25.pddl
788 788 0.0 12509 12509 0.0
p26.pddl
468 468 0.0 40041 40041 0.0
p27.pddl
38957 38957 0.0 1155 1155 0.0
p28.pddl
106042 106042 0.0 953048 953048 0.0
p29.pddl
6680159 6680159 0.0 178332 178332 0.0
p30.pddl
109684 109684 0.0 16125477 16125477 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
71 71 0.0 24 24 0.0
p02.pddl
11533 11533 0.0 32263 32263 0.0
p03.pddl
1938 1938 0.0 309 309 0.0
p04.pddl
322 322 0.0 11564 11564 0.0
p05.pddl
352 352 0.0 52660 52660 0.0
p06.pddl
108 108 0.0 1475 1475 0.0
p07.pddl
761 761 0.0 465 465 0.0
p08.pddl
626 626 0.0 521 521 0.0
p09.pddl
2132 2132 0.0 8666 8666 0.0
p10.pddl
267 267 0.0 21627 21627 0.0
p11.pddl
743 743 0.0 6918 6918 0.0
p12.pddl
699 699 0.0 12250 12250 0.0
p13.pddl
495 495 0.0 40839 40839 0.0
p14.pddl
1022 1022 0.0 17092 17092 0.0
p15.pddl
788 788 0.0 12509 12509 0.0
p16.pddl
468 468 0.0 40041 40041 0.0
p17.pddl
38957 38957 0.0 1155 1155 0.0
p18.pddl
106042 106042 0.0 953048 953048 0.0
p19.pddl
6680159 6680159 0.0 178332 178332 0.0
p20.pddl
109684 109684 0.0 16125477 16125477 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
petri-net-alignment-opt18-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
252 252 0.0 251 251 0.0
p02.pddl
327 327 0.0 318 318 0.0
p03.pddl
378 378 0.0 371 371 0.0
p04.pddl
381 381 0.0 380 380 0.0
p05.pddl
315 315 0.0 311 311 0.0
p06.pddl
380 380 0.0 381 381 0.0
p07.pddl
364 364 0.0 363 363 0.0
p08.pddl
381 381 0.0 382 382 0.0
p09.pddl
382 382 0.0 372 372 0.0
p10.pddl
471 471 0.0 468 468 0.0
p11.pddl
419 419 0.0 410 410 0.0
p12.pddl
530 530 0.0 532 532 0.0
p13.pddl
463 463 0.0 467 467 0.0
p14.pddl
481 481 0.0 472 472 0.0
p15.pddl
468 468 0.0 460 460 0.0
p16.pddl
511 511 0.0 505 505 0.0
p17.pddl
528 528 0.0 519 519 0.0
p18.pddl
511 511 0.0 502 502 0.0
p19.pddl
517 517 0.0 521 521 0.0
p20.pddl
540 540 0.0 534 534 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-notankage
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
5 5 0.0 6 6 0.0
p02-net1-b6-g4.pddl
612 612 0.0 24 24 0.0
p03-net1-b8-g3.pddl
103 103 0.0 22 22 0.0
p04-net1-b8-g5.pddl
613 613 0.0 22 22 0.0
p05-net1-b10-g4.pddl
257 257 0.0 24 24 0.0
p06-net1-b10-g6.pddl
2854 2854 0.0 20 20 0.0
p07-net1-b12-g5.pddl
11 11 0.0 15 15 0.0
p08-net1-b12-g7.pddl
13 13 0.0 14 14 0.0
p09-net1-b14-g6.pddl
27 27 0.0 14 14 0.0
p10-net1-b14-g8.pddl
31 31 0.0 20 20 0.0
p11-net2-b10-g2.pddl
10419 10419 0.0 2820 2820 0.0
p12-net2-b10-g4.pddl
9560 9560 0.0 5056 5056 0.0
p13-net2-b12-g3.pddl
62 62 0.0 15672 15672 0.0
p14-net2-b12-g5.pddl
4253 4253 0.0 3308 3308 0.0
p15-net2-b14-g4.pddl
1006 1006 0.0 13290 13290 0.0
p16-net2-b14-g6.pddl
25403 25403 0.0 243355 243355 0.0
p17-net2-b16-g5.pddl
15819 15819 0.0 2793 2793 0.0
p18-net2-b16-g7.pddl
26905 26905 0.0 3924 3924 0.0
p19-net2-b18-g6.pddl
139 139 0.0 513 513 0.0
p20-net2-b18-g8.pddl
44329 44329 0.0 11252 11252 0.0
p21-net3-b12-g2.pddl
33 33 0.0 315 315 0.0
p22-net3-b12-g4.pddl
53600 53600 0.0 30563 30563 0.0
p23-net3-b14-g3.pddl
337 337 0.0 9046 9046 0.0
p24-net3-b14-g5.pddl
21569 21569 0.0 123975 123975 0.0
p25-net3-b16-g5.pddl
276 276 0.0 83957 83957 0.0
p26-net3-b16-g7.pddl
35302 35302 0.0 7467 7467 0.0
p27-net3-b18-g6.pddl
37639 37639 0.0 1360240 1360240 0.0
p28-net3-b18-g7.pddl
35221 35221 0.0 744708 744708 0.0
p29-net3-b20-g6.pddl
7610 7610 0.0 514813 514813 0.0
p30-net3-b20-g8.pddl
34927 34927 0.0 30295 30295 0.0
p31-net4-b14-g3.pddl
110 110 0.0 16394 16394 0.0
p32-net4-b14-g5.pddl
14057 14057 0.0 6568 6568 0.0
p33-net4-b16-g5.pddl
5563 5563 0.0 24527 24527 0.0
p34-net4-b16-g6.pddl
30339 30339 0.0 45748 45748 0.0
p35-net4-b18-g4.pddl
12096 12096 0.0 1444769 1444769 0.0
p36-net4-b18-g6.pddl
322 322 0.0 4346391 4346391 0.0
p37-net4-b20-g5.pddl
2099 2099 0.0 None None -
p38-net4-b20-g7.pddl
26861 26861 0.0 725574 725574 0.0
p39-net4-b22-g7.pddl
234 234 0.0 None None -
p40-net4-b22-g8.pddl
4551 4551 0.0 2593821 2593821 0.0
p41-net5-b22-g2.pddl
487 487 0.0 223447 223447 0.0
p42-net5-b22-g4.pddl
None None - None None -
p43-net5-b24-g3.pddl
None None - None None -
p44-net5-b24-g5.pddl
None None - None None -
p45-net5-b26-g4.pddl
None None - None None -
p46-net5-b26-g6.pddl
None None - None None -
p47-net5-b28-g5.pddl
None None - None None -
p48-net5-b28-g7.pddl
None None - None None -
p49-net5-b30-g6.pddl
411 411 0.0 None None -
p50-net5-b30-g8.pddl
34138 34138 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-tankage
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
7 7 0.0 6 6 0.0
p02-net1-b6-g4-t50.pddl
860 860 0.0 79 79 0.0
p03-net1-b8-g3-t80.pddl
31 31 0.0 61 61 0.0
p04-net1-b8-g5-t80.pddl
253 253 0.0 71 71 0.0
p05-net1-b10-g4-t50.pddl
98 98 0.0 41 41 0.0
p06-net1-b10-g6-t50.pddl
71 71 0.0 30 30 0.0
p07-net1-b12-g5-t80.pddl
18 18 0.0 9 9 0.0
p08-net1-b12-g7-t80.pddl
36 36 0.0 14 14 0.0
p09-net1-b14-g6-t50.pddl
14024 14024 0.0 14075 14075 0.0
p10-net1-b14-g8-t50.pddl
74 74 0.0 655 655 0.0
p11-net2-b10-g2-t30.pddl
435 435 0.0 14513 14513 0.0
p12-net2-b10-g4-t60.pddl
229 229 0.0 31913 31913 0.0
p13-net2-b12-g3-t70.pddl
97 97 0.0 1916858 1916858 0.0
p14-net2-b12-g5-t30.pddl
687 687 0.0 52239 52239 0.0
p15-net2-b14-g4-t30.pddl
1470 1470 0.0 173035 173035 0.0
p16-net2-b14-g6-t80.pddl
2451 2451 0.0 None None -
p17-net2-b16-g5-t20.pddl
6157 6157 0.0 348927 348927 0.0
p18-net2-b16-g7-t60.pddl
7139 7139 0.0 509176 509176 0.0
p19-net2-b18-g6-t60.pddl
160 160 0.0 383737 383737 0.0
p20-net2-b18-g8-t90.pddl
3260 3260 0.0 None None -
p21-net3-b12-g2-t60.pddl
51 51 0.0 41829 41829 0.0
p22-net3-b12-g4-t60.pddl
2898158 2898158 0.0 1035377 1035377 0.0
p23-net3-b14-g3-t60.pddl
7599 7599 0.0 None None -
p24-net3-b14-g5-t60.pddl
2039 2039 0.0 None None -
p25-net3-b16-g5-t60.pddl
294 294 0.0 None None -
p26-net3-b16-g7-t70.pddl
27296 27296 0.0 None None -
p27-net3-b18-g6-t70.pddl
432 432 0.0 None None -
p28-net3-b18-g7-t70.pddl
1437298 1437298 0.0 None None -
p29-net3-b20-g6-t70.pddl
1060 1060 0.0 None None -
p30-net3-b20-g8-t70.pddl
7014 7014 0.0 None None -
p31-net4-b14-g3-t20.pddl
265423 265423 0.0 57856 57856 0.0
p32-net4-b14-g5-t30.pddl
10476 10476 0.0 2317400 2317400 0.0
p33-net4-b16-g5-t60.pddl
764 764 0.0 None None -
p34-net4-b16-g6-t60.pddl
1355 1355 0.0 None None -
p35-net4-b18-g4-t90.pddl
435 435 0.0 None None -
p36-net4-b18-g6-t90.pddl
19448 19448 0.0 None None -
p37-net4-b20-g5-t60.pddl
357 357 0.0 None None -
p38-net4-b20-g7-t60.pddl
3322 3322 0.0 None None -
p39-net4-b22-g7-t50.pddl
581 581 0.0 None None -
p40-net4-b22-g8-t50.pddl
423 423 0.0 None None -
p41-net5-b22-g2-t20.pddl
85 85 0.0 None None -
p42-net5-b22-g4-t50.pddl
None None - None None -
p43-net5-b24-g3-t80.pddl
None None - None None -
p44-net5-b24-g5-t80.pddl
None None - None None -
p45-net5-b26-g4-t50.pddl
None None - None None -
p46-net5-b26-g6-t50.pddl
None None - None None -
p47-net5-b28-g5-t50.pddl
None None - None None -
p48-net5-b28-g7-t50.pddl
None None - None None -
p49-net5-b30-g6-t50.pddl
1742 1742 0.0 None None -
p50-net5-b30-g8-t50.pddl
20671 20671 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
psr-small
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
9 9 0.0 9 9 0.0
p02-s5-n1-l3-f30.pddl
36 36 0.0 21 21 0.0
p03-s7-n1-l3-f70.pddl
28 28 0.0 21 21 0.0
p04-s8-n1-l4-f10.pddl
22 22 0.0 13 13 0.0
p05-s9-n1-l4-f30.pddl
38 38 0.0 21 21 0.0
p06-s10-n1-l4-f50.pddl
9 9 0.0 9 9 0.0
p07-s11-n1-l4-f70.pddl
36 36 0.0 21 21 0.0
p08-s12-n1-l5-f10.pddl
10 10 0.0 9 9 0.0
p09-s13-n1-l5-f30.pddl
10 10 0.0 9 9 0.0
p10-s17-n2-l2-f30.pddl
128 128 0.0 15 15 0.0
p11-s18-n2-l2-f50.pddl
110 110 0.0 65 65 0.0
p12-s21-n2-l3-f30.pddl
49 49 0.0 35 35 0.0
p13-s22-n2-l3-f50.pddl
41 41 0.0 35 35 0.0
p14-s23-n2-l3-f70.pddl
12 12 0.0 11 11 0.0
p15-s24-n2-l4-f10.pddl
88 88 0.0 14976 14976 0.0
p16-s29-n2-l5-f30.pddl
604 604 0.0 2695 2695 0.0
p17-s30-n2-l5-f50.pddl
12 12 0.0 11 11 0.0
p18-s31-n2-l5-f70.pddl
46 46 0.0 23 23 0.0
p19-s33-n3-l2-f30.pddl
982 982 0.0 4432 4432 0.0
p20-s34-n3-l2-f50.pddl
41 41 0.0 38 38 0.0
p21-s35-n3-l2-f70.pddl
20 20 0.0 13 13 0.0
p22-s37-n3-l3-f30.pddl
2293 2293 0.0 334 334 0.0
p23-s38-n3-l3-f50.pddl
38 38 0.0 17 17 0.0
p24-s39-n3-l3-f70.pddl
20 20 0.0 13 13 0.0
p25-s40-n3-l4-f10.pddl
26 26 0.0 56860 56860 0.0
p26-s41-n3-l4-f30.pddl
41 41 0.0 38 38 0.0
p27-s42-n3-l4-f50.pddl
105 105 0.0 61 61 0.0
p28-s43-n3-l4-f70.pddl
48 48 0.0 25 25 0.0
p29-s45-n3-l5-f30.pddl
861 861 0.0 104 104 0.0
p30-s46-n3-l5-f50.pddl
168 168 0.0 86 86 0.0
p31-s49-n4-l2-f30.pddl
164 164 0.0 51340 51340 0.0
p32-s50-n4-l2-f50.pddl
204 204 0.0 145 145 0.0
p33-s51-n4-l2-f70.pddl
195 195 0.0 2024 2024 0.0
p34-s55-n4-l3-f70.pddl
114 114 0.0 72 72 0.0
p35-s57-n5-l2-f30.pddl
664 664 0.0 251253 251253 0.0
p36-s65-n6-l2-f30.pddl
765 765 0.0 826598 826598 0.0
p37-s67-n6-l2-f70.pddl
210 210 0.0 81 81 0.0
p38-s78-n3-l3-f50.pddl
64 64 0.0 27 27 0.0
p39-s79-n3-l3-f70.pddl
151 151 0.0 90 90 0.0
p40-s80-n3-l4-f10.pddl
452 452 0.0 4051610 4051610 0.0
p41-s81-n3-l4-f30.pddl
20 20 0.0 13 13 0.0
p42-s82-n3-l4-f50.pddl
954 954 0.0 1743 1743 0.0
p43-s83-n3-l4-f70.pddl
184 184 0.0 90 90 0.0
p44-s89-n4-l2-f30.pddl
348 348 0.0 79 79 0.0
p45-s94-n4-l3-f50.pddl
105 105 0.0 53 53 0.0
p46-s97-n5-l2-f30.pddl
505 505 0.0 79502 79502 0.0
p47-s98-n5-l2-f50.pddl
156 156 0.0 120 120 0.0
p48-s101-n5-l3-f30.pddl
635 635 0.0 425 425 0.0
p49-s105-n6-l2-f30.pddl
1660 1660 0.0 1314 1314 0.0
p50-s107-n6-l2-f70.pddl
323 323 0.0 78 78 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
rovers
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
16 16 0.0 23 23 0.0
p02.pddl
9 9 0.0 13 13 0.0
p03.pddl
20 20 0.0 55 55 0.0
p04.pddl
8 8 0.0 13 13 0.0
p05.pddl
51 51 0.0 117 117 0.0
p06.pddl
188 188 0.0 129 129 0.0
p07.pddl
47 47 0.0 1878 1878 0.0
p08.pddl
55 55 0.0 1646 1646 0.0
p09.pddl
70 70 0.0 21021 21021 0.0
p10.pddl
138 138 0.0 35095 35095 0.0
p11.pddl
99 99 0.0 6497 6497 0.0
p12.pddl
32 32 0.0 2446 2446 0.0
p13.pddl
239 239 0.0 9652 9652 0.0
p14.pddl
110 110 0.0 22452 22452 0.0
p15.pddl
408 408 0.0 34929 34929 0.0
p16.pddl
250 250 0.0 28505 28505 0.0
p17.pddl
127 127 0.0 436400 436400 0.0
p18.pddl
152 152 0.0 4153925 4153925 0.0
p19.pddl
499 499 0.0 None None -
p20.pddl
746 746 0.0 None None -
p21.pddl
572 572 0.0 None None -
p22.pddl
668 668 0.0 2843497 2843497 0.0
p23.pddl
741 741 0.0 None None -
p24.pddl
1502 1502 0.0 None None -
p25.pddl
98 98 0.0 41916 41916 0.0
p26.pddl
433 433 0.0 None None -
p27.pddl
934 934 0.0 None None -
p28.pddl
939 939 0.0 None None -
p29.pddl
382 382 0.0 None None -
p30.pddl
1059 1059 0.0 None None -
p31.pddl
1725 1725 0.0 None None -
p32.pddl
3193 3193 0.0 None None -
p33.pddl
6742 6742 0.0 None None -
p34.pddl
2442 2442 0.0 None None -
p35.pddl
10290 10290 0.0 None None -
p36.pddl
5816 5816 0.0 None None -
p37.pddl
17637 17637 0.0 None None -
p38.pddl
9207 9207 0.0 None None -
p39.pddl
8367 8367 0.0 None None -
p40.pddl
14421 14421 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
satellite
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
11 11 0.0 15 15 0.0
p02-pfile2.pddl
18 18 0.0 20 20 0.0
p03-pfile3.pddl
11 11 0.0 81 81 0.0
p04-pfile4.pddl
27 27 0.0 299 299 0.0
p05-pfile5.pddl
39 39 0.0 2676 2676 0.0
p06-pfile6.pddl
36 36 0.0 7750 7750 0.0
p07-pfile7.pddl
22 22 0.0 7573 7573 0.0
p08-pfile8.pddl
59 59 0.0 207571 207571 0.0
p09-pfile9.pddl
78 78 0.0 61667 61667 0.0
p10-pfile10.pddl
88 88 0.0 373320 373320 0.0
p11-pfile11.pddl
49 49 0.0 58549 58549 0.0
p12-pfile12.pddl
57 57 0.0 1315885 1315885 0.0
p13-pfile13.pddl
478 478 0.0 None None -
p14-pfile14.pddl
113 113 0.0 316267 316267 0.0
p15-pfile15.pddl
277 277 0.0 None None -
p16-pfile16.pddl
74 74 0.0 None None -
p17-pfile17.pddl
296 296 0.0 None None -
p18-pfile18.pddl
121 121 0.0 None None -
p19-pfile19.pddl
284 284 0.0 None None -
p20-pfile20.pddl
1304 1304 0.0 None None -
p21-HC-pfile1.pddl
212 212 0.0 45826 45826 0.0
p22-HC-pfile2.pddl
272 272 0.0 None None -
p23-HC-pfile3.pddl
799 799 0.0 23828 23828 0.0
p24-HC-pfile4.pddl
1512 1512 0.0 None None -
p25-HC-pfile5.pddl
1967 1967 0.0 None None -
p26-HC-pfile6.pddl
974 974 0.0 None None -
p27-HC-pfile7.pddl
694 694 0.0 None None -
p28-HC-pfile8.pddl
4700 4700 0.0 None None -
p29-HC-pfile9.pddl
1405 1405 0.0 None None -
p30-HC-pfile10.pddl
5655 5655 0.0 None None -
p31-HC-pfile11.pddl
3033 3033 0.0 None None -
p32-HC-pfile12.pddl
9661 9661 0.0 None None -
p33-HC-pfile13.pddl
17839 17839 0.0 None None -
p34-HC-pfile14.pddl
291 291 0.0 None None -
p35-HC-pfile15.pddl
5992 5992 0.0 None None -
p36-HC-pfile16.pddl
991 991 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-08-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
15 15 0.0 14 14 0.0
p02.pddl
49 49 0.0 32 32 0.0
p03.pddl
78 78 0.0 37 37 0.0
p04.pddl
28 28 0.0 21 21 0.0
p05.pddl
102 102 0.0 67 67 0.0
p06.pddl
180 180 0.0 76 76 0.0
p07.pddl
45 45 0.0 29 29 0.0
p08.pddl
178 178 0.0 124 124 0.0
p09.pddl
319 319 0.0 138 138 0.0
p10.pddl
66 66 0.0 38 38 0.0
p11.pddl
279 279 0.0 209 209 0.0
p12.pddl
510 510 0.0 229 229 0.0
p13.pddl
91 91 0.0 48 48 0.0
p14.pddl
407 407 0.0 328 328 0.0
p15.pddl
759 759 0.0 355 355 0.0
p16.pddl
120 120 0.0 59 59 0.0
p17.pddl
564 564 0.0 487 487 0.0
p18.pddl
1073 1073 0.0 522 522 0.0
p19.pddl
153 153 0.0 71 71 0.0
p20.pddl
752 752 0.0 692 692 0.0
p21.pddl
1459 1459 0.0 736 736 0.0
p22.pddl
5 5 0.0 7 7 0.0
p23.pddl
5 5 0.0 7 7 0.0
p24.pddl
5 5 0.0 7 7 0.0
p25.pddl
14 14 0.0 20 20 0.0
p26.pddl
140 140 0.0 57 57 0.0
p27.pddl
149 149 0.0 2362 2362 0.0
p28.pddl
28 28 0.0 44 44 0.0
p29.pddl
1421 1421 0.0 153 153 0.0
p30.pddl
323 323 0.0 597 597 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
5 5 0.0 7 7 0.0
p02.pddl
49 49 0.0 32 32 0.0
p03.pddl
78 78 0.0 37 37 0.0
p04.pddl
28 28 0.0 21 21 0.0
p05.pddl
45 45 0.0 29 29 0.0
p06.pddl
102 102 0.0 67 67 0.0
p07.pddl
153 153 0.0 71 71 0.0
p08.pddl
66 66 0.0 38 38 0.0
p09.pddl
91 91 0.0 48 48 0.0
p10.pddl
120 120 0.0 59 59 0.0
p11.pddl
14 14 0.0 20 20 0.0
p12.pddl
180 180 0.0 76 76 0.0
p13.pddl
149 149 0.0 2362 2362 0.0
p14.pddl
140 140 0.0 57 57 0.0
p15.pddl
178 178 0.0 124 124 0.0
p16.pddl
279 279 0.0 209 209 0.0
p17.pddl
407 407 0.0 328 328 0.0
p18.pddl
564 564 0.0 487 487 0.0
p19.pddl
752 752 0.0 692 692 0.0
p20.pddl
28 28 0.0 44 44 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
snake-opt18-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
962 962 0.0 9715 9715 0.0
p02.pddl
4726 4726 0.0 172083 172083 0.0
p03.pddl
52113 52113 0.0 664515 664515 0.0
p04.pddl
20 20 0.0 22 22 0.0
p05.pddl
49 49 0.0 209 209 0.0
p06.pddl
1750 1750 0.0 227986 227986 0.0
p07.pddl
1606960 1606960 0.0 10830106 10830106 0.0
p08.pddl
None None - 43497907 43497907 0.0
p09.pddl
69 69 0.0 1096 1096 0.0
p10.pddl
448 448 0.0 10954 10954 0.0
p11.pddl
1752 1752 0.0 509916 509916 0.0
p12.pddl
370018 370018 0.0 10733129 10733129 0.0
p13.pddl
50466 50466 0.0 None None -
p14.pddl
None None - None None -
p15.pddl
254 254 0.0 27873 27873 0.0
p16.pddl
46910 46910 0.0 8377457 8377457 0.0
p17.pddl
738065 738065 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
4206 4206 0.0 103766 103766 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt08-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
146 146 0.0 2060 2060 0.0
p02.pddl
191 191 0.0 347 347 0.0
p03.pddl
87 87 0.0 361 361 0.0
p04.pddl
749 749 0.0 7149 7149 0.0
p05.pddl
160 160 0.0 None None -
p06.pddl
275 275 0.0 14129 14129 0.0
p07.pddl
1090 1090 0.0 66228 66228 0.0
p08.pddl
32010 32010 0.0 4198331 4198331 0.0
p09.pddl
4123 4123 0.0 1017840 1017840 0.0
p10.pddl
11242 11242 0.0 516243 516243 0.0
p11.pddl
75284 75284 0.0 264140 264140 0.0
p12.pddl
12644 12644 0.0 5894126 5894126 0.0
p13.pddl
634871 634871 0.0 6042304 6042304 0.0
p14.pddl
1840 1840 0.0 55800 55800 0.0
p15.pddl
83496 83496 0.0 2441113 2441113 0.0
p16.pddl
28765 28765 0.0 167040 167040 0.0
p17.pddl
5637 5637 0.0 105631 105631 0.0
p18.pddl
50698 50698 0.0 5961007 5961007 0.0
p19.pddl
97468 97468 0.0 13124193 13124193 0.0
p20.pddl
1671 1671 0.0 2761 2761 0.0
p21.pddl
1679 1679 0.0 2473 2473 0.0
p22.pddl
55054 55054 0.0 7627194 7627194 0.0
p23.pddl
3959 3959 0.0 726179 726179 0.0
p24.pddl
157481 157481 0.0 None None -
p25.pddl
6845122 6845122 0.0 None None -
p26.pddl
46289 46289 0.0 None None -
p27.pddl
12284 12284 0.0 33562 33562 0.0
p28.pddl
2421284 2421284 0.0 13582169 13582169 0.0
p29.pddl
108 108 0.0 None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
275 275 0.0 14129 14129 0.0
p02.pddl
5637 5637 0.0 105631 105631 0.0
p03.pddl
1840 1840 0.0 55800 55800 0.0
p04.pddl
749 749 0.0 7149 7149 0.0
p05.pddl
28765 28765 0.0 167040 167040 0.0
p06.pddl
75284 75284 0.0 264140 264140 0.0
p07.pddl
11242 11242 0.0 516243 516243 0.0
p08.pddl
4123 4123 0.0 1017840 1017840 0.0
p09.pddl
1090 1090 0.0 66228 66228 0.0
p10.pddl
160 160 0.0 None None -
p11.pddl
634871 634871 0.0 6042304 6042304 0.0
p12.pddl
1671 1671 0.0 2761 2761 0.0
p13.pddl
32010 32010 0.0 4198331 4198331 0.0
p14.pddl
12644 12644 0.0 5894126 5894126 0.0
p15.pddl
50698 50698 0.0 5961007 5961007 0.0
p16.pddl
83496 83496 0.0 2441113 2441113 0.0
p17.pddl
97468 97468 0.0 13124193 13124193 0.0
p18.pddl
1679 1679 0.0 2473 2473 0.0
p19.pddl
55054 55054 0.0 7627194 7627194 0.0
p20.pddl
3959 3959 0.0 726179 726179 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
spider-opt18-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
83 83 0.0 126 126 0.0
p02.pddl
1747 1747 0.0 4284 4284 0.0
p03.pddl
312 312 0.0 2444 2444 0.0
p04.pddl
294 294 0.0 7758 7758 0.0
p05.pddl
3333 3333 0.0 27702 27702 0.0
p06.pddl
9171 9171 0.0 2728729 2728729 0.0
p07.pddl
163 163 0.0 330 330 0.0
p08.pddl
140 140 0.0 290 290 0.0
p09.pddl
8987 8987 0.0 26806 26806 0.0
p10.pddl
38914 38914 0.0 520318 520318 0.0
p11.pddl
1052 1052 0.0 26925 26925 0.0
p12.pddl
2994 2994 0.0 1023138 1023138 0.0
p13.pddl
20518 20518 0.0 59839 59839 0.0
p14.pddl
63 63 0.0 114 114 0.0
p15.pddl
92 92 0.0 129 129 0.0
p16.pddl
139 139 0.0 716 716 0.0
p17.pddl
306 306 0.0 431 431 0.0
p18.pddl
536 536 0.0 673893 673893 0.0
p19.pddl
423 423 0.0 7709 7709 0.0
p20.pddl
878 878 0.0 8959 8959 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
storage
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
3 3 0.0 4 4 0.0
p02.pddl
3 3 0.0 4 4 0.0
p03.pddl
3 3 0.0 4 4 0.0
p04.pddl
30 30 0.0 24 24 0.0
p05.pddl
20 20 0.0 71 71 0.0
p06.pddl
24 24 0.0 108 108 0.0
p07.pddl
79 79 0.0 119 119 0.0
p08.pddl
160 160 0.0 1078 1078 0.0
p09.pddl
145 145 0.0 1235 1235 0.0
p10.pddl
190 190 0.0 936 936 0.0
p11.pddl
2870 2870 0.0 8163 8163 0.0
p12.pddl
1884 1884 0.0 44623 44623 0.0
p13.pddl
10096 10096 0.0 875 875 0.0
p14.pddl
18553 18553 0.0 4837 4837 0.0
p15.pddl
4753 4753 0.0 25454 25454 0.0
p16.pddl
5462 5462 0.0 291312 291312 0.0
p17.pddl
7301 7301 0.0 4868033 4868033 0.0
p18.pddl
689227 689227 0.0 None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
161665 161665 0.0 None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
termes-opt18-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
834 834 0.0 12283 12283 0.0
p02.pddl
10895 10895 0.0 16558 16558 0.0
p03.pddl
12080 12080 0.0 130314 130314 0.0
p04.pddl
9538 9538 0.0 112614 112614 0.0
p05.pddl
691458 691458 0.0 1576728 1576728 0.0
p06.pddl
200628 200628 0.0 3225819 3225819 0.0
p07.pddl
2002909 2002909 0.0 30923374 30923374 0.0
p08.pddl
2515288 2515288 0.0 6910238 6910238 0.0
p09.pddl
None None - None None -
p10.pddl
9687681 9687681 0.0 None None -
p11.pddl
1414 1414 0.0 64601 64601 0.0
p12.pddl
3296 3296 0.0 4405 4405 0.0
p13.pddl
6737 6737 0.0 97129 97129 0.0
p14.pddl
4643 4643 0.0 32617 32617 0.0
p15.pddl
103820 103820 0.0 217114 217114 0.0
p16.pddl
56783 56783 0.0 386019 386019 0.0
p17.pddl
29792 29792 0.0 59903 59903 0.0
p18.pddl
1387 1387 0.0 5226 5226 0.0
p19.pddl
22597 22597 0.0 17944 17944 0.0
p20.pddl
31129 31129 0.0 104534 104534 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tetris-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
8476 8476 0.0 82 82 0.0
p01-8.pddl
5439 5439 0.0 173 173 0.0
p01-10.pddl
1132267 1132267 0.0 26355 26355 0.0
p02-4.pddl
342 342 0.0 12 12 0.0
p02-6.pddl
4560 4560 0.0 73 73 0.0
p02-8.pddl
3824 3824 0.0 978 978 0.0
p02-10.pddl
125107 125107 0.0 3869 3869 0.0
p03-4.pddl
2130 2130 0.0 24 24 0.0
p03-6.pddl
6097 6097 0.0 248 248 0.0
p03-8.pddl
4190 4190 0.0 231 231 0.0
p03-10.pddl
7380 7380 0.0 886 886 0.0
p04-6.pddl
8394 8394 0.0 304 304 0.0
p04-8.pddl
17767 17767 0.0 382 382 0.0
p04-10.pddl
14461 14461 0.0 714 714 0.0
p05-6.pddl
2577 2577 0.0 86 86 0.0
p05-8.pddl
345546 345546 0.0 346 346 0.0
p05-10.pddl
4874 4874 0.0 863 863 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
5 5 0.0 5 5 0.0
p02.pddl
979 979 0.0 171 171 0.0
p03.pddl
81 81 0.0 63 63 0.0
p04.pddl
300 300 0.0 366 366 0.0
p05.pddl
991 991 0.0 2974 2974 0.0
p06.pddl
199 199 0.0 601 601 0.0
p07.pddl
604 604 0.0 71 71 0.0
p08.pddl
2470497 2470497 0.0 4636 4636 0.0
p09.pddl
6556 6556 0.0 229 229 0.0
p10.pddl
98 98 0.0 2742 2742 0.0
p11.pddl
499 499 0.0 791 791 0.0
p12.pddl
227 227 0.0 2392 2392 0.0
p13.pddl
3847 3847 0.0 2269 2269 0.0
p14.pddl
200 200 0.0 338 338 0.0
p15.pddl
None None - 2801 2801 0.0
p16.pddl
173 173 0.0 824 824 0.0
p17.pddl
2698 2698 0.0 46804 46804 0.0
p18.pddl
7792 7792 0.0 8229 8229 0.0
p19.pddl
407 407 0.0 1845 1845 0.0
p20.pddl
668 668 0.0 19758 19758 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
691 691 0.0 1116530 1116530 0.0
p02.pddl
740 740 0.0 7347 7347 0.0
p03.pddl
191 191 0.0 681 681 0.0
p04.pddl
95 95 0.0 2976 2976 0.0
p05.pddl
1799 1799 0.0 69841 69841 0.0
p06.pddl
4015 4015 0.0 93358 93358 0.0
p07.pddl
318 318 0.0 783 783 0.0
p08.pddl
90 90 0.0 210 210 0.0
p09.pddl
190 190 0.0 3442 3442 0.0
p10.pddl
497 497 0.0 24233 24233 0.0
p11.pddl
499 499 0.0 791 791 0.0
p12.pddl
227 227 0.0 2392 2392 0.0
p13.pddl
3847 3847 0.0 2269 2269 0.0
p14.pddl
200 200 0.0 338 338 0.0
p15.pddl
None None - 2801 2801 0.0
p16.pddl
173 173 0.0 824 824 0.0
p17.pddl
2698 2698 0.0 46804 46804 0.0
p18.pddl
7792 7792 0.0 8229 8229 0.0
p19.pddl
407 407 0.0 1845 1845 0.0
p20.pddl
668 668 0.0 19758 19758 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tpp
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
6 6 0.0 6 6 0.0
p02.pddl
11 11 0.0 9 9 0.0
p03.pddl
16 16 0.0 12 12 0.0
p04.pddl
21 21 0.0 15 15 0.0
p05.pddl
28 28 0.0 163 163 0.0
p06.pddl
71 71 0.0 1366 1366 0.0
p07.pddl
139 139 0.0 2401 2401 0.0
p08.pddl
206 206 0.0 4114 4114 0.0
p09.pddl
302 302 0.0 6287 6287 0.0
p10.pddl
545 545 0.0 12830 12830 0.0
p11.pddl
624 624 0.0 23567 23567 0.0
p12.pddl
578 578 0.0 36384 36384 0.0
p13.pddl
315 315 0.0 17483 17483 0.0
p14.pddl
532 532 0.0 37159 37159 0.0
p15.pddl
790 790 0.0 27290 27290 0.0
p16.pddl
1072 1072 0.0 142999 142999 0.0
p17.pddl
1286 1286 0.0 1637665 1637665 0.0
p18.pddl
644 644 0.0 511090 511090 0.0
p19.pddl
1962 1962 0.0 1137139 1137139 0.0
p20.pddl
2339 2339 0.0 2904747 2904747 0.0
p21.pddl
1564 1564 0.0 280180 280180 0.0
p22.pddl
820 820 0.0 286023 286023 0.0
p23.pddl
1553 1553 0.0 654119 654119 0.0
p24.pddl
4521 4521 0.0 466673 466673 0.0
p25.pddl
2136 2136 0.0 2076202 2076202 0.0
p26.pddl
2023 2023 0.0 1937464 1937464 0.0
p27.pddl
2661 2661 0.0 1770145 1770145 0.0
p28.pddl
2706 2706 0.0 None None -
p29.pddl
5721 5721 0.0 None None -
p30.pddl
4418 4418 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt08-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
10 10 0.0 27 27 0.0
p02.pddl
23 23 0.0 164 164 0.0
p03.pddl
48 48 0.0 297 297 0.0
p04.pddl
78 78 0.0 431 431 0.0
p05.pddl
89 89 0.0 1130 1130 0.0
p06.pddl
155 155 0.0 6469 6469 0.0
p07.pddl
235 235 0.0 31319 31319 0.0
p08.pddl
179 179 0.0 34140 34140 0.0
p09.pddl
342 342 0.0 61906 61906 0.0
p10.pddl
346 346 0.0 132584 132584 0.0
p11.pddl
14 14 0.0 79 79 0.0
p12.pddl
24 24 0.0 292 292 0.0
p13.pddl
47 47 0.0 1688 1688 0.0
p14.pddl
79 79 0.0 3118 3118 0.0
p15.pddl
478 478 0.0 4492 4492 0.0
p16.pddl
324 324 0.0 99123 99123 0.0
p17.pddl
810 810 0.0 351363 351363 0.0
p18.pddl
1117 1117 0.0 522919 522919 0.0
p19.pddl
1052 1052 0.0 1181643 1181643 0.0
p20.pddl
1543 1543 0.0 2912351 2912351 0.0
p21.pddl
21 21 0.0 31 31 0.0
p22.pddl
32 32 0.0 119 119 0.0
p23.pddl
54 54 0.0 386 386 0.0
p24.pddl
35 35 0.0 510 510 0.0
p25.pddl
124 124 0.0 1957 1957 0.0
p26.pddl
118 118 0.0 7250 7250 0.0
p27.pddl
147 147 0.0 5310 5310 0.0
p28.pddl
548 548 0.0 88515 88515 0.0
p29.pddl
298 298 0.0 66333 66333 0.0
p30.pddl
307 307 0.0 73209 73209 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54 54 0.0 386 386 0.0
p02.pddl
48 48 0.0 297 297 0.0
p03.pddl
24 24 0.0 292 292 0.0
p04.pddl
47 47 0.0 1688 1688 0.0
p05.pddl
35 35 0.0 510 510 0.0
p06.pddl
78 78 0.0 431 431 0.0
p07.pddl
91 91 0.0 922 922 0.0
p08.pddl
101 101 0.0 5815 5815 0.0
p09.pddl
184 184 0.0 2495 2495 0.0
p10.pddl
235 235 0.0 7409 7409 0.0
p11.pddl
339 339 0.0 3998 3998 0.0
p12.pddl
260 260 0.0 17668 17668 0.0
p13.pddl
197 197 0.0 2756 2756 0.0
p14.pddl
175 175 0.0 7418 7418 0.0
p15.pddl
209 209 0.0 1746 1746 0.0
p16.pddl
397 397 0.0 12467 12467 0.0
p17.pddl
89 89 0.0 1130 1130 0.0
p18.pddl
79 79 0.0 3118 3118 0.0
p19.pddl
124 124 0.0 1957 1957 0.0
p20.pddl
155 155 0.0 6469 6469 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
39 39 0.0 134 134 0.0
p02.pddl
44 44 0.0 792 792 0.0
p03.pddl
46 46 0.0 875 875 0.0
p04.pddl
56 56 0.0 3452 3452 0.0
p05.pddl
101 101 0.0 29458 29458 0.0
p06.pddl
167 167 0.0 10029 10029 0.0
p07.pddl
79 79 0.0 2048 2048 0.0
p08.pddl
123 123 0.0 6471 6471 0.0
p09.pddl
128 128 0.0 11907 11907 0.0
p10.pddl
155 155 0.0 174931 174931 0.0
p11.pddl
365 365 0.0 375619 375619 0.0
p12.pddl
445 445 0.0 781406 781406 0.0
p13.pddl
54 54 0.0 1600 1600 0.0
p14.pddl
74 74 0.0 1358 1358 0.0
p15.pddl
81 81 0.0 5397 5397 0.0
p16.pddl
100 100 0.0 197367 197367 0.0
p17.pddl
311 311 0.0 339123 339123 0.0
p18.pddl
234 234 0.0 508912 508912 0.0
p19.pddl
394 394 0.0 159768 159768 0.0
p20.pddl
394 394 0.0 159768 159768 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
trucks-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
58 58 0.0 162 162 0.0
p02.pddl
67 67 0.0 13314 13314 0.0
p03.pddl
93 93 0.0 259890 259890 0.0
p04.pddl
5081 5081 0.0 223 223 0.0
p05.pddl
131 131 0.0 213 213 0.0
p06.pddl
214 214 0.0 258 258 0.0
p07.pddl
2098 2098 0.0 7783465 7783465 0.0
p08.pddl
353 353 0.0 None None -
p09.pddl
1364 1364 0.0 None None -
p10.pddl
87358 87358 0.0 None None -
p11.pddl
11164 11164 0.0 None None -
p12.pddl
146665 146665 0.0 None None -
p13.pddl
566104 566104 0.0 None None -
p14.pddl
43356 43356 0.0 None None -
p15.pddl
721203 721203 0.0 None None -
p16.pddl
2804867 2804867 0.0 None None -
p17.pddl
1010834 1010834 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
None None - None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
3 3 0.0 4 4 0.0
problem02-half.pddl
2 2 0.0 2 2 0.0
problem03-full.pddl
14 14 0.0 9 9 0.0
problem03-half.pddl
8 8 0.0 7 7 0.0
problem04-full.pddl
30 30 0.0 16 16 0.0
problem04-half.pddl
21 21 0.0 15 15 0.0
problem05-full.pddl
45 45 0.0 25 25 0.0
problem05-half.pddl
35 35 0.0 36 36 0.0
problem06-full.pddl
101 101 0.0 36 36 0.0
problem06-half.pddl
55 55 0.0 47 47 0.0
problem07-full.pddl
97 97 0.0 63 63 0.0
problem07-half.pddl
92 92 0.0 66 66 0.0
problem08-full.pddl
163 163 0.0 64 64 0.0
problem08-half.pddl
130 130 0.0 74 74 0.0
problem09-full.pddl
199 199 0.0 81 81 0.0
problem09-half.pddl
272 272 0.0 162 162 0.0
problem10-full.pddl
256 256 0.0 100 100 0.0
problem10-half.pddl
233 233 0.0 144 144 0.0
problem11-full.pddl
477 477 0.0 161 161 0.0
problem11-half.pddl
227 227 0.0 255 255 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt14-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
45 45 0.0 25 25 0.0
p-1-6.pddl
101 101 0.0 36 36 0.0
p-1-7.pddl
97 97 0.0 63 63 0.0
p-1-8.pddl
163 163 0.0 64 64 0.0
p-1-9.pddl
199 199 0.0 81 81 0.0
p-1-10.pddl
256 256 0.0 100 100 0.0
p-1-11.pddl
477 477 0.0 161 161 0.0
p-1-12.pddl
399 399 0.0 147 147 0.0
p-1-13.pddl
740 740 0.0 183 183 0.0
p-1-14.pddl
907 907 0.0 206 206 0.0
p-1-15.pddl
1047 1047 0.0 293 293 0.0
p-1-16.pddl
1315 1315 0.0 277 277 0.0
p-1-17.pddl
1250 1250 0.0 369 369 0.0
p-1-18.pddl
1648 1648 0.0 397 397 0.0
p-05-5.pddl
46 46 0.0 30 30 0.0
p-05-6.pddl
56 56 0.0 49 49 0.0
p-05-7.pddl
116 116 0.0 61 61 0.0
p-05-8.pddl
143 143 0.0 89 89 0.0
p-05-9.pddl
179 179 0.0 129 129 0.0
p-05-10.pddl
210 210 0.0 121 121 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt08-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
9 9 0.0 25 25 0.0
p02.pddl
290 290 0.0 13 13 0.0
p03.pddl
35 35 0.0 32 32 0.0
p04.pddl
28 28 0.0 None None -
p05.pddl
2923 2923 0.0 93 93 0.0
p06.pddl
23 23 0.0 5426 5426 0.0
p07.pddl
45 45 0.0 109 109 0.0
p08.pddl
26 26 0.0 None None -
p09.pddl
5520 5520 0.0 None None -
p10.pddl
56 56 0.0 20672 20672 0.0
p11.pddl
8 8 0.0 25 25 0.0
p12.pddl
14 14 0.0 28 28 0.0
p13.pddl
14 14 0.0 80 80 0.0
p14.pddl
2198 2198 0.0 14 14 0.0
p15.pddl
4027 4027 0.0 22 22 0.0
p16.pddl
2830 2830 0.0 None None -
p17.pddl
3593 3593 0.0 2321 2321 0.0
p18.pddl
26 26 0.0 6456 6456 0.0
p19.pddl
48 48 0.0 28 28 0.0
p20.pddl
5016 5016 0.0 13134 13134 0.0
p21.pddl
90 90 0.0 6 6 0.0
p22.pddl
9 9 0.0 9 9 0.0
p23.pddl
12 12 0.0 13 13 0.0
p24.pddl
2247 2247 0.0 16518865 16518865 0.0
p25.pddl
4539 4539 0.0 25 25 0.0
p26.pddl
17 17 0.0 None None -
p27.pddl
3914 3914 0.0 None None -
p28.pddl
7109 7109 0.0 None None -
p29.pddl
34 34 0.0 31 31 0.0
p30.pddl
7095 7095 0.0 169326 169326 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt11-strips
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
12 12 0.0 13 13 0.0
p02.pddl
14 14 0.0 28 28 0.0
p03.pddl
14 14 0.0 80 80 0.0
p04.pddl
35 35 0.0 32 32 0.0
p05.pddl
2247 2247 0.0 16518865 16518865 0.0
p06.pddl
28 28 0.0 None None -
p07.pddl
2198 2198 0.0 14 14 0.0
p08.pddl
4539 4539 0.0 25 25 0.0
p09.pddl
2923 2923 0.0 93 93 0.0
p10.pddl
4027 4027 0.0 22 22 0.0
p11.pddl
17 17 0.0 None None -
p12.pddl
2830 2830 0.0 None None -
p13.pddl
23 23 0.0 5426 5426 0.0
p14.pddl
3914 3914 0.0 None None -
p15.pddl
3593 3593 0.0 2321 2321 0.0
p16.pddl
45 45 0.0 109 109 0.0
p17.pddl
7109 7109 0.0 None None -
p18.pddl
26 26 0.0 6456 6456 0.0
p19.pddl
26 26 0.0 None None -
p20.pddl
34 34 0.0 31 31 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
zenotravel
Show table
expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
2 2 0.0 2 2 0.0
p02.pddl
12 12 0.0 8 8 0.0
p03.pddl
13 13 0.0 102 102 0.0
p04.pddl
22 22 0.0 149 149 0.0
p05.pddl
31 31 0.0 282 282 0.0
p06.pddl
25 25 0.0 508 508 0.0
p07.pddl
50 50 0.0 414 414 0.0
p08.pddl
55 55 0.0 760 760 0.0
p09.pddl
92 92 0.0 1284 1284 0.0
p10.pddl
108 108 0.0 1499 1499 0.0
p11.pddl
44 44 0.0 1726 1726 0.0
p12.pddl
83 83 0.0 1901 1901 0.0
p13.pddl
141 141 0.0 3330 3330 0.0
p14.pddl
254 254 0.0 29632 29632 0.0
p15.pddl
717 717 0.0 46323 46323 0.0
p16.pddl
315 315 0.0 44523 44523 0.0
p17.pddl
809 809 0.0 191833 191833 0.0
p18.pddl
1101 1101 0.0 50778 50778 0.0
p19.pddl
1260 1260 0.0 129938 129938 0.0
p20.pddl
2703 2703 0.0 210322 210322 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
generated
Show table
Only instances where all algorithms have a value for "generated" are considered. Each table entry gives the geometric mean of "generated" for that domain. The bottom row reports the geometric mean across all domains.
agricola-opt18-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
606 606 0.0 498095 498095 0.0
p02.pddl
2828 2828 0.0 589594 589594 0.0
p03.pddl
837 837 0.0 686937 686937 0.0
p04.pddl
969 969 0.0 624757 624757 0.0
p05.pddl
809 809 0.0 520435 520435 0.0
p06.pddl
718 718 0.0 1078434 1078434 0.0
p07.pddl
3812 3812 0.0 535393 535393 0.0
p08.pddl
919 919 0.0 786822 786822 0.0
p09.pddl
964 964 0.0 904151 904151 0.0
p10.pddl
4162 4162 0.0 426301 426301 0.0
p11.pddl
1226 1226 0.0 703141 703141 0.0
p12.pddl
1861 1861 0.0 719885 719885 0.0
p13.pddl
1334 1334 0.0 449105 449105 0.0
p14.pddl
1074 1074 0.0 589442 589442 0.0
p15.pddl
3654 3654 0.0 959534 959534 0.0
p16.pddl
1177 1177 0.0 684704 684704 0.0
p17.pddl
1410 1410 0.0 701668 701668 0.0
p18.pddl
7562 7562 0.0 831574 831574 0.0
p19.pddl
1257 1257 0.0 499477 499477 0.0
p20.pddl
1955 1955 0.0 714941 714941 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
airport
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
9 9 0.0 9 9 0.0
p02-airport1-p1.pddl
16 16 0.0 16 16 0.0
p03-airport1-p2.pddl
60 60 0.0 44 44 0.0
p04-airport2-p1.pddl
21 21 0.0 21 21 0.0
p05-airport2-p1.pddl
31 31 0.0 28 28 0.0
p06-airport2-p2.pddl
137 137 0.0 108 108 0.0
p07-airport2-p2.pddl
130 130 0.0 122 122 0.0
p08-airport2-p3.pddl
1456 1456 0.0 955 955 0.0
p09-airport2-p4.pddl
2168 2168 0.0 31442 31442 0.0
p10-airport3-p1.pddl
20 20 0.0 20 20 0.0
p11-airport3-p1.pddl
31 31 0.0 28 28 0.0
p12-airport3-p2.pddl
253 253 0.0 102 102 0.0
p13-airport3-p2.pddl
160 160 0.0 103 103 0.0
p14-airport3-p3.pddl
11396 11396 0.0 246 246 0.0
p15-airport3-p3.pddl
1402 1402 0.0 538 538 0.0
p16-airport3-p4.pddl
88822 88822 0.0 41496 41496 0.0
p17-airport3-p5.pddl
24524 24524 0.0 990897 990897 0.0
p18-airport3-p6.pddl
82715 82715 0.0 9758598 9758598 0.0
p19-airport3-p6.pddl
29255 29255 0.0 15104205 15104205 0.0
p20-airport3-p7.pddl
191816 191816 0.0 93550890 93550890 0.0
p21-airport4halfMUC-p2.pddl
1163 1163 0.0 297 297 0.0
p22-airport4halfMUC-p3.pddl
187505 187505 0.0 686 686 0.0
p23-airport4halfMUC-p4.pddl
308736 308736 0.0 1020 1020 0.0
p24-airport4halfMUC-p4.pddl
250595 250595 0.0 1091 1091 0.0
p25-airport4halfMUC-p5.pddl
325041 325041 0.0 None None -
p26-airport4halfMUC-p6.pddl
None None - None None -
p27-airport4halfMUC-p6.pddl
306829 306829 0.0 None None -
p28-airport4halfMUC-p7.pddl
None None - None None -
p29-airport4halfMUC-p8.pddl
None None - None None -
p30-airport4halfMUC-p8.pddl
None None - None None -
p31-airport4halfMUC-p9.pddl
None None - None None -
p32-airport4halfMUC-p10.pddl
None None - None None -
p33-airport4halfMUC-p10.pddl
None None - None None -
p34-airport4halfMUC-p11.pddl
None None - None None -
p35-airport4halfMUC-p12.pddl
None None - None None -
p36-airport5MUC-p2.pddl
317 317 0.0 1383 1383 0.0
p37-airport5MUC-p3.pddl
159064 159064 0.0 2340069 2340069 0.0
p38-airport5MUC-p3.pddl
215230 215230 0.0 218888 218888 0.0
p39-airport5MUC-p4.pddl
187854 187854 0.0 None None -
p40-airport5MUC-p4.pddl
27557 27557 0.0 2314381 2314381 0.0
p41-airport5MUC-p4.pddl
251242 251242 0.0 None None -
p42-airport5MUC-p5.pddl
None None - None None -
p43-airport5MUC-p5.pddl
268156 268156 0.0 560189 560189 0.0
p44-airport5MUC-p5.pddl
327471 327471 0.0 None None -
p45-airport5MUC-p6.pddl
None None - None None -
p46-airport5MUC-p6.pddl
None None - None None -
p47-airport5MUC-p8.pddl
None None - None None -
p48-airport5MUC-p9.pddl
None None - None None -
p49-airport5MUC-p10.pddl
None None - None None -
p50-airport5MUC-p15.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
5537 5537 0.0 59219 59219 0.0
pfile01-002.pddl
2648 2648 0.0 45259 45259 0.0
pfile01-003.pddl
2671 2671 0.0 45158 45158 0.0
pfile01-004.pddl
2699 2699 0.0 45259 45259 0.0
pfile02-005.pddl
6840 6840 0.0 199573 199573 0.0
pfile02-006.pddl
5017 5017 0.0 3268097 3268097 0.0
pfile02-007.pddl
6322 6322 0.0 198809 198809 0.0
pfile02-008.pddl
6144 6144 0.0 255234 255234 0.0
pfile03-009.pddl
10432 10432 0.0 750759 750759 0.0
pfile03-010.pddl
17826 17826 0.0 755484 755484 0.0
pfile03-011.pddl
11467 11467 0.0 823576 823576 0.0
pfile03-012.pddl
16807 16807 0.0 824185 824185 0.0
pfile04-013.pddl
23013 23013 0.0 2953056 2953056 0.0
pfile04-014.pddl
24989 24989 0.0 7071833 7071833 0.0
pfile04-015.pddl
32433 32433 0.0 3370300 3370300 0.0
pfile04-016.pddl
32895 32895 0.0 2951757 2951757 0.0
pfile05-017.pddl
32385 32385 0.0 5041401 5041401 0.0
pfile05-018.pddl
31594 31594 0.0 6186728 6186728 0.0
pfile05-019.pddl
32375 32375 0.0 9578248 9578248 0.0
pfile05-020.pddl
27871 27871 0.0 13547344 13547344 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
6795 6795 0.0 3267296 3267296 0.0
p435-2.pddl
10520 10520 0.0 202001 202001 0.0
p435-3.pddl
6751 6751 0.0 3269992 3269992 0.0
p536-1.pddl
11035 11035 0.0 29956089 29956089 0.0
p536-2.pddl
17688 17688 0.0 756343 756343 0.0
p536-3.pddl
10422 10422 0.0 750811 750811 0.0
p638-1.pddl
19108 19108 0.0 2953762 2953762 0.0
p638-2.pddl
14705 14705 0.0 5929796 5929796 0.0
p638-3.pddl
26211 26211 0.0 3348272 3348272 0.0
p739-1.pddl
26906 26906 0.0 8507869 8507869 0.0
p739-2.pddl
45988 45988 0.0 9849813 9849813 0.0
p739-3.pddl
32751 32751 0.0 9843540 9843540 0.0
p839-1.pddl
47871 47871 0.0 17638174 17638174 0.0
p839-2.pddl
42362 42362 0.0 15645120 15645120 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
blocks
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
35 35 0.0 18 18 0.0
probBLOCKS-4-1.pddl
30 30 0.0 88 88 0.0
probBLOCKS-4-2.pddl
28 28 0.0 22 22 0.0
probBLOCKS-5-0.pddl
44 44 0.0 81 81 0.0
probBLOCKS-5-1.pddl
55 55 0.0 209 209 0.0
probBLOCKS-5-2.pddl
118 118 0.0 331 331 0.0
probBLOCKS-6-0.pddl
62 62 0.0 432 432 0.0
probBLOCKS-6-1.pddl
99 99 0.0 44 44 0.0
probBLOCKS-6-2.pddl
200 200 0.0 215 215 0.0
probBLOCKS-7-0.pddl
169 169 0.0 1928 1928 0.0
probBLOCKS-7-1.pddl
352 352 0.0 1993 1993 0.0
probBLOCKS-7-2.pddl
322 322 0.0 1095 1095 0.0
probBLOCKS-8-0.pddl
284 284 0.0 784 784 0.0
probBLOCKS-8-1.pddl
243 243 0.0 3292 3292 0.0
probBLOCKS-8-2.pddl
182 182 0.0 415 415 0.0
probBLOCKS-9-0.pddl
831 831 0.0 4815 4815 0.0
probBLOCKS-9-1.pddl
1001 1001 0.0 5101 5101 0.0
probBLOCKS-9-2.pddl
454 454 0.0 4079 4079 0.0
probBLOCKS-10-0.pddl
993 993 0.0 596 596 0.0
probBLOCKS-10-1.pddl
1012 1012 0.0 16147 16147 0.0
probBLOCKS-10-2.pddl
1343 1343 0.0 8993 8993 0.0
probBLOCKS-11-0.pddl
420 420 0.0 7035 7035 0.0
probBLOCKS-11-1.pddl
1422 1422 0.0 22377 22377 0.0
probBLOCKS-11-2.pddl
639 639 0.0 3821 3821 0.0
probBLOCKS-12-0.pddl
1310 1310 0.0 10433 10433 0.0
probBLOCKS-12-1.pddl
1411 1411 0.0 22266 22266 0.0
probBLOCKS-13-0.pddl
4369 4369 0.0 12894 12894 0.0
probBLOCKS-13-1.pddl
3280 3280 0.0 13840 13840 0.0
probBLOCKS-14-0.pddl
1065 1065 0.0 8164 8164 0.0
probBLOCKS-14-1.pddl
1979 1979 0.0 17375 17375 0.0
probBLOCKS-15-0.pddl
6570 6570 0.0 31604 31604 0.0
probBLOCKS-15-1.pddl
1917 1917 0.0 284559 284559 0.0
probBLOCKS-16-1.pddl
4210 4210 0.0 51994 51994 0.0
probBLOCKS-16-2.pddl
17621 17621 0.0 46096 46096 0.0
probBLOCKS-17-0.pddl
22816 22816 0.0 1975873 1975873 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
childsnack-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
17478 17478 0.0 13328089 13328089 0.0
child-snack_pfile01.pddl
9962 9962 0.0 14149176 14149176 0.0
child-snack_pfile02-2.pddl
35156 35156 0.0 75592750 75592750 0.0
child-snack_pfile02.pddl
20035 20035 0.0 88073445 88073445 0.0
child-snack_pfile03-2.pddl
102257 102257 0.0 392346058 392346058 0.0
child-snack_pfile03.pddl
85165 85165 0.0 393317433 393317433 0.0
child-snack_pfile04-2.pddl
131194 131194 0.0 None None -
child-snack_pfile04.pddl
152634 152634 0.0 None None -
child-snack_pfile05-2.pddl
214149 214149 0.0 None None -
child-snack_pfile05.pddl
217263 217263 0.0 None None -
child-snack_pfile06-2.pddl
310096 310096 0.0 None None -
child-snack_pfile06.pddl
344858 344858 0.0 None None -
child-snack_pfile07-2.pddl
473119 473119 0.0 None None -
child-snack_pfile07.pddl
619007 619007 0.0 None None -
child-snack_pfile08-2.pddl
659330 659330 0.0 None None -
child-snack_pfile08.pddl
None None - None None -
child-snack_pfile09-2.pddl
None None - None None -
child-snack_pfile09.pddl
None None - None None -
child-snack_pfile10-2.pddl
None None - None None -
child-snack_pfile10.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
data-network-opt18-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
433 433 0.0 454 454 0.0
p02.pddl
63 63 0.0 351 351 0.0
p03.pddl
176 176 0.0 3843 3843 0.0
p04.pddl
243 243 0.0 878 878 0.0
p05.pddl
336 336 0.0 7528 7528 0.0
p06.pddl
205 205 0.0 6464 6464 0.0
p07.pddl
2618 2618 0.0 36234239 36234239 0.0
p08.pddl
92252 92252 0.0 19732 19732 0.0
p09.pddl
373 373 0.0 4047 4047 0.0
p10.pddl
168 168 0.0 883 883 0.0
p11.pddl
129 129 0.0 4856 4856 0.0
p12.pddl
124 124 0.0 4953 4953 0.0
p13.pddl
174 174 0.0 1414 1414 0.0
p14.pddl
49324 49324 0.0 6034 6034 0.0
p15.pddl
227 227 0.0 14634 14634 0.0
p16.pddl
7319 7319 0.0 178223 178223 0.0
p17.pddl
310 310 0.0 19426 19426 0.0
p18.pddl
244509 244509 0.0 13880799 13880799 0.0
p19.pddl
1188 1188 0.0 777300 777300 0.0
p20.pddl
75853 75853 0.0 61219500 61219500 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
depot
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
119 119 0.0 296 296 0.0
p02.pddl
332 332 0.0 385 385 0.0
p03.pddl
26220 26220 0.0 50011 50011 0.0
p04.pddl
14403 14403 0.0 1739 1739 0.0
p05.pddl
552303 552303 0.0 2590 2590 0.0
p06.pddl
66437739 66437739 0.0 4754 4754 0.0
p07.pddl
4972 4972 0.0 929847 929847 0.0
p08.pddl
68065 68065 0.0 21320 21320 0.0
p09.pddl
307250 307250 0.0 4075893 4075893 0.0
p10.pddl
115494 115494 0.0 21749 21749 0.0
p11.pddl
243566 243566 0.0 22346 22346 0.0
p12.pddl
515644 515644 0.0 None None -
p13.pddl
1587 1587 0.0 2112 2112 0.0
p14.pddl
9417 9417 0.0 18025821 18025821 0.0
p15.pddl
4889707 4889707 0.0 86951510 86951510 0.0
p16.pddl
3035 3035 0.0 18687143 18687143 0.0
p17.pddl
2629 2629 0.0 187124 187124 0.0
p18.pddl
21616 21616 0.0 None None -
p19.pddl
451179 451179 0.0 304627049 304627049 0.0
p20.pddl
None None - 953991 953991 0.0
p21.pddl
15981 15981 0.0 78849489 78849489 0.0
p22.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
driverlog
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
68 68 0.0 78 78 0.0
p02.pddl
38925 38925 0.0 1892 1892 0.0
p03.pddl
185 185 0.0 1079 1079 0.0
p04.pddl
46748 46748 0.0 4772 4772 0.0
p05.pddl
57747 57747 0.0 36634 36634 0.0
p06.pddl
7471 7471 0.0 460 460 0.0
p07.pddl
580 580 0.0 2026 2026 0.0
p08.pddl
91441 91441 0.0 5572 5572 0.0
p09.pddl
6670 6670 0.0 3258 3258 0.0
p10.pddl
861 861 0.0 5336 5336 0.0
p11.pddl
1646 1646 0.0 3681 3681 0.0
p12.pddl
106758 106758 0.0 6044 6044 0.0
p13.pddl
49512 49512 0.0 7147 7147 0.0
p14.pddl
2733 2733 0.0 20587 20587 0.0
p15.pddl
4619 4619 0.0 193488 193488 0.0
p16.pddl
851892 851892 0.0 913474 913474 0.0
p17.pddl
45021 45021 0.0 None None -
p18.pddl
1255672 1255672 0.0 4153876 4153876 0.0
p19.pddl
1361632 1361632 0.0 15567431 15567431 0.0
p20.pddl
1053375 1053375 0.0 3984772 3984772 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt08-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
899 899 0.0 8185 8185 0.0
p02.pddl
278 278 0.0 3731 3731 0.0
p03.pddl
793 793 0.0 3804 3804 0.0
p04.pddl
1263 1263 0.0 60372 60372 0.0
p05.pddl
1320 1320 0.0 16178 16178 0.0
p06.pddl
2388 2388 0.0 51229 51229 0.0
p07.pddl
1977 1977 0.0 13182 13182 0.0
p08.pddl
1085 1085 0.0 31022 31022 0.0
p09.pddl
3672 3672 0.0 59526 59526 0.0
p10.pddl
3382 3382 0.0 47540 47540 0.0
p11.pddl
961 961 0.0 14413 14413 0.0
p12.pddl
1431 1431 0.0 19267 19267 0.0
p13.pddl
1032 1032 0.0 6759 6759 0.0
p14.pddl
2194 2194 0.0 31500 31500 0.0
p15.pddl
1857 1857 0.0 9655 9655 0.0
p16.pddl
4034 4034 0.0 118607 118607 0.0
p17.pddl
3694 3694 0.0 11264 11264 0.0
p18.pddl
2506 2506 0.0 51703 51703 0.0
p19.pddl
3793 3793 0.0 32690 32690 0.0
p20.pddl
2913 2913 0.0 29984 29984 0.0
p21.pddl
952 952 0.0 87141 87141 0.0
p22.pddl
960 960 0.0 209478 209478 0.0
p23.pddl
1305 1305 0.0 131105 131105 0.0
p24.pddl
3083 3083 0.0 487983 487983 0.0
p25.pddl
1970 1970 0.0 69176 69176 0.0
p26.pddl
1184 1184 0.0 14667 14667 0.0
p27.pddl
4455 4455 0.0 70883 70883 0.0
p28.pddl
3159 3159 0.0 102809 102809 0.0
p29.pddl
4418 4418 0.0 106218 106218 0.0
p30.pddl
6924 6924 0.0 813052 813052 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
961 961 0.0 14413 14413 0.0
p02.pddl
952 952 0.0 87141 87141 0.0
p03.pddl
1431 1431 0.0 19267 19267 0.0
p04.pddl
793 793 0.0 3804 3804 0.0
p05.pddl
1032 1032 0.0 6759 6759 0.0
p06.pddl
1263 1263 0.0 60372 60372 0.0
p07.pddl
1184 1184 0.0 14667 14667 0.0
p08.pddl
1320 1320 0.0 16178 16178 0.0
p09.pddl
960 960 0.0 209478 209478 0.0
p10.pddl
2194 2194 0.0 31500 31500 0.0
p11.pddl
3159 3159 0.0 102809 102809 0.0
p12.pddl
2388 2388 0.0 51229 51229 0.0
p13.pddl
1977 1977 0.0 13182 13182 0.0
p14.pddl
1085 1085 0.0 31022 31022 0.0
p15.pddl
3672 3672 0.0 59526 59526 0.0
p16.pddl
1857 1857 0.0 9655 9655 0.0
p17.pddl
3694 3694 0.0 11264 11264 0.0
p18.pddl
2506 2506 0.0 51703 51703 0.0
p19.pddl
1305 1305 0.0 131105 131105 0.0
p20.pddl
3083 3083 0.0 487983 487983 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
12068 12068 0.0 2996040 2996040 0.0
opt-p01-002.pddl
764 764 0.0 1831826 1831826 0.0
opt-p02-003.pddl
4249263 4249263 0.0 None None -
opt-p02-004.pddl
2302094 2302094 0.0 None None -
opt-p03-005.pddl
3244192 3244192 0.0 None None -
opt-p03-006.pddl
22991474 22991474 0.0 None None -
opt-p04-007.pddl
37440918 37440918 0.0 None None -
opt-p04-008.pddl
94146494 94146494 0.0 None None -
opt-p05-009.pddl
20289934 20289934 0.0 None None -
opt-p05-010.pddl
None None - None None -
opt-p06-011.pddl
None None - None None -
opt-p06-012.pddl
None None - None None -
opt-p07-013.pddl
None None - None None -
opt-p07-014.pddl
None None - None None -
opt-p08-015.pddl
None None - None None -
opt-p08-016.pddl
None None - None None -
opt-p09-017.pddl
None None - None None -
opt-p09-018.pddl
None None - None None -
opt-p10-019.pddl
None None - None None -
opt-p10-020.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
2934169 2934169 0.0 None None -
p01-4-4-2.pddl
52764463 52764463 0.0 None None -
p01-5-3-2.pddl
40088413 40088413 0.0 None None -
p01-5-4-2.pddl
None None - None None -
p01-5-5-2.pddl
None None - None None -
p01-6-4-2.pddl
None None - None None -
p01-6-5-2.pddl
None None - None None -
p02-4-4-2.pddl
62609266 62609266 0.0 None None -
p02-5-3-2.pddl
19859189 19859189 0.0 None None -
p02-5-4-2.pddl
None None - None None -
p02-5-5-2.pddl
None None - None None -
p02-6-4-2.pddl
None None - None None -
p02-6-5-2.pddl
None None - None None -
p03-4-3-2.pddl
3511802 3511802 0.0 None None -
p03-4-4-2.pddl
45493756 45493756 0.0 None None -
p03-5-3-2.pddl
22071103 22071103 0.0 None None -
p03-5-4-2.pddl
45792857 45792857 0.0 None None -
p03-5-5-2.pddl
None None - None None -
p03-6-4-2.pddl
None None - None None -
p03-6-5-2.pddl
None None - None None -
Sum of diffs
0.00
None
Arithmetic mean of diffs
0.00
None
freecell
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
46 46 0.0 48 48 0.0
p02.pddl
99 99 0.0 95 95 0.0
p03.pddl
136 136 0.0 158 158 0.0
p04.pddl
406 406 0.0 231 231 0.0
p05.pddl
242 242 0.0 237 237 0.0
p06.pddl
574 574 0.0 322 322 0.0
p07.pddl
4787 4787 0.0 10389 10389 0.0
p08.pddl
587 587 0.0 474 474 0.0
p09.pddl
631 631 0.0 415 415 0.0
p10.pddl
2724 2724 0.0 850 850 0.0
p11.pddl
10995 10995 0.0 9839 9839 0.0
p12.pddl
725 725 0.0 428 428 0.0
p13.pddl
14865 14865 0.0 1230 1230 0.0
p14.pddl
1126 1126 0.0 3035 3035 0.0
p15.pddl
2052 2052 0.0 790 790 0.0
p16.pddl
2334 2334 0.0 2928 2928 0.0
p17.pddl
1477 1477 0.0 776 776 0.0
p18.pddl
4739 4739 0.0 101928 101928 0.0
p19.pddl
56083 56083 0.0 105157 105157 0.0
p20.pddl
2902 2902 0.0 63375 63375 0.0
probfreecell-2-1.pddl
54 54 0.0 54 54 0.0
probfreecell-2-2.pddl
68 68 0.0 74 74 0.0
probfreecell-2-3.pddl
50 50 0.0 65 65 0.0
probfreecell-2-4.pddl
68 68 0.0 76 76 0.0
probfreecell-2-5.pddl
61 61 0.0 64 64 0.0
probfreecell-3-1.pddl
111 111 0.0 106 106 0.0
probfreecell-3-2.pddl
133 133 0.0 137 137 0.0
probfreecell-3-3.pddl
132 132 0.0 126 126 0.0
probfreecell-3-4.pddl
138 138 0.0 148 148 0.0
probfreecell-3-5.pddl
134 134 0.0 134 134 0.0
probfreecell-4-1.pddl
214 214 0.0 195 195 0.0
probfreecell-4-2.pddl
186 186 0.0 190 190 0.0
probfreecell-4-3.pddl
186 186 0.0 186 186 0.0
probfreecell-4-4.pddl
223 223 0.0 222 222 0.0
probfreecell-4-5.pddl
200 200 0.0 200 200 0.0
probfreecell-5-1.pddl
549 549 0.0 345 345 0.0
probfreecell-5-2.pddl
310 310 0.0 292 292 0.0
probfreecell-5-3.pddl
233 233 0.0 257 257 0.0
probfreecell-5-4.pddl
352 352 0.0 312 312 0.0
probfreecell-5-5.pddl
333 333 0.0 278 278 0.0
probfreecell-6-1.pddl
417 417 0.0 374 374 0.0
probfreecell-6-2.pddl
325 325 0.0 361 361 0.0
probfreecell-6-3.pddl
431 431 0.0 371 371 0.0
probfreecell-6-4.pddl
423 423 0.0 381 381 0.0
probfreecell-6-5.pddl
504 504 0.0 414 414 0.0
probfreecell-7-1.pddl
755 755 0.0 500 500 0.0
probfreecell-7-2.pddl
370 370 0.0 384 384 0.0
probfreecell-7-3.pddl
990 990 0.0 522 522 0.0
probfreecell-7-4.pddl
783 783 0.0 555 555 0.0
probfreecell-7-5.pddl
725 725 0.0 670 670 0.0
probfreecell-8-1.pddl
1301 1301 0.0 465 465 0.0
probfreecell-8-2.pddl
860 860 0.0 562 562 0.0
probfreecell-8-3.pddl
1050 1050 0.0 499 499 0.0
probfreecell-8-4.pddl
737 737 0.0 584 584 0.0
probfreecell-8-5.pddl
1603 1603 0.0 764 764 0.0
probfreecell-9-1.pddl
1559 1559 0.0 827 827 0.0
probfreecell-9-2.pddl
1286 1286 0.0 840 840 0.0
probfreecell-9-3.pddl
962 962 0.0 608 608 0.0
probfreecell-9-4.pddl
1271 1271 0.0 715 715 0.0
probfreecell-9-5.pddl
1602 1602 0.0 1289 1289 0.0
probfreecell-10-1.pddl
7754 7754 0.0 5726 5726 0.0
probfreecell-10-2.pddl
1389 1389 0.0 2228 2228 0.0
probfreecell-10-3.pddl
1798 1798 0.0 15926 15926 0.0
probfreecell-10-4.pddl
1923 1923 0.0 11244 11244 0.0
probfreecell-10-5.pddl
2909 2909 0.0 1461 1461 0.0
probfreecell-11-1.pddl
1925 1925 0.0 51084 51084 0.0
probfreecell-11-2.pddl
2966 2966 0.0 168158 168158 0.0
probfreecell-11-3.pddl
1851 1851 0.0 31589 31589 0.0
probfreecell-11-4.pddl
2154 2154 0.0 1757 1757 0.0
probfreecell-11-5.pddl
None None - 1944 1944 0.0
probfreecell-12-1.pddl
85804 85804 0.0 80233 80233 0.0
probfreecell-12-2.pddl
3365 3365 0.0 19127 19127 0.0
probfreecell-12-3.pddl
1255 1255 0.0 15285 15285 0.0
probfreecell-12-4.pddl
2960 2960 0.0 27392 27392 0.0
probfreecell-12-5.pddl
2795712 2795712 0.0 49083 49083 0.0
probfreecell-13-1.pddl
118454 118454 0.0 66087 66087 0.0
probfreecell-13-2.pddl
84402 84402 0.0 90870 90870 0.0
probfreecell-13-3.pddl
2627 2627 0.0 19556 19556 0.0
probfreecell-13-4.pddl
22584 22584 0.0 13027 13027 0.0
probfreecell-13-5.pddl
2298641 2298641 0.0 3855947 3855947 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
ged-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
12 12 0.0 6 6 0.0
d-1-3.pddl
80 80 0.0 70 70 0.0
d-1-4.pddl
12 12 0.0 6 6 0.0
d-1-8.pddl
93 93 0.0 97 97 0.0
d-2-1.pddl
12 12 0.0 6 6 0.0
d-2-3.pddl
60 60 0.0 50 50 0.0
d-2-4.pddl
47 47 0.0 34 34 0.0
d-2-8.pddl
132 132 0.0 135 135 0.0
d-3-1.pddl
81 81 0.0 70 70 0.0
d-3-2.pddl
59 59 0.0 50 50 0.0
d-3-4.pddl
143 143 0.0 127 127 0.0
d-4-2.pddl
45 45 0.0 34 34 0.0
d-4-3.pddl
142 142 0.0 128 128 0.0
d-4-8.pddl
132 132 0.0 135 135 0.0
d-7-5.pddl
103 103 0.0 101 101 0.0
d-7-6.pddl
89 89 0.0 75 75 0.0
d-8-1.pddl
97 97 0.0 103 103 0.0
d-8-2.pddl
132 132 0.0 141 141 0.0
d-8-4.pddl
135 135 0.0 139 139 0.0
d-8-9.pddl
313 313 0.0 218 218 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
grid
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
80 80 0.0 185 185 0.0
prob02.pddl
257 257 0.0 4088 4088 0.0
prob03.pddl
1020 1020 0.0 None None -
prob04.pddl
586 586 0.0 4140 4140 0.0
prob05.pddl
2557 2557 0.0 4118256 4118256 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
gripper
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
63 63 0.0 99 99 0.0
prob02.pddl
124 124 0.0 258 258 0.0
prob03.pddl
203 203 0.0 533 533 0.0
prob04.pddl
300 300 0.0 956 956 0.0
prob05.pddl
415 415 0.0 1559 1559 0.0
prob06.pddl
548 548 0.0 2374 2374 0.0
prob07.pddl
699 699 0.0 3433 3433 0.0
prob08.pddl
868 868 0.0 4768 4768 0.0
prob09.pddl
1055 1055 0.0 6411 6411 0.0
prob10.pddl
1260 1260 0.0 8394 8394 0.0
prob11.pddl
1483 1483 0.0 10749 10749 0.0
prob12.pddl
1724 1724 0.0 13508 13508 0.0
prob13.pddl
1983 1983 0.0 16703 16703 0.0
prob14.pddl
2260 2260 0.0 20366 20366 0.0
prob15.pddl
2555 2555 0.0 24529 24529 0.0
prob16.pddl
2868 2868 0.0 29224 29224 0.0
prob17.pddl
3199 3199 0.0 34483 34483 0.0
prob18.pddl
3548 3548 0.0 40338 40338 0.0
prob19.pddl
3915 3915 0.0 46821 46821 0.0
prob20.pddl
4300 4300 0.0 53964 53964 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
hiking-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
1040 1040 0.0 2486 2486 0.0
ptesting-1-2-4.pddl
6951 6951 0.0 12314 12314 0.0
ptesting-1-2-5.pddl
26232 26232 0.0 40998 40998 0.0
ptesting-1-2-7.pddl
142427 142427 0.0 288799 288799 0.0
ptesting-1-2-8.pddl
278734 278734 0.0 613134 613134 0.0
ptesting-2-2-3.pddl
888 888 0.0 67599 67599 0.0
ptesting-2-2-4.pddl
72695 72695 0.0 692904 692904 0.0
ptesting-2-2-5.pddl
157475 157475 0.0 1656925 1656925 0.0
ptesting-2-2-6.pddl
296124 296124 0.0 2103177 2103177 0.0
ptesting-2-2-7.pddl
649134 649134 0.0 5651289 5651289 0.0
ptesting-2-2-8.pddl
840823 840823 0.0 6016416 6016416 0.0
ptesting-2-3-4.pddl
113315 113315 0.0 712760 712760 0.0
ptesting-2-3-5.pddl
240656 240656 0.0 2166150 2166150 0.0
ptesting-2-3-6.pddl
438516 438516 0.0 5822101 5822101 0.0
ptesting-2-3-7.pddl
896953 896953 0.0 6571331 6571331 0.0
ptesting-2-4-3.pddl
1111 1111 0.0 199764 199764 0.0
ptesting-2-4-4.pddl
123603 123603 0.0 1158294 1158294 0.0
ptesting-2-4-5.pddl
397401 397401 0.0 3140047 3140047 0.0
ptesting-2-4-6.pddl
509249 509249 0.0 7300078 7300078 0.0
ptesting-2-4-7.pddl
880241 880241 0.0 16521380 16521380 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics00
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
254 254 0.0 253 253 0.0
probLOGISTICS-4-1.pddl
288 288 0.0 180 180 0.0
probLOGISTICS-4-2.pddl
170 170 0.0 140 140 0.0
probLOGISTICS-5-0.pddl
475 475 0.0 313 313 0.0
probLOGISTICS-5-1.pddl
217 217 0.0 188 188 0.0
probLOGISTICS-5-2.pddl
83 83 0.0 63 63 0.0
probLOGISTICS-6-0.pddl
454 454 0.0 302 302 0.0
probLOGISTICS-6-1.pddl
217 217 0.0 176 176 0.0
probLOGISTICS-6-2.pddl
513 513 0.0 312 312 0.0
probLOGISTICS-6-9.pddl
493 493 0.0 292 292 0.0
probLOGISTICS-7-0.pddl
1228 1228 0.0 742 742 0.0
probLOGISTICS-7-1.pddl
2040 2040 0.0 978 978 0.0
probLOGISTICS-8-0.pddl
851 851 0.0 631 631 0.0
probLOGISTICS-8-1.pddl
1711 1711 0.0 1073 1073 0.0
probLOGISTICS-9-0.pddl
1337 1337 0.0 981 981 0.0
probLOGISTICS-9-1.pddl
830 830 0.0 677 677 0.0
probLOGISTICS-10-0.pddl
2958 2958 0.0 1521 1521 0.0
probLOGISTICS-10-1.pddl
2034 2034 0.0 1480 1480 0.0
probLOGISTICS-11-0.pddl
2796 2796 0.0 1949 1949 0.0
probLOGISTICS-11-1.pddl
5046 5046 0.0 2187 2187 0.0
probLOGISTICS-12-0.pddl
2553 2553 0.0 1554 1554 0.0
probLOGISTICS-12-1.pddl
5801 5801 0.0 3024 3024 0.0
probLOGISTICS-13-0.pddl
13399 13399 0.0 52331 52331 0.0
probLOGISTICS-13-1.pddl
11040 11040 0.0 47134 47134 0.0
probLOGISTICS-14-0.pddl
7880 7880 0.0 57067 57067 0.0
probLOGISTICS-14-1.pddl
11132 11132 0.0 78695 78695 0.0
probLOGISTICS-15-0.pddl
17810 17810 0.0 80222 80222 0.0
probLOGISTICS-15-1.pddl
10407 10407 0.0 113018 113018 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics98
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1937 1937 0.0 50500 50500 0.0
prob02.pddl
7602 7602 0.0 984201 984201 0.0
prob03.pddl
17696 17696 0.0 29142076 29142076 0.0
prob04.pddl
63486 63486 0.0 None None -
prob05.pddl
1355 1355 0.0 11904 11904 0.0
prob06.pddl
116589 116589 0.0 None None -
prob07.pddl
14562 14562 0.0 5172354 5172354 0.0
prob08.pddl
27736 27736 0.0 None None -
prob09.pddl
240830 240830 0.0 None None -
prob10.pddl
210182 210182 0.0 127440757 127440757 0.0
prob11.pddl
7616 7616 0.0 3561612 3561612 0.0
prob12.pddl
86165 86165 0.0 None None -
prob13.pddl
215765 215765 0.0 None None -
prob14.pddl
255892 255892 0.0 None None -
prob15.pddl
61782 61782 0.0 4365368 4365368 0.0
prob16.pddl
76747 76747 0.0 None None -
prob17.pddl
22889 22889 0.0 None None -
prob18.pddl
1958954 1958954 0.0 None None -
prob19.pddl
916841 916841 0.0 None None -
prob20.pddl
2178950 2178950 0.0 None None -
prob21.pddl
787092 787092 0.0 None None -
prob22.pddl
16720582 16720582 0.0 None None -
prob23.pddl
159335 159335 0.0 79970825 79970825 0.0
prob24.pddl
163213 163213 0.0 None None -
prob25.pddl
5072400 5072400 0.0 None None -
prob26.pddl
2320533 2320533 0.0 None None -
prob27.pddl
3014434 3014434 0.0 None None -
prob28.pddl
68459172 68459172 0.0 None None -
prob29.pddl
6334471 6334471 0.0 None None -
prob30.pddl
4181023 4181023 0.0 None None -
prob31.pddl
326 326 0.0 5771 5771 0.0
prob32.pddl
545 545 0.0 2045 2045 0.0
prob33.pddl
1295 1295 0.0 7694 7694 0.0
prob34.pddl
17254 17254 0.0 1409083 1409083 0.0
prob35.pddl
2624 2624 0.0 98497 98497 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
miconic
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
7 7 0.0 7 7 0.0
s1-1.pddl
6 6 0.0 6 6 0.0
s1-2.pddl
7 7 0.0 7 7 0.0
s1-3.pddl
7 7 0.0 7 7 0.0
s1-4.pddl
7 7 0.0 7 7 0.0
s2-0.pddl
36 36 0.0 43 43 0.0
s2-1.pddl
36 36 0.0 28 28 0.0
s2-2.pddl
36 36 0.0 28 28 0.0
s2-3.pddl
28 28 0.0 28 28 0.0
s2-4.pddl
46 46 0.0 34 34 0.0
s3-0.pddl
108 108 0.0 72 72 0.0
s3-1.pddl
122 122 0.0 87 87 0.0
s3-2.pddl
110 110 0.0 62 62 0.0
s3-3.pddl
100 100 0.0 62 62 0.0
s3-4.pddl
104 104 0.0 62 62 0.0
s4-0.pddl
169 169 0.0 174 174 0.0
s4-1.pddl
162 162 0.0 181 181 0.0
s4-2.pddl
280 280 0.0 179 179 0.0
s4-3.pddl
319 319 0.0 140 140 0.0
s4-4.pddl
324 324 0.0 181 181 0.0
s5-0.pddl
467 467 0.0 357 357 0.0
s5-1.pddl
470 470 0.0 229 229 0.0
s5-2.pddl
339 339 0.0 219 219 0.0
s5-3.pddl
281 281 0.0 315 315 0.0
s5-4.pddl
506 506 0.0 281 281 0.0
s6-0.pddl
713 713 0.0 420 420 0.0
s6-1.pddl
413 413 0.0 536 536 0.0
s6-2.pddl
774 774 0.0 486 486 0.0
s6-3.pddl
611 611 0.0 454 454 0.0
s6-4.pddl
746 746 0.0 564 564 0.0
s7-0.pddl
727 727 0.0 657 657 0.0
s7-1.pddl
1232 1232 0.0 818 818 0.0
s7-2.pddl
615 615 0.0 569 569 0.0
s7-3.pddl
934 934 0.0 755 755 0.0
s7-4.pddl
1127 1127 0.0 609 609 0.0
s8-0.pddl
1055 1055 0.0 824 824 0.0
s8-1.pddl
1475 1475 0.0 1241 1241 0.0
s8-2.pddl
1754 1754 0.0 808 808 0.0
s8-3.pddl
1700 1700 0.0 684 684 0.0
s8-4.pddl
1316 1316 0.0 714 714 0.0
s9-0.pddl
2249 2249 0.0 894 894 0.0
s9-1.pddl
2333 2333 0.0 789 789 0.0
s9-2.pddl
2209 2209 0.0 1087 1087 0.0
s9-3.pddl
1932 1932 0.0 1015 1015 0.0
s9-4.pddl
1593 1593 0.0 1053 1053 0.0
s10-0.pddl
2865 2865 0.0 1412 1412 0.0
s10-1.pddl
2490 2490 0.0 1051 1051 0.0
s10-2.pddl
2888 2888 0.0 1459 1459 0.0
s10-3.pddl
2078 2078 0.0 1546 1546 0.0
s10-4.pddl
2564 2564 0.0 1568 1568 0.0
s11-0.pddl
3823 3823 0.0 2171 2171 0.0
s11-1.pddl
2902 2902 0.0 2080 2080 0.0
s11-2.pddl
4440 4440 0.0 1624 1624 0.0
s11-3.pddl
3680 3680 0.0 2214 2214 0.0
s11-4.pddl
3508 3508 0.0 1994 1994 0.0
s12-0.pddl
2694 2694 0.0 1868 1868 0.0
s12-1.pddl
4809 4809 0.0 3179 3179 0.0
s12-2.pddl
4737 4737 0.0 2709 2709 0.0
s12-3.pddl
4328 4328 0.0 2524 2524 0.0
s12-4.pddl
5492 5492 0.0 2114 2114 0.0
s13-0.pddl
6685 6685 0.0 2589 2589 0.0
s13-1.pddl
5500 5500 0.0 3495 3495 0.0
s13-2.pddl
6552 6552 0.0 3727 3727 0.0
s13-3.pddl
4920 4920 0.0 3160 3160 0.0
s13-4.pddl
4856 4856 0.0 4240 4240 0.0
s14-0.pddl
5379 5379 0.0 3561 3561 0.0
s14-1.pddl
7364 7364 0.0 3743 3743 0.0
s14-2.pddl
7321 7321 0.0 3792 3792 0.0
s14-3.pddl
5915 5915 0.0 5145 5145 0.0
s14-4.pddl
6757 6757 0.0 4291 4291 0.0
s15-0.pddl
7163 7163 0.0 4677 4677 0.0
s15-1.pddl
11433 11433 0.0 3367 3367 0.0
s15-2.pddl
9809 9809 0.0 4013 4013 0.0
s15-3.pddl
8990 8990 0.0 4740 4740 0.0
s15-4.pddl
8879 8879 0.0 4580 4580 0.0
s16-0.pddl
10185 10185 0.0 5968 5968 0.0
s16-1.pddl
9837 9837 0.0 6177 6177 0.0
s16-2.pddl
12963 12963 0.0 6045 6045 0.0
s16-3.pddl
10874 10874 0.0 4833 4833 0.0
s16-4.pddl
10952 10952 0.0 5660 5660 0.0
s17-0.pddl
13565 13565 0.0 6309 6309 0.0
s17-1.pddl
10972 10972 0.0 6211 6211 0.0
s17-2.pddl
13314 13314 0.0 8527 8527 0.0
s17-3.pddl
14682 14682 0.0 5176 5176 0.0
s17-4.pddl
10941 10941 0.0 6938 6938 0.0
s18-0.pddl
14201 14201 0.0 8178 8178 0.0
s18-1.pddl
13188 13188 0.0 5877 5877 0.0
s18-2.pddl
14920 14920 0.0 7051 7051 0.0
s18-3.pddl
16719 16719 0.0 8145 8145 0.0
s18-4.pddl
14658 14658 0.0 5650 5650 0.0
s19-0.pddl
19129 19129 0.0 11953 11953 0.0
s19-1.pddl
17287 17287 0.0 10492 10492 0.0
s19-2.pddl
19003 19003 0.0 7538 7538 0.0
s19-3.pddl
20298 20298 0.0 6490 6490 0.0
s19-4.pddl
18420 18420 0.0 7333 7333 0.0
s20-0.pddl
19551 19551 0.0 9182 9182 0.0
s20-1.pddl
20967 20967 0.0 10981 10981 0.0
s20-2.pddl
19322 19322 0.0 8909 8909 0.0
s20-3.pddl
18491 18491 0.0 12030 12030 0.0
s20-4.pddl
18993 18993 0.0 11586 11586 0.0
s21-0.pddl
25647 25647 0.0 10405 10405 0.0
s21-1.pddl
24011 24011 0.0 15339 15339 0.0
s21-2.pddl
17508 17508 0.0 14819 14819 0.0
s21-3.pddl
20760 20760 0.0 11809 11809 0.0
s21-4.pddl
18064 18064 0.0 13552 13552 0.0
s22-0.pddl
30347 30347 0.0 10259 10259 0.0
s22-1.pddl
28533 28533 0.0 13443 13443 0.0
s22-2.pddl
27964 27964 0.0 14838 14838 0.0
s22-3.pddl
28175 28175 0.0 12249 12249 0.0
s22-4.pddl
25839 25839 0.0 14654 14654 0.0
s23-0.pddl
33825 33825 0.0 14987 14987 0.0
s23-1.pddl
29057 29057 0.0 12531 12531 0.0
s23-2.pddl
26778 26778 0.0 17825 17825 0.0
s23-3.pddl
27045 27045 0.0 15357 15357 0.0
s23-4.pddl
28489 28489 0.0 12255 12255 0.0
s24-0.pddl
30514 30514 0.0 16734 16734 0.0
s24-1.pddl
33481 33481 0.0 18720 18720 0.0
s24-2.pddl
35537 35537 0.0 15859 15859 0.0
s24-3.pddl
34037 34037 0.0 16413 16413 0.0
s24-4.pddl
35039 35039 0.0 20932 20932 0.0
s25-0.pddl
37246 37246 0.0 22453 22453 0.0
s25-1.pddl
44640 44640 0.0 18884 18884 0.0
s25-2.pddl
33578 33578 0.0 23599 23599 0.0
s25-3.pddl
42777 42777 0.0 19890 19890 0.0
s25-4.pddl
43474 43474 0.0 16885 16885 0.0
s26-0.pddl
46981 46981 0.0 22378 22378 0.0
s26-1.pddl
41712 41712 0.0 21555 21555 0.0
s26-2.pddl
52467 52467 0.0 25861 25861 0.0
s26-3.pddl
46946 46946 0.0 22394 22394 0.0
s26-4.pddl
38208 38208 0.0 28255 28255 0.0
s27-0.pddl
55390 55390 0.0 24907 24907 0.0
s27-1.pddl
46392 46392 0.0 23751 23751 0.0
s27-2.pddl
55455 55455 0.0 17643 17643 0.0
s27-3.pddl
48601 48601 0.0 28180 28180 0.0
s27-4.pddl
50704 50704 0.0 23746 23746 0.0
s28-0.pddl
62587 62587 0.0 28204 28204 0.0
s28-1.pddl
55172 55172 0.0 32175 32175 0.0
s28-2.pddl
61082 61082 0.0 25369 25369 0.0
s28-3.pddl
44792 44792 0.0 25354 25354 0.0
s28-4.pddl
54888 54888 0.0 25329 25329 0.0
s29-0.pddl
57197 57197 0.0 34048 34048 0.0
s29-1.pddl
53424 53424 0.0 28396 28396 0.0
s29-2.pddl
62315 62315 0.0 31811 31811 0.0
s29-3.pddl
70541 70541 0.0 25401 25401 0.0
s29-4.pddl
73466 73466 0.0 23804 23804 0.0
s30-0.pddl
58600 58600 0.0 34278 34278 0.0
s30-1.pddl
65454 65454 0.0 31425 31425 0.0
s30-2.pddl
62530 62530 0.0 29701 29701 0.0
s30-3.pddl
75638 75638 0.0 30611 30611 0.0
s30-4.pddl
69135 69135 0.0 26181 26181 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
movie
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
216 216 0.0 216 216 0.0
prob02.pddl
256 256 0.0 256 256 0.0
prob03.pddl
296 296 0.0 296 296 0.0
prob04.pddl
336 336 0.0 336 336 0.0
prob05.pddl
376 376 0.0 376 376 0.0
prob06.pddl
416 416 0.0 416 416 0.0
prob07.pddl
456 456 0.0 456 456 0.0
prob08.pddl
496 496 0.0 496 496 0.0
prob09.pddl
536 536 0.0 536 536 0.0
prob10.pddl
576 576 0.0 576 576 0.0
prob11.pddl
616 616 0.0 616 616 0.0
prob12.pddl
656 656 0.0 656 656 0.0
prob13.pddl
696 696 0.0 696 696 0.0
prob14.pddl
736 736 0.0 736 736 0.0
prob15.pddl
776 776 0.0 776 776 0.0
prob16.pddl
816 816 0.0 816 816 0.0
prob17.pddl
856 856 0.0 856 856 0.0
prob18.pddl
896 896 0.0 896 896 0.0
prob19.pddl
936 936 0.0 936 936 0.0
prob20.pddl
976 976 0.0 976 976 0.0
prob21.pddl
1016 1016 0.0 1016 1016 0.0
prob22.pddl
1056 1056 0.0 1056 1056 0.0
prob23.pddl
1096 1096 0.0 1096 1096 0.0
prob24.pddl
1136 1136 0.0 1136 1136 0.0
prob25.pddl
1176 1176 0.0 1176 1176 0.0
prob26.pddl
1216 1216 0.0 1216 1216 0.0
prob27.pddl
1256 1256 0.0 1256 1256 0.0
prob28.pddl
1296 1296 0.0 1296 1296 0.0
prob29.pddl
1336 1336 0.0 1336 1336 0.0
prob30.pddl
1376 1376 0.0 1376 1376 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mprime
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
169 169 0.0 661 661 0.0
prob02.pddl
1814 1814 0.0 8461698 8461698 0.0
prob03.pddl
604 604 0.0 712135 712135 0.0
prob04.pddl
538 538 0.0 5666 5666 0.0
prob05.pddl
549 549 0.0 9884138 9884138 0.0
prob06.pddl
101619 101619 0.0 None None -
prob07.pddl
311 311 0.0 523661 523661 0.0
prob08.pddl
4103 4103 0.0 None None -
prob09.pddl
1240 1240 0.0 563512 563512 0.0
prob10.pddl
4897 4897 0.0 None None -
prob11.pddl
522 522 0.0 283 283 0.0
prob12.pddl
1059 1059 0.0 7543629 7543629 0.0
prob13.pddl
14850 14850 0.0 None None -
prob14.pddl
17138 17138 0.0 None None -
prob15.pddl
14885 14885 0.0 None None -
prob16.pddl
916 916 0.0 5251132 5251132 0.0
prob17.pddl
1517 1517 0.0 77968850 77968850 0.0
prob18.pddl
56871 56871 0.0 None None -
prob19.pddl
8454 8454 0.0 None None -
prob20.pddl
12601 12601 0.0 None None -
prob21.pddl
16202 16202 0.0 48596412 48596412 0.0
prob22.pddl
21795 21795 0.0 None None -
prob23.pddl
18369 18369 0.0 None None -
prob24.pddl
2653 2653 0.0 None None -
prob25.pddl
77 77 0.0 3016 3016 0.0
prob26.pddl
930 930 0.0 125725023 125725023 0.0
prob27.pddl
562 562 0.0 97130 97130 0.0
prob28.pddl
247 247 0.0 467 467 0.0
prob29.pddl
358 358 0.0 345776 345776 0.0
prob30.pddl
3326 3326 0.0 None None -
prob31.pddl
535 535 0.0 127869 127869 0.0
prob32.pddl
342 342 0.0 2549911 2549911 0.0
prob33.pddl
13651 13651 0.0 None None -
prob34.pddl
286 286 0.0 176149 176149 0.0
prob35.pddl
191 191 0.0 110018 110018 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mystery
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
22 22 0.0 21 21 0.0
prob02.pddl
8490 8490 0.0 526820 526820 0.0
prob03.pddl
81 81 0.0 5303 5303 0.0
prob04.pddl
25660951 25660951 0.0 82970715 82970715 0.0
prob05.pddl
None None - None None -
prob06.pddl
542775 542775 0.0 None None -
prob07.pddl
0 0 0.0 None None -
prob08.pddl
None None - None None -
prob09.pddl
21601112 21601112 0.0 28264 28264 0.0
prob10.pddl
629 629 0.0 None None -
prob11.pddl
56 56 0.0 35 35 0.0
prob12.pddl
3611716 3611716 0.0 10994147 10994147 0.0
prob13.pddl
2572 2572 0.0 None None -
prob14.pddl
2430 2430 0.0 None None -
prob15.pddl
2043 2043 0.0 23450729 23450729 0.0
prob16.pddl
None None - None None -
prob17.pddl
223 223 0.0 160765 160765 0.0
prob18.pddl
0 0 0.0 None None -
prob19.pddl
16202 16202 0.0 2909412 2909412 0.0
prob20.pddl
904 904 0.0 77034495 77034495 0.0
prob21.pddl
None None - None None -
prob22.pddl
None None - None None -
prob23.pddl
None None - None None -
prob24.pddl
None None - None None -
prob25.pddl
37 37 0.0 389 389 0.0
prob26.pddl
113 113 0.0 161127 161127 0.0
prob27.pddl
116 116 0.0 1970 1970 0.0
prob28.pddl
57 57 0.0 45 45 0.0
prob29.pddl
80 80 0.0 2223 2223 0.0
prob30.pddl
522 522 0.0 494284 494284 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
nomystery-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
132 132 0.0 2296 2296 0.0
p02.pddl
119 119 0.0 87 87 0.0
p03.pddl
176 176 0.0 132 132 0.0
p04.pddl
372 372 0.0 705961 705961 0.0
p05.pddl
597 597 0.0 57467012 57467012 0.0
p06.pddl
699 699 0.0 None None -
p07.pddl
678 678 0.0 None None -
p08.pddl
870 870 0.0 None None -
p09.pddl
950 950 0.0 748 748 0.0
p10.pddl
1435 1435 0.0 None None -
p11.pddl
369 369 0.0 690 690 0.0
p12.pddl
6382 6382 0.0 34196 34196 0.0
p13.pddl
523 523 0.0 101668 101668 0.0
p14.pddl
26626 26626 0.0 1199483 1199483 0.0
p15.pddl
1247 1247 0.0 1168286 1168286 0.0
p16.pddl
None None - None None -
p17.pddl
10311 10311 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
2558 2558 0.0 None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt08-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
48 48 0.0 51 51 0.0
p02.pddl
55 55 0.0 59 59 0.0
p03.pddl
92 92 0.0 78 78 0.0
p04.pddl
97 97 0.0 98 98 0.0
p05.pddl
123 123 0.0 137 137 0.0
p06.pddl
142 142 0.0 142 142 0.0
p07.pddl
159 159 0.0 172 172 0.0
p08.pddl
177 177 0.0 205 205 0.0
p09.pddl
233 233 0.0 239 239 0.0
p10.pddl
216 216 0.0 245 245 0.0
p11.pddl
270 270 0.0 293 293 0.0
p12.pddl
268 268 0.0 313 313 0.0
p13.pddl
306 306 0.0 336 336 0.0
p14.pddl
347 347 0.0 383 383 0.0
p15.pddl
413 413 0.0 434 434 0.0
p16.pddl
382 382 0.0 426 426 0.0
p17.pddl
417 417 0.0 489 489 0.0
p18.pddl
471 471 0.0 580 580 0.0
p19.pddl
465 465 0.0 608 608 0.0
p20.pddl
550 550 0.0 573 573 0.0
p21.pddl
609 609 0.0 683 683 0.0
p22.pddl
613 613 0.0 712 712 0.0
p23.pddl
734 734 0.0 779 779 0.0
p24.pddl
751 751 0.0 784 784 0.0
p25.pddl
789 789 0.0 898 898 0.0
p26.pddl
827 827 0.0 937 937 0.0
p27.pddl
816 816 0.0 986 986 0.0
p28.pddl
951 951 0.0 1008 1008 0.0
p29.pddl
931 931 0.0 1134 1134 0.0
p30.pddl
1067 1067 0.0 1167 1167 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
142 142 0.0 142 142 0.0
p02.pddl
159 159 0.0 172 172 0.0
p03.pddl
177 177 0.0 205 205 0.0
p04.pddl
233 233 0.0 239 239 0.0
p05.pddl
216 216 0.0 245 245 0.0
p06.pddl
270 270 0.0 293 293 0.0
p07.pddl
268 268 0.0 313 313 0.0
p08.pddl
306 306 0.0 336 336 0.0
p09.pddl
347 347 0.0 383 383 0.0
p10.pddl
613 613 0.0 712 712 0.0
p11.pddl
413 413 0.0 434 434 0.0
p12.pddl
382 382 0.0 426 426 0.0
p13.pddl
417 417 0.0 489 489 0.0
p14.pddl
471 471 0.0 580 580 0.0
p15.pddl
465 465 0.0 608 608 0.0
p16.pddl
609 609 0.0 683 683 0.0
p17.pddl
550 550 0.0 573 573 0.0
p18.pddl
734 734 0.0 779 779 0.0
p19.pddl
751 751 0.0 784 784 0.0
p20.pddl
789 789 0.0 898 898 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
452 452 0.0 425 425 0.0
p20_2.pddl
402 402 0.0 475 475 0.0
p20_3.pddl
408 408 0.0 459 459 0.0
p25_1.pddl
580 580 0.0 672 672 0.0
p25_3.pddl
590 590 0.0 731 731 0.0
p30_1.pddl
982 982 0.0 896 896 0.0
p30_2.pddl
883 883 0.0 960 960 0.0
p30_3.pddl
807 807 0.0 1073 1073 0.0
p35_1.pddl
1136 1136 0.0 1185 1185 0.0
p35_2.pddl
1241 1241 0.0 1313 1313 0.0
p35_3.pddl
1053 1053 0.0 1408 1408 0.0
p40_1.pddl
1607 1607 0.0 1511 1511 0.0
p40_2.pddl
1411 1411 0.0 1489 1489 0.0
p40_3.pddl
1349 1349 0.0 1736 1736 0.0
p45_1.pddl
1841 1841 0.0 1801 1801 0.0
p45_2.pddl
1732 1732 0.0 1984 1984 0.0
p45_3.pddl
1628 1628 0.0 2257 2257 0.0
p50_1.pddl
2414 2414 0.0 2272 2272 0.0
p50_2.pddl
2020 2020 0.0 2415 2415 0.0
p50_3.pddl
1882 1882 0.0 2705 2705 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
81 81 0.0 83 83 0.0
p02.pddl
81 81 0.0 83 83 0.0
p03.pddl
78 78 0.0 83 83 0.0
p04.pddl
78 78 0.0 84 84 0.0
p05.pddl
72 72 0.0 84 84 0.0
p06.pddl
242 242 0.0 267 267 0.0
p07.pddl
219 219 0.0 260 260 0.0
p08.pddl
687 687 0.0 857 857 0.0
p09.pddl
639 639 0.0 832 832 0.0
p10.pddl
735 735 0.0 977 977 0.0
p11.pddl
688 688 0.0 946 946 0.0
p12.pddl
692 692 0.0 908 908 0.0
p13.pddl
689 689 0.0 932 932 0.0
p14.pddl
698 698 0.0 910 910 0.0
p15.pddl
646 646 0.0 865 865 0.0
p16.pddl
659 659 0.0 875 875 0.0
p17.pddl
955 955 0.0 1242 1242 0.0
p18.pddl
2644 2644 0.0 3636 3636 0.0
p19.pddl
966 966 0.0 1401 1401 0.0
p20.pddl
1423 1423 0.0 1855 1855 0.0
p21.pddl
1450 1450 0.0 1891 1891 0.0
p22.pddl
1432 1432 0.0 1964 1964 0.0
p23.pddl
1376 1376 0.0 1915 1915 0.0
p24.pddl
3679 3679 0.0 4904 4904 0.0
p25.pddl
3558 3558 0.0 4783 4783 0.0
p26.pddl
3369 3369 0.0 4832 4832 0.0
p27.pddl
7097 7097 0.0 10455 10455 0.0
p28.pddl
13668 13668 0.0 18618 18618 0.0
p29.pddl
12972 12972 0.0 17922 17922 0.0
p30.pddl
12068 12068 0.0 18201 18201 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-opt18-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
16 16 0.0 16 16 0.0
p02.pddl
16 16 0.0 16 16 0.0
p03.pddl
100 100 0.0 100 100 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
6 6 0.0 6 6 0.0
p08.pddl
None None - None None -
p09.pddl
28 28 0.0 28 28 0.0
p10.pddl
28 28 0.0 28 28 0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
44 44 0.0 44 44 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-split-opt18-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
89 89 0.0 116 116 0.0
p02.pddl
95 95 0.0 770 770 0.0
p03.pddl
926 926 0.0 159396 159396 0.0
p04.pddl
840 840 0.0 251382 251382 0.0
p05.pddl
897 897 0.0 78050 78050 0.0
p06.pddl
1386 1386 0.0 4090564 4090564 0.0
p07.pddl
479 479 0.0 477 477 0.0
p08.pddl
6020 6020 0.0 11710934 11710934 0.0
p09.pddl
261 261 0.0 48851 48851 0.0
p10.pddl
301 301 0.0 77765 77765 0.0
p11.pddl
33559 33559 0.0 None None -
p12.pddl
22172 22172 0.0 None None -
p13.pddl
79458 79458 0.0 None None -
p14.pddl
882 882 0.0 3080 3080 0.0
p15.pddl
None None - None None -
p16.pddl
65601 65601 0.0 None None -
p17.pddl
160040 160040 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
15924 15924 0.0 None None -
p20.pddl
551758 551758 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-08-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
10 10 0.0 18 18 0.0
p02.pddl
32 32 0.0 44 44 0.0
p03.pddl
67 67 0.0 64 64 0.0
p04.pddl
115 115 0.0 228 228 0.0
p05.pddl
176 176 0.0 350 350 0.0
p06.pddl
250 250 0.0 324 324 0.0
p07.pddl
337 337 0.0 943 943 0.0
p08.pddl
437 437 0.0 1153 1153 0.0
p09.pddl
550 550 0.0 1494 1494 0.0
p10.pddl
676 676 0.0 959 959 0.0
p11.pddl
15 15 0.0 15 15 0.0
p12.pddl
49 49 0.0 302 302 0.0
p13.pddl
103 103 0.0 66835 66835 0.0
p14.pddl
175 175 0.0 3236409 3236409 0.0
p15.pddl
702 702 0.0 None None -
p16.pddl
395 395 0.0 None None -
p17.pddl
523 523 0.0 None None -
p18.pddl
701 701 0.0 None None -
p19.pddl
4057 4057 0.0 None None -
p20.pddl
1636 1636 0.0 None None -
p21.pddl
14 14 0.0 14 14 0.0
p22.pddl
43 43 0.0 45 45 0.0
p23.pddl
88 88 0.0 94 94 0.0
p24.pddl
149 149 0.0 159 159 0.0
p25.pddl
444 444 0.0 2533011 2533011 0.0
p26.pddl
319 319 0.0 365 365 0.0
p27.pddl
428 428 0.0 466 466 0.0
p28.pddl
553 553 0.0 667 667 0.0
p29.pddl
2234 2234 0.0 None None -
p30.pddl
1052 1052 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
43 43 0.0 45 45 0.0
p02.pddl
32 32 0.0 44 44 0.0
p03.pddl
49 49 0.0 302 302 0.0
p04.pddl
115 115 0.0 228 228 0.0
p05.pddl
88 88 0.0 94 94 0.0
p06.pddl
250 250 0.0 324 324 0.0
p07.pddl
176 176 0.0 350 350 0.0
p08.pddl
149 149 0.0 159 159 0.0
p09.pddl
103 103 0.0 66835 66835 0.0
p10.pddl
444 444 0.0 2533011 2533011 0.0
p11.pddl
319 319 0.0 365 365 0.0
p12.pddl
175 175 0.0 3236409 3236409 0.0
p13.pddl
337 337 0.0 943 943 0.0
p14.pddl
437 437 0.0 1153 1153 0.0
p15.pddl
550 550 0.0 1494 1494 0.0
p16.pddl
676 676 0.0 959 959 0.0
p17.pddl
702 702 0.0 None None -
p18.pddl
395 395 0.0 None None -
p19.pddl
523 523 0.0 None None -
p20.pddl
428 428 0.0 466 466 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parking-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
934 934 0.0 None None -
pfile03-012.pddl
4432 4432 0.0 None None -
pfile04-013.pddl
5714 5714 0.0 None None -
pfile04-014.pddl
8012 8012 0.0 None None -
pfile04-015.pddl
3518 3518 0.0 None None -
pfile04-016.pddl
5158 5158 0.0 None None -
pfile05-017.pddl
4350 4350 0.0 None None -
pfile05-018.pddl
3648 3648 0.0 None None -
pfile05-019.pddl
11882 11882 0.0 None None -
pfile05-020.pddl
8542 8542 0.0 None None -
pfile06-021.pddl
10495 10495 0.0 None None -
pfile06-022.pddl
10270 10270 0.0 None None -
pfile06-023.pddl
8245 8245 0.0 None None -
pfile06-024.pddl
26975 26975 0.0 None None -
pfile07-025.pddl
29346 29346 0.0 None None -
pfile07-026.pddl
10636 10636 0.0 None None -
pfile07-027.pddl
8018 8018 0.0 None None -
pfile07-028.pddl
28700 28700 0.0 None None -
pfile08-029.pddl
25720 25720 0.0 None None -
pfile08-030.pddl
18627 18627 0.0 None None -
Sum of diffs
0.00
None
Arithmetic mean of diffs
0.00
None
parking-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
2014 2014 0.0 None None -
p_12_7-02.pddl
2468 2468 0.0 1659622 1659622 0.0
p_12_7-03.pddl
4130 4130 0.0 None None -
p_12_7-04.pddl
3522 3522 0.0 None None -
p_14_8-01.pddl
3380 3380 0.0 None None -
p_14_8-02.pddl
4691 4691 0.0 None None -
p_14_8-03.pddl
10217 10217 0.0 None None -
p_14_8-04.pddl
5057 5057 0.0 None None -
p_16_9-01.pddl
7630 7630 0.0 None None -
p_16_9-02.pddl
5184 5184 0.0 None None -
p_16_9-03.pddl
3384 3384 0.0 None None -
p_16_9-04.pddl
3616 3616 0.0 None None -
p_18_10-01.pddl
14796 14796 0.0 None None -
p_18_10-02.pddl
8155 8155 0.0 None None -
p_18_10-03.pddl
3636 3636 0.0 None None -
p_18_10-04.pddl
3119 3119 0.0 None None -
p_20_11-01.pddl
22380 22380 0.0 None None -
p_20_11-02.pddl
13914 13914 0.0 None None -
p_20_11-03.pddl
19604 19604 0.0 None None -
p_20_11-04.pddl
39466 39466 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pathways-noneg
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
162 162 0.0 5999 5999 0.0
p02.pddl
115 115 0.0 131 131 0.0
p03.pddl
793 793 0.0 12884 12884 0.0
p04.pddl
621 621 0.0 61212 61212 0.0
p05.pddl
1286 1286 0.0 2006129 2006129 0.0
p06.pddl
8452 8452 0.0 40243313 40243313 0.0
p07.pddl
14131 14131 0.0 287350398 287350398 0.0
p08.pddl
19636 19636 0.0 None None -
p09.pddl
19086 19086 0.0 41850521 41850521 0.0
p10.pddl
None None - None None -
p11.pddl
30018 30018 0.0 156785621 156785621 0.0
p12.pddl
26975 26975 0.0 None None -
p13.pddl
35743 35743 0.0 None None -
p14.pddl
43037 43037 0.0 None None -
p15.pddl
27853 27853 0.0 None None -
p16.pddl
None None - None None -
p17.pddl
46891 46891 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
183358 183358 0.0 None None -
p24.pddl
175652 175652 0.0 None None -
p25.pddl
163298 163298 0.0 None None -
p26.pddl
153764 153764 0.0 None None -
p27.pddl
223437 223437 0.0 None None -
p28.pddl
140240 140240 0.0 None None -
p29.pddl
342120 342120 0.0 None None -
p30.pddl
348362 348362 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-08-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
13 13 0.0 11 11 0.0
p02.pddl
27 27 0.0 51 51 0.0
p03.pddl
58 58 0.0 78 78 0.0
p04.pddl
120 120 0.0 174 174 0.0
p05.pddl
105 105 0.0 87 87 0.0
p06.pddl
239 239 0.0 124 124 0.0
p07.pddl
69 69 0.0 26 26 0.0
p08.pddl
309 309 0.0 303 303 0.0
p09.pddl
142 142 0.0 518 518 0.0
p10.pddl
3480 3480 0.0 1395 1395 0.0
p11.pddl
1128 1128 0.0 2932 2932 0.0
p12.pddl
1212 1212 0.0 545 545 0.0
p13.pddl
361 361 0.0 25965 25965 0.0
p14.pddl
491 491 0.0 21162 21162 0.0
p15.pddl
412 412 0.0 2910 2910 0.0
p16.pddl
608 608 0.0 10380 10380 0.0
p17.pddl
25272 25272 0.0 57671 57671 0.0
p18.pddl
4401 4401 0.0 439 439 0.0
p19.pddl
753 753 0.0 19346 19346 0.0
p20.pddl
1459 1459 0.0 785 785 0.0
p21.pddl
708 708 0.0 37034 37034 0.0
p22.pddl
1755 1755 0.0 11891 11891 0.0
p23.pddl
1287 1287 0.0 73000 73000 0.0
p24.pddl
2433 2433 0.0 29107 29107 0.0
p25.pddl
1695 1695 0.0 21721 21721 0.0
p26.pddl
1172 1172 0.0 69723 69723 0.0
p27.pddl
85519 85519 0.0 1754 1754 0.0
p28.pddl
228933 228933 0.0 1812037 1812037 0.0
p29.pddl
14953221 14953221 0.0 332251 332251 0.0
p30.pddl
243432 243432 0.0 33575669 33575669 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
163 163 0.0 40 40 0.0
p02.pddl
25272 25272 0.0 57671 57671 0.0
p03.pddl
4401 4401 0.0 439 439 0.0
p04.pddl
753 753 0.0 19346 19346 0.0
p05.pddl
807 807 0.0 91056 91056 0.0
p06.pddl
293 293 0.0 2215 2215 0.0
p07.pddl
1776 1776 0.0 698 698 0.0
p08.pddl
1459 1459 0.0 785 785 0.0
p09.pddl
5152 5152 0.0 14582 14582 0.0
p10.pddl
708 708 0.0 37034 37034 0.0
p11.pddl
1755 1755 0.0 11891 11891 0.0
p12.pddl
1513 1513 0.0 21045 21045 0.0
p13.pddl
1287 1287 0.0 73000 73000 0.0
p14.pddl
2433 2433 0.0 29107 29107 0.0
p15.pddl
1695 1695 0.0 21721 21721 0.0
p16.pddl
1172 1172 0.0 69723 69723 0.0
p17.pddl
85519 85519 0.0 1754 1754 0.0
p18.pddl
228933 228933 0.0 1812037 1812037 0.0
p19.pddl
14953221 14953221 0.0 332251 332251 0.0
p20.pddl
243432 243432 0.0 33575669 33575669 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
petri-net-alignment-opt18-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
695 695 0.0 1118 1118 0.0
p02.pddl
836 836 0.0 1467 1467 0.0
p03.pddl
941 941 0.0 1723 1723 0.0
p04.pddl
977 977 0.0 1785 1785 0.0
p05.pddl
811 811 0.0 1417 1417 0.0
p06.pddl
952 952 0.0 1761 1761 0.0
p07.pddl
931 931 0.0 1624 1624 0.0
p08.pddl
967 967 0.0 1770 1770 0.0
p09.pddl
926 926 0.0 1715 1715 0.0
p10.pddl
1145 1145 0.0 2217 2217 0.0
p11.pddl
1022 1022 0.0 1919 1919 0.0
p12.pddl
1275 1275 0.0 2537 2537 0.0
p13.pddl
1128 1128 0.0 2169 2169 0.0
p14.pddl
1146 1146 0.0 2220 2220 0.0
p15.pddl
1124 1124 0.0 2166 2166 0.0
p16.pddl
1221 1221 0.0 2385 2385 0.0
p17.pddl
1239 1239 0.0 2446 2446 0.0
p18.pddl
1206 1206 0.0 2366 2366 0.0
p19.pddl
1235 1235 0.0 2469 2469 0.0
p20.pddl
1276 1276 0.0 2543 2543 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-notankage
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
29 29 0.0 29 29 0.0
p02-net1-b6-g4.pddl
3037 3037 0.0 111 111 0.0
p03-net1-b8-g3.pddl
810 810 0.0 172 172 0.0
p04-net1-b8-g5.pddl
4554 4554 0.0 156 156 0.0
p05-net1-b10-g4.pddl
2613 2613 0.0 226 226 0.0
p06-net1-b10-g6.pddl
29459 29459 0.0 201 201 0.0
p07-net1-b12-g5.pddl
151 151 0.0 192 192 0.0
p08-net1-b12-g7.pddl
193 193 0.0 193 193 0.0
p09-net1-b14-g6.pddl
431 431 0.0 182 182 0.0
p10-net1-b14-g8.pddl
495 495 0.0 273 273 0.0
p11-net2-b10-g2.pddl
40233 40233 0.0 11060 11060 0.0
p12-net2-b10-g4.pddl
35807 35807 0.0 19229 19229 0.0
p13-net2-b12-g3.pddl
332 332 0.0 63173 63173 0.0
p14-net2-b12-g5.pddl
19211 19211 0.0 16721 16721 0.0
p15-net2-b14-g4.pddl
4412 4412 0.0 55696 55696 0.0
p16-net2-b14-g6.pddl
97409 97409 0.0 1022143 1022143 0.0
p17-net2-b16-g5.pddl
98229 98229 0.0 16032 16032 0.0
p18-net2-b16-g7.pddl
155447 155447 0.0 24520 24520 0.0
p19-net2-b18-g6.pddl
1265 1265 0.0 3189 3189 0.0
p20-net2-b18-g8.pddl
257332 257332 0.0 67068 67068 0.0
p21-net3-b12-g2.pddl
169 169 0.0 1733 1733 0.0
p22-net3-b12-g4.pddl
351657 351657 0.0 205225 205225 0.0
p23-net3-b14-g3.pddl
2455 2455 0.0 70254 70254 0.0
p24-net3-b14-g5.pddl
155581 155581 0.0 766956 766956 0.0
p25-net3-b16-g5.pddl
2875 2875 0.0 730001 730001 0.0
p26-net3-b16-g7.pddl
333792 333792 0.0 67610 67610 0.0
p27-net3-b18-g6.pddl
287264 287264 0.0 13173469 13173469 0.0
p28-net3-b18-g7.pddl
364055 364055 0.0 7887249 7887249 0.0
p29-net3-b20-g6.pddl
99411 99411 0.0 7695459 7695459 0.0
p30-net3-b20-g8.pddl
395454 395454 0.0 322623 322623 0.0
p31-net4-b14-g3.pddl
895 895 0.0 115974 115974 0.0
p32-net4-b14-g5.pddl
93305 93305 0.0 48766 48766 0.0
p33-net4-b16-g5.pddl
65167 65167 0.0 212952 212952 0.0
p34-net4-b16-g6.pddl
287957 287957 0.0 424808 424808 0.0
p35-net4-b18-g4.pddl
154902 154902 0.0 16199318 16199318 0.0
p36-net4-b18-g6.pddl
3925 3925 0.0 48776792 48776792 0.0
p37-net4-b20-g5.pddl
26698 26698 0.0 None None -
p38-net4-b20-g7.pddl
306065 306065 0.0 10109636 10109636 0.0
p39-net4-b22-g7.pddl
3933 3933 0.0 None None -
p40-net4-b22-g8.pddl
71376 71376 0.0 38442060 38442060 0.0
p41-net5-b22-g2.pddl
6914 6914 0.0 3022081 3022081 0.0
p42-net5-b22-g4.pddl
None None - None None -
p43-net5-b24-g3.pddl
None None - None None -
p44-net5-b24-g5.pddl
None None - None None -
p45-net5-b26-g4.pddl
None None - None None -
p46-net5-b26-g6.pddl
None None - None None -
p47-net5-b28-g5.pddl
None None - None None -
p48-net5-b28-g7.pddl
None None - None None -
p49-net5-b30-g6.pddl
9589 9589 0.0 None None -
p50-net5-b30-g8.pddl
746730 746730 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-tankage
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
40 40 0.0 29 29 0.0
p02-net1-b6-g4-t50.pddl
3773 3773 0.0 337 337 0.0
p03-net1-b8-g3-t80.pddl
494 494 0.0 866 866 0.0
p04-net1-b8-g5-t80.pddl
3926 3926 0.0 925 925 0.0
p05-net1-b10-g4-t50.pddl
1626 1626 0.0 486 486 0.0
p06-net1-b10-g6-t50.pddl
1250 1250 0.0 444 444 0.0
p07-net1-b12-g5-t80.pddl
801 801 0.0 245 245 0.0
p08-net1-b12-g7-t80.pddl
1501 1501 0.0 518 518 0.0
p09-net1-b14-g6-t50.pddl
456621 456621 0.0 415557 415557 0.0
p10-net1-b14-g8-t50.pddl
2998 2998 0.0 18715 18715 0.0
p11-net2-b10-g2-t30.pddl
2521 2521 0.0 90517 90517 0.0
p12-net2-b10-g4-t60.pddl
1945 1945 0.0 263099 263099 0.0
p13-net2-b12-g3-t70.pddl
1038 1038 0.0 15554640 15554640 0.0
p14-net2-b12-g5-t30.pddl
4677 4677 0.0 401204 401204 0.0
p15-net2-b14-g4-t30.pddl
9001 9001 0.0 1274382 1274382 0.0
p16-net2-b14-g6-t80.pddl
24413 24413 0.0 None None -
p17-net2-b16-g5-t20.pddl
32845 32845 0.0 1817915 1817915 0.0
p18-net2-b16-g7-t60.pddl
77890 77890 0.0 7443915 7443915 0.0
p19-net2-b18-g6-t60.pddl
2579 2579 0.0 5839394 5839394 0.0
p20-net2-b18-g8-t90.pddl
53853 53853 0.0 None None -
p21-net3-b12-g2-t60.pddl
351 351 0.0 335000 335000 0.0
p22-net3-b12-g4-t60.pddl
29272014 29272014 0.0 8988471 8988471 0.0
p23-net3-b14-g3-t60.pddl
109535 109535 0.0 None None -
p24-net3-b14-g5-t60.pddl
30652 30652 0.0 None None -
p25-net3-b16-g5-t60.pddl
9974 9974 0.0 None None -
p26-net3-b16-g7-t70.pddl
905892 905892 0.0 None None -
p27-net3-b18-g6-t70.pddl
13015 13015 0.0 None None -
p28-net3-b18-g7-t70.pddl
33724867 33724867 0.0 None None -
p29-net3-b20-g6-t70.pddl
54245 54245 0.0 None None -
p30-net3-b20-g8-t70.pddl
246405 246405 0.0 None None -
p31-net4-b14-g3-t20.pddl
914282 914282 0.0 272005 272005 0.0
p32-net4-b14-g5-t30.pddl
97094 97094 0.0 20102233 20102233 0.0
p33-net4-b16-g5-t60.pddl
19444 19444 0.0 None None -
p34-net4-b16-g6-t60.pddl
25724 25724 0.0 None None -
p35-net4-b18-g4-t90.pddl
26832 26832 0.0 None None -
p36-net4-b18-g6-t90.pddl
1153743 1153743 0.0 None None -
p37-net4-b20-g5-t60.pddl
13033 13033 0.0 None None -
p38-net4-b20-g7-t60.pddl
99801 99801 0.0 None None -
p39-net4-b22-g7-t50.pddl
31739 31739 0.0 None None -
p40-net4-b22-g8-t50.pddl
21706 21706 0.0 None None -
p41-net5-b22-g2-t20.pddl
1676 1676 0.0 None None -
p42-net5-b22-g4-t50.pddl
None None - None None -
p43-net5-b24-g3-t80.pddl
None None - None None -
p44-net5-b24-g5-t80.pddl
None None - None None -
p45-net5-b26-g4-t50.pddl
None None - None None -
p46-net5-b26-g6-t50.pddl
None None - None None -
p47-net5-b28-g5-t50.pddl
None None - None None -
p48-net5-b28-g7-t50.pddl
None None - None None -
p49-net5-b30-g6-t50.pddl
108137 108137 0.0 None None -
p50-net5-b30-g8-t50.pddl
1271077 1271077 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
psr-small
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
13 13 0.0 12 12 0.0
p02-s5-n1-l3-f30.pddl
78 78 0.0 46 46 0.0
p03-s7-n1-l3-f70.pddl
56 56 0.0 42 42 0.0
p04-s8-n1-l4-f10.pddl
72 72 0.0 34 34 0.0
p05-s9-n1-l4-f30.pddl
102 102 0.0 50 50 0.0
p06-s10-n1-l4-f50.pddl
13 13 0.0 12 12 0.0
p07-s11-n1-l4-f70.pddl
97 97 0.0 50 50 0.0
p08-s12-n1-l5-f10.pddl
32 32 0.0 20 20 0.0
p09-s13-n1-l5-f30.pddl
24 24 0.0 16 16 0.0
p10-s17-n2-l2-f30.pddl
430 430 0.0 60 60 0.0
p11-s18-n2-l2-f50.pddl
233 233 0.0 140 140 0.0
p12-s21-n2-l3-f30.pddl
102 102 0.0 64 64 0.0
p13-s22-n2-l3-f50.pddl
94 94 0.0 85 85 0.0
p14-s23-n2-l3-f70.pddl
22 22 0.0 19 19 0.0
p15-s24-n2-l4-f10.pddl
379 379 0.0 90604 90604 0.0
p16-s29-n2-l5-f30.pddl
2444 2444 0.0 11981 11981 0.0
p17-s30-n2-l5-f50.pddl
20 20 0.0 17 17 0.0
p18-s31-n2-l5-f70.pddl
114 114 0.0 58 58 0.0
p19-s33-n3-l2-f30.pddl
4333 4333 0.0 22678 22678 0.0
p20-s34-n3-l2-f50.pddl
75 75 0.0 69 69 0.0
p21-s35-n3-l2-f70.pddl
38 38 0.0 26 26 0.0
p22-s37-n3-l3-f30.pddl
7329 7329 0.0 1429 1429 0.0
p23-s38-n3-l3-f50.pddl
95 95 0.0 45 45 0.0
p24-s39-n3-l3-f70.pddl
38 38 0.0 26 26 0.0
p25-s40-n3-l4-f10.pddl
175 175 0.0 343291 343291 0.0
p26-s41-n3-l4-f30.pddl
79 79 0.0 75 75 0.0
p27-s42-n3-l4-f50.pddl
309 309 0.0 178 178 0.0
p28-s43-n3-l4-f70.pddl
144 144 0.0 74 74 0.0
p29-s45-n3-l5-f30.pddl
3300 3300 0.0 501 501 0.0
p30-s46-n3-l5-f50.pddl
539 539 0.0 271 271 0.0
p31-s49-n4-l2-f30.pddl
621 621 0.0 227430 227430 0.0
p32-s50-n4-l2-f50.pddl
497 497 0.0 381 381 0.0
p33-s51-n4-l2-f70.pddl
881 881 0.0 8591 8591 0.0
p34-s55-n4-l3-f70.pddl
256 256 0.0 180 180 0.0
p35-s57-n5-l2-f30.pddl
2361 2361 0.0 757734 757734 0.0
p36-s65-n6-l2-f30.pddl
2892 2892 0.0 3598794 3598794 0.0
p37-s67-n6-l2-f70.pddl
505 505 0.0 238 238 0.0
p38-s78-n3-l3-f50.pddl
165 165 0.0 72 72 0.0
p39-s79-n3-l3-f70.pddl
576 576 0.0 340 340 0.0
p40-s80-n3-l4-f10.pddl
1939 1939 0.0 23966391 23966391 0.0
p41-s81-n3-l4-f30.pddl
40 40 0.0 28 28 0.0
p42-s82-n3-l4-f50.pddl
4383 4383 0.0 7814 7814 0.0
p43-s83-n3-l4-f70.pddl
568 568 0.0 298 298 0.0
p44-s89-n4-l2-f30.pddl
1114 1114 0.0 306 306 0.0
p45-s94-n4-l3-f50.pddl
235 235 0.0 130 130 0.0
p46-s97-n5-l2-f30.pddl
1489 1489 0.0 203057 203057 0.0
p47-s98-n5-l2-f50.pddl
370 370 0.0 314 314 0.0
p48-s101-n5-l3-f30.pddl
2295 2295 0.0 1965 1965 0.0
p49-s105-n6-l2-f30.pddl
5513 5513 0.0 7245 7245 0.0
p50-s107-n6-l2-f70.pddl
771 771 0.0 233 233 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
rovers
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
94 94 0.0 152 152 0.0
p02.pddl
68 68 0.0 84 84 0.0
p03.pddl
132 132 0.0 406 406 0.0
p04.pddl
67 67 0.0 99 99 0.0
p05.pddl
739 739 0.0 1809 1809 0.0
p06.pddl
2494 2494 0.0 1951 1951 0.0
p07.pddl
629 629 0.0 25671 25671 0.0
p08.pddl
1119 1119 0.0 31993 31993 0.0
p09.pddl
1428 1428 0.0 492181 492181 0.0
p10.pddl
3124 3124 0.0 1038230 1038230 0.0
p11.pddl
2115 2115 0.0 154696 154696 0.0
p12.pddl
664 664 0.0 48630 48630 0.0
p13.pddl
4964 4964 0.0 223481 223481 0.0
p14.pddl
2793 2793 0.0 570499 570499 0.0
p15.pddl
13103 13103 0.0 882267 882267 0.0
p16.pddl
5594 5594 0.0 598787 598787 0.0
p17.pddl
4763 4763 0.0 18167609 18167609 0.0
p18.pddl
6691 6691 0.0 164404591 164404591 0.0
p19.pddl
21802 21802 0.0 None None -
p20.pddl
37608 37608 0.0 None None -
p21.pddl
22575 22575 0.0 None None -
p22.pddl
40140 40140 0.0 140095321 140095321 0.0
p23.pddl
45345 45345 0.0 None None -
p24.pddl
88037 88037 0.0 None None -
p25.pddl
7333 7333 0.0 2756548 2756548 0.0
p26.pddl
26739 26739 0.0 None None -
p27.pddl
51365 51365 0.0 None None -
p28.pddl
69766 69766 0.0 None None -
p29.pddl
32339 32339 0.0 None None -
p30.pddl
77854 77854 0.0 None None -
p31.pddl
148367 148367 0.0 None None -
p32.pddl
300353 300353 0.0 None None -
p33.pddl
550045 550045 0.0 None None -
p34.pddl
260385 260385 0.0 None None -
p35.pddl
1002319 1002319 0.0 None None -
p36.pddl
499660 499660 0.0 None None -
p37.pddl
1720842 1720842 0.0 None None -
p38.pddl
1161469 1161469 0.0 None None -
p39.pddl
1047530 1047530 0.0 None None -
p40.pddl
1846348 1846348 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
satellite
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
84 84 0.0 107 107 0.0
p02-pfile2.pddl
156 156 0.0 169 169 0.0
p03-pfile3.pddl
208 208 0.0 1391 1391 0.0
p04-pfile4.pddl
559 559 0.0 6179 6179 0.0
p05-pfile5.pddl
1360 1360 0.0 86675 86675 0.0
p06-pfile6.pddl
1219 1219 0.0 262866 262866 0.0
p07-pfile7.pddl
1105 1105 0.0 379551 379551 0.0
p08-pfile8.pddl
3711 3711 0.0 13163624 13163624 0.0
p09-pfile9.pddl
5951 5951 0.0 4809605 4809605 0.0
p10-pfile10.pddl
7819 7819 0.0 33248814 33248814 0.0
p11-pfile11.pddl
4957 4957 0.0 5973236 5973236 0.0
p12-pfile12.pddl
7321 7321 0.0 168716210 168716210 0.0
p13-pfile13.pddl
72841 72841 0.0 None None -
p14-pfile14.pddl
17495 17495 0.0 48661875 48661875 0.0
p15-pfile15.pddl
57412 57412 0.0 None None -
p16-pfile16.pddl
19406 19406 0.0 None None -
p17-pfile17.pddl
91906 91906 0.0 None None -
p18-pfile18.pddl
15620 15620 0.0 None None -
p19-pfile19.pddl
37032 37032 0.0 None None -
p20-pfile20.pddl
170528 170528 0.0 None None -
p21-HC-pfile1.pddl
46778 46778 0.0 10035780 10035780 0.0
p22-HC-pfile2.pddl
73388 73388 0.0 None None -
p23-HC-pfile3.pddl
304421 304421 0.0 9068604 9068604 0.0
p24-HC-pfile4.pddl
783017 783017 0.0 None None -
p25-HC-pfile5.pddl
1166182 1166182 0.0 None None -
p26-HC-pfile6.pddl
586173 586173 0.0 None None -
p27-HC-pfile7.pddl
524972 524972 0.0 None None -
p28-HC-pfile8.pddl
4994893 4994893 0.0 None None -
p29-HC-pfile9.pddl
2224812 2224812 0.0 None None -
p30-HC-pfile10.pddl
10678279 10678279 0.0 None None -
p31-HC-pfile11.pddl
7086120 7086120 0.0 None None -
p32-HC-pfile12.pddl
29822108 29822108 0.0 None None -
p33-HC-pfile13.pddl
68560667 68560667 0.0 None None -
p34-HC-pfile14.pddl
298649 298649 0.0 None None -
p35-HC-pfile15.pddl
9868333 9868333 0.0 None None -
p36-HC-pfile16.pddl
2040830 2040830 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-08-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
270 270 0.0 234 234 0.0
p02.pddl
588 588 0.0 372 372 0.0
p03.pddl
780 780 0.0 360 360 0.0
p04.pddl
896 896 0.0 640 640 0.0
p05.pddl
2040 2040 0.0 1320 1320 0.0
p06.pddl
3060 3060 0.0 1275 1275 0.0
p07.pddl
2250 2250 0.0 1400 1400 0.0
p08.pddl
5340 5340 0.0 3690 3690 0.0
p09.pddl
8294 8294 0.0 3562 3562 0.0
p10.pddl
4752 4752 0.0 2664 2664 0.0
p11.pddl
11718 11718 0.0 8736 8736 0.0
p12.pddl
18870 18870 0.0 8436 8436 0.0
p13.pddl
8918 8918 0.0 4606 4606 0.0
p14.pddl
22792 22792 0.0 18312 18312 0.0
p15.pddl
37950 37950 0.0 17700 17700 0.0
p16.pddl
15360 15360 0.0 7424 7424 0.0
p17.pddl
40608 40608 0.0 34992 34992 0.0
p18.pddl
69745 69745 0.0 33865 33865 0.0
p19.pddl
24786 24786 0.0 11340 11340 0.0
p20.pddl
67680 67680 0.0 62190 62190 0.0
p21.pddl
119638 119638 0.0 60270 60270 0.0
p22.pddl
10 10 0.0 12 12 0.0
p23.pddl
10 10 0.0 12 12 0.0
p24.pddl
10 10 0.0 12 12 0.0
p25.pddl
112 112 0.0 152 152 0.0
p26.pddl
840 840 0.0 336 336 0.0
p27.pddl
745 745 0.0 11805 11805 0.0
p28.pddl
504 504 0.0 774 774 0.0
p29.pddl
17052 17052 0.0 1824 1824 0.0
p30.pddl
3230 3230 0.0 5960 5960 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
10 10 0.0 12 12 0.0
p02.pddl
588 588 0.0 372 372 0.0
p03.pddl
780 780 0.0 360 360 0.0
p04.pddl
896 896 0.0 640 640 0.0
p05.pddl
2250 2250 0.0 1400 1400 0.0
p06.pddl
2040 2040 0.0 1320 1320 0.0
p07.pddl
24786 24786 0.0 11340 11340 0.0
p08.pddl
4752 4752 0.0 2664 2664 0.0
p09.pddl
8918 8918 0.0 4606 4606 0.0
p10.pddl
15360 15360 0.0 7424 7424 0.0
p11.pddl
112 112 0.0 152 152 0.0
p12.pddl
3060 3060 0.0 1275 1275 0.0
p13.pddl
745 745 0.0 11805 11805 0.0
p14.pddl
840 840 0.0 336 336 0.0
p15.pddl
5340 5340 0.0 3690 3690 0.0
p16.pddl
11718 11718 0.0 8736 8736 0.0
p17.pddl
22792 22792 0.0 18312 18312 0.0
p18.pddl
40608 40608 0.0 34992 34992 0.0
p19.pddl
67680 67680 0.0 62190 62190 0.0
p20.pddl
504 504 0.0 774 774 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
snake-opt18-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1826 1826 0.0 18944 18944 0.0
p02.pddl
9058 9058 0.0 312516 312516 0.0
p03.pddl
95536 95536 0.0 1118866 1118866 0.0
p04.pddl
41 41 0.0 44 44 0.0
p05.pddl
116 116 0.0 473 473 0.0
p06.pddl
3694 3694 0.0 444489 444489 0.0
p07.pddl
2992812 2992812 0.0 19036807 19036807 0.0
p08.pddl
None None - 69279162 69279162 0.0
p09.pddl
153 153 0.0 2525 2525 0.0
p10.pddl
970 970 0.0 23071 23071 0.0
p11.pddl
3850 3850 0.0 1072455 1072455 0.0
p12.pddl
738180 738180 0.0 20693119 20693119 0.0
p13.pddl
102366 102366 0.0 None None -
p14.pddl
None None - None None -
p15.pddl
617 617 0.0 61956 61956 0.0
p16.pddl
104584 104584 0.0 17342530 17342530 0.0
p17.pddl
1536050 1536050 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
10137 10137 0.0 232148 232148 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt08-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
386 386 0.0 5188 5188 0.0
p02.pddl
535 535 0.0 910 910 0.0
p03.pddl
203 203 0.0 810 810 0.0
p04.pddl
2031 2031 0.0 18995 18995 0.0
p05.pddl
577 577 0.0 None None -
p06.pddl
740 740 0.0 37528 37528 0.0
p07.pddl
3102 3102 0.0 160215 160215 0.0
p08.pddl
93648 93648 0.0 11441695 11441695 0.0
p09.pddl
11584 11584 0.0 2530442 2530442 0.0
p10.pddl
29641 29641 0.0 1328990 1328990 0.0
p11.pddl
173405 173405 0.0 585299 585299 0.0
p12.pddl
34293 34293 0.0 15170257 15170257 0.0
p13.pddl
1794778 1794778 0.0 16280867 16280867 0.0
p14.pddl
4763 4763 0.0 138748 138748 0.0
p15.pddl
224365 224365 0.0 6236162 6236162 0.0
p16.pddl
74732 74732 0.0 424931 424931 0.0
p17.pddl
14178 14178 0.0 259198 259198 0.0
p18.pddl
126381 126381 0.0 14725789 14725789 0.0
p19.pddl
266966 266966 0.0 35090776 35090776 0.0
p20.pddl
3341 3341 0.0 5518 5518 0.0
p21.pddl
4516 4516 0.0 6933 6933 0.0
p22.pddl
156276 156276 0.0 20414860 20414860 0.0
p23.pddl
11724 11724 0.0 2025139 2025139 0.0
p24.pddl
431708 431708 0.0 None None -
p25.pddl
18067958 18067958 0.0 None None -
p26.pddl
134522 134522 0.0 None None -
p27.pddl
33582 33582 0.0 78873 78873 0.0
p28.pddl
6405012 6405012 0.0 35486348 35486348 0.0
p29.pddl
329 329 0.0 None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
740 740 0.0 37528 37528 0.0
p02.pddl
14178 14178 0.0 259198 259198 0.0
p03.pddl
4763 4763 0.0 138748 138748 0.0
p04.pddl
2031 2031 0.0 18995 18995 0.0
p05.pddl
74732 74732 0.0 424931 424931 0.0
p06.pddl
173405 173405 0.0 585299 585299 0.0
p07.pddl
29641 29641 0.0 1328990 1328990 0.0
p08.pddl
11584 11584 0.0 2530442 2530442 0.0
p09.pddl
3102 3102 0.0 160215 160215 0.0
p10.pddl
577 577 0.0 None None -
p11.pddl
1794778 1794778 0.0 16280867 16280867 0.0
p12.pddl
3341 3341 0.0 5518 5518 0.0
p13.pddl
93648 93648 0.0 11441695 11441695 0.0
p14.pddl
34293 34293 0.0 15170257 15170257 0.0
p15.pddl
126381 126381 0.0 14725789 14725789 0.0
p16.pddl
224365 224365 0.0 6236162 6236162 0.0
p17.pddl
266966 266966 0.0 35090776 35090776 0.0
p18.pddl
4516 4516 0.0 6933 6933 0.0
p19.pddl
156276 156276 0.0 20414860 20414860 0.0
p20.pddl
11724 11724 0.0 2025139 2025139 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
spider-opt18-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
147 147 0.0 164 164 0.0
p02.pddl
2487 2487 0.0 4772 4772 0.0
p03.pddl
579 579 0.0 2799 2799 0.0
p04.pddl
533 533 0.0 9693 9693 0.0
p05.pddl
4522 4522 0.0 31788 31788 0.0
p06.pddl
15882 15882 0.0 4011608 4011608 0.0
p07.pddl
274 274 0.0 407 407 0.0
p08.pddl
234 234 0.0 346 346 0.0
p09.pddl
14418 14418 0.0 32069 32069 0.0
p10.pddl
67637 67637 0.0 640513 640513 0.0
p11.pddl
1956 1956 0.0 37059 37059 0.0
p12.pddl
5233 5233 0.0 1648875 1648875 0.0
p13.pddl
37894 37894 0.0 94369 94369 0.0
p14.pddl
112 112 0.0 154 154 0.0
p15.pddl
149 149 0.0 173 173 0.0
p16.pddl
287 287 0.0 1050 1050 0.0
p17.pddl
546 546 0.0 581 581 0.0
p18.pddl
1234 1234 0.0 994168 994168 0.0
p19.pddl
1322 1322 0.0 14475 14475 0.0
p20.pddl
1725 1725 0.0 13990 13990 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
storage
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
7 7 0.0 7 7 0.0
p02.pddl
9 9 0.0 9 9 0.0
p03.pddl
11 11 0.0 11 11 0.0
p04.pddl
78 78 0.0 62 62 0.0
p05.pddl
105 105 0.0 284 284 0.0
p06.pddl
134 134 0.0 500 500 0.0
p07.pddl
303 303 0.0 295 295 0.0
p08.pddl
1127 1127 0.0 4965 4965 0.0
p09.pddl
1284 1284 0.0 7188 7188 0.0
p10.pddl
872 872 0.0 2268 2268 0.0
p11.pddl
22121 22121 0.0 40240 40240 0.0
p12.pddl
22006 22006 0.0 298846 298846 0.0
p13.pddl
49715 49715 0.0 2880 2880 0.0
p14.pddl
148315 148315 0.0 21881 21881 0.0
p15.pddl
58886 58886 0.0 163213 163213 0.0
p16.pddl
81498 81498 0.0 2106479 2106479 0.0
p17.pddl
115240 115240 0.0 34974550 34974550 0.0
p18.pddl
9532266 9532266 0.0 None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
2954649 2954649 0.0 None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
termes-opt18-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
3387 3387 0.0 44490 44490 0.0
p02.pddl
37442 37442 0.0 56097 56097 0.0
p03.pddl
46591 46591 0.0 411130 411130 0.0
p04.pddl
34221 34221 0.0 359089 359089 0.0
p05.pddl
2120565 2120565 0.0 4568539 4568539 0.0
p06.pddl
659450 659450 0.0 9408232 9408232 0.0
p07.pddl
6555771 6555771 0.0 89323490 89323490 0.0
p08.pddl
7777383 7777383 0.0 19402202 19402202 0.0
p09.pddl
None None - None None -
p10.pddl
30276050 30276050 0.0 None None -
p11.pddl
5209 5209 0.0 217767 217767 0.0
p12.pddl
11067 11067 0.0 13512 13512 0.0
p13.pddl
22718 22718 0.0 300978 300978 0.0
p14.pddl
16971 16971 0.0 110007 110007 0.0
p15.pddl
348074 348074 0.0 683044 683044 0.0
p16.pddl
176954 176954 0.0 1131020 1131020 0.0
p17.pddl
91033 91033 0.0 192649 192649 0.0
p18.pddl
5140 5140 0.0 17027 17027 0.0
p19.pddl
69746 69746 0.0 50197 50197 0.0
p20.pddl
103348 103348 0.0 300567 300567 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tetris-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
89403 89403 0.0 757 757 0.0
p01-8.pddl
49875 49875 0.0 1434 1434 0.0
p01-10.pddl
18943062 18943062 0.0 357088 357088 0.0
p02-4.pddl
1978 1978 0.0 50 50 0.0
p02-6.pddl
39732 39732 0.0 551 551 0.0
p02-8.pddl
43181 43181 0.0 11446 11446 0.0
p02-10.pddl
1882460 1882460 0.0 53930 53930 0.0
p03-4.pddl
20328 20328 0.0 203 203 0.0
p03-6.pddl
71344 71344 0.0 2596 2596 0.0
p03-8.pddl
41169 41169 0.0 2156 2156 0.0
p03-10.pddl
86376 86376 0.0 8911 8911 0.0
p04-6.pddl
88831 88831 0.0 2894 2894 0.0
p04-8.pddl
205792 205792 0.0 3851 3851 0.0
p04-10.pddl
129891 129891 0.0 5816 5816 0.0
p05-6.pddl
21894 21894 0.0 716 716 0.0
p05-8.pddl
4000184 4000184 0.0 3297 3297 0.0
p05-10.pddl
53615 53615 0.0 9402 9402 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
27 27 0.0 22 22 0.0
p02.pddl
2424 2424 0.0 476 476 0.0
p03.pddl
251 251 0.0 185 185 0.0
p04.pddl
758 758 0.0 1036 1036 0.0
p05.pddl
3233 3233 0.0 8852 8852 0.0
p06.pddl
605 605 0.0 1797 1797 0.0
p07.pddl
1673 1673 0.0 206 206 0.0
p08.pddl
6463724 6463724 0.0 13679 13679 0.0
p09.pddl
22723 22723 0.0 721 721 0.0
p10.pddl
333 333 0.0 8487 8487 0.0
p11.pddl
1466 1466 0.0 2344 2344 0.0
p12.pddl
712 712 0.0 7386 7386 0.0
p13.pddl
12854 12854 0.0 7033 7033 0.0
p14.pddl
714 714 0.0 1067 1067 0.0
p15.pddl
None None - 9157 9157 0.0
p16.pddl
572 572 0.0 2625 2625 0.0
p17.pddl
10210 10210 0.0 145541 145541 0.0
p18.pddl
24728 24728 0.0 26005 26005 0.0
p19.pddl
1369 1369 0.0 5553 5553 0.0
p20.pddl
2049 2049 0.0 64982 64982 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
2212 2212 0.0 3270010 3270010 0.0
p02.pddl
2491 2491 0.0 23347 23347 0.0
p03.pddl
648 648 0.0 2151 2151 0.0
p04.pddl
344 344 0.0 9147 9147 0.0
p05.pddl
6363 6363 0.0 215146 215146 0.0
p06.pddl
12233 12233 0.0 287642 287642 0.0
p07.pddl
1063 1063 0.0 2452 2452 0.0
p08.pddl
317 317 0.0 656 656 0.0
p09.pddl
607 607 0.0 10722 10722 0.0
p10.pddl
1675 1675 0.0 78495 78495 0.0
p11.pddl
1466 1466 0.0 2344 2344 0.0
p12.pddl
712 712 0.0 7386 7386 0.0
p13.pddl
12854 12854 0.0 7033 7033 0.0
p14.pddl
714 714 0.0 1067 1067 0.0
p15.pddl
None None - 9157 9157 0.0
p16.pddl
572 572 0.0 2625 2625 0.0
p17.pddl
10210 10210 0.0 145541 145541 0.0
p18.pddl
24728 24728 0.0 26005 26005 0.0
p19.pddl
1369 1369 0.0 5553 5553 0.0
p20.pddl
2049 2049 0.0 64982 64982 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tpp
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
9 9 0.0 8 8 0.0
p02.pddl
22 22 0.0 17 17 0.0
p03.pddl
40 40 0.0 29 29 0.0
p04.pddl
63 63 0.0 44 44 0.0
p05.pddl
112 112 0.0 701 701 0.0
p06.pddl
375 375 0.0 10206 10206 0.0
p07.pddl
763 763 0.0 19984 19984 0.0
p08.pddl
1211 1211 0.0 37672 37672 0.0
p09.pddl
2210 2210 0.0 56420 56420 0.0
p10.pddl
4246 4246 0.0 110118 110118 0.0
p11.pddl
4207 4207 0.0 208509 208509 0.0
p12.pddl
4184 4184 0.0 355970 355970 0.0
p13.pddl
3459 3459 0.0 207566 207566 0.0
p14.pddl
5500 5500 0.0 448391 448391 0.0
p15.pddl
8334 8334 0.0 334651 334651 0.0
p16.pddl
13076 13076 0.0 2065596 2065596 0.0
p17.pddl
17183 17183 0.0 25902678 25902678 0.0
p18.pddl
7824 7824 0.0 8151995 8151995 0.0
p19.pddl
28205 28205 0.0 17817859 17817859 0.0
p20.pddl
35234 35234 0.0 46934799 46934799 0.0
p21.pddl
22752 22752 0.0 4621694 4621694 0.0
p22.pddl
10701 10701 0.0 5050363 5050363 0.0
p23.pddl
23477 23477 0.0 12712677 12712677 0.0
p24.pddl
77850 77850 0.0 9061788 9061788 0.0
p25.pddl
34374 34374 0.0 36787371 36787371 0.0
p26.pddl
33446 33446 0.0 37523336 37523336 0.0
p27.pddl
44170 44170 0.0 32737338 32737338 0.0
p28.pddl
49449 49449 0.0 None None -
p29.pddl
119519 119519 0.0 None None -
p30.pddl
89488 89488 0.0 None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt08-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
43 43 0.0 123 123 0.0
p02.pddl
109 109 0.0 830 830 0.0
p03.pddl
334 334 0.0 2114 2114 0.0
p04.pddl
673 673 0.0 3076 3076 0.0
p05.pddl
1141 1141 0.0 11613 11613 0.0
p06.pddl
1965 1965 0.0 82470 82470 0.0
p07.pddl
3387 3387 0.0 396477 396477 0.0
p08.pddl
2391 2391 0.0 440239 440239 0.0
p09.pddl
5589 5589 0.0 918199 918199 0.0
p10.pddl
5960 5960 0.0 2214988 2214988 0.0
p11.pddl
70 70 0.0 349 349 0.0
p12.pddl
153 153 0.0 1741 1741 0.0
p13.pddl
393 393 0.0 12190 12190 0.0
p14.pddl
679 679 0.0 22725 22725 0.0
p15.pddl
5178 5178 0.0 35223 35223 0.0
p16.pddl
6676 6676 0.0 1629852 1629852 0.0
p17.pddl
10730 10730 0.0 4825718 4825718 0.0
p18.pddl
17847 17847 0.0 8791938 8791938 0.0
p19.pddl
20912 20912 0.0 20051074 20051074 0.0
p20.pddl
16368 16368 0.0 34644494 34644494 0.0
p21.pddl
113 113 0.0 164 164 0.0
p22.pddl
194 194 0.0 651 651 0.0
p23.pddl
351 351 0.0 2282 2282 0.0
p24.pddl
290 290 0.0 3463 3463 0.0
p25.pddl
1060 1060 0.0 14546 14546 0.0
p26.pddl
1831 1831 0.0 98923 98923 0.0
p27.pddl
1783 1783 0.0 67154 67154 0.0
p28.pddl
8525 8525 0.0 1285460 1285460 0.0
p29.pddl
4085 4085 0.0 961725 961725 0.0
p30.pddl
5994 5994 0.0 1182046 1182046 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
351 351 0.0 2282 2282 0.0
p02.pddl
334 334 0.0 2114 2114 0.0
p03.pddl
153 153 0.0 1741 1741 0.0
p04.pddl
393 393 0.0 12190 12190 0.0
p05.pddl
290 290 0.0 3463 3463 0.0
p06.pddl
673 673 0.0 3076 3076 0.0
p07.pddl
739 739 0.0 7771 7771 0.0
p08.pddl
1191 1191 0.0 62613 62613 0.0
p09.pddl
1792 1792 0.0 24198 24198 0.0
p10.pddl
2669 2669 0.0 82750 82750 0.0
p11.pddl
3649 3649 0.0 39974 39974 0.0
p12.pddl
3725 3725 0.0 247749 247749 0.0
p13.pddl
1753 1753 0.0 18090 18090 0.0
p14.pddl
2766 2766 0.0 99541 99541 0.0
p15.pddl
2411 2411 0.0 16156 16156 0.0
p16.pddl
6007 6007 0.0 168828 168828 0.0
p17.pddl
1141 1141 0.0 11613 11613 0.0
p18.pddl
679 679 0.0 22725 22725 0.0
p19.pddl
1060 1060 0.0 14546 14546 0.0
p20.pddl
1965 1965 0.0 82470 82470 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
296 296 0.0 919 919 0.0
p02.pddl
455 455 0.0 7412 7412 0.0
p03.pddl
383 383 0.0 7635 7635 0.0
p04.pddl
639 639 0.0 39610 39610 0.0
p05.pddl
1593 1593 0.0 387734 387734 0.0
p06.pddl
2081 2081 0.0 111305 111305 0.0
p07.pddl
523 523 0.0 12504 12504 0.0
p08.pddl
878 878 0.0 45564 45564 0.0
p09.pddl
1340 1340 0.0 101741 101741 0.0
p10.pddl
1913 1913 0.0 1895001 1895001 0.0
p11.pddl
4517 4517 0.0 4632935 4632935 0.0
p12.pddl
6210 6210 0.0 9574378 9574378 0.0
p13.pddl
388 388 0.0 10162 10162 0.0
p14.pddl
813 813 0.0 10254 10254 0.0
p15.pddl
840 840 0.0 43873 43873 0.0
p16.pddl
1302 1302 0.0 2341070 2341070 0.0
p17.pddl
4798 4798 0.0 4302833 4302833 0.0
p18.pddl
3393 3393 0.0 6154230 6154230 0.0
p19.pddl
5814 5814 0.0 1919263 1919263 0.0
p20.pddl
5814 5814 0.0 1919263 1919263 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
trucks-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
623 623 0.0 794 794 0.0
p02.pddl
940 940 0.0 65395 65395 0.0
p03.pddl
2020 2020 0.0 2192888 2192888 0.0
p04.pddl
66220 66220 0.0 4425 4425 0.0
p05.pddl
5197 5197 0.0 7927 7927 0.0
p06.pddl
7214 7214 0.0 10938 10938 0.0
p07.pddl
60671 60671 0.0 71374395 71374395 0.0
p08.pddl
15437 15437 0.0 None None -
p09.pddl
81778 81778 0.0 None None -
p10.pddl
1781499 1781499 0.0 None None -
p11.pddl
1214713 1214713 0.0 None None -
p12.pddl
17159087 17159087 0.0 None None -
p13.pddl
30747518 30747518 0.0 None None -
p14.pddl
1828271 1828271 0.0 None None -
p15.pddl
28343865 28343865 0.0 None None -
p16.pddl
165101682 165101682 0.0 None None -
p17.pddl
171807877 171807877 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
None None - None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
6 6 0.0 6 6 0.0
problem02-half.pddl
4 4 0.0 2 2 0.0
problem03-full.pddl
41 41 0.0 22 22 0.0
problem03-half.pddl
21 21 0.0 17 17 0.0
problem04-full.pddl
99 99 0.0 46 46 0.0
problem04-half.pddl
67 67 0.0 40 40 0.0
problem05-full.pddl
155 155 0.0 78 78 0.0
problem05-half.pddl
119 119 0.0 115 115 0.0
problem06-full.pddl
360 360 0.0 117 117 0.0
problem06-half.pddl
197 197 0.0 150 150 0.0
problem07-full.pddl
350 350 0.0 214 214 0.0
problem07-half.pddl
338 338 0.0 223 223 0.0
problem08-full.pddl
608 608 0.0 221 221 0.0
problem08-half.pddl
492 492 0.0 252 252 0.0
problem09-full.pddl
748 748 0.0 286 286 0.0
problem09-half.pddl
1031 1031 0.0 581 581 0.0
problem10-full.pddl
965 965 0.0 357 357 0.0
problem10-half.pddl
874 874 0.0 519 519 0.0
problem11-full.pddl
1798 1798 0.0 582 582 0.0
problem11-half.pddl
864 864 0.0 932 932 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt14-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
155 155 0.0 78 78 0.0
p-1-6.pddl
360 360 0.0 117 117 0.0
p-1-7.pddl
350 350 0.0 214 214 0.0
p-1-8.pddl
608 608 0.0 221 221 0.0
p-1-9.pddl
748 748 0.0 286 286 0.0
p-1-10.pddl
965 965 0.0 357 357 0.0
p-1-11.pddl
1798 1798 0.0 582 582 0.0
p-1-12.pddl
1508 1508 0.0 534 534 0.0
p-1-13.pddl
2841 2841 0.0 670 670 0.0
p-1-14.pddl
3504 3504 0.0 758 758 0.0
p-1-15.pddl
4080 4080 0.0 1087 1087 0.0
p-1-16.pddl
5103 5103 0.0 1030 1030 0.0
p-1-17.pddl
4863 4863 0.0 1382 1382 0.0
p-1-18.pddl
6426 6426 0.0 1498 1498 0.0
p-05-5.pddl
161 161 0.0 95 95 0.0
p-05-6.pddl
203 203 0.0 166 166 0.0
p-05-7.pddl
436 436 0.0 210 210 0.0
p-05-8.pddl
531 531 0.0 306 306 0.0
p-05-9.pddl
670 670 0.0 460 460 0.0
p-05-10.pddl
799 799 0.0 428 428 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt08-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
89 89 0.0 185 185 0.0
p02.pddl
4480 4480 0.0 180 180 0.0
p03.pddl
678 678 0.0 433 433 0.0
p04.pddl
789 789 0.0 None None -
p05.pddl
98049 98049 0.0 1612 1612 0.0
p06.pddl
764 764 0.0 104368 104368 0.0
p07.pddl
1645 1645 0.0 2340 2340 0.0
p08.pddl
1467 1467 0.0 None None -
p09.pddl
236333 236333 0.0 None None -
p10.pddl
5654 5654 0.0 713917 713917 0.0
p11.pddl
98 98 0.0 225 225 0.0
p12.pddl
208 208 0.0 299 299 0.0
p13.pddl
333 333 0.0 1024 1024 0.0
p14.pddl
64801 64801 0.0 409 409 0.0
p15.pddl
117782 117782 0.0 668 668 0.0
p16.pddl
108370 108370 0.0 None None -
p17.pddl
167391 167391 0.0 53598 53598 0.0
p18.pddl
1625 1625 0.0 139628 139628 0.0
p19.pddl
3146 3146 0.0 1732 1732 0.0
p20.pddl
287952 287952 0.0 362654 362654 0.0
p21.pddl
1001 1001 0.0 53 53 0.0
p22.pddl
119 119 0.0 107 107 0.0
p23.pddl
168 168 0.0 168 168 0.0
p24.pddl
67097 67097 0.0 308029599 308029599 0.0
p25.pddl
167710 167710 0.0 722 722 0.0
p26.pddl
831 831 0.0 None None -
p27.pddl
173381 173381 0.0 None None -
p28.pddl
380635 380635 0.0 None None -
p29.pddl
2451 2451 0.0 2000 2000 0.0
p30.pddl
566528 566528 0.0 5469197 5469197 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt11-strips
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
168 168 0.0 168 168 0.0
p02.pddl
208 208 0.0 299 299 0.0
p03.pddl
333 333 0.0 1024 1024 0.0
p04.pddl
678 678 0.0 433 433 0.0
p05.pddl
67097 67097 0.0 308029599 308029599 0.0
p06.pddl
789 789 0.0 None None -
p07.pddl
64801 64801 0.0 409 409 0.0
p08.pddl
167710 167710 0.0 722 722 0.0
p09.pddl
98049 98049 0.0 1612 1612 0.0
p10.pddl
117782 117782 0.0 668 668 0.0
p11.pddl
831 831 0.0 None None -
p12.pddl
108370 108370 0.0 None None -
p13.pddl
764 764 0.0 104368 104368 0.0
p14.pddl
173381 173381 0.0 None None -
p15.pddl
167391 167391 0.0 53598 53598 0.0
p16.pddl
1645 1645 0.0 2340 2340 0.0
p17.pddl
380635 380635 0.0 None None -
p18.pddl
1625 1625 0.0 139628 139628 0.0
p19.pddl
1467 1467 0.0 None None -
p20.pddl
2451 2451 0.0 2000 2000 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
zenotravel
Show table
generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
7 7 0.0 5 5 0.0
p02.pddl
48 48 0.0 32 32 0.0
p03.pddl
215 215 0.0 1483 1483 0.0
p04.pddl
221 221 0.0 1863 1863 0.0
p05.pddl
373 373 0.0 3345 3345 0.0
p06.pddl
407 407 0.0 8405 8405 0.0
p07.pddl
411 411 0.0 5038 5038 0.0
p08.pddl
1275 1275 0.0 16420 16420 0.0
p09.pddl
1452 1452 0.0 25417 25417 0.0
p10.pddl
2808 2808 0.0 33744 33744 0.0
p11.pddl
1688 1688 0.0 59771 59771 0.0
p12.pddl
2588 2588 0.0 52902 52902 0.0
p13.pddl
5183 5183 0.0 109537 109537 0.0
p14.pddl
21727 21727 0.0 2257050 2257050 0.0
p15.pddl
20601 20601 0.0 1431116 1431116 0.0
p16.pddl
38431 38431 0.0 4297392 4297392 0.0
p17.pddl
34870 34870 0.0 19108277 19108277 0.0
p18.pddl
51017 51017 0.0 3269902 3269902 0.0
p19.pddl
40559 40559 0.0 4718767 4718767 0.0
p20.pddl
137891 137891 0.0 11541131 11541131 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
initial_h_value
No task was found where all algorithms have a value for "initial_h_value". Therefore no domain-wise table can be generated.
agricola-opt18-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 25 25 0.0
p02.pddl
None None - 25 25 0.0
p03.pddl
None None - 25 25 0.0
p04.pddl
None None - 30 30 0.0
p05.pddl
None None - 30 30 0.0
p06.pddl
None None - 30 30 0.0
p07.pddl
None None - 35 35 0.0
p08.pddl
None None - 35 35 0.0
p09.pddl
None None - 35 35 0.0
p10.pddl
None None - 40 40 0.0
p11.pddl
None None - 40 40 0.0
p12.pddl
None None - 40 40 0.0
p13.pddl
None None - 45 45 0.0
p14.pddl
None None - 45 45 0.0
p15.pddl
None None - 45 45 0.0
p16.pddl
None None - 50 50 0.0
p17.pddl
None None - 50 50 0.0
p18.pddl
None None - 50 50 0.0
p19.pddl
None None - 55 55 0.0
p20.pddl
None None - 55 55 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
airport
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
None None - 9 9 0.0
p02-airport1-p1.pddl
None None - 10 10 0.0
p03-airport1-p2.pddl
None None - 22 22 0.0
p04-airport2-p1.pddl
None None - 21 21 0.0
p05-airport2-p1.pddl
None None - 22 22 0.0
p06-airport2-p2.pddl
None None - 44 44 0.0
p07-airport2-p2.pddl
None None - 46 46 0.0
p08-airport2-p3.pddl
None None - 68 68 0.0
p09-airport2-p4.pddl
None None - 83 83 0.0
p10-airport3-p1.pddl
None None - 19 19 0.0
p11-airport3-p1.pddl
None None - 22 22 0.0
p12-airport3-p2.pddl
None None - 42 42 0.0
p13-airport3-p2.pddl
None None - 42 42 0.0
p14-airport3-p3.pddl
None None - 64 64 0.0
p15-airport3-p3.pddl
None None - 64 64 0.0
p16-airport3-p4.pddl
None None - 86 86 0.0
p17-airport3-p5.pddl
None None - 101 101 0.0
p18-airport3-p6.pddl
None None - 121 121 0.0
p19-airport3-p6.pddl
None None - 109 109 0.0
p20-airport3-p7.pddl
None None - 135 135 0.0
p21-airport4halfMUC-p2.pddl
None None - 103 103 0.0
p22-airport4halfMUC-p3.pddl
None None - 158 158 0.0
p23-airport4halfMUC-p4.pddl
None None - 182 182 0.0
p24-airport4halfMUC-p4.pddl
None None - 166 166 0.0
p25-airport4halfMUC-p5.pddl
None None - 226 226 0.0
p26-airport4halfMUC-p6.pddl
None None - 238 238 0.0
p27-airport4halfMUC-p6.pddl
None None - 252 252 0.0
p28-airport4halfMUC-p7.pddl
None None - 310 310 0.0
p29-airport4halfMUC-p8.pddl
None None - 328 328 0.0
p30-airport4halfMUC-p8.pddl
None None - 318 318 0.0
p31-airport4halfMUC-p9.pddl
None None - 376 376 0.0
p32-airport4halfMUC-p10.pddl
None None - 414 414 0.0
p33-airport4halfMUC-p10.pddl
None None - 412 412 0.0
p34-airport4halfMUC-p11.pddl
None None - 452 452 0.0
p35-airport4halfMUC-p12.pddl
None None - 464 464 0.0
p36-airport5MUC-p2.pddl
None None - 79 79 0.0
p37-airport5MUC-p3.pddl
None None - 84 84 0.0
p38-airport5MUC-p3.pddl
None None - 101 101 0.0
p39-airport5MUC-p4.pddl
None None - 120 120 0.0
p40-airport5MUC-p4.pddl
None None - 126 126 0.0
p41-airport5MUC-p4.pddl
None None - 118 118 0.0
p42-airport5MUC-p5.pddl
None None - 162 162 0.0
p43-airport5MUC-p5.pddl
None None - 142 142 0.0
p44-airport5MUC-p5.pddl
None None - 179 179 0.0
p45-airport5MUC-p6.pddl
None None - 197 197 0.0
p46-airport5MUC-p6.pddl
None None - 178 178 0.0
p47-airport5MUC-p8.pddl
None None - 257 257 0.0
p48-airport5MUC-p9.pddl
None None - 262 262 0.0
p49-airport5MUC-p10.pddl
None None - 319 319 0.0
p50-airport5MUC-p15.pddl
None None - 448 448 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
barman-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
None None - 12 12 0.0
pfile01-002.pddl
None None - 12 12 0.0
pfile01-003.pddl
None None - 12 12 0.0
pfile01-004.pddl
None None - 12 12 0.0
pfile02-005.pddl
None None - 14 14 0.0
pfile02-006.pddl
None None - 14 14 0.0
pfile02-007.pddl
None None - 14 14 0.0
pfile02-008.pddl
None None - 14 14 0.0
pfile03-009.pddl
None None - 16 16 0.0
pfile03-010.pddl
None None - 16 16 0.0
pfile03-011.pddl
None None - 16 16 0.0
pfile03-012.pddl
None None - 16 16 0.0
pfile04-013.pddl
None None - 19 19 0.0
pfile04-014.pddl
None None - 19 19 0.0
pfile04-015.pddl
None None - 19 19 0.0
pfile04-016.pddl
None None - 19 19 0.0
pfile05-017.pddl
None None - 21 21 0.0
pfile05-018.pddl
None None - 21 21 0.0
pfile05-019.pddl
None None - 21 21 0.0
pfile05-020.pddl
None None - 21 21 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
barman-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
None None - 14 14 0.0
p435-2.pddl
None None - 14 14 0.0
p435-3.pddl
None None - 14 14 0.0
p536-1.pddl
None None - 16 16 0.0
p536-2.pddl
None None - 16 16 0.0
p536-3.pddl
None None - 16 16 0.0
p638-1.pddl
None None - 19 19 0.0
p638-2.pddl
None None - 19 19 0.0
p638-3.pddl
None None - 19 19 0.0
p739-1.pddl
None None - 21 21 0.0
p739-2.pddl
None None - 21 21 0.0
p739-3.pddl
None None - 21 21 0.0
p839-1.pddl
None None - 22 22 0.0
p839-2.pddl
None None - 22 22 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
blocks
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
None None - 6 6 0.0
probBLOCKS-4-1.pddl
None None - 7 7 0.0
probBLOCKS-4-2.pddl
None None - 7 7 0.0
probBLOCKS-5-0.pddl
None None - 9 9 0.0
probBLOCKS-5-1.pddl
None None - 8 8 0.0
probBLOCKS-5-2.pddl
None None - 12 12 0.0
probBLOCKS-6-0.pddl
None None - 14 14 0.0
probBLOCKS-6-1.pddl
None None - 11 11 0.0
probBLOCKS-6-2.pddl
None None - 15 15 0.0
probBLOCKS-7-0.pddl
None None - 18 18 0.0
probBLOCKS-7-1.pddl
None None - 15 15 0.0
probBLOCKS-7-2.pddl
None None - 15 15 0.0
probBLOCKS-8-0.pddl
None None - 16 16 0.0
probBLOCKS-8-1.pddl
None None - 14 14 0.0
probBLOCKS-8-2.pddl
None None - 17 17 0.0
probBLOCKS-9-0.pddl
None None - 21 21 0.0
probBLOCKS-9-1.pddl
None None - 22 22 0.0
probBLOCKS-9-2.pddl
None None - 23 23 0.0
probBLOCKS-10-0.pddl
None None - 26 26 0.0
probBLOCKS-10-1.pddl
None None - 26 26 0.0
probBLOCKS-10-2.pddl
None None - 26 26 0.0
probBLOCKS-11-0.pddl
None None - 24 24 0.0
probBLOCKS-11-1.pddl
None None - 27 27 0.0
probBLOCKS-11-2.pddl
None None - 25 25 0.0
probBLOCKS-12-0.pddl
None None - 29 29 0.0
probBLOCKS-12-1.pddl
None None - 32 32 0.0
probBLOCKS-13-0.pddl
None None - 34 34 0.0
probBLOCKS-13-1.pddl
None None - 35 35 0.0
probBLOCKS-14-0.pddl
None None - 33 33 0.0
probBLOCKS-14-1.pddl
None None - 35 35 0.0
probBLOCKS-15-0.pddl
None None - 36 36 0.0
probBLOCKS-15-1.pddl
None None - 39 39 0.0
probBLOCKS-16-1.pddl
None None - 43 43 0.0
probBLOCKS-16-2.pddl
None None - 40 40 0.0
probBLOCKS-17-0.pddl
None None - 44 44 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
childsnack-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
None None - 6 6 0.0
child-snack_pfile01.pddl
None None - 6 6 0.0
child-snack_pfile02-2.pddl
None None - 7 7 0.0
child-snack_pfile02.pddl
None None - 7 7 0.0
child-snack_pfile03-2.pddl
None None - 8 8 0.0
child-snack_pfile03.pddl
None None - 8 8 0.0
child-snack_pfile04-2.pddl
None None - 9 9 0.0
child-snack_pfile04.pddl
None None - 9 9 0.0
child-snack_pfile05-2.pddl
None None - 10 10 0.0
child-snack_pfile05.pddl
None None - 10 10 0.0
child-snack_pfile06-2.pddl
None None - 11 11 0.0
child-snack_pfile06.pddl
None None - 11 11 0.0
child-snack_pfile07-2.pddl
None None - 12 12 0.0
child-snack_pfile07.pddl
None None - 12 12 0.0
child-snack_pfile08-2.pddl
None None - 13 13 0.0
child-snack_pfile08.pddl
None None - 13 13 0.0
child-snack_pfile09-2.pddl
None None - 14 14 0.0
child-snack_pfile09.pddl
None None - 14 14 0.0
child-snack_pfile10-2.pddl
None None - 15 15 0.0
child-snack_pfile10.pddl
None None - 15 15 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
data-network-opt18-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 4 4 0.0
p02.pddl
None None - 2 2 0.0
p03.pddl
None None - 6 6 0.0
p04.pddl
None None - 8 8 0.0
p05.pddl
None None - 7 7 0.0
p06.pddl
None None - 4 4 0.0
p07.pddl
None None - 7 7 0.0
p08.pddl
None None - 8 8 0.0
p09.pddl
None None - 3 3 0.0
p10.pddl
None None - 4 4 0.0
p11.pddl
None None - 2 2 0.0
p12.pddl
None None - 3 3 0.0
p13.pddl
None None - 5 5 0.0
p14.pddl
None None - 12 12 0.0
p15.pddl
None None - 3 3 0.0
p16.pddl
None None - 6 6 0.0
p17.pddl
None None - 4 4 0.0
p18.pddl
None None - 8 8 0.0
p19.pddl
None None - 8 8 0.0
p20.pddl
None None - 7 7 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
depot
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 7 7 0.0
p02.pddl
None None - 11 11 0.0
p03.pddl
None None - 20 20 0.0
p04.pddl
None None - 21 21 0.0
p05.pddl
None None - 31 31 0.0
p06.pddl
None None - 39 39 0.0
p07.pddl
None None - 14 14 0.0
p08.pddl
None None - 27 27 0.0
p09.pddl
None None - 44 44 0.0
p10.pddl
None None - 15 15 0.0
p11.pddl
None None - 33 33 0.0
p12.pddl
None None - 41 41 0.0
p13.pddl
None None - 19 19 0.0
p14.pddl
None None - 15 15 0.0
p15.pddl
None None - 44 44 0.0
p16.pddl
None None - 15 15 0.0
p17.pddl
None None - 12 12 0.0
p18.pddl
None None - 33 33 0.0
p19.pddl
None None - 22 22 0.0
p20.pddl
None None - 45 45 0.0
p21.pddl
None None - 16 16 0.0
p22.pddl
None None - 56 56 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
driverlog
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 2 2 0.0
p02.pddl
None None - 7 7 0.0
p03.pddl
None None - 4 4 0.0
p04.pddl
None None - 6 6 0.0
p05.pddl
None None - 7 7 0.0
p06.pddl
None None - 5 5 0.0
p07.pddl
None None - 6 6 0.0
p08.pddl
None None - 7 7 0.0
p09.pddl
None None - 7 7 0.0
p10.pddl
None None - 6 6 0.0
p11.pddl
None None - 6 6 0.0
p12.pddl
None None - 9 9 0.0
p13.pddl
None None - 8 8 0.0
p14.pddl
None None - 9 9 0.0
p15.pddl
None None - 10 10 0.0
p16.pddl
None None - 19 19 0.0
p17.pddl
None None - 22 22 0.0
p18.pddl
None None - 23 23 0.0
p19.pddl
None None - 31 31 0.0
p20.pddl
None None - 30 30 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
elevators-opt08-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 8 8 0.0
p02.pddl
None None - 6 6 0.0
p03.pddl
None None - 11 11 0.0
p04.pddl
None None - 12 12 0.0
p05.pddl
None None - 14 14 0.0
p06.pddl
None None - 14 14 0.0
p07.pddl
None None - 14 14 0.0
p08.pddl
None None - 9 9 0.0
p09.pddl
None None - 16 16 0.0
p10.pddl
None None - 16 16 0.0
p11.pddl
None None - 11 11 0.0
p12.pddl
None None - 12 12 0.0
p13.pddl
None None - 12 12 0.0
p14.pddl
None None - 17 17 0.0
p15.pddl
None None - 16 16 0.0
p16.pddl
None None - 18 18 0.0
p17.pddl
None None - 17 17 0.0
p18.pddl
None None - 20 20 0.0
p19.pddl
None None - 20 20 0.0
p20.pddl
None None - 20 20 0.0
p21.pddl
None None - 11 11 0.0
p22.pddl
None None - 6 6 0.0
p23.pddl
None None - 13 13 0.0
p24.pddl
None None - 13 13 0.0
p25.pddl
None None - 17 17 0.0
p26.pddl
None None - 17 17 0.0
p27.pddl
None None - 19 19 0.0
p28.pddl
None None - 17 17 0.0
p29.pddl
None None - 14 14 0.0
p30.pddl
None None - 19 19 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
elevators-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 11 11 0.0
p02.pddl
None None - 11 11 0.0
p03.pddl
None None - 12 12 0.0
p04.pddl
None None - 11 11 0.0
p05.pddl
None None - 12 12 0.0
p06.pddl
None None - 12 12 0.0
p07.pddl
None None - 17 17 0.0
p08.pddl
None None - 14 14 0.0
p09.pddl
None None - 6 6 0.0
p10.pddl
None None - 17 17 0.0
p11.pddl
None None - 17 17 0.0
p12.pddl
None None - 14 14 0.0
p13.pddl
None None - 14 14 0.0
p14.pddl
None None - 9 9 0.0
p15.pddl
None None - 16 16 0.0
p16.pddl
None None - 16 16 0.0
p17.pddl
None None - 17 17 0.0
p18.pddl
None None - 20 20 0.0
p19.pddl
None None - 13 13 0.0
p20.pddl
None None - 13 13 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
floortile-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
None None - 10 10 0.0
opt-p01-002.pddl
None None - 11 11 0.0
opt-p02-003.pddl
None None - 12 12 0.0
opt-p02-004.pddl
None None - 13 13 0.0
opt-p03-005.pddl
None None - 17 17 0.0
opt-p03-006.pddl
None None - 17 17 0.0
opt-p04-007.pddl
None None - 18 18 0.0
opt-p04-008.pddl
None None - 17 17 0.0
opt-p05-009.pddl
None None - 22 22 0.0
opt-p05-010.pddl
None None - 22 22 0.0
opt-p06-011.pddl
None None - 26 26 0.0
opt-p06-012.pddl
None None - 26 26 0.0
opt-p07-013.pddl
None None - 27 27 0.0
opt-p07-014.pddl
None None - 26 26 0.0
opt-p08-015.pddl
None None - 33 33 0.0
opt-p08-016.pddl
None None - 33 33 0.0
opt-p09-017.pddl
None None - 38 38 0.0
opt-p09-018.pddl
None None - 39 39 0.0
opt-p10-019.pddl
None None - 38 38 0.0
opt-p10-020.pddl
None None - 39 39 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
floortile-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
None None - 13 13 0.0
p01-4-4-2.pddl
None None - 18 18 0.0
p01-5-3-2.pddl
None None - 17 17 0.0
p01-5-4-2.pddl
None None - 21 21 0.0
p01-5-5-2.pddl
None None - 26 26 0.0
p01-6-4-2.pddl
None None - 26 26 0.0
p01-6-5-2.pddl
None None - 32 32 0.0
p02-4-4-2.pddl
None None - 17 17 0.0
p02-5-3-2.pddl
None None - 17 17 0.0
p02-5-4-2.pddl
None None - 21 21 0.0
p02-5-5-2.pddl
None None - 27 27 0.0
p02-6-4-2.pddl
None None - 25 25 0.0
p02-6-5-2.pddl
None None - 32 32 0.0
p03-4-3-2.pddl
None None - 14 14 0.0
p03-4-4-2.pddl
None None - 18 18 0.0
p03-5-3-2.pddl
None None - 17 17 0.0
p03-5-4-2.pddl
None None - 22 22 0.0
p03-5-5-2.pddl
None None - 27 27 0.0
p03-6-4-2.pddl
None None - 25 25 0.0
p03-6-5-2.pddl
None None - 32 32 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
freecell
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 12 12 0.0
p02.pddl
None None - 19 19 0.0
p03.pddl
None None - 27 27 0.0
p04.pddl
None None - 35 35 0.0
p05.pddl
None None - 43 43 0.0
p06.pddl
None None - 50 50 0.0
p07.pddl
None None - 51 51 0.0
p08.pddl
None None - 58 58 0.0
p09.pddl
None None - 58 58 0.0
p10.pddl
None None - 65 65 0.0
p11.pddl
None None - 66 66 0.0
p12.pddl
None None - 66 66 0.0
p13.pddl
None None - 73 73 0.0
p14.pddl
None None - 72 72 0.0
p15.pddl
None None - 80 80 0.0
p16.pddl
None None - 80 80 0.0
p17.pddl
None None - 88 88 0.0
p18.pddl
None None - 88 88 0.0
p19.pddl
None None - 96 96 0.0
p20.pddl
None None - 96 96 0.0
probfreecell-2-1.pddl
None None - 10 10 0.0
probfreecell-2-2.pddl
None None - 10 10 0.0
probfreecell-2-3.pddl
None None - 11 11 0.0
probfreecell-2-4.pddl
None None - 10 10 0.0
probfreecell-2-5.pddl
None None - 10 10 0.0
probfreecell-3-1.pddl
None None - 17 17 0.0
probfreecell-3-2.pddl
None None - 17 17 0.0
probfreecell-3-3.pddl
None None - 17 17 0.0
probfreecell-3-4.pddl
None None - 17 17 0.0
probfreecell-3-5.pddl
None None - 17 17 0.0
probfreecell-4-1.pddl
None None - 25 25 0.0
probfreecell-4-2.pddl
None None - 25 25 0.0
probfreecell-4-3.pddl
None None - 24 24 0.0
probfreecell-4-4.pddl
None None - 25 25 0.0
probfreecell-4-5.pddl
None None - 24 24 0.0
probfreecell-5-1.pddl
None None - 32 32 0.0
probfreecell-5-2.pddl
None None - 33 33 0.0
probfreecell-5-3.pddl
None None - 32 32 0.0
probfreecell-5-4.pddl
None None - 32 32 0.0
probfreecell-5-5.pddl
None None - 32 32 0.0
probfreecell-6-1.pddl
None None - 40 40 0.0
probfreecell-6-2.pddl
None None - 41 41 0.0
probfreecell-6-3.pddl
None None - 40 40 0.0
probfreecell-6-4.pddl
None None - 40 40 0.0
probfreecell-6-5.pddl
None None - 40 40 0.0
probfreecell-7-1.pddl
None None - 48 48 0.0
probfreecell-7-2.pddl
None None - 48 48 0.0
probfreecell-7-3.pddl
None None - 48 48 0.0
probfreecell-7-4.pddl
None None - 48 48 0.0
probfreecell-7-5.pddl
None None - 48 48 0.0
probfreecell-8-1.pddl
None None - 56 56 0.0
probfreecell-8-2.pddl
None None - 56 56 0.0
probfreecell-8-3.pddl
None None - 56 56 0.0
probfreecell-8-4.pddl
None None - 56 56 0.0
probfreecell-8-5.pddl
None None - 56 56 0.0
probfreecell-9-1.pddl
None None - 64 64 0.0
probfreecell-9-2.pddl
None None - 64 64 0.0
probfreecell-9-3.pddl
None None - 64 64 0.0
probfreecell-9-4.pddl
None None - 64 64 0.0
probfreecell-9-5.pddl
None None - 64 64 0.0
probfreecell-10-1.pddl
None None - 72 72 0.0
probfreecell-10-2.pddl
None None - 72 72 0.0
probfreecell-10-3.pddl
None None - 72 72 0.0
probfreecell-10-4.pddl
None None - 72 72 0.0
probfreecell-10-5.pddl
None None - 72 72 0.0
probfreecell-11-1.pddl
None None - 80 80 0.0
probfreecell-11-2.pddl
None None - 80 80 0.0
probfreecell-11-3.pddl
None None - 80 80 0.0
probfreecell-11-4.pddl
None None - 80 80 0.0
probfreecell-11-5.pddl
None None - 80 80 0.0
probfreecell-12-1.pddl
None None - 88 88 0.0
probfreecell-12-2.pddl
None None - 88 88 0.0
probfreecell-12-3.pddl
None None - 88 88 0.0
probfreecell-12-4.pddl
None None - 88 88 0.0
probfreecell-12-5.pddl
None None - 88 88 0.0
probfreecell-13-1.pddl
None None - 96 96 0.0
probfreecell-13-2.pddl
None None - 96 96 0.0
probfreecell-13-3.pddl
None None - 96 96 0.0
probfreecell-13-4.pddl
None None - 96 96 0.0
probfreecell-13-5.pddl
None None - 96 96 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
ged-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
None None - 1 1 0.0
d-1-3.pddl
None None - 7 7 0.0
d-1-4.pddl
None None - 1 1 0.0
d-1-8.pddl
None None - 8 8 0.0
d-2-1.pddl
None None - 1 1 0.0
d-2-3.pddl
None None - 6 6 0.0
d-2-4.pddl
None None - 5 5 0.0
d-2-8.pddl
None None - 9 9 0.0
d-3-1.pddl
None None - 7 7 0.0
d-3-2.pddl
None None - 6 6 0.0
d-3-4.pddl
None None - 9 9 0.0
d-4-2.pddl
None None - 5 5 0.0
d-4-3.pddl
None None - 9 9 0.0
d-4-8.pddl
None None - 9 9 0.0
d-7-5.pddl
None None - 8 8 0.0
d-7-6.pddl
None None - 6 6 0.0
d-8-1.pddl
None None - 8 8 0.0
d-8-2.pddl
None None - 9 9 0.0
d-8-4.pddl
None None - 9 9 0.0
d-8-9.pddl
None None - 11 11 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
grid
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
None None - 8 8 0.0
prob02.pddl
None None - 10 10 0.0
prob03.pddl
None None - 18 18 0.0
prob04.pddl
None None - 13 13 0.0
prob05.pddl
None None - 33 33 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
gripper
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
None None - 5 5 0.0
prob02.pddl
None None - 7 7 0.0
prob03.pddl
None None - 9 9 0.0
prob04.pddl
None None - 11 11 0.0
prob05.pddl
None None - 13 13 0.0
prob06.pddl
None None - 15 15 0.0
prob07.pddl
None None - 17 17 0.0
prob08.pddl
None None - 19 19 0.0
prob09.pddl
None None - 21 21 0.0
prob10.pddl
None None - 23 23 0.0
prob11.pddl
None None - 25 25 0.0
prob12.pddl
None None - 27 27 0.0
prob13.pddl
None None - 29 29 0.0
prob14.pddl
None None - 31 31 0.0
prob15.pddl
None None - 33 33 0.0
prob16.pddl
None None - 35 35 0.0
prob17.pddl
None None - 37 37 0.0
prob18.pddl
None None - 39 39 0.0
prob19.pddl
None None - 41 41 0.0
prob20.pddl
None None - 43 43 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
hiking-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
None None - 7 7 0.0
ptesting-1-2-4.pddl
None None - 11 11 0.0
ptesting-1-2-5.pddl
None None - 15 15 0.0
ptesting-1-2-7.pddl
None None - 23 23 0.0
ptesting-1-2-8.pddl
None None - 27 27 0.0
ptesting-2-2-3.pddl
None None - 8 8 0.0
ptesting-2-2-4.pddl
None None - 14 14 0.0
ptesting-2-2-5.pddl
None None - 20 20 0.0
ptesting-2-2-6.pddl
None None - 26 26 0.0
ptesting-2-2-7.pddl
None None - 32 32 0.0
ptesting-2-2-8.pddl
None None - 38 38 0.0
ptesting-2-3-4.pddl
None None - 14 14 0.0
ptesting-2-3-5.pddl
None None - 20 20 0.0
ptesting-2-3-6.pddl
None None - 26 26 0.0
ptesting-2-3-7.pddl
None None - 32 32 0.0
ptesting-2-4-3.pddl
None None - 8 8 0.0
ptesting-2-4-4.pddl
None None - 14 14 0.0
ptesting-2-4-5.pddl
None None - 20 20 0.0
ptesting-2-4-6.pddl
None None - 26 26 0.0
ptesting-2-4-7.pddl
None None - 32 32 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
logistics00
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
None None - 19 19 0.0
probLOGISTICS-4-1.pddl
None None - 17 17 0.0
probLOGISTICS-4-2.pddl
None None - 13 13 0.0
probLOGISTICS-5-0.pddl
None None - 25 25 0.0
probLOGISTICS-5-1.pddl
None None - 15 15 0.0
probLOGISTICS-5-2.pddl
None None - 8 8 0.0
probLOGISTICS-6-0.pddl
None None - 23 23 0.0
probLOGISTICS-6-1.pddl
None None - 13 13 0.0
probLOGISTICS-6-2.pddl
None None - 23 23 0.0
probLOGISTICS-6-9.pddl
None None - 21 21 0.0
probLOGISTICS-7-0.pddl
None None - 33 33 0.0
probLOGISTICS-7-1.pddl
None None - 39 39 0.0
probLOGISTICS-8-0.pddl
None None - 29 29 0.0
probLOGISTICS-8-1.pddl
None None - 41 41 0.0
probLOGISTICS-9-0.pddl
None None - 33 33 0.0
probLOGISTICS-9-1.pddl
None None - 29 29 0.0
probLOGISTICS-10-0.pddl
None None - 41 41 0.0
probLOGISTICS-10-1.pddl
None None - 39 39 0.0
probLOGISTICS-11-0.pddl
None None - 45 45 0.0
probLOGISTICS-11-1.pddl
None None - 55 55 0.0
probLOGISTICS-12-0.pddl
None None - 39 39 0.0
probLOGISTICS-12-1.pddl
None None - 63 63 0.0
probLOGISTICS-13-0.pddl
None None - 52 52 0.0
probLOGISTICS-13-1.pddl
None None - 44 44 0.0
probLOGISTICS-14-0.pddl
None None - 43 43 0.0
probLOGISTICS-14-1.pddl
None None - 52 52 0.0
probLOGISTICS-15-0.pddl
None None - 55 55 0.0
probLOGISTICS-15-1.pddl
None None - 48 48 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
logistics98
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
None None - 16 16 0.0
prob02.pddl
None None - 17 17 0.0
prob03.pddl
None None - 37 37 0.0
prob04.pddl
None None - 30 30 0.0
prob05.pddl
None None - 18 18 0.0
prob06.pddl
None None - 34 34 0.0
prob07.pddl
None None - 18 18 0.0
prob08.pddl
None None - 18 18 0.0
prob09.pddl
None None - 33 33 0.0
prob10.pddl
None None - 62 62 0.0
prob11.pddl
None None - 10 10 0.0
prob12.pddl
None None - 14 14 0.0
prob13.pddl
None None - 46 46 0.0
prob14.pddl
None None - 34 34 0.0
prob15.pddl
None None - 55 55 0.0
prob16.pddl
None None - 20 20 0.0
prob17.pddl
None None - 16 16 0.0
prob18.pddl
None None - 112 112 0.0
prob19.pddl
None None - 48 48 0.0
prob20.pddl
None None - 88 88 0.0
prob21.pddl
None None - 37 37 0.0
prob22.pddl
None None - 115 115 0.0
prob23.pddl
None None - 45 45 0.0
prob24.pddl
None None - 12 12 0.0
prob25.pddl
None None - 133 133 0.0
prob26.pddl
None None - 76 76 0.0
prob27.pddl
None None - 66 66 0.0
prob28.pddl
None None - 86 86 0.0
prob29.pddl
None None - 159 159 0.0
prob30.pddl
None None - 39 39 0.0
prob31.pddl
None None - 9 9 0.0
prob32.pddl
None None - 12 12 0.0
prob33.pddl
None None - 17 17 0.0
prob34.pddl
None None - 15 15 0.0
prob35.pddl
None None - 25 25 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
miconic
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
None None - 3 3 0.0
s1-1.pddl
None None - 3 3 0.0
s1-2.pddl
None None - 3 3 0.0
s1-3.pddl
None None - 3 3 0.0
s1-4.pddl
None None - 3 3 0.0
s2-0.pddl
None None - 7 7 0.0
s2-1.pddl
None None - 6 6 0.0
s2-2.pddl
None None - 6 6 0.0
s2-3.pddl
None None - 7 7 0.0
s2-4.pddl
None None - 6 6 0.0
s3-0.pddl
None None - 10 10 0.0
s3-1.pddl
None None - 10 10 0.0
s3-2.pddl
None None - 9 9 0.0
s3-3.pddl
None None - 9 9 0.0
s3-4.pddl
None None - 9 9 0.0
s4-0.pddl
None None - 14 14 0.0
s4-1.pddl
None None - 13 13 0.0
s4-2.pddl
None None - 14 14 0.0
s4-3.pddl
None None - 14 14 0.0
s4-4.pddl
None None - 15 15 0.0
s5-0.pddl
None None - 17 17 0.0
s5-1.pddl
None None - 16 16 0.0
s5-2.pddl
None None - 14 14 0.0
s5-3.pddl
None None - 17 17 0.0
s5-4.pddl
None None - 17 17 0.0
s6-0.pddl
None None - 18 18 0.0
s6-1.pddl
None None - 19 19 0.0
s6-2.pddl
None None - 19 19 0.0
s6-3.pddl
None None - 18 18 0.0
s6-4.pddl
None None - 20 20 0.0
s7-0.pddl
None None - 23 23 0.0
s7-1.pddl
None None - 24 24 0.0
s7-2.pddl
None None - 22 22 0.0
s7-3.pddl
None None - 22 22 0.0
s7-4.pddl
None None - 25 25 0.0
s8-0.pddl
None None - 27 27 0.0
s8-1.pddl
None None - 26 26 0.0
s8-2.pddl
None None - 25 25 0.0
s8-3.pddl
None None - 27 27 0.0
s8-4.pddl
None None - 26 26 0.0
s9-0.pddl
None None - 30 30 0.0
s9-1.pddl
None None - 29 29 0.0
s9-2.pddl
None None - 29 29 0.0
s9-3.pddl
None None - 31 31 0.0
s9-4.pddl
None None - 27 27 0.0
s10-0.pddl
None None - 33 33 0.0
s10-1.pddl
None None - 32 32 0.0
s10-2.pddl
None None - 31 31 0.0
s10-3.pddl
None None - 34 34 0.0
s10-4.pddl
None None - 32 32 0.0
s11-0.pddl
None None - 36 36 0.0
s11-1.pddl
None None - 34 34 0.0
s11-2.pddl
None None - 37 37 0.0
s11-3.pddl
None None - 37 37 0.0
s11-4.pddl
None None - 34 34 0.0
s12-0.pddl
None None - 40 40 0.0
s12-1.pddl
None None - 40 40 0.0
s12-2.pddl
None None - 39 39 0.0
s12-3.pddl
None None - 38 38 0.0
s12-4.pddl
None None - 41 41 0.0
s13-0.pddl
None None - 43 43 0.0
s13-1.pddl
None None - 41 41 0.0
s13-2.pddl
None None - 46 46 0.0
s13-3.pddl
None None - 43 43 0.0
s13-4.pddl
None None - 41 41 0.0
s14-0.pddl
None None - 45 45 0.0
s14-1.pddl
None None - 47 47 0.0
s14-2.pddl
None None - 49 49 0.0
s14-3.pddl
None None - 42 42 0.0
s14-4.pddl
None None - 45 45 0.0
s15-0.pddl
None None - 46 46 0.0
s15-1.pddl
None None - 49 49 0.0
s15-2.pddl
None None - 49 49 0.0
s15-3.pddl
None None - 50 50 0.0
s15-4.pddl
None None - 46 46 0.0
s16-0.pddl
None None - 53 53 0.0
s16-1.pddl
None None - 52 52 0.0
s16-2.pddl
None None - 54 54 0.0
s16-3.pddl
None None - 51 51 0.0
s16-4.pddl
None None - 53 53 0.0
s17-0.pddl
None None - 55 55 0.0
s17-1.pddl
None None - 54 54 0.0
s17-2.pddl
None None - 54 54 0.0
s17-3.pddl
None None - 59 59 0.0
s17-4.pddl
None None - 54 54 0.0
s18-0.pddl
None None - 59 59 0.0
s18-1.pddl
None None - 58 58 0.0
s18-2.pddl
None None - 58 58 0.0
s18-3.pddl
None None - 59 59 0.0
s18-4.pddl
None None - 56 56 0.0
s19-0.pddl
None None - 62 62 0.0
s19-1.pddl
None None - 65 65 0.0
s19-2.pddl
None None - 61 61 0.0
s19-3.pddl
None None - 63 63 0.0
s19-4.pddl
None None - 62 62 0.0
s20-0.pddl
None None - 63 63 0.0
s20-1.pddl
None None - 66 66 0.0
s20-2.pddl
None None - 62 62 0.0
s20-3.pddl
None None - 63 63 0.0
s20-4.pddl
None None - 64 64 0.0
s21-0.pddl
None None - 69 69 0.0
s21-1.pddl
None None - 69 69 0.0
s21-2.pddl
None None - 69 69 0.0
s21-3.pddl
None None - 66 66 0.0
s21-4.pddl
None None - 70 70 0.0
s22-0.pddl
None None - 72 72 0.0
s22-1.pddl
None None - 70 70 0.0
s22-2.pddl
None None - 71 71 0.0
s22-3.pddl
None None - 75 75 0.0
s22-4.pddl
None None - 71 71 0.0
s23-0.pddl
None None - 75 75 0.0
s23-1.pddl
None None - 74 74 0.0
s23-2.pddl
None None - 73 73 0.0
s23-3.pddl
None None - 71 71 0.0
s23-4.pddl
None None - 74 74 0.0
s24-0.pddl
None None - 79 79 0.0
s24-1.pddl
None None - 78 78 0.0
s24-2.pddl
None None - 77 77 0.0
s24-3.pddl
None None - 79 79 0.0
s24-4.pddl
None None - 77 77 0.0
s25-0.pddl
None None - 81 81 0.0
s25-1.pddl
None None - 85 85 0.0
s25-2.pddl
None None - 78 78 0.0
s25-3.pddl
None None - 84 84 0.0
s25-4.pddl
None None - 82 82 0.0
s26-0.pddl
None None - 83 83 0.0
s26-1.pddl
None None - 83 83 0.0
s26-2.pddl
None None - 90 90 0.0
s26-3.pddl
None None - 88 88 0.0
s26-4.pddl
None None - 82 82 0.0
s27-0.pddl
None None - 87 87 0.0
s27-1.pddl
None None - 91 91 0.0
s27-2.pddl
None None - 87 87 0.0
s27-3.pddl
None None - 89 89 0.0
s27-4.pddl
None None - 88 88 0.0
s28-0.pddl
None None - 94 94 0.0
s28-1.pddl
None None - 92 92 0.0
s28-2.pddl
None None - 93 93 0.0
s28-3.pddl
None None - 87 87 0.0
s28-4.pddl
None None - 92 92 0.0
s29-0.pddl
None None - 94 94 0.0
s29-1.pddl
None None - 91 91 0.0
s29-2.pddl
None None - 95 95 0.0
s29-3.pddl
None None - 96 96 0.0
s29-4.pddl
None None - 99 99 0.0
s30-0.pddl
None None - 95 95 0.0
s30-1.pddl
None None - 98 98 0.0
s30-2.pddl
None None - 96 96 0.0
s30-3.pddl
None None - 100 100 0.0
s30-4.pddl
None None - 99 99 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
movie
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
None None - 7 7 0.0
prob02.pddl
None None - 7 7 0.0
prob03.pddl
None None - 7 7 0.0
prob04.pddl
None None - 7 7 0.0
prob05.pddl
None None - 7 7 0.0
prob06.pddl
None None - 7 7 0.0
prob07.pddl
None None - 7 7 0.0
prob08.pddl
None None - 7 7 0.0
prob09.pddl
None None - 7 7 0.0
prob10.pddl
None None - 7 7 0.0
prob11.pddl
None None - 7 7 0.0
prob12.pddl
None None - 7 7 0.0
prob13.pddl
None None - 7 7 0.0
prob14.pddl
None None - 7 7 0.0
prob15.pddl
None None - 7 7 0.0
prob16.pddl
None None - 7 7 0.0
prob17.pddl
None None - 7 7 0.0
prob18.pddl
None None - 7 7 0.0
prob19.pddl
None None - 7 7 0.0
prob20.pddl
None None - 7 7 0.0
prob21.pddl
None None - 7 7 0.0
prob22.pddl
None None - 7 7 0.0
prob23.pddl
None None - 7 7 0.0
prob24.pddl
None None - 7 7 0.0
prob25.pddl
None None - 7 7 0.0
prob26.pddl
None None - 7 7 0.0
prob27.pddl
None None - 7 7 0.0
prob28.pddl
None None - 7 7 0.0
prob29.pddl
None None - 7 7 0.0
prob30.pddl
None None - 7 7 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
mprime
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
None None - 4 4 0.0
prob02.pddl
None None - 2 2 0.0
prob03.pddl
None None - 1 1 0.0
prob04.pddl
None None - 6 6 0.0
prob05.pddl
None None - 2 2 0.0
prob06.pddl
None None - 2 2 0.0
prob07.pddl
None None - 1 1 0.0
prob08.pddl
None None - 1 1 0.0
prob09.pddl
None None - 2 2 0.0
prob10.pddl
None None - 1 1 0.0
prob11.pddl
None None - 7 7 0.0
prob12.pddl
None None - 1 1 0.0
prob13.pddl
None None - 2 2 0.0
prob14.pddl
None None - 2 2 0.0
prob15.pddl
None None - 1 1 0.0
prob16.pddl
None None - 2 2 0.0
prob17.pddl
None None - 1 1 0.0
prob18.pddl
None None - 1 1 0.0
prob19.pddl
None None - 1 1 0.0
prob20.pddl
None None - 1 1 0.0
prob21.pddl
None None - 1 1 0.0
prob22.pddl
None None - 1 1 0.0
prob23.pddl
None None - 1 1 0.0
prob24.pddl
None None - 1 1 0.0
prob25.pddl
None None - 1 1 0.0
prob26.pddl
None None - 1 1 0.0
prob27.pddl
None None - 2 2 0.0
prob28.pddl
None None - 8 8 0.0
prob29.pddl
None None - 1 1 0.0
prob30.pddl
None None - 2 2 0.0
prob31.pddl
None None - 1 1 0.0
prob32.pddl
None None - 1 1 0.0
prob33.pddl
None None - 2 2 0.0
prob34.pddl
None None - 1 1 0.0
prob35.pddl
None None - 1 1 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
mystery
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
None None - 4 4 0.0
prob02.pddl
None None - 2 2 0.0
prob03.pddl
None None - 1 1 0.0
prob04.pddl
None None - 7 7 0.0
prob05.pddl
None None - 2 2 0.0
prob06.pddl
None None - 2 2 0.0
prob07.pddl
9223372036854775807 9223372036854775807 0.0 None None -
prob08.pddl
None None - 1 1 0.0
prob09.pddl
None None - 2 2 0.0
prob10.pddl
None None - 1 1 0.0
prob11.pddl
None None - 7 7 0.0
prob12.pddl
None None - 1 1 0.0
prob13.pddl
None None - 2 2 0.0
prob14.pddl
None None - 2 2 0.0
prob15.pddl
None None - 1 1 0.0
prob16.pddl
None None - 5 5 0.0
prob17.pddl
None None - 1 1 0.0
prob18.pddl
9223372036854775807 9223372036854775807 0.0 None None -
prob19.pddl
None None - 1 1 0.0
prob20.pddl
None None - 1 1 0.0
prob21.pddl
None None - 1 1 0.0
prob22.pddl
None None - 2 2 0.0
prob23.pddl
None None - 2 2 0.0
prob24.pddl
None None - 11 11 0.0
prob25.pddl
None None - 1 1 0.0
prob26.pddl
None None - 1 1 0.0
prob27.pddl
None None - 2 2 0.0
prob28.pddl
None None - 8 8 0.0
prob29.pddl
None None - 1 1 0.0
prob30.pddl
None None - 2 2 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
nomystery-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 9 9 0.0
p02.pddl
None None - 11 11 0.0
p03.pddl
None None - 13 13 0.0
p04.pddl
None None - 16 16 0.0
p05.pddl
None None - 20 20 0.0
p06.pddl
None None - 23 23 0.0
p07.pddl
None None - 27 27 0.0
p08.pddl
None None - 29 29 0.0
p09.pddl
None None - 30 30 0.0
p10.pddl
None None - 33 33 0.0
p11.pddl
None None - 9 9 0.0
p12.pddl
None None - 11 11 0.0
p13.pddl
None None - 13 13 0.0
p14.pddl
None None - 16 16 0.0
p15.pddl
None None - 20 20 0.0
p16.pddl
None None - 23 23 0.0
p17.pddl
None None - 27 27 0.0
p18.pddl
None None - 29 29 0.0
p19.pddl
None None - 30 30 0.0
p20.pddl
None None - 33 33 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
openstacks-opt08-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 16 16 0.0
p02.pddl
None None - 19 19 0.0
p03.pddl
None None - 22 22 0.0
p04.pddl
None None - 25 25 0.0
p05.pddl
None None - 28 28 0.0
p06.pddl
None None - 31 31 0.0
p07.pddl
None None - 34 34 0.0
p08.pddl
None None - 37 37 0.0
p09.pddl
None None - 40 40 0.0
p10.pddl
None None - 43 43 0.0
p11.pddl
None None - 46 46 0.0
p12.pddl
None None - 49 49 0.0
p13.pddl
None None - 52 52 0.0
p14.pddl
None None - 55 55 0.0
p15.pddl
None None - 58 58 0.0
p16.pddl
None None - 61 61 0.0
p17.pddl
None None - 64 64 0.0
p18.pddl
None None - 67 67 0.0
p19.pddl
None None - 70 70 0.0
p20.pddl
None None - 73 73 0.0
p21.pddl
None None - 76 76 0.0
p22.pddl
None None - 79 79 0.0
p23.pddl
None None - 82 82 0.0
p24.pddl
None None - 85 85 0.0
p25.pddl
None None - 88 88 0.0
p26.pddl
None None - 91 91 0.0
p27.pddl
None None - 94 94 0.0
p28.pddl
None None - 97 97 0.0
p29.pddl
None None - 100 100 0.0
p30.pddl
None None - 103 103 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
openstacks-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 31 31 0.0
p02.pddl
None None - 34 34 0.0
p03.pddl
None None - 37 37 0.0
p04.pddl
None None - 40 40 0.0
p05.pddl
None None - 43 43 0.0
p06.pddl
None None - 46 46 0.0
p07.pddl
None None - 49 49 0.0
p08.pddl
None None - 52 52 0.0
p09.pddl
None None - 55 55 0.0
p10.pddl
None None - 79 79 0.0
p11.pddl
None None - 58 58 0.0
p12.pddl
None None - 61 61 0.0
p13.pddl
None None - 64 64 0.0
p14.pddl
None None - 67 67 0.0
p15.pddl
None None - 70 70 0.0
p16.pddl
None None - 76 76 0.0
p17.pddl
None None - 73 73 0.0
p18.pddl
None None - 82 82 0.0
p19.pddl
None None - 85 85 0.0
p20.pddl
None None - 88 88 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
openstacks-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
None None - 61 61 0.0
p20_2.pddl
None None - 61 61 0.0
p20_3.pddl
None None - 61 61 0.0
p25_1.pddl
None None - 76 76 0.0
p25_3.pddl
None None - 76 76 0.0
p30_1.pddl
None None - 91 91 0.0
p30_2.pddl
None None - 91 91 0.0
p30_3.pddl
None None - 91 91 0.0
p35_1.pddl
None None - 106 106 0.0
p35_2.pddl
None None - 106 106 0.0
p35_3.pddl
None None - 106 106 0.0
p40_1.pddl
None None - 121 121 0.0
p40_2.pddl
None None - 121 121 0.0
p40_3.pddl
None None - 121 121 0.0
p45_1.pddl
None None - 136 136 0.0
p45_2.pddl
None None - 136 136 0.0
p45_3.pddl
None None - 136 136 0.0
p50_1.pddl
None None - 151 151 0.0
p50_2.pddl
None None - 151 151 0.0
p50_3.pddl
None None - 151 151 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
openstacks-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 21 21 0.0
p02.pddl
None None - 21 21 0.0
p03.pddl
None None - 21 21 0.0
p04.pddl
None None - 21 21 0.0
p05.pddl
None None - 21 21 0.0
p06.pddl
None None - 41 41 0.0
p07.pddl
None None - 41 41 0.0
p08.pddl
None None - 81 81 0.0
p09.pddl
None None - 81 81 0.0
p10.pddl
None None - 81 81 0.0
p11.pddl
None None - 81 81 0.0
p12.pddl
None None - 81 81 0.0
p13.pddl
None None - 81 81 0.0
p14.pddl
None None - 81 81 0.0
p15.pddl
None None - 81 81 0.0
p16.pddl
None None - 81 81 0.0
p17.pddl
None None - 101 101 0.0
p18.pddl
None None - 169 169 0.0
p19.pddl
None None - 101 101 0.0
p20.pddl
None None - 121 121 0.0
p21.pddl
None None - 121 121 0.0
p22.pddl
None None - 121 121 0.0
p23.pddl
None None - 121 121 0.0
p24.pddl
None None - 201 201 0.0
p25.pddl
None None - 201 201 0.0
p26.pddl
None None - 201 201 0.0
p27.pddl
None None - 301 301 0.0
p28.pddl
None None - 401 401 0.0
p29.pddl
None None - 401 401 0.0
p30.pddl
None None - 401 401 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
organic-synthesis-opt18-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 6 6 0.0
p02.pddl
None None - 6 6 0.0
p03.pddl
None None - 7 7 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
None None - 4 4 0.0
p08.pddl
None None - None None -
p09.pddl
None None - 3 3 0.0
p10.pddl
None None - 3 3 0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
None None - 12 12 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
organic-synthesis-split-opt18-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 7 7 0.0
p02.pddl
None None - 7 7 0.0
p03.pddl
None None - 45 45 0.0
p04.pddl
None None - 21 21 0.0
p05.pddl
None None - 2 2 0.0
p06.pddl
None None - 20 20 0.0
p07.pddl
None None - 17 17 0.0
p08.pddl
None None - 11 11 0.0
p09.pddl
None None - 2 2 0.0
p10.pddl
None None - 2 2 0.0
p11.pddl
None None - 6 6 0.0
p12.pddl
None None - 4 4 0.0
p13.pddl
None None - 6 6 0.0
p14.pddl
None None - 14 14 0.0
p15.pddl
None None - 20 20 0.0
p16.pddl
None None - 22 22 0.0
p17.pddl
None None - 33 33 0.0
p18.pddl
None None - 14 14 0.0
p19.pddl
None None - 2 2 0.0
p20.pddl
None None - 9 9 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
parcprinter-08-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 7 7 0.0
p02.pddl
None None - 16 16 0.0
p03.pddl
None None - 35 35 0.0
p04.pddl
None None - 28 28 0.0
p05.pddl
None None - 35 35 0.0
p06.pddl
None None - 44 44 0.0
p07.pddl
None None - 43 43 0.0
p08.pddl
None None - 54 54 0.0
p09.pddl
None None - 61 61 0.0
p10.pddl
None None - 70 70 0.0
p11.pddl
None None - 10 10 0.0
p12.pddl
None None - 17 17 0.0
p13.pddl
None None - 24 24 0.0
p14.pddl
None None - 31 31 0.0
p15.pddl
None None - 39 39 0.0
p16.pddl
None None - 45 45 0.0
p17.pddl
None None - 52 52 0.0
p18.pddl
None None - 59 59 0.0
p19.pddl
None None - 68 68 0.0
p20.pddl
None None - 74 74 0.0
p21.pddl
None None - 9 9 0.0
p22.pddl
None None - 20 20 0.0
p23.pddl
None None - 27 27 0.0
p24.pddl
None None - 36 36 0.0
p25.pddl
None None - 46 46 0.0
p26.pddl
None None - 54 54 0.0
p27.pddl
None None - 59 59 0.0
p28.pddl
None None - 72 72 0.0
p29.pddl
None None - 85 85 0.0
p30.pddl
None None - 83 83 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
parcprinter-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 20 20 0.0
p02.pddl
None None - 16 16 0.0
p03.pddl
None None - 17 17 0.0
p04.pddl
None None - 28 28 0.0
p05.pddl
None None - 27 27 0.0
p06.pddl
None None - 44 44 0.0
p07.pddl
None None - 35 35 0.0
p08.pddl
None None - 36 36 0.0
p09.pddl
None None - 24 24 0.0
p10.pddl
None None - 46 46 0.0
p11.pddl
None None - 54 54 0.0
p12.pddl
None None - 31 31 0.0
p13.pddl
None None - 43 43 0.0
p14.pddl
None None - 54 54 0.0
p15.pddl
None None - 61 61 0.0
p16.pddl
None None - 70 70 0.0
p17.pddl
None None - 39 39 0.0
p18.pddl
None None - 45 45 0.0
p19.pddl
None None - 52 52 0.0
p20.pddl
None None - 59 59 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
parking-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
None None - 19 19 0.0
pfile03-012.pddl
None None - 26 26 0.0
pfile04-013.pddl
None None - 32 32 0.0
pfile04-014.pddl
None None - 30 30 0.0
pfile04-015.pddl
None None - 29 29 0.0
pfile04-016.pddl
None None - 27 27 0.0
pfile05-017.pddl
None None - 34 34 0.0
pfile05-018.pddl
None None - 32 32 0.0
pfile05-019.pddl
None None - 36 36 0.0
pfile05-020.pddl
None None - 35 35 0.0
pfile06-021.pddl
None None - 36 36 0.0
pfile06-022.pddl
None None - 39 39 0.0
pfile06-023.pddl
None None - 37 37 0.0
pfile06-024.pddl
None None - 36 36 0.0
pfile07-025.pddl
None None - 44 44 0.0
pfile07-026.pddl
None None - 41 41 0.0
pfile07-027.pddl
None None - 45 45 0.0
pfile07-028.pddl
None None - 45 45 0.0
pfile08-029.pddl
None None - 49 49 0.0
pfile08-030.pddl
None None - 48 48 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
parking-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
None None - 25 25 0.0
p_12_7-02.pddl
None None - 24 24 0.0
p_12_7-03.pddl
None None - 25 25 0.0
p_12_7-04.pddl
None None - 24 24 0.0
p_14_8-01.pddl
None None - 28 28 0.0
p_14_8-02.pddl
None None - 31 31 0.0
p_14_8-03.pddl
None None - 30 30 0.0
p_14_8-04.pddl
None None - 28 28 0.0
p_16_9-01.pddl
None None - 33 33 0.0
p_16_9-02.pddl
None None - 31 31 0.0
p_16_9-03.pddl
None None - 32 32 0.0
p_16_9-04.pddl
None None - 35 35 0.0
p_18_10-01.pddl
None None - 41 41 0.0
p_18_10-02.pddl
None None - 38 38 0.0
p_18_10-03.pddl
None None - 38 38 0.0
p_18_10-04.pddl
None None - 38 38 0.0
p_20_11-01.pddl
None None - 43 43 0.0
p_20_11-02.pddl
None None - 41 41 0.0
p_20_11-03.pddl
None None - 45 45 0.0
p_20_11-04.pddl
None None - 43 43 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
pathways-noneg
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 1 1 0.0
p02.pddl
None None - 11 11 0.0
p03.pddl
None None - 8 8 0.0
p04.pddl
None None - 8 8 0.0
p05.pddl
None None - 10 10 0.0
p06.pddl
None None - 24 24 0.0
p07.pddl
None None - 18 18 0.0
p08.pddl
None None - 32 32 0.0
p09.pddl
None None - 32 32 0.0
p10.pddl
None None - 40 40 0.0
p11.pddl
None None - 30 30 0.0
p12.pddl
None None - 43 43 0.0
p13.pddl
None None - 39 39 0.0
p14.pddl
None None - 36 36 0.0
p15.pddl
None None - 54 54 0.0
p16.pddl
None None - 51 51 0.0
p17.pddl
None None - 56 56 0.0
p18.pddl
None None - 44 44 0.0
p19.pddl
None None - 48 48 0.0
p20.pddl
None None - 50 50 0.0
p21.pddl
None None - 67 67 0.0
p22.pddl
None None - 48 48 0.0
p23.pddl
None None - 52 52 0.0
p24.pddl
None None - 63 63 0.0
p25.pddl
None None - 64 64 0.0
p26.pddl
None None - 73 73 0.0
p27.pddl
None None - 71 71 0.0
p28.pddl
None None - 69 69 0.0
p29.pddl
None None - 65 65 0.0
p30.pddl
None None - 71 71 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
pegsol-08-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 9 9 0.0
p02.pddl
None None - 5 5 0.0
p03.pddl
None None - 6 6 0.0
p04.pddl
None None - 9 9 0.0
p05.pddl
None None - 10 10 0.0
p06.pddl
None None - 11 11 0.0
p07.pddl
None None - 14 14 0.0
p08.pddl
None None - 11 11 0.0
p09.pddl
None None - 13 13 0.0
p10.pddl
None None - 14 14 0.0
p11.pddl
None None - 12 12 0.0
p12.pddl
None None - 13 13 0.0
p13.pddl
None None - 13 13 0.0
p14.pddl
None None - 14 14 0.0
p15.pddl
None None - 16 16 0.0
p16.pddl
None None - 16 16 0.0
p17.pddl
None None - 17 17 0.0
p18.pddl
None None - 17 17 0.0
p19.pddl
None None - 17 17 0.0
p20.pddl
None None - 16 16 0.0
p21.pddl
None None - 16 16 0.0
p22.pddl
None None - 18 18 0.0
p23.pddl
None None - 17 17 0.0
p24.pddl
None None - 18 18 0.0
p25.pddl
None None - 18 18 0.0
p26.pddl
None None - 21 21 0.0
p27.pddl
None None - 22 22 0.0
p28.pddl
None None - 24 24 0.0
p29.pddl
None None - 27 27 0.0
p30.pddl
None None - 33 33 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
pegsol-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 14 14 0.0
p02.pddl
None None - 17 17 0.0
p03.pddl
None None - 17 17 0.0
p04.pddl
None None - 17 17 0.0
p05.pddl
None None - 15 15 0.0
p06.pddl
None None - 17 17 0.0
p07.pddl
None None - 15 15 0.0
p08.pddl
None None - 16 16 0.0
p09.pddl
None None - 16 16 0.0
p10.pddl
None None - 16 16 0.0
p11.pddl
None None - 18 18 0.0
p12.pddl
None None - 18 18 0.0
p13.pddl
None None - 17 17 0.0
p14.pddl
None None - 18 18 0.0
p15.pddl
None None - 18 18 0.0
p16.pddl
None None - 21 21 0.0
p17.pddl
None None - 22 22 0.0
p18.pddl
None None - 24 24 0.0
p19.pddl
None None - 27 27 0.0
p20.pddl
None None - 33 33 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
petri-net-alignment-opt18-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 245 245 0.0
p02.pddl
None None - 310 310 0.0
p03.pddl
None None - 363 363 0.0
p04.pddl
None None - 372 372 0.0
p05.pddl
None None - 300 300 0.0
p06.pddl
None None - 373 373 0.0
p07.pddl
None None - 355 355 0.0
p08.pddl
None None - 374 374 0.0
p09.pddl
None None - 364 364 0.0
p10.pddl
None None - 457 457 0.0
p11.pddl
None None - 402 402 0.0
p12.pddl
None None - 521 521 0.0
p13.pddl
None None - 456 456 0.0
p14.pddl
None None - 464 464 0.0
p15.pddl
None None - 451 451 0.0
p16.pddl
None None - 494 494 0.0
p17.pddl
None None - 511 511 0.0
p18.pddl
None None - 494 494 0.0
p19.pddl
None None - 510 510 0.0
p20.pddl
None None - 523 523 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
pipesworld-notankage
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
None None - 5 5 0.0
p02-net1-b6-g4.pddl
None None - 8 8 0.0
p03-net1-b8-g3.pddl
None None - 8 8 0.0
p04-net1-b8-g5.pddl
None None - 10 10 0.0
p05-net1-b10-g4.pddl
None None - 9 9 0.0
p06-net1-b10-g6.pddl
None None - 12 12 0.0
p07-net1-b12-g5.pddl
None None - 11 11 0.0
p08-net1-b12-g7.pddl
None None - 15 15 0.0
p09-net1-b14-g6.pddl
None None - 18 18 0.0
p10-net1-b14-g8.pddl
None None - 24 24 0.0
p11-net2-b10-g2.pddl
None None - 6 6 0.0
p12-net2-b10-g4.pddl
None None - 9 9 0.0
p13-net2-b12-g3.pddl
None None - 8 8 0.0
p14-net2-b12-g5.pddl
None None - 13 13 0.0
p15-net2-b14-g4.pddl
None None - 9 9 0.0
p16-net2-b14-g6.pddl
None None - 13 13 0.0
p17-net2-b16-g5.pddl
None None - 10 10 0.0
p18-net2-b16-g7.pddl
None None - 15 15 0.0
p19-net2-b18-g6.pddl
None None - 12 12 0.0
p20-net2-b18-g8.pddl
None None - 17 17 0.0
p21-net3-b12-g2.pddl
None None - 5 5 0.0
p22-net3-b12-g4.pddl
None None - 13 13 0.0
p23-net3-b14-g3.pddl
None None - 9 9 0.0
p24-net3-b14-g5.pddl
None None - 13 13 0.0
p25-net3-b16-g5.pddl
None None - 16 16 0.0
p26-net3-b16-g7.pddl
None None - 22 22 0.0
p27-net3-b18-g6.pddl
None None - 16 16 0.0
p28-net3-b18-g7.pddl
None None - 20 20 0.0
p29-net3-b20-g6.pddl
None None - 16 16 0.0
p30-net3-b20-g8.pddl
None None - 21 21 0.0
p31-net4-b14-g3.pddl
None None - 5 5 0.0
p32-net4-b14-g5.pddl
None None - 9 9 0.0
p33-net4-b16-g5.pddl
None None - 7 7 0.0
p34-net4-b16-g6.pddl
None None - 11 11 0.0
p35-net4-b18-g4.pddl
None None - 6 6 0.0
p36-net4-b18-g6.pddl
None None - 10 10 0.0
p37-net4-b20-g5.pddl
None None - 6 6 0.0
p38-net4-b20-g7.pddl
None None - 8 8 0.0
p39-net4-b22-g7.pddl
None None - 12 12 0.0
p40-net4-b22-g8.pddl
None None - 13 13 0.0
p41-net5-b22-g2.pddl
None None - 2 2 0.0
p42-net5-b22-g4.pddl
None None - 9 9 0.0
p43-net5-b24-g3.pddl
None None - 8 8 0.0
p44-net5-b24-g5.pddl
None None - 10 10 0.0
p45-net5-b26-g4.pddl
None None - 9 9 0.0
p46-net5-b26-g6.pddl
None None - 12 12 0.0
p47-net5-b28-g5.pddl
None None - 15 15 0.0
p48-net5-b28-g7.pddl
None None - 19 19 0.0
p49-net5-b30-g6.pddl
None None - 10 10 0.0
p50-net5-b30-g8.pddl
None None - 17 17 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
pipesworld-tankage
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
None None - 6 6 0.0
p02-net1-b6-g4-t50.pddl
None None - 9 9 0.0
p03-net1-b8-g3-t80.pddl
None None - 9 9 0.0
p04-net1-b8-g5-t80.pddl
None None - 11 11 0.0
p05-net1-b10-g4-t50.pddl
None None - 10 10 0.0
p06-net1-b10-g6-t50.pddl
None None - 13 13 0.0
p07-net1-b12-g5-t80.pddl
None None - 11 11 0.0
p08-net1-b12-g7-t80.pddl
None None - 15 15 0.0
p09-net1-b14-g6-t50.pddl
None None - 18 18 0.0
p10-net1-b14-g8-t50.pddl
None None - 24 24 0.0
p11-net2-b10-g2-t30.pddl
None None - 7 7 0.0
p12-net2-b10-g4-t60.pddl
None None - 10 10 0.0
p13-net2-b12-g3-t70.pddl
None None - 8 8 0.0
p14-net2-b12-g5-t30.pddl
None None - 14 14 0.0
p15-net2-b14-g4-t30.pddl
None None - 9 9 0.0
p16-net2-b14-g6-t80.pddl
None None - 13 13 0.0
p17-net2-b16-g5-t20.pddl
None None - 12 12 0.0
p18-net2-b16-g7-t60.pddl
None None - 15 15 0.0
p19-net2-b18-g6-t60.pddl
None None - 12 12 0.0
p20-net2-b18-g8-t90.pddl
None None - 17 17 0.0
p21-net3-b12-g2-t60.pddl
None None - 5 5 0.0
p22-net3-b12-g4-t60.pddl
None None - 13 13 0.0
p23-net3-b14-g3-t60.pddl
None None - 11 11 0.0
p24-net3-b14-g5-t60.pddl
None None - 15 15 0.0
p25-net3-b16-g5-t60.pddl
None None - 16 16 0.0
p26-net3-b16-g7-t70.pddl
None None - 22 22 0.0
p27-net3-b18-g6-t70.pddl
None None - 16 16 0.0
p28-net3-b18-g7-t70.pddl
None None - 21 21 0.0
p29-net3-b20-g6-t70.pddl
None None - 16 16 0.0
p30-net3-b20-g8-t70.pddl
None None - 21 21 0.0
p31-net4-b14-g3-t20.pddl
None None - 6 6 0.0
p32-net4-b14-g5-t30.pddl
None None - 11 11 0.0
p33-net4-b16-g5-t60.pddl
None None - 9 9 0.0
p34-net4-b16-g6-t60.pddl
None None - 11 11 0.0
p35-net4-b18-g4-t90.pddl
None None - 6 6 0.0
p36-net4-b18-g6-t90.pddl
None None - 10 10 0.0
p37-net4-b20-g5-t60.pddl
None None - 6 6 0.0
p38-net4-b20-g7-t60.pddl
None None - 8 8 0.0
p39-net4-b22-g7-t50.pddl
None None - 12 12 0.0
p40-net4-b22-g8-t50.pddl
None None - 13 13 0.0
p41-net5-b22-g2-t20.pddl
None None - 2 2 0.0
p42-net5-b22-g4-t50.pddl
None None - 9 9 0.0
p43-net5-b24-g3-t80.pddl
None None - 9 9 0.0
p44-net5-b24-g5-t80.pddl
None None - 11 11 0.0
p45-net5-b26-g4-t50.pddl
None None - 9 9 0.0
p46-net5-b26-g6-t50.pddl
None None - 12 12 0.0
p47-net5-b28-g5-t50.pddl
None None - 15 15 0.0
p48-net5-b28-g7-t50.pddl
None None - 19 19 0.0
p49-net5-b30-g6-t50.pddl
None None - 10 10 0.0
p50-net5-b30-g8-t50.pddl
None None - 17 17 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
psr-small
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
None None - 1 1 0.0
p02-s5-n1-l3-f30.pddl
None None - 1 1 0.0
p03-s7-n1-l3-f70.pddl
None None - 1 1 0.0
p04-s8-n1-l4-f10.pddl
None None - 1 1 0.0
p05-s9-n1-l4-f30.pddl
None None - 1 1 0.0
p06-s10-n1-l4-f50.pddl
None None - 1 1 0.0
p07-s11-n1-l4-f70.pddl
None None - 1 1 0.0
p08-s12-n1-l5-f10.pddl
None None - 1 1 0.0
p09-s13-n1-l5-f30.pddl
None None - 1 1 0.0
p10-s17-n2-l2-f30.pddl
None None - 2 2 0.0
p11-s18-n2-l2-f50.pddl
None None - 2 2 0.0
p12-s21-n2-l3-f30.pddl
None None - 2 2 0.0
p13-s22-n2-l3-f50.pddl
None None - 3 3 0.0
p14-s23-n2-l3-f70.pddl
None None - 2 2 0.0
p15-s24-n2-l4-f10.pddl
None None - 2 2 0.0
p16-s29-n2-l5-f30.pddl
None None - 3 3 0.0
p17-s30-n2-l5-f50.pddl
None None - 2 2 0.0
p18-s31-n2-l5-f70.pddl
None None - 2 2 0.0
p19-s33-n3-l2-f30.pddl
None None - 5 5 0.0
p20-s34-n3-l2-f50.pddl
None None - 3 3 0.0
p21-s35-n3-l2-f70.pddl
None None - 3 3 0.0
p22-s37-n3-l3-f30.pddl
None None - 4 4 0.0
p23-s38-n3-l3-f50.pddl
None None - 3 3 0.0
p24-s39-n3-l3-f70.pddl
None None - 3 3 0.0
p25-s40-n3-l4-f10.pddl
None None - 2 2 0.0
p26-s41-n3-l4-f30.pddl
None None - 3 3 0.0
p27-s42-n3-l4-f50.pddl
None None - 3 3 0.0
p28-s43-n3-l4-f70.pddl
None None - 3 3 0.0
p29-s45-n3-l5-f30.pddl
None None - 5 5 0.0
p30-s46-n3-l5-f50.pddl
None None - 3 3 0.0
p31-s49-n4-l2-f30.pddl
None None - 4 4 0.0
p32-s50-n4-l2-f50.pddl
None None - 4 4 0.0
p33-s51-n4-l2-f70.pddl
None None - 4 4 0.0
p34-s55-n4-l3-f70.pddl
None None - 4 4 0.0
p35-s57-n5-l2-f30.pddl
None None - 4 4 0.0
p36-s65-n6-l2-f30.pddl
None None - 6 6 0.0
p37-s67-n6-l2-f70.pddl
None None - 6 6 0.0
p38-s78-n3-l3-f50.pddl
None None - 3 3 0.0
p39-s79-n3-l3-f70.pddl
None None - 3 3 0.0
p40-s80-n3-l4-f10.pddl
None None - 3 3 0.0
p41-s81-n3-l4-f30.pddl
None None - 3 3 0.0
p42-s82-n3-l4-f50.pddl
None None - 4 4 0.0
p43-s83-n3-l4-f70.pddl
None None - 4 4 0.0
p44-s89-n4-l2-f30.pddl
None None - 5 5 0.0
p45-s94-n4-l3-f50.pddl
None None - 4 4 0.0
p46-s97-n5-l2-f30.pddl
None None - 5 5 0.0
p47-s98-n5-l2-f50.pddl
None None - 4 4 0.0
p48-s101-n5-l3-f30.pddl
None None - 5 5 0.0
p49-s105-n6-l2-f30.pddl
None None - 7 7 0.0
p50-s107-n6-l2-f70.pddl
None None - 6 6 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
rovers
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 9 9 0.0
p02.pddl
None None - 7 7 0.0
p03.pddl
None None - 8 8 0.0
p04.pddl
None None - 7 7 0.0
p05.pddl
None None - 14 14 0.0
p06.pddl
None None - 25 25 0.0
p07.pddl
None None - 6 6 0.0
p08.pddl
None None - 8 8 0.0
p09.pddl
None None - 15 15 0.0
p10.pddl
None None - 11 11 0.0
p11.pddl
None None - 17 17 0.0
p12.pddl
None None - 6 6 0.0
p13.pddl
None None - 12 12 0.0
p14.pddl
None None - 14 14 0.0
p15.pddl
None None - 16 16 0.0
p16.pddl
None None - 11 11 0.0
p17.pddl
None None - 21 21 0.0
p18.pddl
None None - 11 11 0.0
p19.pddl
None None - 17 17 0.0
p20.pddl
None None - 20 20 0.0
p21.pddl
None None - 14 14 0.0
p22.pddl
None None - 16 16 0.0
p23.pddl
None None - 19 19 0.0
p24.pddl
None None - 21 21 0.0
p25.pddl
None None - 10 10 0.0
p26.pddl
None None - 14 14 0.0
p27.pddl
None None - 20 20 0.0
p28.pddl
None None - 19 19 0.0
p29.pddl
None None - 16 16 0.0
p30.pddl
None None - 25 25 0.0
p31.pddl
None None - 24 24 0.0
p32.pddl
None None - 35 35 0.0
p33.pddl
None None - 44 44 0.0
p34.pddl
None None - 32 32 0.0
p35.pddl
None None - 63 63 0.0
p36.pddl
None None - 41 41 0.0
p37.pddl
None None - 58 58 0.0
p38.pddl
None None - 55 55 0.0
p39.pddl
None None - 63 63 0.0
p40.pddl
None None - 69 69 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
satellite
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
None None - 8 8 0.0
p02-pfile2.pddl
None None - 12 12 0.0
p03-pfile3.pddl
None None - 5 5 0.0
p04-pfile4.pddl
None None - 12 12 0.0
p05-pfile5.pddl
None None - 7 7 0.0
p06-pfile6.pddl
None None - 11 11 0.0
p07-pfile7.pddl
None None - 9 9 0.0
p08-pfile8.pddl
None None - 10 10 0.0
p09-pfile9.pddl
None None - 13 13 0.0
p10-pfile10.pddl
None None - 12 12 0.0
p11-pfile11.pddl
None None - 14 14 0.0
p12-pfile12.pddl
None None - 26 26 0.0
p13-pfile13.pddl
None None - 27 27 0.0
p14-pfile14.pddl
None None - 19 19 0.0
p15-pfile15.pddl
None None - 23 23 0.0
p16-pfile16.pddl
None None - 23 23 0.0
p17-pfile17.pddl
None None - 20 20 0.0
p18-pfile18.pddl
None None - 13 13 0.0
p19-pfile19.pddl
None None - 28 28 0.0
p20-pfile20.pddl
None None - 40 40 0.0
p21-HC-pfile1.pddl
None None - 37 37 0.0
p22-HC-pfile2.pddl
None None - 45 45 0.0
p23-HC-pfile3.pddl
None None - 51 51 0.0
p24-HC-pfile4.pddl
None None - 70 70 0.0
p25-HC-pfile5.pddl
None None - 64 64 0.0
p26-HC-pfile6.pddl
None None - 68 68 0.0
p27-HC-pfile7.pddl
None None - 65 65 0.0
p28-HC-pfile8.pddl
None None - 94 94 0.0
p29-HC-pfile9.pddl
None None - 93 93 0.0
p30-HC-pfile10.pddl
None None - 114 114 0.0
p31-HC-pfile11.pddl
None None - 133 133 0.0
p32-HC-pfile12.pddl
None None - 182 182 0.0
p33-HC-pfile13.pddl
None None - 231 231 0.0
p34-HC-pfile14.pddl
None None - 141 141 0.0
p35-HC-pfile15.pddl
None None - 187 187 0.0
p36-HC-pfile16.pddl
None None - 178 178 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
scanalyzer-08-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 6 6 0.0
p02.pddl
None None - 6 6 0.0
p03.pddl
None None - 11 11 0.0
p04.pddl
None None - 8 8 0.0
p05.pddl
None None - 8 8 0.0
p06.pddl
None None - 15 15 0.0
p07.pddl
None None - 10 10 0.0
p08.pddl
None None - 10 10 0.0
p09.pddl
None None - 19 19 0.0
p10.pddl
None None - 12 12 0.0
p11.pddl
None None - 12 12 0.0
p12.pddl
None None - 23 23 0.0
p13.pddl
None None - 14 14 0.0
p14.pddl
None None - 14 14 0.0
p15.pddl
None None - 27 27 0.0
p16.pddl
None None - 16 16 0.0
p17.pddl
None None - 16 16 0.0
p18.pddl
None None - 31 31 0.0
p19.pddl
None None - 18 18 0.0
p20.pddl
None None - 18 18 0.0
p21.pddl
None None - 35 35 0.0
p22.pddl
None None - 11 11 0.0
p23.pddl
None None - 11 11 0.0
p24.pddl
None None - 11 11 0.0
p25.pddl
None None - 16 16 0.0
p26.pddl
None None - 16 16 0.0
p27.pddl
None None - 27 27 0.0
p28.pddl
None None - 24 24 0.0
p29.pddl
None None - 24 24 0.0
p30.pddl
None None - 43 43 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
scanalyzer-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 11 11 0.0
p02.pddl
None None - 6 6 0.0
p03.pddl
None None - 11 11 0.0
p04.pddl
None None - 8 8 0.0
p05.pddl
None None - 10 10 0.0
p06.pddl
None None - 8 8 0.0
p07.pddl
None None - 18 18 0.0
p08.pddl
None None - 12 12 0.0
p09.pddl
None None - 14 14 0.0
p10.pddl
None None - 16 16 0.0
p11.pddl
None None - 16 16 0.0
p12.pddl
None None - 15 15 0.0
p13.pddl
None None - 27 27 0.0
p14.pddl
None None - 16 16 0.0
p15.pddl
None None - 10 10 0.0
p16.pddl
None None - 12 12 0.0
p17.pddl
None None - 14 14 0.0
p18.pddl
None None - 16 16 0.0
p19.pddl
None None - 18 18 0.0
p20.pddl
None None - 24 24 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
snake-opt18-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 5 5 0.0
p02.pddl
None None - 5 5 0.0
p03.pddl
None None - 5 5 0.0
p04.pddl
None None - 5 5 0.0
p05.pddl
None None - 5 5 0.0
p06.pddl
None None - 5 5 0.0
p07.pddl
None None - 5 5 0.0
p08.pddl
None None - 5 5 0.0
p09.pddl
None None - 5 5 0.0
p10.pddl
None None - 5 5 0.0
p11.pddl
None None - 5 5 0.0
p12.pddl
None None - 5 5 0.0
p13.pddl
None None - 5 5 0.0
p14.pddl
None None - 5 5 0.0
p15.pddl
None None - 5 5 0.0
p16.pddl
None None - 5 5 0.0
p17.pddl
None None - 5 5 0.0
p18.pddl
None None - 5 5 0.0
p19.pddl
None None - 5 5 0.0
p20.pddl
None None - 5 5 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
sokoban-opt08-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 19 19 0.0
p02.pddl
None None - 13 13 0.0
p03.pddl
None None - 7 7 0.0
p04.pddl
None None - 33 33 0.0
p05.pddl
None None - 8 8 0.0
p06.pddl
None None - 6 6 0.0
p07.pddl
None None - 10 10 0.0
p08.pddl
None None - 14 14 0.0
p09.pddl
None None - 15 15 0.0
p10.pddl
None None - 20 20 0.0
p11.pddl
None None - 27 27 0.0
p12.pddl
None None - 16 16 0.0
p13.pddl
None None - 8 8 0.0
p14.pddl
None None - 5 5 0.0
p15.pddl
None None - 80 80 0.0
p16.pddl
None None - 25 25 0.0
p17.pddl
None None - 9 9 0.0
p18.pddl
None None - 43 43 0.0
p19.pddl
None None - 32 32 0.0
p20.pddl
None None - 3 3 0.0
p21.pddl
None None - 1 1 0.0
p22.pddl
None None - 40 40 0.0
p23.pddl
None None - 23 23 0.0
p24.pddl
None None - 20 20 0.0
p25.pddl
None None - 35 35 0.0
p26.pddl
None None - 18 18 0.0
p27.pddl
None None - 13 13 0.0
p28.pddl
None None - 12 12 0.0
p29.pddl
None None - 12 12 0.0
p30.pddl
None None - 12 12 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
sokoban-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 6 6 0.0
p02.pddl
None None - 9 9 0.0
p03.pddl
None None - 5 5 0.0
p04.pddl
None None - 33 33 0.0
p05.pddl
None None - 25 25 0.0
p06.pddl
None None - 27 27 0.0
p07.pddl
None None - 20 20 0.0
p08.pddl
None None - 15 15 0.0
p09.pddl
None None - 10 10 0.0
p10.pddl
None None - 8 8 0.0
p11.pddl
None None - 8 8 0.0
p12.pddl
None None - 3 3 0.0
p13.pddl
None None - 14 14 0.0
p14.pddl
None None - 16 16 0.0
p15.pddl
None None - 43 43 0.0
p16.pddl
None None - 80 80 0.0
p17.pddl
None None - 32 32 0.0
p18.pddl
None None - 1 1 0.0
p19.pddl
None None - 40 40 0.0
p20.pddl
None None - 23 23 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
spider-opt18-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 64 64 0.0
p02.pddl
None None - 82 82 0.0
p03.pddl
None None - 100 100 0.0
p04.pddl
None None - 124 124 0.0
p05.pddl
None None - 154 154 0.0
p06.pddl
None None - 176 176 0.0
p07.pddl
None None - 52 52 0.0
p08.pddl
None None - 71 71 0.0
p09.pddl
None None - 91 91 0.0
p10.pddl
None None - 109 109 0.0
p11.pddl
None None - 130 130 0.0
p12.pddl
None None - 147 147 0.0
p13.pddl
None None - 165 165 0.0
p14.pddl
None None - 49 49 0.0
p15.pddl
None None - 74 74 0.0
p16.pddl
None None - 82 82 0.0
p17.pddl
None None - 112 112 0.0
p18.pddl
None None - 131 131 0.0
p19.pddl
None None - 139 139 0.0
p20.pddl
None None - 170 170 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
storage
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 4 4 0.0
p02.pddl
None None - 2 2 0.0
p03.pddl
None None - 2 2 0.0
p04.pddl
None None - 6 6 0.0
p05.pddl
None None - 2 2 0.0
p06.pddl
None None - 2 2 0.0
p07.pddl
None None - 8 8 0.0
p08.pddl
None None - 3 3 0.0
p09.pddl
None None - 3 3 0.0
p10.pddl
None None - 10 10 0.0
p11.pddl
None None - 4 4 0.0
p12.pddl
None None - 4 4 0.0
p13.pddl
None None - 12 12 0.0
p14.pddl
None None - 5 5 0.0
p15.pddl
None None - 5 5 0.0
p16.pddl
None None - 6 6 0.0
p17.pddl
None None - 7 7 0.0
p18.pddl
None None - 8 8 0.0
p19.pddl
None None - 9 9 0.0
p20.pddl
None None - 10 10 0.0
p21.pddl
None None - 11 11 0.0
p22.pddl
None None - 12 12 0.0
p23.pddl
None None - 13 13 0.0
p24.pddl
None None - 14 14 0.0
p25.pddl
None None - 15 15 0.0
p26.pddl
None None - 16 16 0.0
p27.pddl
None None - 17 17 0.0
p28.pddl
None None - 18 18 0.0
p29.pddl
None None - 19 19 0.0
p30.pddl
None None - 20 20 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
termes-opt18-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 4 4 0.0
p02.pddl
None None - 10 10 0.0
p03.pddl
None None - 5 5 0.0
p04.pddl
None None - 8 8 0.0
p05.pddl
None None - 6 6 0.0
p06.pddl
None None - 11 11 0.0
p07.pddl
None None - 13 13 0.0
p08.pddl
None None - 15 15 0.0
p09.pddl
None None - 8 8 0.0
p10.pddl
None None - 13 13 0.0
p11.pddl
None None - 10 10 0.0
p12.pddl
None None - 11 11 0.0
p13.pddl
None None - 14 14 0.0
p14.pddl
None None - 15 15 0.0
p15.pddl
None None - 14 14 0.0
p16.pddl
None None - 17 17 0.0
p17.pddl
None None - 16 16 0.0
p18.pddl
None None - 15 15 0.0
p19.pddl
None None - 15 15 0.0
p20.pddl
None None - 19 19 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
tetris-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
None None - 10 10 0.0
p01-8.pddl
None None - 9 9 0.0
p01-10.pddl
None None - 10 10 0.0
p02-4.pddl
None None - 4 4 0.0
p02-6.pddl
None None - 8 8 0.0
p02-8.pddl
None None - 11 11 0.0
p02-10.pddl
None None - 12 12 0.0
p03-4.pddl
None None - 5 5 0.0
p03-6.pddl
None None - 7 7 0.0
p03-8.pddl
None None - 10 10 0.0
p03-10.pddl
None None - 14 14 0.0
p04-6.pddl
None None - 8 8 0.0
p04-8.pddl
None None - 14 14 0.0
p04-10.pddl
None None - 13 13 0.0
p05-6.pddl
None None - 7 7 0.0
p05-8.pddl
None None - 12 12 0.0
p05-10.pddl
None None - 12 12 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
tidybot-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 4 4 0.0
p02.pddl
None None - 21 21 0.0
p03.pddl
None None - 13 13 0.0
p04.pddl
None None - 26 26 0.0
p05.pddl
None None - 19 19 0.0
p06.pddl
None None - 22 22 0.0
p07.pddl
None None - 13 13 0.0
p08.pddl
None None - 19 19 0.0
p09.pddl
None None - 16 16 0.0
p10.pddl
None None - 17 17 0.0
p11.pddl
None None - 14 14 0.0
p12.pddl
None None - 17 17 0.0
p13.pddl
None None - 14 14 0.0
p14.pddl
None None - 9 9 0.0
p15.pddl
None None - 8 8 0.0
p16.pddl
None None - 11 11 0.0
p17.pddl
None None - 11 11 0.0
p18.pddl
None None - 13 13 0.0
p19.pddl
None None - 10 10 0.0
p20.pddl
None None - 19 19 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
tidybot-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 12 12 0.0
p02.pddl
None None - 13 13 0.0
p03.pddl
None None - 13 13 0.0
p04.pddl
None None - 7 7 0.0
p05.pddl
None None - 12 12 0.0
p06.pddl
None None - 14 14 0.0
p07.pddl
None None - 11 11 0.0
p08.pddl
None None - 12 12 0.0
p09.pddl
None None - 8 8 0.0
p10.pddl
None None - 12 12 0.0
p11.pddl
None None - 14 14 0.0
p12.pddl
None None - 17 17 0.0
p13.pddl
None None - 14 14 0.0
p14.pddl
None None - 9 9 0.0
p15.pddl
None None - 8 8 0.0
p16.pddl
None None - 11 11 0.0
p17.pddl
None None - 11 11 0.0
p18.pddl
None None - 13 13 0.0
p19.pddl
None None - 10 10 0.0
p20.pddl
None None - 19 19 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
tpp
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 4 4 0.0
p02.pddl
None None - 7 7 0.0
p03.pddl
None None - 10 10 0.0
p04.pddl
None None - 13 13 0.0
p05.pddl
None None - 10 10 0.0
p06.pddl
None None - 12 12 0.0
p07.pddl
None None - 16 16 0.0
p08.pddl
None None - 19 19 0.0
p09.pddl
None None - 20 20 0.0
p10.pddl
None None - 22 22 0.0
p11.pddl
None None - 19 19 0.0
p12.pddl
None None - 19 19 0.0
p13.pddl
None None - 14 14 0.0
p14.pddl
None None - 20 20 0.0
p15.pddl
None None - 24 24 0.0
p16.pddl
None None - 28 28 0.0
p17.pddl
None None - 23 23 0.0
p18.pddl
None None - 22 22 0.0
p19.pddl
None None - 31 31 0.0
p20.pddl
None None - 36 36 0.0
p21.pddl
None None - 36 36 0.0
p22.pddl
None None - 27 27 0.0
p23.pddl
None None - 35 35 0.0
p24.pddl
None None - 35 35 0.0
p25.pddl
None None - 43 43 0.0
p26.pddl
None None - 44 44 0.0
p27.pddl
None None - 48 48 0.0
p28.pddl
None None - 50 50 0.0
p29.pddl
None None - 61 61 0.0
p30.pddl
None None - 58 58 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
transport-opt08-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 2 2 0.0
p02.pddl
None None - 3 3 0.0
p03.pddl
None None - 4 4 0.0
p04.pddl
None None - 5 5 0.0
p05.pddl
None None - 6 6 0.0
p06.pddl
None None - 7 7 0.0
p07.pddl
None None - 8 8 0.0
p08.pddl
None None - 9 9 0.0
p09.pddl
None None - 10 10 0.0
p10.pddl
None None - 11 11 0.0
p11.pddl
None None - 2 2 0.0
p12.pddl
None None - 3 3 0.0
p13.pddl
None None - 4 4 0.0
p14.pddl
None None - 5 5 0.0
p15.pddl
None None - 6 6 0.0
p16.pddl
None None - 7 7 0.0
p17.pddl
None None - 8 8 0.0
p18.pddl
None None - 9 9 0.0
p19.pddl
None None - 10 10 0.0
p20.pddl
None None - 11 11 0.0
p21.pddl
None None - 2 2 0.0
p22.pddl
None None - 3 3 0.0
p23.pddl
None None - 4 4 0.0
p24.pddl
None None - 5 5 0.0
p25.pddl
None None - 6 6 0.0
p26.pddl
None None - 7 7 0.0
p27.pddl
None None - 8 8 0.0
p28.pddl
None None - 9 9 0.0
p29.pddl
None None - 10 10 0.0
p30.pddl
None None - 11 11 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
transport-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 4 4 0.0
p02.pddl
None None - 4 4 0.0
p03.pddl
None None - 3 3 0.0
p04.pddl
None None - 4 4 0.0
p05.pddl
None None - 5 5 0.0
p06.pddl
None None - 5 5 0.0
p07.pddl
None None - 6 6 0.0
p08.pddl
None None - 6 6 0.0
p09.pddl
None None - 7 7 0.0
p10.pddl
None None - 7 7 0.0
p11.pddl
None None - 8 8 0.0
p12.pddl
None None - 8 8 0.0
p13.pddl
None None - 8 8 0.0
p14.pddl
None None - 8 8 0.0
p15.pddl
None None - 9 9 0.0
p16.pddl
None None - 9 9 0.0
p17.pddl
None None - 6 6 0.0
p18.pddl
None None - 5 5 0.0
p19.pddl
None None - 6 6 0.0
p20.pddl
None None - 7 7 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
transport-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 4 4 0.0
p02.pddl
None None - 4 4 0.0
p03.pddl
None None - 5 5 0.0
p04.pddl
None None - 5 5 0.0
p05.pddl
None None - 6 6 0.0
p06.pddl
None None - 6 6 0.0
p07.pddl
None None - 4 4 0.0
p08.pddl
None None - 4 4 0.0
p09.pddl
None None - 5 5 0.0
p10.pddl
None None - 5 5 0.0
p11.pddl
None None - 6 6 0.0
p12.pddl
None None - 6 6 0.0
p13.pddl
None None - 4 4 0.0
p14.pddl
None None - 4 4 0.0
p15.pddl
None None - 5 5 0.0
p16.pddl
None None - 5 5 0.0
p17.pddl
None None - 6 6 0.0
p18.pddl
None None - 6 6 0.0
p19.pddl
None None - 7 7 0.0
p20.pddl
None None - 7 7 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
trucks-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 9 9 0.0
p02.pddl
None None - 11 11 0.0
p03.pddl
None None - 13 13 0.0
p04.pddl
None None - 15 15 0.0
p05.pddl
None None - 17 17 0.0
p06.pddl
None None - 19 19 0.0
p07.pddl
None None - 15 15 0.0
p08.pddl
None None - 18 18 0.0
p09.pddl
None None - 19 19 0.0
p10.pddl
None None - 22 22 0.0
p11.pddl
None None - 24 24 0.0
p12.pddl
None None - 26 26 0.0
p13.pddl
None None - 22 22 0.0
p14.pddl
None None - 25 25 0.0
p15.pddl
None None - 27 27 0.0
p16.pddl
None None - 29 29 0.0
p17.pddl
None None - 31 31 0.0
p18.pddl
None None - 33 33 0.0
p19.pddl
None None - 30 30 0.0
p20.pddl
None None - 32 32 0.0
p21.pddl
None None - 34 34 0.0
p22.pddl
None None - 36 36 0.0
p23.pddl
None None - 38 38 0.0
p24.pddl
None None - 40 40 0.0
p25.pddl
None None - 36 36 0.0
p26.pddl
None None - 39 39 0.0
p27.pddl
None None - 41 41 0.0
p28.pddl
None None - 43 43 0.0
p29.pddl
None None - 45 45 0.0
p30.pddl
None None - 47 47 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
visitall-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
None None - 3 3 0.0
problem02-half.pddl
None None - 1 1 0.0
problem03-full.pddl
None None - 8 8 0.0
problem03-half.pddl
None None - 4 4 0.0
problem04-full.pddl
None None - 15 15 0.0
problem04-half.pddl
None None - 7 7 0.0
problem05-full.pddl
None None - 24 24 0.0
problem05-half.pddl
None None - 14 14 0.0
problem06-full.pddl
None None - 35 35 0.0
problem06-half.pddl
None None - 15 15 0.0
problem07-full.pddl
None None - 48 48 0.0
problem07-half.pddl
None None - 32 32 0.0
problem08-full.pddl
None None - 63 63 0.0
problem08-half.pddl
None None - 32 32 0.0
problem09-full.pddl
None None - 80 80 0.0
problem09-half.pddl
None None - 49 49 0.0
problem10-full.pddl
None None - 99 99 0.0
problem10-half.pddl
None None - 47 47 0.0
problem11-full.pddl
None None - 120 120 0.0
problem11-half.pddl
None None - 57 57 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
visitall-opt14-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
None None - 24 24 0.0
p-1-6.pddl
None None - 35 35 0.0
p-1-7.pddl
None None - 48 48 0.0
p-1-8.pddl
None None - 63 63 0.0
p-1-9.pddl
None None - 80 80 0.0
p-1-10.pddl
None None - 99 99 0.0
p-1-11.pddl
None None - 120 120 0.0
p-1-12.pddl
None None - 143 143 0.0
p-1-13.pddl
None None - 168 168 0.0
p-1-14.pddl
None None - 195 195 0.0
p-1-15.pddl
None None - 224 224 0.0
p-1-16.pddl
None None - 255 255 0.0
p-1-17.pddl
None None - 288 288 0.0
p-1-18.pddl
None None - 323 323 0.0
p-05-5.pddl
None None - 17 17 0.0
p-05-6.pddl
None None - 17 17 0.0
p-05-7.pddl
None None - 23 23 0.0
p-05-8.pddl
None None - 30 30 0.0
p-05-9.pddl
None None - 41 41 0.0
p-05-10.pddl
None None - 45 45 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
woodworking-opt08-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 17 17 0.0
p02.pddl
None None - 16 16 0.0
p03.pddl
None None - 27 27 0.0
p04.pddl
None None - 26 26 0.0
p05.pddl
None None - 33 33 0.0
p06.pddl
None None - 40 40 0.0
p07.pddl
None None - 43 43 0.0
p08.pddl
None None - 44 44 0.0
p09.pddl
None None - 46 46 0.0
p10.pddl
None None - 54 54 0.0
p11.pddl
None None - 15 15 0.0
p12.pddl
None None - 22 22 0.0
p13.pddl
None None - 26 26 0.0
p14.pddl
None None - 28 28 0.0
p15.pddl
None None - 32 32 0.0
p16.pddl
None None - 29 29 0.0
p17.pddl
None None - 43 43 0.0
p18.pddl
None None - 46 46 0.0
p19.pddl
None None - 44 44 0.0
p20.pddl
None None - 57 57 0.0
p21.pddl
None None - 12 12 0.0
p22.pddl
None None - 18 18 0.0
p23.pddl
None None - 23 23 0.0
p24.pddl
None None - 26 26 0.0
p25.pddl
None None - 42 42 0.0
p26.pddl
None None - 38 38 0.0
p27.pddl
None None - 43 43 0.0
p28.pddl
None None - 47 47 0.0
p29.pddl
None None - 56 56 0.0
p30.pddl
None None - 68 68 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
woodworking-opt11-strips
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 23 23 0.0
p02.pddl
None None - 22 22 0.0
p03.pddl
None None - 26 26 0.0
p04.pddl
None None - 27 27 0.0
p05.pddl
None None - 26 26 0.0
p06.pddl
None None - 26 26 0.0
p07.pddl
None None - 28 28 0.0
p08.pddl
None None - 42 42 0.0
p09.pddl
None None - 33 33 0.0
p10.pddl
None None - 32 32 0.0
p11.pddl
None None - 38 38 0.0
p12.pddl
None None - 29 29 0.0
p13.pddl
None None - 40 40 0.0
p14.pddl
None None - 43 43 0.0
p15.pddl
None None - 43 43 0.0
p16.pddl
None None - 43 43 0.0
p17.pddl
None None - 47 47 0.0
p18.pddl
None None - 46 46 0.0
p19.pddl
None None - 44 44 0.0
p20.pddl
None None - 56 56 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
zenotravel
Show table
initial_h_value
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
None None - 1 1 0.0
p02.pddl
None None - 4 4 0.0
p03.pddl
None None - 2 2 0.0
p04.pddl
None None - 3 3 0.0
p05.pddl
None None - 4 4 0.0
p06.pddl
None None - 4 4 0.0
p07.pddl
None None - 4 4 0.0
p08.pddl
None None - 4 4 0.0
p09.pddl
None None - 7 7 0.0
p10.pddl
None None - 9 9 0.0
p11.pddl
None None - 5 5 0.0
p12.pddl
None None - 7 7 0.0
p13.pddl
None None - 9 9 0.0
p14.pddl
None None - 12 12 0.0
p15.pddl
None None - 12 12 0.0
p16.pddl
None None - 15 15 0.0
p17.pddl
None None - 21 21 0.0
p18.pddl
None None - 19 19 0.0
p19.pddl
None None - 24 24 0.0
p20.pddl
None None - 25 25 0.0
Sum of diffs
None
0.00
Arithmetic mean of diffs
None
0.00
landmarks
Show table
Only instances where all algorithms have a value for "landmarks" are considered. Each table entry gives the sum of "landmarks" for that domain. The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
52 52 0.0 31 31 0.0
p02.pddl
53 53 0.0 32 32 0.0
p03.pddl
53 53 0.0 32 32 0.0
p04.pddl
62 62 0.0 37 37 0.0
p05.pddl
62 62 0.0 37 37 0.0
p06.pddl
62 62 0.0 37 37 0.0
p07.pddl
71 71 0.0 42 42 0.0
p08.pddl
71 71 0.0 42 42 0.0
p09.pddl
71 71 0.0 42 42 0.0
p10.pddl
80 80 0.0 47 47 0.0
p11.pddl
80 80 0.0 47 47 0.0
p12.pddl
80 80 0.0 47 47 0.0
p13.pddl
89 89 0.0 52 52 0.0
p14.pddl
88 88 0.0 51 51 0.0
p15.pddl
89 89 0.0 52 52 0.0
p16.pddl
98 98 0.0 57 57 0.0
p17.pddl
98 98 0.0 57 57 0.0
p18.pddl
98 98 0.0 57 57 0.0
p19.pddl
107 107 0.0 62 62 0.0
p20.pddl
107 107 0.0 62 62 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
airport
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
28 28 0.0 28 28 0.0
p02-airport1-p1.pddl
27 27 0.0 27 27 0.0
p03-airport1-p2.pddl
65 65 0.0 61 61 0.0
p04-airport2-p1.pddl
66 66 0.0 66 66 0.0
p05-airport2-p1.pddl
65 65 0.0 65 65 0.0
p06-airport2-p2.pddl
149 149 0.0 148 148 0.0
p07-airport2-p2.pddl
149 149 0.0 146 146 0.0
p08-airport2-p3.pddl
209 209 0.0 206 206 0.0
p09-airport2-p4.pddl
265 265 0.0 257 257 0.0
p10-airport3-p1.pddl
60 60 0.0 60 60 0.0
p11-airport3-p1.pddl
67 67 0.0 67 67 0.0
p12-airport3-p2.pddl
149 149 0.0 148 148 0.0
p13-airport3-p2.pddl
139 139 0.0 136 136 0.0
p14-airport3-p3.pddl
210 210 0.0 209 209 0.0
p15-airport3-p3.pddl
207 207 0.0 204 204 0.0
p16-airport3-p4.pddl
269 269 0.0 266 266 0.0
p17-airport3-p5.pddl
327 327 0.0 319 319 0.0
p18-airport3-p6.pddl
391 391 0.0 383 383 0.0
p19-airport3-p6.pddl
361 361 0.0 347 347 0.0
p20-airport3-p7.pddl
452 452 0.0 439 439 0.0
p21-airport4halfMUC-p2.pddl
397 397 0.0 398 398 0.0
p22-airport4halfMUC-p3.pddl
580 580 0.0 574 574 0.0
p23-airport4halfMUC-p4.pddl
740 740 0.0 740 740 0.0
p24-airport4halfMUC-p4.pddl
679 679 0.0 679 679 0.0
p25-airport4halfMUC-p5.pddl
855 855 0.0 847 847 0.0
p26-airport4halfMUC-p6.pddl
1032 1032 0.0 1030 1030 0.0
p27-airport4halfMUC-p6.pddl
1087 1087 0.0 1087 1087 0.0
p28-airport4halfMUC-p7.pddl
1290 1290 0.0 1281 1281 0.0
p29-airport4halfMUC-p8.pddl
1464 1464 0.0 1452 1452 0.0
p30-airport4halfMUC-p8.pddl
1403 1403 0.0 1403 1403 0.0
p31-airport4halfMUC-p9.pddl
1635 1635 0.0 1626 1626 0.0
p32-airport4halfMUC-p10.pddl
1818 1818 0.0 1804 1804 0.0
p33-airport4halfMUC-p10.pddl
1815 1815 0.0 1806 1806 0.0
p34-airport4halfMUC-p11.pddl
1993 1993 0.0 1979 1979 0.0
p35-airport4halfMUC-p12.pddl
2145 2145 0.0 2126 2126 0.0
p36-airport5MUC-p2.pddl
327 327 0.0 315 315 0.0
p37-airport5MUC-p3.pddl
361 361 0.0 325 325 0.0
p38-airport5MUC-p3.pddl
516 516 0.0 492 492 0.0
p39-airport5MUC-p4.pddl
477 477 0.0 425 425 0.0
p40-airport5MUC-p4.pddl
666 666 0.0 630 630 0.0
p41-airport5MUC-p4.pddl
710 710 0.0 684 684 0.0
p42-airport5MUC-p5.pddl
823 823 0.0 771 771 0.0
p43-airport5MUC-p5.pddl
871 871 0.0 833 833 0.0
p44-airport5MUC-p5.pddl
963 963 0.0 922 922 0.0
p45-airport5MUC-p6.pddl
1124 1124 0.0 1076 1076 0.0
p46-airport5MUC-p6.pddl
1043 1043 0.0 989 989 0.0
p47-airport5MUC-p8.pddl
1491 1491 0.0 1415 1415 0.0
p48-airport5MUC-p9.pddl
1563 1563 0.0 1465 1465 0.0
p49-airport5MUC-p10.pddl
1872 1872 0.0 1768 1768 0.0
p50-airport5MUC-p15.pddl
2808 2808 0.0 2632 2632 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
37 37 0.0 24 24 0.0
pfile01-002.pddl
37 37 0.0 24 24 0.0
pfile01-003.pddl
37 37 0.0 24 24 0.0
pfile01-004.pddl
37 37 0.0 24 24 0.0
pfile02-005.pddl
40 40 0.0 28 28 0.0
pfile02-006.pddl
40 40 0.0 28 28 0.0
pfile02-007.pddl
40 40 0.0 28 28 0.0
pfile02-008.pddl
40 40 0.0 28 28 0.0
pfile03-009.pddl
46 46 0.0 32 32 0.0
pfile03-010.pddl
46 46 0.0 32 32 0.0
pfile03-011.pddl
46 46 0.0 32 32 0.0
pfile03-012.pddl
46 46 0.0 32 32 0.0
pfile04-013.pddl
56 56 0.0 39 39 0.0
pfile04-014.pddl
56 56 0.0 39 39 0.0
pfile04-015.pddl
56 56 0.0 39 39 0.0
pfile04-016.pddl
56 56 0.0 39 39 0.0
pfile05-017.pddl
62 62 0.0 43 43 0.0
pfile05-018.pddl
62 62 0.0 43 43 0.0
pfile05-019.pddl
62 62 0.0 43 43 0.0
pfile05-020.pddl
62 62 0.0 43 43 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
barman-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
40 40 0.0 28 28 0.0
p435-2.pddl
40 40 0.0 28 28 0.0
p435-3.pddl
40 40 0.0 28 28 0.0
p536-1.pddl
46 46 0.0 32 32 0.0
p536-2.pddl
46 46 0.0 32 32 0.0
p536-3.pddl
46 46 0.0 32 32 0.0
p638-1.pddl
56 56 0.0 39 39 0.0
p638-2.pddl
56 56 0.0 39 39 0.0
p638-3.pddl
56 56 0.0 39 39 0.0
p739-1.pddl
62 62 0.0 43 43 0.0
p739-2.pddl
62 62 0.0 43 43 0.0
p739-3.pddl
62 62 0.0 43 43 0.0
p839-1.pddl
64 64 0.0 44 44 0.0
p839-2.pddl
64 64 0.0 44 44 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
blocks
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
14 14 0.0 14 14 0.0
probBLOCKS-4-1.pddl
16 16 0.0 13 13 0.0
probBLOCKS-4-2.pddl
15 15 0.0 14 14 0.0
probBLOCKS-5-0.pddl
20 20 0.0 17 17 0.0
probBLOCKS-5-1.pddl
18 18 0.0 16 16 0.0
probBLOCKS-5-2.pddl
23 23 0.0 19 19 0.0
probBLOCKS-6-0.pddl
27 27 0.0 23 23 0.0
probBLOCKS-6-1.pddl
23 23 0.0 22 22 0.0
probBLOCKS-6-2.pddl
28 28 0.0 23 23 0.0
probBLOCKS-7-0.pddl
33 33 0.0 27 27 0.0
probBLOCKS-7-1.pddl
30 30 0.0 25 25 0.0
probBLOCKS-7-2.pddl
30 30 0.0 25 25 0.0
probBLOCKS-8-0.pddl
32 32 0.0 28 28 0.0
probBLOCKS-8-1.pddl
31 31 0.0 27 27 0.0
probBLOCKS-8-2.pddl
33 33 0.0 30 30 0.0
probBLOCKS-9-0.pddl
40 40 0.0 33 33 0.0
probBLOCKS-9-1.pddl
41 41 0.0 33 33 0.0
probBLOCKS-9-2.pddl
42 42 0.0 35 35 0.0
probBLOCKS-10-0.pddl
46 46 0.0 38 38 0.0
probBLOCKS-10-1.pddl
47 47 0.0 39 39 0.0
probBLOCKS-10-2.pddl
47 47 0.0 39 39 0.0
probBLOCKS-11-0.pddl
47 47 0.0 39 39 0.0
probBLOCKS-11-1.pddl
50 50 0.0 43 43 0.0
probBLOCKS-11-2.pddl
48 48 0.0 39 39 0.0
probBLOCKS-12-0.pddl
54 54 0.0 45 45 0.0
probBLOCKS-12-1.pddl
56 56 0.0 46 46 0.0
probBLOCKS-13-0.pddl
60 60 0.0 50 50 0.0
probBLOCKS-13-1.pddl
62 62 0.0 51 51 0.0
probBLOCKS-14-0.pddl
62 62 0.0 51 51 0.0
probBLOCKS-14-1.pddl
64 64 0.0 55 55 0.0
probBLOCKS-15-0.pddl
67 67 0.0 57 57 0.0
probBLOCKS-15-1.pddl
70 70 0.0 57 57 0.0
probBLOCKS-16-1.pddl
76 76 0.0 63 63 0.0
probBLOCKS-16-2.pddl
72 72 0.0 58 58 0.0
probBLOCKS-17-0.pddl
79 79 0.0 67 67 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
childsnack-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
15 15 0.0 6 6 0.0
child-snack_pfile01.pddl
14 14 0.0 6 6 0.0
child-snack_pfile02-2.pddl
17 17 0.0 7 7 0.0
child-snack_pfile02.pddl
16 16 0.0 7 7 0.0
child-snack_pfile03-2.pddl
19 19 0.0 8 8 0.0
child-snack_pfile03.pddl
19 19 0.0 8 8 0.0
child-snack_pfile04-2.pddl
21 21 0.0 9 9 0.0
child-snack_pfile04.pddl
21 21 0.0 9 9 0.0
child-snack_pfile05-2.pddl
23 23 0.0 10 10 0.0
child-snack_pfile05.pddl
23 23 0.0 10 10 0.0
child-snack_pfile06-2.pddl
25 25 0.0 11 11 0.0
child-snack_pfile06.pddl
25 25 0.0 11 11 0.0
child-snack_pfile07-2.pddl
27 27 0.0 12 12 0.0
child-snack_pfile07.pddl
27 27 0.0 12 12 0.0
child-snack_pfile08-2.pddl
29 29 0.0 13 13 0.0
child-snack_pfile08.pddl
29 29 0.0 13 13 0.0
child-snack_pfile09-2.pddl
31 31 0.0 14 14 0.0
child-snack_pfile09.pddl
31 31 0.0 14 14 0.0
child-snack_pfile10-2.pddl
33 33 0.0 15 15 0.0
child-snack_pfile10.pddl
33 33 0.0 15 15 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
data-network-opt18-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
4 4 0.0 10 10 0.0
p02.pddl
4 4 0.0 5 5 0.0
p03.pddl
8 8 0.0 13 13 0.0
p04.pddl
12 12 0.0 16 16 0.0
p05.pddl
13 13 0.0 14 14 0.0
p06.pddl
8 8 0.0 9 9 0.0
p07.pddl
12 12 0.0 14 14 0.0
p08.pddl
13 13 0.0 16 16 0.0
p09.pddl
4 4 0.0 7 7 0.0
p10.pddl
8 8 0.0 8 8 0.0
p11.pddl
4 4 0.0 5 5 0.0
p12.pddl
4 4 0.0 7 7 0.0
p13.pddl
8 8 0.0 11 11 0.0
p14.pddl
24 24 0.0 22 22 0.0
p15.pddl
4 4 0.0 7 7 0.0
p16.pddl
8 8 0.0 13 13 0.0
p17.pddl
8 8 0.0 8 8 0.0
p18.pddl
12 12 0.0 17 17 0.0
p19.pddl
12 12 0.0 16 16 0.0
p20.pddl
12 12 0.0 15 15 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
depot
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
21 21 0.0 17 17 0.0
p02.pddl
29 29 0.0 25 25 0.0
p03.pddl
47 47 0.0 38 38 0.0
p04.pddl
53 53 0.0 43 43 0.0
p05.pddl
71 71 0.0 57 57 0.0
p06.pddl
93 93 0.0 75 75 0.0
p07.pddl
38 38 0.0 33 33 0.0
p08.pddl
71 71 0.0 56 56 0.0
p09.pddl
103 103 0.0 83 83 0.0
p10.pddl
43 43 0.0 37 37 0.0
p11.pddl
70 70 0.0 65 65 0.0
p12.pddl
98 98 0.0 83 83 0.0
p13.pddl
56 56 0.0 46 46 0.0
p14.pddl
48 48 0.0 42 42 0.0
p15.pddl
99 99 0.0 87 87 0.0
p16.pddl
47 47 0.0 34 34 0.0
p17.pddl
42 42 0.0 32 32 0.0
p18.pddl
105 105 0.0 72 72 0.0
p19.pddl
60 60 0.0 52 52 0.0
p20.pddl
100 100 0.0 92 92 0.0
p21.pddl
41 41 0.0 48 48 0.0
p22.pddl
105 105 0.0 123 123 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
driverlog
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
10 10 0.0 7 7 0.0
p02.pddl
21 21 0.0 16 16 0.0
p03.pddl
15 15 0.0 10 10 0.0
p04.pddl
20 20 0.0 16 16 0.0
p05.pddl
24 24 0.0 17 17 0.0
p06.pddl
20 20 0.0 17 17 0.0
p07.pddl
22 22 0.0 17 17 0.0
p08.pddl
27 27 0.0 20 20 0.0
p09.pddl
27 27 0.0 19 19 0.0
p10.pddl
21 21 0.0 14 14 0.0
p11.pddl
24 24 0.0 14 14 0.0
p12.pddl
32 32 0.0 21 21 0.0
p13.pddl
29 29 0.0 18 18 0.0
p14.pddl
33 33 0.0 20 20 0.0
p15.pddl
38 38 0.0 21 21 0.0
p16.pddl
40 40 0.0 43 43 0.0
p17.pddl
47 47 0.0 50 50 0.0
p18.pddl
46 46 0.0 50 50 0.0
p19.pddl
65 65 0.0 70 70 0.0
p20.pddl
63 63 0.0 65 65 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt08-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
18 18 0.0 13 13 0.0
p02.pddl
14 14 0.0 11 11 0.0
p03.pddl
23 23 0.0 19 19 0.0
p04.pddl
24 24 0.0 20 20 0.0
p05.pddl
29 29 0.0 23 23 0.0
p06.pddl
31 31 0.0 23 23 0.0
p07.pddl
29 29 0.0 24 24 0.0
p08.pddl
24 24 0.0 17 17 0.0
p09.pddl
40 40 0.0 27 27 0.0
p10.pddl
37 37 0.0 27 27 0.0
p11.pddl
23 23 0.0 18 18 0.0
p12.pddl
20 20 0.0 19 19 0.0
p13.pddl
22 22 0.0 20 20 0.0
p14.pddl
29 29 0.0 25 25 0.0
p15.pddl
30 30 0.0 25 25 0.0
p16.pddl
34 34 0.0 27 27 0.0
p17.pddl
32 32 0.0 27 27 0.0
p18.pddl
34 34 0.0 30 30 0.0
p19.pddl
42 42 0.0 31 31 0.0
p20.pddl
37 37 0.0 31 31 0.0
p21.pddl
21 21 0.0 20 20 0.0
p22.pddl
13 13 0.0 11 11 0.0
p23.pddl
28 28 0.0 23 23 0.0
p24.pddl
28 28 0.0 21 21 0.0
p25.pddl
31 31 0.0 28 28 0.0
p26.pddl
27 27 0.0 28 28 0.0
p27.pddl
41 41 0.0 31 31 0.0
p28.pddl
30 30 0.0 27 27 0.0
p29.pddl
37 37 0.0 25 25 0.0
p30.pddl
43 43 0.0 32 32 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
elevators-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
23 23 0.0 18 18 0.0
p02.pddl
21 21 0.0 20 20 0.0
p03.pddl
20 20 0.0 19 19 0.0
p04.pddl
23 23 0.0 19 19 0.0
p05.pddl
22 22 0.0 20 20 0.0
p06.pddl
24 24 0.0 20 20 0.0
p07.pddl
27 27 0.0 28 28 0.0
p08.pddl
29 29 0.0 23 23 0.0
p09.pddl
13 13 0.0 11 11 0.0
p10.pddl
29 29 0.0 25 25 0.0
p11.pddl
30 30 0.0 27 27 0.0
p12.pddl
31 31 0.0 23 23 0.0
p13.pddl
29 29 0.0 24 24 0.0
p14.pddl
24 24 0.0 17 17 0.0
p15.pddl
40 40 0.0 27 27 0.0
p16.pddl
30 30 0.0 25 25 0.0
p17.pddl
32 32 0.0 27 27 0.0
p18.pddl
34 34 0.0 30 30 0.0
p19.pddl
28 28 0.0 23 23 0.0
p20.pddl
28 28 0.0 21 21 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
25 25 0.0 19 19 0.0
opt-p01-002.pddl
26 26 0.0 20 20 0.0
opt-p02-003.pddl
30 30 0.0 24 24 0.0
opt-p02-004.pddl
31 31 0.0 25 25 0.0
opt-p03-005.pddl
43 43 0.0 32 32 0.0
opt-p03-006.pddl
42 42 0.0 32 32 0.0
opt-p04-007.pddl
43 43 0.0 34 34 0.0
opt-p04-008.pddl
42 42 0.0 33 33 0.0
opt-p05-009.pddl
54 54 0.0 42 42 0.0
opt-p05-010.pddl
55 55 0.0 42 42 0.0
opt-p06-011.pddl
66 66 0.0 50 50 0.0
opt-p06-012.pddl
66 66 0.0 50 50 0.0
opt-p07-013.pddl
68 68 0.0 52 52 0.0
opt-p07-014.pddl
65 65 0.0 51 51 0.0
opt-p08-015.pddl
71 71 0.0 63 63 0.0
opt-p08-016.pddl
71 71 0.0 63 63 0.0
opt-p09-017.pddl
81 81 0.0 73 73 0.0
opt-p09-018.pddl
82 82 0.0 74 74 0.0
opt-p10-019.pddl
82 82 0.0 74 74 0.0
opt-p10-020.pddl
84 84 0.0 75 75 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
floortile-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
31 31 0.0 25 25 0.0
p01-4-4-2.pddl
44 44 0.0 34 34 0.0
p01-5-3-2.pddl
42 42 0.0 32 32 0.0
p01-5-4-2.pddl
52 52 0.0 41 41 0.0
p01-5-5-2.pddl
66 66 0.0 51 51 0.0
p01-6-4-2.pddl
66 66 0.0 50 50 0.0
p01-6-5-2.pddl
82 82 0.0 62 62 0.0
p02-4-4-2.pddl
42 42 0.0 33 33 0.0
p02-5-3-2.pddl
41 41 0.0 32 32 0.0
p02-5-4-2.pddl
53 53 0.0 41 41 0.0
p02-5-5-2.pddl
67 67 0.0 52 52 0.0
p02-6-4-2.pddl
64 64 0.0 49 49 0.0
p02-6-5-2.pddl
82 82 0.0 62 62 0.0
p03-4-3-2.pddl
34 34 0.0 26 26 0.0
p03-4-4-2.pddl
44 44 0.0 34 34 0.0
p03-5-3-2.pddl
41 41 0.0 32 32 0.0
p03-5-4-2.pddl
54 54 0.0 42 42 0.0
p03-5-5-2.pddl
67 67 0.0 52 52 0.0
p03-6-4-2.pddl
64 64 0.0 49 49 0.0
p03-6-5-2.pddl
82 82 0.0 62 62 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
freecell
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
25 25 0.0 29 29 0.0
p02.pddl
34 34 0.0 41 41 0.0
p03.pddl
51 51 0.0 53 53 0.0
p04.pddl
60 60 0.0 66 66 0.0
p05.pddl
72 72 0.0 77 77 0.0
p06.pddl
84 84 0.0 89 89 0.0
p07.pddl
85 85 0.0 90 90 0.0
p08.pddl
95 95 0.0 102 102 0.0
p09.pddl
94 94 0.0 102 102 0.0
p10.pddl
106 106 0.0 114 114 0.0
p11.pddl
107 107 0.0 114 114 0.0
p12.pddl
108 108 0.0 114 114 0.0
p13.pddl
120 120 0.0 125 125 0.0
p14.pddl
118 118 0.0 125 125 0.0
p15.pddl
129 129 0.0 138 138 0.0
p16.pddl
131 131 0.0 137 137 0.0
p17.pddl
145 145 0.0 149 149 0.0
p18.pddl
141 141 0.0 150 150 0.0
p19.pddl
152 152 0.0 162 162 0.0
p20.pddl
153 153 0.0 162 162 0.0
probfreecell-2-1.pddl
20 20 0.0 29 29 0.0
probfreecell-2-2.pddl
24 24 0.0 29 29 0.0
probfreecell-2-3.pddl
25 25 0.0 29 29 0.0
probfreecell-2-4.pddl
23 23 0.0 29 29 0.0
probfreecell-2-5.pddl
22 22 0.0 29 29 0.0
probfreecell-3-1.pddl
31 31 0.0 41 41 0.0
probfreecell-3-2.pddl
35 35 0.0 41 41 0.0
probfreecell-3-3.pddl
34 34 0.0 41 41 0.0
probfreecell-3-4.pddl
35 35 0.0 41 41 0.0
probfreecell-3-5.pddl
32 32 0.0 41 41 0.0
probfreecell-4-1.pddl
48 48 0.0 53 53 0.0
probfreecell-4-2.pddl
47 47 0.0 53 53 0.0
probfreecell-4-3.pddl
47 47 0.0 53 53 0.0
probfreecell-4-4.pddl
46 46 0.0 53 53 0.0
probfreecell-4-5.pddl
42 42 0.0 53 53 0.0
probfreecell-5-1.pddl
60 60 0.0 65 65 0.0
probfreecell-5-2.pddl
59 59 0.0 65 65 0.0
probfreecell-5-3.pddl
57 57 0.0 65 65 0.0
probfreecell-5-4.pddl
59 59 0.0 65 65 0.0
probfreecell-5-5.pddl
57 57 0.0 65 65 0.0
probfreecell-6-1.pddl
68 68 0.0 77 77 0.0
probfreecell-6-2.pddl
71 71 0.0 77 77 0.0
probfreecell-6-3.pddl
71 71 0.0 77 77 0.0
probfreecell-6-4.pddl
72 72 0.0 77 77 0.0
probfreecell-6-5.pddl
69 69 0.0 77 77 0.0
probfreecell-7-1.pddl
82 82 0.0 89 89 0.0
probfreecell-7-2.pddl
82 82 0.0 89 89 0.0
probfreecell-7-3.pddl
83 83 0.0 89 89 0.0
probfreecell-7-4.pddl
82 82 0.0 89 89 0.0
probfreecell-7-5.pddl
82 82 0.0 89 89 0.0
probfreecell-8-1.pddl
94 94 0.0 101 101 0.0
probfreecell-8-2.pddl
94 94 0.0 102 102 0.0
probfreecell-8-3.pddl
95 95 0.0 101 101 0.0
probfreecell-8-4.pddl
93 93 0.0 101 101 0.0
probfreecell-8-5.pddl
94 94 0.0 101 101 0.0
probfreecell-9-1.pddl
105 105 0.0 113 113 0.0
probfreecell-9-2.pddl
105 105 0.0 114 114 0.0
probfreecell-9-3.pddl
108 108 0.0 113 113 0.0
probfreecell-9-4.pddl
105 105 0.0 113 113 0.0
probfreecell-9-5.pddl
106 106 0.0 113 113 0.0
probfreecell-10-1.pddl
117 117 0.0 126 126 0.0
probfreecell-10-2.pddl
117 117 0.0 126 126 0.0
probfreecell-10-3.pddl
120 120 0.0 125 125 0.0
probfreecell-10-4.pddl
117 117 0.0 125 125 0.0
probfreecell-10-5.pddl
118 118 0.0 125 125 0.0
probfreecell-11-1.pddl
129 129 0.0 138 138 0.0
probfreecell-11-2.pddl
129 129 0.0 138 138 0.0
probfreecell-11-3.pddl
129 129 0.0 137 137 0.0
probfreecell-11-4.pddl
129 129 0.0 137 137 0.0
probfreecell-11-5.pddl
129 129 0.0 138 138 0.0
probfreecell-12-1.pddl
141 141 0.0 150 150 0.0
probfreecell-12-2.pddl
141 141 0.0 150 150 0.0
probfreecell-12-3.pddl
141 141 0.0 149 149 0.0
probfreecell-12-4.pddl
141 141 0.0 150 150 0.0
probfreecell-12-5.pddl
141 141 0.0 150 150 0.0
probfreecell-13-1.pddl
153 153 0.0 162 162 0.0
probfreecell-13-2.pddl
153 153 0.0 162 162 0.0
probfreecell-13-3.pddl
153 153 0.0 162 162 0.0
probfreecell-13-4.pddl
153 153 0.0 162 162 0.0
probfreecell-13-5.pddl
153 153 0.0 162 162 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
ged-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
7 7 0.0 8 8 0.0
d-1-3.pddl
18 18 0.0 20 20 0.0
d-1-4.pddl
7 7 0.0 8 8 0.0
d-1-8.pddl
21 21 0.0 23 23 0.0
d-2-1.pddl
7 7 0.0 8 8 0.0
d-2-3.pddl
15 15 0.0 17 17 0.0
d-2-4.pddl
12 12 0.0 14 14 0.0
d-2-8.pddl
26 26 0.0 28 28 0.0
d-3-1.pddl
18 18 0.0 20 20 0.0
d-3-2.pddl
15 15 0.0 17 17 0.0
d-3-4.pddl
22 22 0.0 24 24 0.0
d-4-2.pddl
12 12 0.0 14 14 0.0
d-4-3.pddl
22 22 0.0 24 24 0.0
d-4-8.pddl
26 26 0.0 28 28 0.0
d-7-5.pddl
21 21 0.0 23 23 0.0
d-7-6.pddl
17 17 0.0 19 19 0.0
d-8-1.pddl
21 21 0.0 23 23 0.0
d-8-2.pddl
26 26 0.0 28 28 0.0
d-8-4.pddl
26 26 0.0 28 28 0.0
d-8-9.pddl
28 28 0.0 30 30 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
grid
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
13 13 0.0 13 13 0.0
prob02.pddl
21 21 0.0 17 17 0.0
prob03.pddl
29 29 0.0 26 26 0.0
prob04.pddl
24 24 0.0 19 19 0.0
prob05.pddl
52 52 0.0 47 47 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
gripper
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
14 14 0.0 10 10 0.0
prob02.pddl
20 20 0.0 14 14 0.0
prob03.pddl
26 26 0.0 18 18 0.0
prob04.pddl
32 32 0.0 22 22 0.0
prob05.pddl
38 38 0.0 26 26 0.0
prob06.pddl
44 44 0.0 30 30 0.0
prob07.pddl
50 50 0.0 34 34 0.0
prob08.pddl
56 56 0.0 38 38 0.0
prob09.pddl
62 62 0.0 42 42 0.0
prob10.pddl
68 68 0.0 46 46 0.0
prob11.pddl
74 74 0.0 50 50 0.0
prob12.pddl
80 80 0.0 54 54 0.0
prob13.pddl
86 86 0.0 58 58 0.0
prob14.pddl
92 92 0.0 62 62 0.0
prob15.pddl
98 98 0.0 66 66 0.0
prob16.pddl
104 104 0.0 70 70 0.0
prob17.pddl
110 110 0.0 74 74 0.0
prob18.pddl
116 116 0.0 78 78 0.0
prob19.pddl
122 122 0.0 82 82 0.0
prob20.pddl
128 128 0.0 86 86 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
hiking-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
12 12 0.0 12 12 0.0
ptesting-1-2-4.pddl
16 16 0.0 16 16 0.0
ptesting-1-2-5.pddl
20 20 0.0 20 20 0.0
ptesting-1-2-7.pddl
28 28 0.0 28 28 0.0
ptesting-1-2-8.pddl
32 32 0.0 32 32 0.0
ptesting-2-2-3.pddl
17 17 0.0 14 14 0.0
ptesting-2-2-4.pddl
24 24 0.0 20 20 0.0
ptesting-2-2-5.pddl
31 31 0.0 26 26 0.0
ptesting-2-2-6.pddl
38 38 0.0 32 32 0.0
ptesting-2-2-7.pddl
45 45 0.0 38 38 0.0
ptesting-2-2-8.pddl
52 52 0.0 44 44 0.0
ptesting-2-3-4.pddl
23 23 0.0 20 20 0.0
ptesting-2-3-5.pddl
31 31 0.0 26 26 0.0
ptesting-2-3-6.pddl
38 38 0.0 32 32 0.0
ptesting-2-3-7.pddl
44 44 0.0 38 38 0.0
ptesting-2-4-3.pddl
17 17 0.0 14 14 0.0
ptesting-2-4-4.pddl
23 23 0.0 20 20 0.0
ptesting-2-4-5.pddl
30 30 0.0 26 26 0.0
ptesting-2-4-6.pddl
38 38 0.0 32 32 0.0
ptesting-2-4-7.pddl
45 45 0.0 38 38 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics00
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
26 26 0.0 26 26 0.0
probLOGISTICS-4-1.pddl
24 24 0.0 24 24 0.0
probLOGISTICS-4-2.pddl
20 20 0.0 20 20 0.0
probLOGISTICS-5-0.pddl
33 33 0.0 33 33 0.0
probLOGISTICS-5-1.pddl
23 23 0.0 23 23 0.0
probLOGISTICS-5-2.pddl
15 15 0.0 15 15 0.0
probLOGISTICS-6-0.pddl
32 32 0.0 32 32 0.0
probLOGISTICS-6-1.pddl
22 22 0.0 22 22 0.0
probLOGISTICS-6-2.pddl
32 32 0.0 32 32 0.0
probLOGISTICS-6-9.pddl
30 30 0.0 30 30 0.0
probLOGISTICS-7-0.pddl
44 44 0.0 44 44 0.0
probLOGISTICS-7-1.pddl
50 50 0.0 50 50 0.0
probLOGISTICS-8-0.pddl
41 41 0.0 41 41 0.0
probLOGISTICS-8-1.pddl
53 53 0.0 53 53 0.0
probLOGISTICS-9-0.pddl
46 46 0.0 46 46 0.0
probLOGISTICS-9-1.pddl
42 42 0.0 42 42 0.0
probLOGISTICS-10-0.pddl
56 56 0.0 56 56 0.0
probLOGISTICS-10-1.pddl
54 54 0.0 54 54 0.0
probLOGISTICS-11-0.pddl
61 61 0.0 61 61 0.0
probLOGISTICS-11-1.pddl
71 71 0.0 71 71 0.0
probLOGISTICS-12-0.pddl
56 56 0.0 56 56 0.0
probLOGISTICS-12-1.pddl
80 80 0.0 80 80 0.0
probLOGISTICS-13-0.pddl
84 84 0.0 70 70 0.0
probLOGISTICS-13-1.pddl
74 74 0.0 62 62 0.0
probLOGISTICS-14-0.pddl
74 74 0.0 62 62 0.0
probLOGISTICS-14-1.pddl
85 85 0.0 71 71 0.0
probLOGISTICS-15-0.pddl
90 90 0.0 75 75 0.0
probLOGISTICS-15-1.pddl
82 82 0.0 68 68 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
logistics98
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
33 33 0.0 25 25 0.0
prob02.pddl
36 36 0.0 26 26 0.0
prob03.pddl
64 64 0.0 52 52 0.0
prob04.pddl
50 50 0.0 41 41 0.0
prob05.pddl
27 27 0.0 24 24 0.0
prob06.pddl
77 77 0.0 49 49 0.0
prob07.pddl
28 28 0.0 28 28 0.0
prob08.pddl
44 44 0.0 26 26 0.0
prob09.pddl
84 84 0.0 47 47 0.0
prob10.pddl
122 122 0.0 92 92 0.0
prob11.pddl
22 22 0.0 18 18 0.0
prob12.pddl
31 31 0.0 20 20 0.0
prob13.pddl
63 63 0.0 63 63 0.0
prob14.pddl
62 62 0.0 54 54 0.0
prob15.pddl
82 82 0.0 71 71 0.0
prob16.pddl
35 35 0.0 27 27 0.0
prob17.pddl
24 24 0.0 24 24 0.0
prob18.pddl
152 152 0.0 152 152 0.0
prob19.pddl
105 105 0.0 67 67 0.0
prob20.pddl
128 128 0.0 112 112 0.0
prob21.pddl
82 82 0.0 50 50 0.0
prob22.pddl
213 213 0.0 157 157 0.0
prob23.pddl
112 112 0.0 67 67 0.0
prob24.pddl
20 20 0.0 16 16 0.0
prob25.pddl
179 179 0.0 171 171 0.0
prob26.pddl
200 200 0.0 114 114 0.0
prob27.pddl
130 130 0.0 88 88 0.0
prob28.pddl
187 187 0.0 117 117 0.0
prob29.pddl
254 254 0.0 216 216 0.0
prob30.pddl
113 113 0.0 54 54 0.0
prob31.pddl
17 17 0.0 14 14 0.0
prob32.pddl
20 20 0.0 16 16 0.0
prob33.pddl
31 31 0.0 25 25 0.0
prob34.pddl
45 45 0.0 21 21 0.0
prob35.pddl
37 37 0.0 33 33 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
miconic
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
6 6 0.0 4 4 0.0
s1-1.pddl
6 6 0.0 4 4 0.0
s1-2.pddl
6 6 0.0 4 4 0.0
s1-3.pddl
6 6 0.0 4 4 0.0
s1-4.pddl
6 6 0.0 4 4 0.0
s2-0.pddl
12 12 0.0 8 8 0.0
s2-1.pddl
11 11 0.0 7 7 0.0
s2-2.pddl
11 11 0.0 7 7 0.0
s2-3.pddl
12 12 0.0 8 8 0.0
s2-4.pddl
11 11 0.0 7 7 0.0
s3-0.pddl
17 17 0.0 11 11 0.0
s3-1.pddl
17 17 0.0 11 11 0.0
s3-2.pddl
16 16 0.0 10 10 0.0
s3-3.pddl
16 16 0.0 10 10 0.0
s3-4.pddl
16 16 0.0 10 10 0.0
s4-0.pddl
23 23 0.0 15 15 0.0
s4-1.pddl
22 22 0.0 14 14 0.0
s4-2.pddl
23 23 0.0 15 15 0.0
s4-3.pddl
23 23 0.0 15 15 0.0
s4-4.pddl
24 24 0.0 16 16 0.0
s5-0.pddl
28 28 0.0 18 18 0.0
s5-1.pddl
27 27 0.0 17 17 0.0
s5-2.pddl
25 25 0.0 15 15 0.0
s5-3.pddl
28 28 0.0 18 18 0.0
s5-4.pddl
28 28 0.0 18 18 0.0
s6-0.pddl
31 31 0.0 19 19 0.0
s6-1.pddl
32 32 0.0 20 20 0.0
s6-2.pddl
32 32 0.0 20 20 0.0
s6-3.pddl
31 31 0.0 19 19 0.0
s6-4.pddl
33 33 0.0 21 21 0.0
s7-0.pddl
38 38 0.0 24 24 0.0
s7-1.pddl
39 39 0.0 25 25 0.0
s7-2.pddl
37 37 0.0 23 23 0.0
s7-3.pddl
37 37 0.0 23 23 0.0
s7-4.pddl
40 40 0.0 26 26 0.0
s8-0.pddl
44 44 0.0 28 28 0.0
s8-1.pddl
43 43 0.0 27 27 0.0
s8-2.pddl
42 42 0.0 26 26 0.0
s8-3.pddl
44 44 0.0 28 28 0.0
s8-4.pddl
43 43 0.0 27 27 0.0
s9-0.pddl
49 49 0.0 31 31 0.0
s9-1.pddl
48 48 0.0 30 30 0.0
s9-2.pddl
48 48 0.0 30 30 0.0
s9-3.pddl
50 50 0.0 32 32 0.0
s9-4.pddl
46 46 0.0 28 28 0.0
s10-0.pddl
54 54 0.0 34 34 0.0
s10-1.pddl
53 53 0.0 33 33 0.0
s10-2.pddl
52 52 0.0 32 32 0.0
s10-3.pddl
55 55 0.0 35 35 0.0
s10-4.pddl
53 53 0.0 33 33 0.0
s11-0.pddl
59 59 0.0 37 37 0.0
s11-1.pddl
57 57 0.0 35 35 0.0
s11-2.pddl
60 60 0.0 38 38 0.0
s11-3.pddl
60 60 0.0 38 38 0.0
s11-4.pddl
57 57 0.0 35 35 0.0
s12-0.pddl
65 65 0.0 41 41 0.0
s12-1.pddl
65 65 0.0 41 41 0.0
s12-2.pddl
64 64 0.0 40 40 0.0
s12-3.pddl
63 63 0.0 39 39 0.0
s12-4.pddl
66 66 0.0 42 42 0.0
s13-0.pddl
70 70 0.0 44 44 0.0
s13-1.pddl
68 68 0.0 42 42 0.0
s13-2.pddl
73 73 0.0 47 47 0.0
s13-3.pddl
70 70 0.0 44 44 0.0
s13-4.pddl
68 68 0.0 42 42 0.0
s14-0.pddl
74 74 0.0 46 46 0.0
s14-1.pddl
76 76 0.0 48 48 0.0
s14-2.pddl
78 78 0.0 50 50 0.0
s14-3.pddl
71 71 0.0 43 43 0.0
s14-4.pddl
74 74 0.0 46 46 0.0
s15-0.pddl
77 77 0.0 47 47 0.0
s15-1.pddl
80 80 0.0 50 50 0.0
s15-2.pddl
80 80 0.0 50 50 0.0
s15-3.pddl
81 81 0.0 51 51 0.0
s15-4.pddl
77 77 0.0 47 47 0.0
s16-0.pddl
86 86 0.0 54 54 0.0
s16-1.pddl
85 85 0.0 53 53 0.0
s16-2.pddl
87 87 0.0 55 55 0.0
s16-3.pddl
84 84 0.0 52 52 0.0
s16-4.pddl
86 86 0.0 54 54 0.0
s17-0.pddl
90 90 0.0 56 56 0.0
s17-1.pddl
89 89 0.0 55 55 0.0
s17-2.pddl
89 89 0.0 55 55 0.0
s17-3.pddl
94 94 0.0 60 60 0.0
s17-4.pddl
89 89 0.0 55 55 0.0
s18-0.pddl
96 96 0.0 60 60 0.0
s18-1.pddl
95 95 0.0 59 59 0.0
s18-2.pddl
95 95 0.0 59 59 0.0
s18-3.pddl
96 96 0.0 60 60 0.0
s18-4.pddl
93 93 0.0 57 57 0.0
s19-0.pddl
101 101 0.0 63 63 0.0
s19-1.pddl
104 104 0.0 66 66 0.0
s19-2.pddl
100 100 0.0 62 62 0.0
s19-3.pddl
102 102 0.0 64 64 0.0
s19-4.pddl
101 101 0.0 63 63 0.0
s20-0.pddl
104 104 0.0 64 64 0.0
s20-1.pddl
107 107 0.0 67 67 0.0
s20-2.pddl
103 103 0.0 63 63 0.0
s20-3.pddl
104 104 0.0 64 64 0.0
s20-4.pddl
105 105 0.0 65 65 0.0
s21-0.pddl
112 112 0.0 70 70 0.0
s21-1.pddl
112 112 0.0 70 70 0.0
s21-2.pddl
112 112 0.0 70 70 0.0
s21-3.pddl
109 109 0.0 67 67 0.0
s21-4.pddl
113 113 0.0 71 71 0.0
s22-0.pddl
117 117 0.0 73 73 0.0
s22-1.pddl
115 115 0.0 71 71 0.0
s22-2.pddl
116 116 0.0 72 72 0.0
s22-3.pddl
120 120 0.0 76 76 0.0
s22-4.pddl
116 116 0.0 72 72 0.0
s23-0.pddl
122 122 0.0 76 76 0.0
s23-1.pddl
121 121 0.0 75 75 0.0
s23-2.pddl
120 120 0.0 74 74 0.0
s23-3.pddl
118 118 0.0 72 72 0.0
s23-4.pddl
121 121 0.0 75 75 0.0
s24-0.pddl
128 128 0.0 80 80 0.0
s24-1.pddl
127 127 0.0 79 79 0.0
s24-2.pddl
126 126 0.0 78 78 0.0
s24-3.pddl
128 128 0.0 80 80 0.0
s24-4.pddl
126 126 0.0 78 78 0.0
s25-0.pddl
132 132 0.0 82 82 0.0
s25-1.pddl
136 136 0.0 86 86 0.0
s25-2.pddl
129 129 0.0 79 79 0.0
s25-3.pddl
135 135 0.0 85 85 0.0
s25-4.pddl
133 133 0.0 83 83 0.0
s26-0.pddl
136 136 0.0 84 84 0.0
s26-1.pddl
136 136 0.0 84 84 0.0
s26-2.pddl
143 143 0.0 91 91 0.0
s26-3.pddl
141 141 0.0 89 89 0.0
s26-4.pddl
135 135 0.0 83 83 0.0
s27-0.pddl
142 142 0.0 88 88 0.0
s27-1.pddl
146 146 0.0 92 92 0.0
s27-2.pddl
142 142 0.0 88 88 0.0
s27-3.pddl
144 144 0.0 90 90 0.0
s27-4.pddl
143 143 0.0 89 89 0.0
s28-0.pddl
151 151 0.0 95 95 0.0
s28-1.pddl
149 149 0.0 93 93 0.0
s28-2.pddl
150 150 0.0 94 94 0.0
s28-3.pddl
144 144 0.0 88 88 0.0
s28-4.pddl
149 149 0.0 93 93 0.0
s29-0.pddl
153 153 0.0 95 95 0.0
s29-1.pddl
150 150 0.0 92 92 0.0
s29-2.pddl
154 154 0.0 96 96 0.0
s29-3.pddl
155 155 0.0 97 97 0.0
s29-4.pddl
158 158 0.0 100 100 0.0
s30-0.pddl
156 156 0.0 96 96 0.0
s30-1.pddl
159 159 0.0 99 99 0.0
s30-2.pddl
157 157 0.0 97 97 0.0
s30-3.pddl
161 161 0.0 101 101 0.0
s30-4.pddl
160 160 0.0 100 100 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
movie
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
14 14 0.0 7 7 0.0
prob02.pddl
14 14 0.0 7 7 0.0
prob03.pddl
14 14 0.0 7 7 0.0
prob04.pddl
14 14 0.0 7 7 0.0
prob05.pddl
14 14 0.0 7 7 0.0
prob06.pddl
14 14 0.0 7 7 0.0
prob07.pddl
14 14 0.0 7 7 0.0
prob08.pddl
14 14 0.0 7 7 0.0
prob09.pddl
14 14 0.0 7 7 0.0
prob10.pddl
14 14 0.0 7 7 0.0
prob11.pddl
14 14 0.0 7 7 0.0
prob12.pddl
14 14 0.0 7 7 0.0
prob13.pddl
14 14 0.0 7 7 0.0
prob14.pddl
14 14 0.0 7 7 0.0
prob15.pddl
14 14 0.0 7 7 0.0
prob16.pddl
14 14 0.0 7 7 0.0
prob17.pddl
14 14 0.0 7 7 0.0
prob18.pddl
14 14 0.0 7 7 0.0
prob19.pddl
14 14 0.0 7 7 0.0
prob20.pddl
14 14 0.0 7 7 0.0
prob21.pddl
14 14 0.0 7 7 0.0
prob22.pddl
14 14 0.0 7 7 0.0
prob23.pddl
14 14 0.0 7 7 0.0
prob24.pddl
14 14 0.0 7 7 0.0
prob25.pddl
14 14 0.0 7 7 0.0
prob26.pddl
14 14 0.0 7 7 0.0
prob27.pddl
14 14 0.0 7 7 0.0
prob28.pddl
14 14 0.0 7 7 0.0
prob29.pddl
14 14 0.0 7 7 0.0
prob30.pddl
14 14 0.0 7 7 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mprime
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
9 9 0.0 8 8 0.0
prob02.pddl
8 8 0.0 4 4 0.0
prob03.pddl
5 5 0.0 2 2 0.0
prob04.pddl
10 10 0.0 11 11 0.0
prob05.pddl
8 8 0.0 4 4 0.0
prob06.pddl
4 4 0.0 4 4 0.0
prob07.pddl
6 6 0.0 2 2 0.0
prob08.pddl
2 2 0.0 2 2 0.0
prob09.pddl
8 8 0.0 4 4 0.0
prob10.pddl
2 2 0.0 2 2 0.0
prob11.pddl
12 12 0.0 12 12 0.0
prob12.pddl
4 4 0.0 2 2 0.0
prob13.pddl
4 4 0.0 4 4 0.0
prob14.pddl
4 4 0.0 4 4 0.0
prob15.pddl
2 2 0.0 2 2 0.0
prob16.pddl
4 4 0.0 4 4 0.0
prob17.pddl
2 2 0.0 2 2 0.0
prob18.pddl
2 2 0.0 2 2 0.0
prob19.pddl
2 2 0.0 2 2 0.0
prob20.pddl
2 2 0.0 2 2 0.0
prob21.pddl
2 2 0.0 2 2 0.0
prob22.pddl
2 2 0.0 2 2 0.0
prob23.pddl
2 2 0.0 2 2 0.0
prob24.pddl
6 6 0.0 5 5 0.0
prob25.pddl
5 5 0.0 2 2 0.0
prob26.pddl
2 2 0.0 2 2 0.0
prob27.pddl
7 7 0.0 4 4 0.0
prob28.pddl
12 12 0.0 13 13 0.0
prob29.pddl
5 5 0.0 3 3 0.0
prob30.pddl
5 5 0.0 5 5 0.0
prob31.pddl
2 2 0.0 2 2 0.0
prob32.pddl
6 6 0.0 2 2 0.0
prob33.pddl
2 2 0.0 5 5 0.0
prob34.pddl
2 2 0.0 2 2 0.0
prob35.pddl
4 4 0.0 2 2 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mystery
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
10 10 0.0 8 8 0.0
prob02.pddl
8 8 0.0 4 4 0.0
prob03.pddl
5 5 0.0 2 2 0.0
prob04.pddl
11 11 0.0 13 13 0.0
prob05.pddl
12 12 0.0 7 7 0.0
prob06.pddl
4 4 0.0 4 4 0.0
prob07.pddl
2 2 0.0 None None -
prob08.pddl
2 2 0.0 4 4 0.0
prob09.pddl
8 8 0.0 4 4 0.0
prob10.pddl
2 2 0.0 2 2 0.0
prob11.pddl
12 12 0.0 12 12 0.0
prob12.pddl
5 5 0.0 2 2 0.0
prob13.pddl
12 12 0.0 7 7 0.0
prob14.pddl
4 4 0.0 6 6 0.0
prob15.pddl
2 2 0.0 2 2 0.0
prob16.pddl
9 9 0.0 10 10 0.0
prob17.pddl
2 2 0.0 2 2 0.0
prob18.pddl
2 2 0.0 None None -
prob19.pddl
2 2 0.0 2 2 0.0
prob20.pddl
2 2 0.0 2 2 0.0
prob21.pddl
5 5 0.0 2 2 0.0
prob22.pddl
3 3 0.0 4 4 0.0
prob23.pddl
11 11 0.0 5 5 0.0
prob24.pddl
17 17 0.0 22 22 0.0
prob25.pddl
5 5 0.0 2 2 0.0
prob26.pddl
3 3 0.0 2 2 0.0
prob27.pddl
7 7 0.0 4 4 0.0
prob28.pddl
12 12 0.0 13 13 0.0
prob29.pddl
6 6 0.0 3 3 0.0
prob30.pddl
5 5 0.0 5 5 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
nomystery-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
13 13 0.0 14 14 0.0
p02.pddl
16 16 0.0 17 17 0.0
p03.pddl
19 19 0.0 20 20 0.0
p04.pddl
23 23 0.0 24 24 0.0
p05.pddl
28 28 0.0 29 29 0.0
p06.pddl
32 32 0.0 33 33 0.0
p07.pddl
38 38 0.0 38 38 0.0
p08.pddl
40 40 0.0 41 41 0.0
p09.pddl
43 43 0.0 43 43 0.0
p10.pddl
46 46 0.0 47 47 0.0
p11.pddl
13 13 0.0 14 14 0.0
p12.pddl
16 16 0.0 17 17 0.0
p13.pddl
19 19 0.0 20 20 0.0
p14.pddl
23 23 0.0 24 24 0.0
p15.pddl
28 28 0.0 29 29 0.0
p16.pddl
32 32 0.0 33 33 0.0
p17.pddl
38 38 0.0 38 38 0.0
p18.pddl
40 40 0.0 41 41 0.0
p19.pddl
43 43 0.0 43 43 0.0
p20.pddl
46 46 0.0 47 47 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt08-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
25 25 0.0 27 27 0.0
p02.pddl
30 30 0.0 32 32 0.0
p03.pddl
35 35 0.0 37 37 0.0
p04.pddl
40 40 0.0 42 42 0.0
p05.pddl
45 45 0.0 47 47 0.0
p06.pddl
50 50 0.0 52 52 0.0
p07.pddl
55 55 0.0 57 57 0.0
p08.pddl
60 60 0.0 62 62 0.0
p09.pddl
65 65 0.0 67 67 0.0
p10.pddl
70 70 0.0 72 72 0.0
p11.pddl
75 75 0.0 77 77 0.0
p12.pddl
80 80 0.0 82 82 0.0
p13.pddl
85 85 0.0 87 87 0.0
p14.pddl
90 90 0.0 92 92 0.0
p15.pddl
95 95 0.0 97 97 0.0
p16.pddl
100 100 0.0 102 102 0.0
p17.pddl
105 105 0.0 107 107 0.0
p18.pddl
110 110 0.0 112 112 0.0
p19.pddl
115 115 0.0 117 117 0.0
p20.pddl
120 120 0.0 122 122 0.0
p21.pddl
125 125 0.0 127 127 0.0
p22.pddl
130 130 0.0 132 132 0.0
p23.pddl
135 135 0.0 137 137 0.0
p24.pddl
140 140 0.0 142 142 0.0
p25.pddl
145 145 0.0 147 147 0.0
p26.pddl
150 150 0.0 152 152 0.0
p27.pddl
155 155 0.0 157 157 0.0
p28.pddl
160 160 0.0 162 162 0.0
p29.pddl
165 165 0.0 167 167 0.0
p30.pddl
170 170 0.0 172 172 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
50 50 0.0 52 52 0.0
p02.pddl
55 55 0.0 57 57 0.0
p03.pddl
60 60 0.0 62 62 0.0
p04.pddl
65 65 0.0 67 67 0.0
p05.pddl
70 70 0.0 72 72 0.0
p06.pddl
75 75 0.0 77 77 0.0
p07.pddl
80 80 0.0 82 82 0.0
p08.pddl
85 85 0.0 87 87 0.0
p09.pddl
90 90 0.0 92 92 0.0
p10.pddl
130 130 0.0 132 132 0.0
p11.pddl
95 95 0.0 97 97 0.0
p12.pddl
100 100 0.0 102 102 0.0
p13.pddl
105 105 0.0 107 107 0.0
p14.pddl
110 110 0.0 112 112 0.0
p15.pddl
115 115 0.0 117 117 0.0
p16.pddl
125 125 0.0 127 127 0.0
p17.pddl
120 120 0.0 122 122 0.0
p18.pddl
135 135 0.0 137 137 0.0
p19.pddl
140 140 0.0 142 142 0.0
p20.pddl
145 145 0.0 147 147 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
100 100 0.0 102 102 0.0
p20_2.pddl
100 100 0.0 102 102 0.0
p20_3.pddl
100 100 0.0 102 102 0.0
p25_1.pddl
125 125 0.0 127 127 0.0
p25_3.pddl
125 125 0.0 127 127 0.0
p30_1.pddl
150 150 0.0 152 152 0.0
p30_2.pddl
150 150 0.0 152 152 0.0
p30_3.pddl
150 150 0.0 152 152 0.0
p35_1.pddl
175 175 0.0 177 177 0.0
p35_2.pddl
175 175 0.0 177 177 0.0
p35_3.pddl
175 175 0.0 177 177 0.0
p40_1.pddl
200 200 0.0 202 202 0.0
p40_2.pddl
200 200 0.0 202 202 0.0
p40_3.pddl
200 200 0.0 202 202 0.0
p45_1.pddl
225 225 0.0 227 227 0.0
p45_2.pddl
225 225 0.0 227 227 0.0
p45_3.pddl
225 225 0.0 227 227 0.0
p50_1.pddl
250 250 0.0 252 252 0.0
p50_2.pddl
250 250 0.0 252 252 0.0
p50_3.pddl
250 250 0.0 252 252 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
openstacks-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
36 36 0.0 33 33 0.0
p02.pddl
36 36 0.0 33 33 0.0
p03.pddl
36 36 0.0 33 33 0.0
p04.pddl
36 36 0.0 33 33 0.0
p05.pddl
36 36 0.0 33 33 0.0
p06.pddl
71 71 0.0 63 63 0.0
p07.pddl
71 71 0.0 63 63 0.0
p08.pddl
171 171 0.0 123 123 0.0
p09.pddl
171 171 0.0 123 123 0.0
p10.pddl
161 161 0.0 123 123 0.0
p11.pddl
161 161 0.0 123 123 0.0
p12.pddl
161 161 0.0 123 123 0.0
p13.pddl
161 161 0.0 123 123 0.0
p14.pddl
161 161 0.0 123 123 0.0
p15.pddl
161 161 0.0 123 123 0.0
p16.pddl
161 161 0.0 123 123 0.0
p17.pddl
211 211 0.0 153 153 0.0
p18.pddl
371 371 0.0 255 255 0.0
p19.pddl
201 201 0.0 153 153 0.0
p20.pddl
241 241 0.0 183 183 0.0
p21.pddl
241 241 0.0 183 183 0.0
p22.pddl
241 241 0.0 183 183 0.0
p23.pddl
241 241 0.0 183 183 0.0
p24.pddl
401 401 0.0 303 303 0.0
p25.pddl
401 401 0.0 303 303 0.0
p26.pddl
401 401 0.0 303 303 0.0
p27.pddl
601 601 0.0 453 453 0.0
p28.pddl
801 801 0.0 603 603 0.0
p29.pddl
801 801 0.0 603 603 0.0
p30.pddl
801 801 0.0 603 603 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-opt18-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
14 14 0.0 8 8 0.0
p02.pddl
14 14 0.0 8 8 0.0
p03.pddl
22 22 0.0 15 15 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
14 14 0.0 10 10 0.0
p08.pddl
None None - None None -
p09.pddl
11 11 0.0 8 8 0.0
p10.pddl
11 11 0.0 8 8 0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
28 28 0.0 16 16 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-split-opt18-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
15 15 0.0 9 9 0.0
p02.pddl
15 15 0.0 9 9 0.0
p03.pddl
115 115 0.0 73 73 0.0
p04.pddl
67 67 0.0 44 44 0.0
p05.pddl
28 28 0.0 25 25 0.0
p06.pddl
49 49 0.0 55 55 0.0
p07.pddl
42 42 0.0 22 22 0.0
p08.pddl
49 49 0.0 40 40 0.0
p09.pddl
7 7 0.0 5 5 0.0
p10.pddl
7 7 0.0 5 5 0.0
p11.pddl
16 16 0.0 9 9 0.0
p12.pddl
9 9 0.0 5 5 0.0
p13.pddl
54 54 0.0 47 47 0.0
p14.pddl
29 29 0.0 17 17 0.0
p15.pddl
83 83 0.0 63 63 0.0
p16.pddl
33 33 0.0 51 51 0.0
p17.pddl
19 19 0.0 47 47 0.0
p18.pddl
46 46 0.0 32 32 0.0
p19.pddl
16 16 0.0 13 13 0.0
p20.pddl
27 27 0.0 20 20 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-08-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
28 28 0.0 11 11 0.0
p02.pddl
48 48 0.0 27 27 0.0
p03.pddl
58 58 0.0 42 42 0.0
p04.pddl
83 83 0.0 49 49 0.0
p05.pddl
101 101 0.0 61 61 0.0
p06.pddl
120 120 0.0 75 75 0.0
p07.pddl
134 134 0.0 79 79 0.0
p08.pddl
154 154 0.0 95 95 0.0
p09.pddl
172 172 0.0 107 107 0.0
p10.pddl
191 191 0.0 121 121 0.0
p11.pddl
35 35 0.0 14 14 0.0
p12.pddl
56 56 0.0 28 28 0.0
p13.pddl
75 75 0.0 40 40 0.0
p14.pddl
92 92 0.0 52 52 0.0
p15.pddl
113 113 0.0 65 65 0.0
p16.pddl
132 132 0.0 76 76 0.0
p17.pddl
149 149 0.0 88 88 0.0
p18.pddl
168 168 0.0 100 100 0.0
p19.pddl
191 191 0.0 114 114 0.0
p20.pddl
210 210 0.0 125 125 0.0
p21.pddl
29 29 0.0 13 13 0.0
p22.pddl
50 50 0.0 31 31 0.0
p23.pddl
69 69 0.0 43 43 0.0
p24.pddl
89 89 0.0 57 57 0.0
p25.pddl
111 111 0.0 72 72 0.0
p26.pddl
129 129 0.0 85 85 0.0
p27.pddl
147 147 0.0 95 95 0.0
p28.pddl
169 169 0.0 113 113 0.0
p29.pddl
194 194 0.0 131 131 0.0
p30.pddl
207 207 0.0 134 134 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parcprinter-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
50 50 0.0 31 31 0.0
p02.pddl
48 48 0.0 27 27 0.0
p03.pddl
56 56 0.0 28 28 0.0
p04.pddl
83 83 0.0 49 49 0.0
p05.pddl
69 69 0.0 43 43 0.0
p06.pddl
120 120 0.0 75 75 0.0
p07.pddl
101 101 0.0 61 61 0.0
p08.pddl
89 89 0.0 57 57 0.0
p09.pddl
75 75 0.0 40 40 0.0
p10.pddl
111 111 0.0 72 72 0.0
p11.pddl
129 129 0.0 85 85 0.0
p12.pddl
92 92 0.0 52 52 0.0
p13.pddl
134 134 0.0 79 79 0.0
p14.pddl
154 154 0.0 95 95 0.0
p15.pddl
172 172 0.0 107 107 0.0
p16.pddl
191 191 0.0 121 121 0.0
p17.pddl
113 113 0.0 65 65 0.0
p18.pddl
132 132 0.0 76 76 0.0
p19.pddl
149 149 0.0 88 88 0.0
p20.pddl
147 147 0.0 95 95 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parking-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
48 48 0.0 37 37 0.0
pfile03-012.pddl
62 62 0.0 48 48 0.0
pfile04-013.pddl
74 74 0.0 56 56 0.0
pfile04-014.pddl
71 71 0.0 54 54 0.0
pfile04-015.pddl
70 70 0.0 54 54 0.0
pfile04-016.pddl
67 67 0.0 52 52 0.0
pfile05-017.pddl
81 81 0.0 62 62 0.0
pfile05-018.pddl
78 78 0.0 60 60 0.0
pfile05-019.pddl
84 84 0.0 64 64 0.0
pfile05-020.pddl
83 83 0.0 64 64 0.0
pfile06-021.pddl
89 89 0.0 70 70 0.0
pfile06-022.pddl
93 93 0.0 72 72 0.0
pfile06-023.pddl
89 89 0.0 68 68 0.0
pfile06-024.pddl
89 89 0.0 70 70 0.0
pfile07-025.pddl
104 104 0.0 80 80 0.0
pfile07-026.pddl
100 100 0.0 78 78 0.0
pfile07-027.pddl
105 105 0.0 80 80 0.0
pfile07-028.pddl
105 105 0.0 80 80 0.0
pfile08-029.pddl
114 114 0.0 86 86 0.0
pfile08-030.pddl
114 114 0.0 88 88 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
parking-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
61 61 0.0 48 48 0.0
p_12_7-02.pddl
59 59 0.0 46 46 0.0
p_12_7-03.pddl
60 60 0.0 46 46 0.0
p_12_7-04.pddl
59 59 0.0 46 46 0.0
p_14_8-01.pddl
69 69 0.0 54 54 0.0
p_14_8-02.pddl
73 73 0.0 56 56 0.0
p_14_8-03.pddl
72 72 0.0 56 56 0.0
p_14_8-04.pddl
69 69 0.0 54 54 0.0
p_16_9-01.pddl
80 80 0.0 62 62 0.0
p_16_9-02.pddl
77 77 0.0 60 60 0.0
p_16_9-03.pddl
79 79 0.0 62 62 0.0
p_16_9-04.pddl
83 83 0.0 64 64 0.0
p_18_10-01.pddl
95 95 0.0 72 72 0.0
p_18_10-02.pddl
91 91 0.0 70 70 0.0
p_18_10-03.pddl
91 91 0.0 70 70 0.0
p_18_10-04.pddl
91 91 0.0 70 70 0.0
p_20_11-01.pddl
102 102 0.0 78 78 0.0
p_20_11-02.pddl
99 99 0.0 76 76 0.0
p_20_11-03.pddl
105 105 0.0 80 80 0.0
p_20_11-04.pddl
102 102 0.0 78 78 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pathways-noneg
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
3 3 0.0 2 2 0.0
p02.pddl
23 23 0.0 15 15 0.0
p03.pddl
9 9 0.0 11 11 0.0
p04.pddl
12 12 0.0 11 11 0.0
p05.pddl
18 18 0.0 13 13 0.0
p06.pddl
46 46 0.0 31 31 0.0
p07.pddl
37 37 0.0 22 22 0.0
p08.pddl
50 50 0.0 40 40 0.0
p09.pddl
45 45 0.0 41 41 0.0
p10.pddl
74 74 0.0 50 50 0.0
p11.pddl
64 64 0.0 35 35 0.0
p12.pddl
55 55 0.0 55 55 0.0
p13.pddl
79 79 0.0 47 47 0.0
p14.pddl
58 58 0.0 45 45 0.0
p15.pddl
114 114 0.0 65 65 0.0
p16.pddl
98 98 0.0 61 61 0.0
p17.pddl
87 87 0.0 68 68 0.0
p18.pddl
78 78 0.0 53 53 0.0
p19.pddl
93 93 0.0 57 57 0.0
p20.pddl
107 107 0.0 59 59 0.0
p21.pddl
95 95 0.0 80 80 0.0
p22.pddl
105 105 0.0 55 55 0.0
p23.pddl
102 102 0.0 61 61 0.0
p24.pddl
136 136 0.0 73 73 0.0
p25.pddl
139 139 0.0 73 73 0.0
p26.pddl
149 149 0.0 86 86 0.0
p27.pddl
152 152 0.0 82 82 0.0
p28.pddl
152 152 0.0 79 79 0.0
p29.pddl
137 137 0.0 76 76 0.0
p30.pddl
160 160 0.0 81 81 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-08-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
30 30 0.0 30 30 0.0
p02.pddl
39 39 0.0 39 39 0.0
p03.pddl
40 40 0.0 40 40 0.0
p04.pddl
43 43 0.0 43 43 0.0
p05.pddl
31 31 0.0 31 31 0.0
p06.pddl
46 46 0.0 45 45 0.0
p07.pddl
48 48 0.0 48 48 0.0
p08.pddl
44 44 0.0 45 45 0.0
p09.pddl
49 49 0.0 47 47 0.0
p10.pddl
49 49 0.0 48 48 0.0
p11.pddl
46 46 0.0 46 46 0.0
p12.pddl
47 47 0.0 47 47 0.0
p13.pddl
48 48 0.0 47 47 0.0
p14.pddl
49 49 0.0 48 48 0.0
p15.pddl
50 50 0.0 50 50 0.0
p16.pddl
54 54 0.0 50 50 0.0
p17.pddl
51 51 0.0 51 51 0.0
p18.pddl
52 52 0.0 51 51 0.0
p19.pddl
52 52 0.0 51 51 0.0
p20.pddl
50 50 0.0 50 50 0.0
p21.pddl
50 50 0.0 50 50 0.0
p22.pddl
52 52 0.0 52 52 0.0
p23.pddl
51 51 0.0 51 51 0.0
p24.pddl
52 52 0.0 52 52 0.0
p25.pddl
52 52 0.0 52 52 0.0
p26.pddl
55 55 0.0 55 55 0.0
p27.pddl
56 56 0.0 56 56 0.0
p28.pddl
58 58 0.0 58 58 0.0
p29.pddl
61 61 0.0 61 61 0.0
p30.pddl
67 67 0.0 67 67 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pegsol-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
52 52 0.0 48 48 0.0
p02.pddl
51 51 0.0 51 51 0.0
p03.pddl
52 52 0.0 51 51 0.0
p04.pddl
52 52 0.0 51 51 0.0
p05.pddl
53 53 0.0 49 49 0.0
p06.pddl
52 52 0.0 51 51 0.0
p07.pddl
49 49 0.0 49 49 0.0
p08.pddl
50 50 0.0 50 50 0.0
p09.pddl
50 50 0.0 50 50 0.0
p10.pddl
50 50 0.0 50 50 0.0
p11.pddl
52 52 0.0 52 52 0.0
p12.pddl
54 54 0.0 52 52 0.0
p13.pddl
51 51 0.0 51 51 0.0
p14.pddl
52 52 0.0 52 52 0.0
p15.pddl
52 52 0.0 52 52 0.0
p16.pddl
55 55 0.0 55 55 0.0
p17.pddl
56 56 0.0 56 56 0.0
p18.pddl
58 58 0.0 58 58 0.0
p19.pddl
61 61 0.0 61 61 0.0
p20.pddl
67 67 0.0 67 67 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
petri-net-alignment-opt18-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
514 514 0.0 512 512 0.0
p02.pddl
579 579 0.0 577 577 0.0
p03.pddl
632 632 0.0 630 630 0.0
p04.pddl
641 641 0.0 639 639 0.0
p05.pddl
569 569 0.0 567 567 0.0
p06.pddl
642 642 0.0 640 640 0.0
p07.pddl
624 624 0.0 622 622 0.0
p08.pddl
643 643 0.0 641 641 0.0
p09.pddl
633 633 0.0 631 631 0.0
p10.pddl
726 726 0.0 724 724 0.0
p11.pddl
671 671 0.0 669 669 0.0
p12.pddl
790 790 0.0 788 788 0.0
p13.pddl
725 725 0.0 723 723 0.0
p14.pddl
733 733 0.0 731 731 0.0
p15.pddl
720 720 0.0 718 718 0.0
p16.pddl
763 763 0.0 761 761 0.0
p17.pddl
780 780 0.0 778 778 0.0
p18.pddl
763 763 0.0 761 761 0.0
p19.pddl
779 779 0.0 777 777 0.0
p20.pddl
792 792 0.0 790 790 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-notankage
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
12 12 0.0 8 8 0.0
p02-net1-b6-g4.pddl
20 20 0.0 13 13 0.0
p03-net1-b8-g3.pddl
19 19 0.0 11 11 0.0
p04-net1-b8-g5.pddl
25 25 0.0 15 15 0.0
p05-net1-b10-g4.pddl
22 22 0.0 13 13 0.0
p06-net1-b10-g6.pddl
30 30 0.0 18 18 0.0
p07-net1-b12-g5.pddl
27 27 0.0 16 16 0.0
p08-net1-b12-g7.pddl
37 37 0.0 22 22 0.0
p09-net1-b14-g6.pddl
42 42 0.0 24 24 0.0
p10-net1-b14-g8.pddl
56 56 0.0 32 32 0.0
p11-net2-b10-g2.pddl
12 12 0.0 15 15 0.0
p12-net2-b10-g4.pddl
19 19 0.0 18 18 0.0
p13-net2-b12-g3.pddl
16 16 0.0 18 18 0.0
p14-net2-b12-g5.pddl
22 22 0.0 25 25 0.0
p15-net2-b14-g4.pddl
18 18 0.0 19 19 0.0
p16-net2-b14-g6.pddl
26 26 0.0 24 24 0.0
p17-net2-b16-g5.pddl
21 21 0.0 20 20 0.0
p18-net2-b16-g7.pddl
29 29 0.0 27 27 0.0
p19-net2-b18-g6.pddl
23 23 0.0 25 25 0.0
p20-net2-b18-g8.pddl
31 31 0.0 32 32 0.0
p21-net3-b12-g2.pddl
10 10 0.0 11 11 0.0
p22-net3-b12-g4.pddl
25 25 0.0 25 25 0.0
p23-net3-b14-g3.pddl
16 16 0.0 20 20 0.0
p24-net3-b14-g5.pddl
24 24 0.0 26 26 0.0
p25-net3-b16-g5.pddl
26 26 0.0 26 26 0.0
p26-net3-b16-g7.pddl
34 34 0.0 34 34 0.0
p27-net3-b18-g6.pddl
29 29 0.0 29 29 0.0
p28-net3-b18-g7.pddl
37 37 0.0 34 34 0.0
p29-net3-b20-g6.pddl
30 30 0.0 28 28 0.0
p30-net3-b20-g8.pddl
37 37 0.0 34 34 0.0
p31-net4-b14-g3.pddl
14 14 0.0 10 10 0.0
p32-net4-b14-g5.pddl
24 24 0.0 16 16 0.0
p33-net4-b16-g5.pddl
18 18 0.0 18 18 0.0
p34-net4-b16-g6.pddl
25 25 0.0 20 20 0.0
p35-net4-b18-g4.pddl
17 17 0.0 12 12 0.0
p36-net4-b18-g6.pddl
26 26 0.0 20 20 0.0
p37-net4-b20-g5.pddl
18 18 0.0 15 15 0.0
p38-net4-b20-g7.pddl
24 24 0.0 19 19 0.0
p39-net4-b22-g7.pddl
27 27 0.0 25 25 0.0
p40-net4-b22-g8.pddl
30 30 0.0 27 27 0.0
p41-net5-b22-g2.pddl
8 8 0.0 7 7 0.0
p42-net5-b22-g4.pddl
22 22 0.0 20 20 0.0
p43-net5-b24-g3.pddl
17 17 0.0 16 16 0.0
p44-net5-b24-g5.pddl
21 21 0.0 24 24 0.0
p45-net5-b26-g4.pddl
19 19 0.0 23 23 0.0
p46-net5-b26-g6.pddl
26 26 0.0 30 30 0.0
p47-net5-b28-g5.pddl
21 21 0.0 28 28 0.0
p48-net5-b28-g7.pddl
32 32 0.0 36 36 0.0
p49-net5-b30-g6.pddl
27 27 0.0 20 20 0.0
p50-net5-b30-g8.pddl
37 37 0.0 30 30 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-tankage
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
14 14 0.0 14 14 0.0
p02-net1-b6-g4-t50.pddl
22 22 0.0 21 21 0.0
p03-net1-b8-g3-t80.pddl
17 17 0.0 17 17 0.0
p04-net1-b8-g5-t80.pddl
21 21 0.0 19 19 0.0
p05-net1-b10-g4-t50.pddl
20 20 0.0 19 19 0.0
p06-net1-b10-g6-t50.pddl
27 27 0.0 25 25 0.0
p07-net1-b12-g5-t80.pddl
19 19 0.0 17 17 0.0
p08-net1-b12-g7-t80.pddl
25 25 0.0 23 23 0.0
p09-net1-b14-g6-t50.pddl
29 29 0.0 27 27 0.0
p10-net1-b14-g8-t50.pddl
39 39 0.0 35 35 0.0
p11-net2-b10-g2-t30.pddl
15 15 0.0 18 18 0.0
p12-net2-b10-g4-t60.pddl
23 23 0.0 22 22 0.0
p13-net2-b12-g3-t70.pddl
17 17 0.0 21 21 0.0
p14-net2-b12-g5-t30.pddl
26 26 0.0 27 27 0.0
p15-net2-b14-g4-t30.pddl
19 19 0.0 19 19 0.0
p16-net2-b14-g6-t80.pddl
26 26 0.0 24 24 0.0
p17-net2-b16-g5-t20.pddl
27 27 0.0 27 27 0.0
p18-net2-b16-g7-t60.pddl
29 29 0.0 27 27 0.0
p19-net2-b18-g6-t60.pddl
26 26 0.0 27 27 0.0
p20-net2-b18-g8-t90.pddl
32 32 0.0 32 32 0.0
p21-net3-b12-g2-t60.pddl
11 11 0.0 12 12 0.0
p22-net3-b12-g4-t60.pddl
22 22 0.0 26 26 0.0
p23-net3-b14-g3-t60.pddl
20 20 0.0 27 27 0.0
p24-net3-b14-g5-t60.pddl
28 28 0.0 33 33 0.0
p25-net3-b16-g5-t60.pddl
26 26 0.0 27 27 0.0
p26-net3-b16-g7-t70.pddl
34 34 0.0 35 35 0.0
p27-net3-b18-g6-t70.pddl
28 28 0.0 29 29 0.0
p28-net3-b18-g7-t70.pddl
38 38 0.0 39 39 0.0
p29-net3-b20-g6-t70.pddl
28 28 0.0 29 29 0.0
p30-net3-b20-g8-t70.pddl
37 37 0.0 35 35 0.0
p31-net4-b14-g3-t20.pddl
19 19 0.0 18 18 0.0
p32-net4-b14-g5-t30.pddl
30 30 0.0 27 27 0.0
p33-net4-b16-g5-t60.pddl
24 24 0.0 25 25 0.0
p34-net4-b16-g6-t60.pddl
27 27 0.0 23 23 0.0
p35-net4-b18-g4-t90.pddl
19 19 0.0 15 15 0.0
p36-net4-b18-g6-t90.pddl
26 26 0.0 22 22 0.0
p37-net4-b20-g5-t60.pddl
19 19 0.0 17 17 0.0
p38-net4-b20-g7-t60.pddl
24 24 0.0 20 20 0.0
p39-net4-b22-g7-t50.pddl
29 29 0.0 26 26 0.0
p40-net4-b22-g8-t50.pddl
32 32 0.0 28 28 0.0
p41-net5-b22-g2-t20.pddl
13 13 0.0 12 12 0.0
p42-net5-b22-g4-t50.pddl
24 24 0.0 23 23 0.0
p43-net5-b24-g3-t80.pddl
20 20 0.0 24 24 0.0
p44-net5-b24-g5-t80.pddl
24 24 0.0 30 30 0.0
p45-net5-b26-g4-t50.pddl
21 21 0.0 25 25 0.0
p46-net5-b26-g6-t50.pddl
28 28 0.0 31 31 0.0
p47-net5-b28-g5-t50.pddl
27 27 0.0 31 31 0.0
p48-net5-b28-g7-t50.pddl
36 36 0.0 38 38 0.0
p49-net5-b30-g6-t50.pddl
26 26 0.0 24 24 0.0
p50-net5-b30-g8-t50.pddl
36 36 0.0 34 34 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
psr-small
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
4 4 0.0 4 4 0.0
p02-s5-n1-l3-f30.pddl
5 5 0.0 5 5 0.0
p03-s7-n1-l3-f70.pddl
4 4 0.0 4 4 0.0
p04-s8-n1-l4-f10.pddl
8 8 0.0 8 8 0.0
p05-s9-n1-l4-f30.pddl
6 6 0.0 6 6 0.0
p06-s10-n1-l4-f50.pddl
4 4 0.0 4 4 0.0
p07-s11-n1-l4-f70.pddl
6 6 0.0 6 6 0.0
p08-s12-n1-l5-f10.pddl
8 8 0.0 8 8 0.0
p09-s13-n1-l5-f30.pddl
6 6 0.0 6 6 0.0
p10-s17-n2-l2-f30.pddl
12 12 0.0 12 12 0.0
p11-s18-n2-l2-f50.pddl
7 7 0.0 7 7 0.0
p12-s21-n2-l3-f30.pddl
8 8 0.0 8 8 0.0
p13-s22-n2-l3-f50.pddl
8 8 0.0 8 8 0.0
p14-s23-n2-l3-f70.pddl
7 7 0.0 7 7 0.0
p15-s24-n2-l4-f10.pddl
9 9 0.0 8 8 0.0
p16-s29-n2-l5-f30.pddl
8 8 0.0 7 7 0.0
p17-s30-n2-l5-f50.pddl
6 6 0.0 6 6 0.0
p18-s31-n2-l5-f70.pddl
8 8 0.0 8 8 0.0
p19-s33-n3-l2-f30.pddl
13 13 0.0 12 12 0.0
p20-s34-n3-l2-f50.pddl
9 9 0.0 9 9 0.0
p21-s35-n3-l2-f70.pddl
9 9 0.0 9 9 0.0
p22-s37-n3-l3-f30.pddl
17 17 0.0 17 17 0.0
p23-s38-n3-l3-f50.pddl
11 11 0.0 11 11 0.0
p24-s39-n3-l3-f70.pddl
9 9 0.0 9 9 0.0
p25-s40-n3-l4-f10.pddl
13 13 0.0 12 12 0.0
p26-s41-n3-l4-f30.pddl
10 10 0.0 10 10 0.0
p27-s42-n3-l4-f50.pddl
10 10 0.0 10 10 0.0
p28-s43-n3-l4-f70.pddl
8 8 0.0 8 8 0.0
p29-s45-n3-l5-f30.pddl
19 19 0.0 19 19 0.0
p30-s46-n3-l5-f50.pddl
11 11 0.0 11 11 0.0
p31-s49-n4-l2-f30.pddl
16 16 0.0 15 15 0.0
p32-s50-n4-l2-f50.pddl
11 11 0.0 11 11 0.0
p33-s51-n4-l2-f70.pddl
11 11 0.0 10 10 0.0
p34-s55-n4-l3-f70.pddl
11 11 0.0 11 11 0.0
p35-s57-n5-l2-f30.pddl
17 17 0.0 16 16 0.0
p36-s65-n6-l2-f30.pddl
22 22 0.0 21 21 0.0
p37-s67-n6-l2-f70.pddl
17 17 0.0 17 17 0.0
p38-s78-n3-l3-f50.pddl
11 11 0.0 11 11 0.0
p39-s79-n3-l3-f70.pddl
11 11 0.0 11 11 0.0
p40-s80-n3-l4-f10.pddl
14 14 0.0 13 13 0.0
p41-s81-n3-l4-f30.pddl
10 10 0.0 10 10 0.0
p42-s82-n3-l4-f50.pddl
9 9 0.0 8 8 0.0
p43-s83-n3-l4-f70.pddl
10 10 0.0 10 10 0.0
p44-s89-n4-l2-f30.pddl
15 15 0.0 15 15 0.0
p45-s94-n4-l3-f50.pddl
12 12 0.0 12 12 0.0
p46-s97-n5-l2-f30.pddl
18 18 0.0 17 17 0.0
p47-s98-n5-l2-f50.pddl
15 15 0.0 15 15 0.0
p48-s101-n5-l3-f30.pddl
24 24 0.0 24 24 0.0
p49-s105-n6-l2-f30.pddl
28 28 0.0 28 28 0.0
p50-s107-n6-l2-f70.pddl
16 16 0.0 16 16 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
rovers
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
18 18 0.0 13 13 0.0
p02.pddl
16 16 0.0 11 11 0.0
p03.pddl
18 18 0.0 12 12 0.0
p04.pddl
17 17 0.0 11 11 0.0
p05.pddl
33 33 0.0 22 22 0.0
p06.pddl
50 50 0.0 36 36 0.0
p07.pddl
25 25 0.0 11 11 0.0
p08.pddl
34 34 0.0 13 13 0.0
p09.pddl
40 40 0.0 23 23 0.0
p10.pddl
45 45 0.0 19 19 0.0
p11.pddl
42 42 0.0 27 27 0.0
p12.pddl
25 25 0.0 9 9 0.0
p13.pddl
53 53 0.0 21 21 0.0
p14.pddl
37 37 0.0 21 21 0.0
p15.pddl
49 49 0.0 26 26 0.0
p16.pddl
49 49 0.0 19 19 0.0
p17.pddl
57 57 0.0 31 31 0.0
p18.pddl
46 46 0.0 18 18 0.0
p19.pddl
68 68 0.0 26 26 0.0
p20.pddl
86 86 0.0 35 35 0.0
p21.pddl
42 42 0.0 25 25 0.0
p22.pddl
59 59 0.0 27 27 0.0
p23.pddl
41 41 0.0 32 32 0.0
p24.pddl
75 75 0.0 40 40 0.0
p25.pddl
22 22 0.0 17 17 0.0
p26.pddl
30 30 0.0 25 25 0.0
p27.pddl
66 66 0.0 36 36 0.0
p28.pddl
57 57 0.0 33 33 0.0
p29.pddl
44 44 0.0 26 26 0.0
p30.pddl
50 50 0.0 44 44 0.0
p31.pddl
87 87 0.0 43 43 0.0
p32.pddl
70 70 0.0 64 64 0.0
p33.pddl
98 98 0.0 81 81 0.0
p34.pddl
64 64 0.0 54 54 0.0
p35.pddl
134 134 0.0 115 115 0.0
p36.pddl
94 94 0.0 69 69 0.0
p37.pddl
116 116 0.0 104 104 0.0
p38.pddl
110 110 0.0 94 94 0.0
p39.pddl
138 138 0.0 115 115 0.0
p40.pddl
138 138 0.0 117 117 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
satellite
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
14 14 0.0 10 10 0.0
p02-pfile2.pddl
20 20 0.0 14 14 0.0
p03-pfile3.pddl
14 14 0.0 6 6 0.0
p04-pfile4.pddl
26 26 0.0 14 14 0.0
p05-pfile5.pddl
19 19 0.0 9 9 0.0
p06-pfile6.pddl
28 28 0.0 13 13 0.0
p07-pfile7.pddl
29 29 0.0 11 11 0.0
p08-pfile8.pddl
30 30 0.0 10 10 0.0
p09-pfile9.pddl
34 34 0.0 16 16 0.0
p10-pfile10.pddl
40 40 0.0 13 13 0.0
p11-pfile11.pddl
44 44 0.0 17 17 0.0
p12-pfile12.pddl
64 64 0.0 28 28 0.0
p13-pfile13.pddl
77 77 0.0 30 30 0.0
p14-pfile14.pddl
46 46 0.0 22 22 0.0
p15-pfile15.pddl
56 56 0.0 29 29 0.0
p16-pfile16.pddl
46 46 0.0 27 27 0.0
p17-pfile17.pddl
40 40 0.0 23 23 0.0
p18-pfile18.pddl
42 42 0.0 13 13 0.0
p19-pfile19.pddl
71 71 0.0 29 29 0.0
p20-pfile20.pddl
103 103 0.0 41 41 0.0
p21-HC-pfile1.pddl
74 74 0.0 40 40 0.0
p22-HC-pfile2.pddl
116 116 0.0 47 47 0.0
p23-HC-pfile3.pddl
102 102 0.0 55 55 0.0
p24-HC-pfile4.pddl
140 140 0.0 74 74 0.0
p25-HC-pfile5.pddl
128 128 0.0 68 68 0.0
p26-HC-pfile6.pddl
136 136 0.0 72 72 0.0
p27-HC-pfile7.pddl
144 144 0.0 66 66 0.0
p28-HC-pfile8.pddl
188 188 0.0 95 95 0.0
p29-HC-pfile9.pddl
186 186 0.0 99 99 0.0
p30-HC-pfile10.pddl
228 228 0.0 120 120 0.0
p31-HC-pfile11.pddl
266 266 0.0 136 136 0.0
p32-HC-pfile12.pddl
364 364 0.0 186 186 0.0
p33-HC-pfile13.pddl
462 462 0.0 236 236 0.0
p34-HC-pfile14.pddl
421 421 0.0 142 142 0.0
p35-HC-pfile15.pddl
444 444 0.0 190 190 0.0
p36-HC-pfile16.pddl
356 356 0.0 181 181 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-08-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
18 18 0.0 12 12 0.0
p02.pddl
18 18 0.0 12 12 0.0
p03.pddl
25 25 0.0 17 17 0.0
p04.pddl
24 24 0.0 16 16 0.0
p05.pddl
24 24 0.0 16 16 0.0
p06.pddl
34 34 0.0 23 23 0.0
p07.pddl
30 30 0.0 20 20 0.0
p08.pddl
30 30 0.0 20 20 0.0
p09.pddl
39 39 0.0 29 29 0.0
p10.pddl
36 36 0.0 24 24 0.0
p11.pddl
36 36 0.0 24 24 0.0
p12.pddl
47 47 0.0 35 35 0.0
p13.pddl
42 42 0.0 28 28 0.0
p14.pddl
42 42 0.0 28 28 0.0
p15.pddl
55 55 0.0 41 41 0.0
p16.pddl
48 48 0.0 32 32 0.0
p17.pddl
48 48 0.0 32 32 0.0
p18.pddl
63 63 0.0 47 47 0.0
p19.pddl
54 54 0.0 36 36 0.0
p20.pddl
54 54 0.0 36 36 0.0
p21.pddl
71 71 0.0 53 53 0.0
p22.pddl
19 19 0.0 15 15 0.0
p23.pddl
19 19 0.0 15 15 0.0
p24.pddl
19 19 0.0 15 15 0.0
p25.pddl
32 32 0.0 24 24 0.0
p26.pddl
32 32 0.0 24 24 0.0
p27.pddl
43 43 0.0 35 35 0.0
p28.pddl
48 48 0.0 36 36 0.0
p29.pddl
48 48 0.0 36 36 0.0
p30.pddl
67 67 0.0 55 55 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
scanalyzer-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
19 19 0.0 15 15 0.0
p02.pddl
18 18 0.0 12 12 0.0
p03.pddl
25 25 0.0 17 17 0.0
p04.pddl
24 24 0.0 16 16 0.0
p05.pddl
30 30 0.0 20 20 0.0
p06.pddl
24 24 0.0 16 16 0.0
p07.pddl
54 54 0.0 36 36 0.0
p08.pddl
36 36 0.0 24 24 0.0
p09.pddl
42 42 0.0 28 28 0.0
p10.pddl
48 48 0.0 32 32 0.0
p11.pddl
32 32 0.0 24 24 0.0
p12.pddl
34 34 0.0 23 23 0.0
p13.pddl
43 43 0.0 35 35 0.0
p14.pddl
32 32 0.0 24 24 0.0
p15.pddl
30 30 0.0 20 20 0.0
p16.pddl
36 36 0.0 24 24 0.0
p17.pddl
42 42 0.0 28 28 0.0
p18.pddl
48 48 0.0 32 32 0.0
p19.pddl
54 54 0.0 36 36 0.0
p20.pddl
48 48 0.0 36 36 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
snake-opt18-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
31 31 0.0 29 29 0.0
p02.pddl
32 32 0.0 33 33 0.0
p03.pddl
39 39 0.0 37 37 0.0
p04.pddl
23 23 0.0 22 22 0.0
p05.pddl
23 23 0.0 26 26 0.0
p06.pddl
31 31 0.0 33 33 0.0
p07.pddl
36 36 0.0 37 37 0.0
p08.pddl
41 41 0.0 40 40 0.0
p09.pddl
26 26 0.0 24 24 0.0
p10.pddl
28 28 0.0 28 28 0.0
p11.pddl
32 32 0.0 31 31 0.0
p12.pddl
37 37 0.0 37 37 0.0
p13.pddl
42 42 0.0 42 42 0.0
p14.pddl
49 49 0.0 49 49 0.0
p15.pddl
24 24 0.0 26 26 0.0
p16.pddl
35 35 0.0 36 36 0.0
p17.pddl
43 43 0.0 41 41 0.0
p18.pddl
47 47 0.0 45 45 0.0
p19.pddl
54 54 0.0 54 54 0.0
p20.pddl
28 28 0.0 28 28 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt08-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
37 37 0.0 31 31 0.0
p02.pddl
4 4 0.0 22 22 0.0
p03.pddl
3 3 0.0 18 18 0.0
p04.pddl
50 50 0.0 49 49 0.0
p05.pddl
16 16 0.0 17 17 0.0
p06.pddl
16 16 0.0 15 15 0.0
p07.pddl
9 9 0.0 20 20 0.0
p08.pddl
29 29 0.0 25 25 0.0
p09.pddl
30 30 0.0 33 33 0.0
p10.pddl
37 37 0.0 33 33 0.0
p11.pddl
9 9 0.0 51 51 0.0
p12.pddl
25 25 0.0 29 29 0.0
p13.pddl
21 21 0.0 21 21 0.0
p14.pddl
7 7 0.0 13 13 0.0
p15.pddl
8 8 0.0 107 107 0.0
p16.pddl
42 42 0.0 41 41 0.0
p17.pddl
18 18 0.0 19 19 0.0
p18.pddl
8 8 0.0 56 56 0.0
p19.pddl
8 8 0.0 46 46 0.0
p20.pddl
10 10 0.0 8 8 0.0
p21.pddl
15 15 0.0 14 14 0.0
p22.pddl
61 61 0.0 54 54 0.0
p23.pddl
10 10 0.0 37 37 0.0
p24.pddl
35 35 0.0 33 33 0.0
p25.pddl
55 55 0.0 50 50 0.0
p26.pddl
32 32 0.0 29 29 0.0
p27.pddl
14 14 0.0 28 28 0.0
p28.pddl
21 21 0.0 27 27 0.0
p29.pddl
24 24 0.0 25 25 0.0
p30.pddl
24 24 0.0 25 25 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
sokoban-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
16 16 0.0 15 15 0.0
p02.pddl
18 18 0.0 19 19 0.0
p03.pddl
7 7 0.0 13 13 0.0
p04.pddl
50 50 0.0 49 49 0.0
p05.pddl
42 42 0.0 41 41 0.0
p06.pddl
9 9 0.0 51 51 0.0
p07.pddl
37 37 0.0 33 33 0.0
p08.pddl
30 30 0.0 33 33 0.0
p09.pddl
9 9 0.0 20 20 0.0
p10.pddl
16 16 0.0 17 17 0.0
p11.pddl
21 21 0.0 21 21 0.0
p12.pddl
10 10 0.0 8 8 0.0
p13.pddl
29 29 0.0 25 25 0.0
p14.pddl
25 25 0.0 29 29 0.0
p15.pddl
8 8 0.0 56 56 0.0
p16.pddl
8 8 0.0 107 107 0.0
p17.pddl
8 8 0.0 46 46 0.0
p18.pddl
15 15 0.0 14 14 0.0
p19.pddl
61 61 0.0 54 54 0.0
p20.pddl
10 10 0.0 37 37 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
spider-opt18-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
135 135 0.0 101 101 0.0
p02.pddl
173 173 0.0 132 132 0.0
p03.pddl
209 209 0.0 160 160 0.0
p04.pddl
257 257 0.0 196 196 0.0
p05.pddl
296 296 0.0 236 236 0.0
p06.pddl
336 336 0.0 268 268 0.0
p07.pddl
121 121 0.0 89 89 0.0
p08.pddl
161 161 0.0 121 121 0.0
p09.pddl
211 211 0.0 151 151 0.0
p10.pddl
246 246 0.0 180 180 0.0
p11.pddl
267 267 0.0 210 210 0.0
p12.pddl
305 305 0.0 239 239 0.0
p13.pddl
342 342 0.0 268 268 0.0
p14.pddl
114 114 0.0 85 85 0.0
p15.pddl
170 170 0.0 124 124 0.0
p16.pddl
188 188 0.0 140 140 0.0
p17.pddl
247 247 0.0 184 184 0.0
p18.pddl
268 268 0.0 211 211 0.0
p19.pddl
293 293 0.0 231 231 0.0
p20.pddl
350 350 0.0 274 274 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
storage
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
9 9 0.0 7 7 0.0
p02.pddl
8 8 0.0 4 4 0.0
p03.pddl
8 8 0.0 4 4 0.0
p04.pddl
13 13 0.0 11 11 0.0
p05.pddl
11 11 0.0 5 5 0.0
p06.pddl
11 11 0.0 5 5 0.0
p07.pddl
19 19 0.0 14 14 0.0
p08.pddl
15 15 0.0 7 7 0.0
p09.pddl
13 13 0.0 7 7 0.0
p10.pddl
23 23 0.0 17 17 0.0
p11.pddl
17 17 0.0 9 9 0.0
p12.pddl
17 17 0.0 9 9 0.0
p13.pddl
25 25 0.0 21 21 0.0
p14.pddl
23 23 0.0 12 12 0.0
p15.pddl
21 21 0.0 12 12 0.0
p16.pddl
25 25 0.0 14 14 0.0
p17.pddl
29 29 0.0 16 16 0.0
p18.pddl
34 34 0.0 18 18 0.0
p19.pddl
37 37 0.0 21 21 0.0
p20.pddl
41 41 0.0 23 23 0.0
p21.pddl
46 46 0.0 25 25 0.0
p22.pddl
49 49 0.0 27 27 0.0
p23.pddl
54 54 0.0 30 30 0.0
p24.pddl
57 57 0.0 32 32 0.0
p25.pddl
62 62 0.0 34 34 0.0
p26.pddl
32 32 0.0 36 36 0.0
p27.pddl
34 34 0.0 39 39 0.0
p28.pddl
36 36 0.0 41 41 0.0
p29.pddl
38 38 0.0 43 43 0.0
p30.pddl
40 40 0.0 45 45 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
termes-opt18-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
21 21 0.0 17 17 0.0
p02.pddl
24 24 0.0 23 23 0.0
p03.pddl
23 23 0.0 18 18 0.0
p04.pddl
28 28 0.0 21 21 0.0
p05.pddl
24 24 0.0 19 19 0.0
p06.pddl
30 30 0.0 24 24 0.0
p07.pddl
27 27 0.0 26 26 0.0
p08.pddl
30 30 0.0 28 28 0.0
p09.pddl
29 29 0.0 21 21 0.0
p10.pddl
29 29 0.0 26 26 0.0
p11.pddl
28 28 0.0 23 23 0.0
p12.pddl
26 26 0.0 24 24 0.0
p13.pddl
34 34 0.0 27 27 0.0
p14.pddl
30 30 0.0 28 28 0.0
p15.pddl
34 34 0.0 27 27 0.0
p16.pddl
37 37 0.0 30 30 0.0
p17.pddl
36 36 0.0 29 29 0.0
p18.pddl
32 32 0.0 28 28 0.0
p19.pddl
30 30 0.0 28 28 0.0
p20.pddl
36 36 0.0 32 32 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tetris-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
30 30 0.0 18 18 0.0
p01-8.pddl
29 29 0.0 20 20 0.0
p01-10.pddl
39 39 0.0 28 28 0.0
p02-4.pddl
15 15 0.0 11 11 0.0
p02-6.pddl
25 25 0.0 17 17 0.0
p02-8.pddl
34 34 0.0 22 22 0.0
p02-10.pddl
41 41 0.0 28 28 0.0
p03-4.pddl
17 17 0.0 13 13 0.0
p03-6.pddl
25 25 0.0 18 18 0.0
p03-8.pddl
30 30 0.0 22 22 0.0
p03-10.pddl
40 40 0.0 27 27 0.0
p04-6.pddl
27 27 0.0 18 18 0.0
p04-8.pddl
37 37 0.0 23 23 0.0
p04-10.pddl
42 42 0.0 27 27 0.0
p05-6.pddl
23 23 0.0 16 16 0.0
p05-8.pddl
33 33 0.0 24 24 0.0
p05-10.pddl
36 36 0.0 26 26 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
12 12 0.0 12 12 0.0
p02.pddl
29 29 0.0 41 41 0.0
p03.pddl
24 24 0.0 28 28 0.0
p04.pddl
29 29 0.0 51 51 0.0
p05.pddl
29 29 0.0 37 37 0.0
p06.pddl
34 34 0.0 40 40 0.0
p07.pddl
24 24 0.0 28 28 0.0
p08.pddl
29 29 0.0 37 37 0.0
p09.pddl
24 24 0.0 34 34 0.0
p10.pddl
34 34 0.0 31 31 0.0
p11.pddl
29 29 0.0 28 28 0.0
p12.pddl
34 34 0.0 31 31 0.0
p13.pddl
29 29 0.0 28 28 0.0
p14.pddl
22 22 0.0 24 24 0.0
p15.pddl
18 18 0.0 23 23 0.0
p16.pddl
26 26 0.0 27 27 0.0
p17.pddl
22 22 0.0 27 27 0.0
p18.pddl
25 25 0.0 28 28 0.0
p19.pddl
25 25 0.0 26 26 0.0
p20.pddl
30 30 0.0 38 38 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tidybot-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
27 27 0.0 27 27 0.0
p02.pddl
28 28 0.0 27 27 0.0
p03.pddl
26 26 0.0 28 28 0.0
p04.pddl
16 16 0.0 22 22 0.0
p05.pddl
26 26 0.0 28 28 0.0
p06.pddl
27 27 0.0 30 30 0.0
p07.pddl
22 22 0.0 26 26 0.0
p08.pddl
25 25 0.0 26 26 0.0
p09.pddl
20 20 0.0 22 22 0.0
p10.pddl
24 24 0.0 28 28 0.0
p11.pddl
29 29 0.0 28 28 0.0
p12.pddl
34 34 0.0 31 31 0.0
p13.pddl
29 29 0.0 28 28 0.0
p14.pddl
22 22 0.0 24 24 0.0
p15.pddl
18 18 0.0 23 23 0.0
p16.pddl
26 26 0.0 27 27 0.0
p17.pddl
22 22 0.0 27 27 0.0
p18.pddl
25 25 0.0 28 28 0.0
p19.pddl
25 25 0.0 26 26 0.0
p20.pddl
30 30 0.0 38 38 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
tpp
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
9 9 0.0 9 9 0.0
p02.pddl
16 16 0.0 16 16 0.0
p03.pddl
23 23 0.0 23 23 0.0
p04.pddl
30 30 0.0 30 30 0.0
p05.pddl
32 32 0.0 25 25 0.0
p06.pddl
37 37 0.0 28 28 0.0
p07.pddl
45 45 0.0 35 35 0.0
p08.pddl
52 52 0.0 41 41 0.0
p09.pddl
23 23 0.0 41 41 0.0
p10.pddl
26 26 0.0 44 44 0.0
p11.pddl
21 21 0.0 33 33 0.0
p12.pddl
22 22 0.0 34 34 0.0
p13.pddl
21 21 0.0 24 24 0.0
p14.pddl
28 28 0.0 31 31 0.0
p15.pddl
33 33 0.0 36 36 0.0
p16.pddl
39 39 0.0 39 39 0.0
p17.pddl
35 35 0.0 35 35 0.0
p18.pddl
35 35 0.0 35 35 0.0
p19.pddl
45 45 0.0 45 45 0.0
p20.pddl
51 51 0.0 51 51 0.0
p21.pddl
47 47 0.0 47 47 0.0
p22.pddl
39 39 0.0 39 39 0.0
p23.pddl
48 48 0.0 48 48 0.0
p24.pddl
49 49 0.0 49 49 0.0
p25.pddl
58 58 0.0 58 58 0.0
p26.pddl
60 60 0.0 60 60 0.0
p27.pddl
65 65 0.0 65 65 0.0
p28.pddl
68 68 0.0 68 68 0.0
p29.pddl
80 80 0.0 80 80 0.0
p30.pddl
78 78 0.0 78 78 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt08-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
7 7 0.0 4 4 0.0
p02.pddl
11 11 0.0 6 6 0.0
p03.pddl
17 17 0.0 8 8 0.0
p04.pddl
22 22 0.0 10 10 0.0
p05.pddl
29 29 0.0 12 12 0.0
p06.pddl
30 30 0.0 14 14 0.0
p07.pddl
36 36 0.0 16 16 0.0
p08.pddl
38 38 0.0 18 18 0.0
p09.pddl
41 41 0.0 20 20 0.0
p10.pddl
50 50 0.0 22 22 0.0
p11.pddl
9 9 0.0 4 4 0.0
p12.pddl
14 14 0.0 6 6 0.0
p13.pddl
19 19 0.0 8 8 0.0
p14.pddl
23 23 0.0 10 10 0.0
p15.pddl
26 26 0.0 12 12 0.0
p16.pddl
34 34 0.0 14 14 0.0
p17.pddl
39 39 0.0 16 16 0.0
p18.pddl
40 40 0.0 18 18 0.0
p19.pddl
43 43 0.0 20 20 0.0
p20.pddl
55 55 0.0 22 22 0.0
p21.pddl
8 8 0.0 4 4 0.0
p22.pddl
12 12 0.0 6 6 0.0
p23.pddl
17 17 0.0 8 8 0.0
p24.pddl
21 21 0.0 10 10 0.0
p25.pddl
28 28 0.0 12 12 0.0
p26.pddl
29 29 0.0 14 14 0.0
p27.pddl
33 33 0.0 16 16 0.0
p28.pddl
39 39 0.0 18 18 0.0
p29.pddl
42 42 0.0 20 20 0.0
p30.pddl
47 47 0.0 22 22 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
17 17 0.0 8 8 0.0
p02.pddl
17 17 0.0 8 8 0.0
p03.pddl
14 14 0.0 6 6 0.0
p04.pddl
19 19 0.0 8 8 0.0
p05.pddl
21 21 0.0 10 10 0.0
p06.pddl
22 22 0.0 10 10 0.0
p07.pddl
26 26 0.0 12 12 0.0
p08.pddl
24 24 0.0 12 12 0.0
p09.pddl
27 27 0.0 14 14 0.0
p10.pddl
28 28 0.0 14 14 0.0
p11.pddl
31 31 0.0 16 16 0.0
p12.pddl
30 30 0.0 16 16 0.0
p13.pddl
35 35 0.0 16 16 0.0
p14.pddl
34 34 0.0 16 16 0.0
p15.pddl
37 37 0.0 18 18 0.0
p16.pddl
38 38 0.0 18 18 0.0
p17.pddl
29 29 0.0 12 12 0.0
p18.pddl
23 23 0.0 10 10 0.0
p19.pddl
28 28 0.0 12 12 0.0
p20.pddl
30 30 0.0 14 14 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
transport-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
14 14 0.0 8 8 0.0
p02.pddl
17 17 0.0 8 8 0.0
p03.pddl
21 21 0.0 10 10 0.0
p04.pddl
21 21 0.0 10 10 0.0
p05.pddl
28 28 0.0 12 12 0.0
p06.pddl
29 29 0.0 12 12 0.0
p07.pddl
20 20 0.0 8 8 0.0
p08.pddl
21 21 0.0 8 8 0.0
p09.pddl
24 24 0.0 10 10 0.0
p10.pddl
26 26 0.0 10 10 0.0
p11.pddl
26 26 0.0 12 12 0.0
p12.pddl
31 31 0.0 12 12 0.0
p13.pddl
19 19 0.0 8 8 0.0
p14.pddl
20 20 0.0 8 8 0.0
p15.pddl
26 26 0.0 10 10 0.0
p16.pddl
22 22 0.0 10 10 0.0
p17.pddl
30 30 0.0 12 12 0.0
p18.pddl
29 29 0.0 12 12 0.0
p19.pddl
32 32 0.0 14 14 0.0
p20.pddl
32 32 0.0 14 14 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
trucks-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
14 14 0.0 15 15 0.0
p02.pddl
17 17 0.0 18 18 0.0
p03.pddl
22 22 0.0 21 21 0.0
p04.pddl
26 26 0.0 24 24 0.0
p05.pddl
30 30 0.0 27 27 0.0
p06.pddl
33 33 0.0 30 30 0.0
p07.pddl
26 26 0.0 24 24 0.0
p08.pddl
32 32 0.0 28 28 0.0
p09.pddl
34 34 0.0 30 30 0.0
p10.pddl
35 35 0.0 34 34 0.0
p11.pddl
42 42 0.0 37 37 0.0
p12.pddl
47 47 0.0 40 40 0.0
p13.pddl
40 40 0.0 34 34 0.0
p14.pddl
45 45 0.0 38 38 0.0
p15.pddl
48 48 0.0 41 41 0.0
p16.pddl
50 50 0.0 44 44 0.0
p17.pddl
57 57 0.0 47 47 0.0
p18.pddl
61 61 0.0 50 50 0.0
p19.pddl
53 53 0.0 45 45 0.0
p20.pddl
57 57 0.0 48 48 0.0
p21.pddl
57 57 0.0 51 51 0.0
p22.pddl
65 65 0.0 54 54 0.0
p23.pddl
70 70 0.0 57 57 0.0
p24.pddl
74 74 0.0 60 60 0.0
p25.pddl
65 65 0.0 54 54 0.0
p26.pddl
71 71 0.0 58 58 0.0
p27.pddl
75 75 0.0 61 61 0.0
p28.pddl
79 79 0.0 64 64 0.0
p29.pddl
82 82 0.0 67 67 0.0
p30.pddl
86 86 0.0 70 70 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
8 8 0.0 4 4 0.0
problem02-half.pddl
2 2 0.0 2 2 0.0
problem03-full.pddl
18 18 0.0 9 9 0.0
problem03-half.pddl
10 10 0.0 5 5 0.0
problem04-full.pddl
35 35 0.0 16 16 0.0
problem04-half.pddl
18 18 0.0 8 8 0.0
problem05-full.pddl
56 56 0.0 25 25 0.0
problem05-half.pddl
34 34 0.0 15 15 0.0
problem06-full.pddl
80 80 0.0 36 36 0.0
problem06-half.pddl
37 37 0.0 16 16 0.0
problem07-full.pddl
110 110 0.0 49 49 0.0
problem07-half.pddl
76 76 0.0 33 33 0.0
problem08-full.pddl
145 145 0.0 64 64 0.0
problem08-half.pddl
77 77 0.0 33 33 0.0
problem09-full.pddl
184 184 0.0 81 81 0.0
problem09-half.pddl
114 114 0.0 50 50 0.0
problem10-full.pddl
226 226 0.0 100 100 0.0
problem10-half.pddl
114 114 0.0 48 48 0.0
problem11-full.pddl
269 269 0.0 121 121 0.0
problem11-half.pddl
137 137 0.0 58 58 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
visitall-opt14-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
56 56 0.0 25 25 0.0
p-1-6.pddl
80 80 0.0 36 36 0.0
p-1-7.pddl
110 110 0.0 49 49 0.0
p-1-8.pddl
145 145 0.0 64 64 0.0
p-1-9.pddl
184 184 0.0 81 81 0.0
p-1-10.pddl
226 226 0.0 100 100 0.0
p-1-11.pddl
269 269 0.0 121 121 0.0
p-1-12.pddl
326 326 0.0 144 144 0.0
p-1-13.pddl
378 378 0.0 169 169 0.0
p-1-14.pddl
442 442 0.0 196 196 0.0
p-1-15.pddl
501 501 0.0 225 225 0.0
p-1-16.pddl
574 574 0.0 256 256 0.0
p-1-17.pddl
649 649 0.0 289 289 0.0
p-1-18.pddl
726 726 0.0 324 324 0.0
p-05-5.pddl
41 41 0.0 18 18 0.0
p-05-6.pddl
41 41 0.0 18 18 0.0
p-05-7.pddl
56 56 0.0 24 24 0.0
p-05-8.pddl
75 75 0.0 31 31 0.0
p-05-9.pddl
97 97 0.0 42 42 0.0
p-05-10.pddl
109 109 0.0 46 46 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt08-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
31 31 0.0 24 24 0.0
p02.pddl
32 32 0.0 27 27 0.0
p03.pddl
50 50 0.0 35 35 0.0
p04.pddl
48 48 0.0 35 35 0.0
p05.pddl
61 61 0.0 43 43 0.0
p06.pddl
76 76 0.0 52 52 0.0
p07.pddl
82 82 0.0 59 59 0.0
p08.pddl
82 82 0.0 62 62 0.0
p09.pddl
86 86 0.0 73 73 0.0
p10.pddl
100 100 0.0 71 71 0.0
p11.pddl
30 30 0.0 22 22 0.0
p12.pddl
39 39 0.0 28 28 0.0
p13.pddl
46 46 0.0 33 33 0.0
p14.pddl
56 56 0.0 36 36 0.0
p15.pddl
56 56 0.0 41 41 0.0
p16.pddl
59 59 0.0 45 45 0.0
p17.pddl
77 77 0.0 55 55 0.0
p18.pddl
83 83 0.0 61 61 0.0
p19.pddl
83 83 0.0 61 61 0.0
p20.pddl
102 102 0.0 72 72 0.0
p21.pddl
23 23 0.0 18 18 0.0
p22.pddl
38 38 0.0 24 24 0.0
p23.pddl
47 47 0.0 32 32 0.0
p24.pddl
51 51 0.0 38 38 0.0
p25.pddl
73 73 0.0 50 50 0.0
p26.pddl
71 71 0.0 49 49 0.0
p27.pddl
81 81 0.0 55 55 0.0
p28.pddl
90 90 0.0 59 59 0.0
p29.pddl
96 96 0.0 71 71 0.0
p30.pddl
127 127 0.0 85 85 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt11-strips
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
47 47 0.0 32 32 0.0
p02.pddl
39 39 0.0 28 28 0.0
p03.pddl
46 46 0.0 33 33 0.0
p04.pddl
50 50 0.0 35 35 0.0
p05.pddl
51 51 0.0 38 38 0.0
p06.pddl
48 48 0.0 35 35 0.0
p07.pddl
56 56 0.0 36 36 0.0
p08.pddl
73 73 0.0 50 50 0.0
p09.pddl
61 61 0.0 43 43 0.0
p10.pddl
56 56 0.0 41 41 0.0
p11.pddl
71 71 0.0 49 49 0.0
p12.pddl
59 59 0.0 45 45 0.0
p13.pddl
76 76 0.0 52 52 0.0
p14.pddl
81 81 0.0 55 55 0.0
p15.pddl
77 77 0.0 55 55 0.0
p16.pddl
82 82 0.0 59 59 0.0
p17.pddl
90 90 0.0 59 59 0.0
p18.pddl
83 83 0.0 61 61 0.0
p19.pddl
82 82 0.0 62 62 0.0
p20.pddl
96 96 0.0 71 71 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
zenotravel
Show table
landmarks
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
4 4 0.0 5 5 0.0
p02.pddl
7 7 0.0 8 8 0.0
p03.pddl
10 10 0.0 7 7 0.0
p04.pddl
11 11 0.0 9 9 0.0
p05.pddl
14 14 0.0 8 8 0.0
p06.pddl
15 15 0.0 9 9 0.0
p07.pddl
16 16 0.0 10 10 0.0
p08.pddl
17 17 0.0 12 12 0.0
p09.pddl
24 24 0.0 14 14 0.0
p10.pddl
28 28 0.0 19 19 0.0
p11.pddl
20 20 0.0 14 14 0.0
p12.pddl
25 25 0.0 15 15 0.0
p13.pddl
32 32 0.0 19 19 0.0
p14.pddl
24 24 0.0 27 27 0.0
p15.pddl
26 26 0.0 26 26 0.0
p16.pddl
32 32 0.0 34 34 0.0
p17.pddl
44 44 0.0 46 46 0.0
p18.pddl
40 40 0.0 41 41 0.0
p19.pddl
51 51 0.0 53 53 0.0
p20.pddl
50 50 0.0 50 50 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
memory
Show table
Only instances where all algorithms have a value for "memory" are considered. Each table entry gives the sum of "memory" for that domain. The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
84360 84812 452.0 85800 85892 92.0
p02.pddl
96272 97008 736.0 99264 99264 0.0
p03.pddl
123304 124332 1028.0 127620 127620 0.0
p04.pddl
88336 88824 488.0 89920 89920 0.0
p05.pddl
114104 115060 956.0 118300 118300 0.0
p06.pddl
134596 135948 1352.0 140352 140356 4.0
p07.pddl
95156 95752 596.0 97140 97144 4.0
p08.pddl
121612 122656 1044.0 124976 124976 0.0
p09.pddl
162812 164432 1620.0 168900 168904 4.0
p10.pddl
106724 107512 788.0 109608 109608 0.0
p11.pddl
127828 128892 1064.0 132800 132804 4.0
p12.pddl
169596 171300 1704.0 176172 176172 0.0
p13.pddl
110800 111720 920.0 113864 113480 -384.0
p14.pddl
132492 133672 1180.0 136968 136972 4.0
p15.pddl
179748 181480 1732.0 188700 188700 0.0
p16.pddl
114488 115560 1072.0 118352 118352 0.0
p17.pddl
138780 140144 1364.0 143944 143944 0.0
p18.pddl
188540 190324 1784.0 196340 196340 0.0
p19.pddl
118492 119572 1080.0 121620 121620 0.0
p20.pddl
161824 163508 1684.0 167940 167940 0.0
Sum of diffs
22644.00
-272.00
Arithmetic mean of diffs
1132.20
-13.60
airport
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
54656 54668 12.0 54656 54668 12.0
p02-airport1-p1.pddl
54660 54668 8.0 54660 54668 8.0
p03-airport1-p2.pddl
54792 54672 -120.0 54796 54812 16.0
p04-airport2-p1.pddl
54788 54788 0.0 55184 55184 0.0
p05-airport2-p1.pddl
54916 54920 4.0 55312 55324 12.0
p06-airport2-p2.pddl
55184 55192 8.0 55844 55848 4.0
p07-airport2-p2.pddl
55184 55192 8.0 55844 55848 4.0
p08-airport2-p3.pddl
55460 55584 124.0 56780 56776 -4.0
p09-airport2-p4.pddl
55744 55780 36.0 57856 57860 4.0
p10-airport3-p1.pddl
54924 54920 -4.0 55316 55316 0.0
p11-airport3-p1.pddl
54920 54928 8.0 55316 55328 12.0
p12-airport3-p2.pddl
55204 55212 8.0 55996 56012 16.0
p13-airport3-p2.pddl
55204 55212 8.0 55996 56012 16.0
p14-airport3-p3.pddl
55716 55744 28.0 57168 57056 -112.0
p15-airport3-p3.pddl
55584 55608 24.0 57040 57056 16.0
p16-airport3-p4.pddl
60596 60640 44.0 58220 58232 12.0
p17-airport3-p5.pddl
57400 57408 8.0 85760 85768 8.0
p18-airport3-p6.pddl
62248 62256 8.0 321044 321048 4.0
p19-airport3-p6.pddl
57824 57832 8.0 421208 421200 -8.0
p20-airport3-p7.pddl
71088 71108 20.0 2586272 2586312 40.0
p21-airport4halfMUC-p2.pddl
58872 59028 156.0 71808 71848 40.0
p22-airport4halfMUC-p3.pddl
79196 79184 -12.0 85540 85540 0.0
p23-airport4halfMUC-p4.pddl
97964 97972 8.0 104296 104240 -56.0
p24-airport4halfMUC-p4.pddl
89960 89968 8.0 99332 99368 36.0
p25-airport4halfMUC-p5.pddl
104492 104520 28.0 None None -
p26-airport4halfMUC-p6.pddl
None None - None None -
p27-airport4halfMUC-p6.pddl
110368 110376 8.0 None None -
p28-airport4halfMUC-p7.pddl
None None - None None -
p29-airport4halfMUC-p8.pddl
None None - None None -
p30-airport4halfMUC-p8.pddl
None None - None None -
p31-airport4halfMUC-p9.pddl
None None - None None -
p32-airport4halfMUC-p10.pddl
None None - None None -
p33-airport4halfMUC-p10.pddl
None None - None None -
p34-airport4halfMUC-p11.pddl
None None - None None -
p35-airport4halfMUC-p12.pddl
None None - None None -
p36-airport5MUC-p2.pddl
59372 59440 68.0 71912 71916 4.0
p37-airport5MUC-p3.pddl
75844 75724 -120.0 248772 248808 36.0
p38-airport5MUC-p3.pddl
83276 83280 4.0 87992 87980 -12.0
p39-airport5MUC-p4.pddl
89604 89608 4.0 None None -
p40-airport5MUC-p4.pddl
64104 64288 184.0 300004 300068 64.0
p41-airport5MUC-p4.pddl
89920 89920 0.0 None None -
p42-airport5MUC-p5.pddl
None None - None None -
p43-airport5MUC-p5.pddl
100444 100476 32.0 129876 129616 -260.0
p44-airport5MUC-p5.pddl
112676 112696 20.0 None None -
p45-airport5MUC-p6.pddl
None None - None None -
p46-airport5MUC-p6.pddl
None None - None None -
p47-airport5MUC-p8.pddl
None None - None None -
p48-airport5MUC-p9.pddl
None None - None None -
p49-airport5MUC-p10.pddl
None None - None None -
p50-airport5MUC-p15.pddl
None None - None None -
Sum of diffs
628.00
-88.00
Arithmetic mean of diffs
18.47
-3.03
barman-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
55060 55076 16.0 55788 55788 0.0
pfile01-002.pddl
55060 55076 16.0 55516 55516 0.0
pfile01-003.pddl
55060 55076 16.0 55516 55516 0.0
pfile01-004.pddl
55060 55076 16.0 55516 55516 0.0
pfile02-005.pddl
55220 55240 20.0 58800 58808 8.0
pfile02-006.pddl
55220 55240 20.0 91664 91640 -24.0
pfile02-007.pddl
55220 55240 20.0 58800 58796 -4.0
pfile02-008.pddl
55220 55240 20.0 59488 59480 -8.0
pfile03-009.pddl
55468 55476 8.0 71640 71664 24.0
pfile03-010.pddl
55476 55480 4.0 71760 71796 36.0
pfile03-011.pddl
55468 55476 8.0 72924 72984 60.0
pfile03-012.pddl
55476 55480 4.0 72976 73000 24.0
pfile04-013.pddl
55780 55896 116.0 133992 134072 80.0
pfile04-014.pddl
55908 55892 -16.0 234700 234776 76.0
pfile04-015.pddl
56040 56028 -12.0 142728 142796 68.0
pfile04-016.pddl
56040 56164 124.0 133940 133952 12.0
pfile05-017.pddl
56200 56204 4.0 204464 204564 100.0
pfile05-018.pddl
56204 56200 -4.0 230372 230384 12.0
pfile05-019.pddl
56200 56204 4.0 339304 339228 -76.0
pfile05-020.pddl
56072 56072 0.0 429136 429136 0.0
Sum of diffs
384.00
388.00
Arithmetic mean of diffs
19.20
19.40
barman-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
55220 55240 20.0 91624 91652 28.0
p435-2.pddl
55220 55240 20.0 58812 58812 0.0
p435-3.pddl
55220 55240 20.0 91640 91656 16.0
p536-1.pddl
55468 55476 8.0 500668 500684 16.0
p536-2.pddl
55472 55480 8.0 71768 71752 -16.0
p536-3.pddl
55468 55476 8.0 71716 71720 4.0
p638-1.pddl
55780 55760 -20.0 134100 134096 -4.0
p638-2.pddl
55776 55756 -20.0 210984 211012 28.0
p638-3.pddl
55912 55896 -16.0 141776 141880 104.0
p739-1.pddl
56068 56068 0.0 334664 334712 48.0
p739-2.pddl
56604 56736 132.0 347908 347912 4.0
p739-3.pddl
56220 56228 8.0 347772 347780 8.0
p839-1.pddl
56788 56792 4.0 612088 612080 -8.0
p839-2.pddl
56620 56632 12.0 601064 601052 -12.0
Sum of diffs
184.00
216.00
Arithmetic mean of diffs
13.14
15.43
blocks
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
54528 54536 8.0 54528 54536 8.0
probBLOCKS-4-1.pddl
54528 54536 8.0 54528 54536 8.0
probBLOCKS-4-2.pddl
54528 54536 8.0 54528 54536 8.0
probBLOCKS-5-0.pddl
54660 54664 4.0 54660 54664 4.0
probBLOCKS-5-1.pddl
54660 54664 4.0 54660 54664 4.0
probBLOCKS-5-2.pddl
54660 54664 4.0 54660 54664 4.0
probBLOCKS-6-0.pddl
54656 54692 36.0 54656 54688 32.0
probBLOCKS-6-1.pddl
54656 54692 36.0 54656 54688 32.0
probBLOCKS-6-2.pddl
54656 54692 36.0 54656 54688 32.0
probBLOCKS-7-0.pddl
54672 54680 8.0 54660 54676 16.0
probBLOCKS-7-1.pddl
54672 54680 8.0 54660 54676 16.0
probBLOCKS-7-2.pddl
54672 54680 8.0 54660 54676 16.0
probBLOCKS-8-0.pddl
54784 54792 8.0 54784 54792 8.0
probBLOCKS-8-1.pddl
54784 54792 8.0 54784 54792 8.0
probBLOCKS-8-2.pddl
54784 54792 8.0 54784 54792 8.0
probBLOCKS-9-0.pddl
54820 54832 12.0 54820 54820 0.0
probBLOCKS-9-1.pddl
54820 54832 12.0 54820 54952 132.0
probBLOCKS-9-2.pddl
54820 54832 12.0 54820 54820 0.0
probBLOCKS-10-0.pddl
54848 54932 84.0 54984 54984 0.0
probBLOCKS-10-1.pddl
54848 54932 84.0 54984 55116 132.0
probBLOCKS-10-2.pddl
54848 54932 84.0 54984 54984 0.0
probBLOCKS-11-0.pddl
54952 54936 -16.0 54952 54956 4.0
probBLOCKS-11-1.pddl
54952 54936 -16.0 55216 55224 8.0
probBLOCKS-11-2.pddl
54952 54936 -16.0 54952 54956 4.0
probBLOCKS-12-0.pddl
55056 55076 20.0 55188 55196 8.0
probBLOCKS-12-1.pddl
55056 55076 20.0 55320 55260 -60.0
probBLOCKS-13-0.pddl
55100 55252 152.0 55232 55236 4.0
probBLOCKS-13-1.pddl
55232 55252 20.0 55364 55368 4.0
probBLOCKS-14-0.pddl
55184 55208 24.0 55316 55320 4.0
probBLOCKS-14-1.pddl
55184 55208 24.0 55344 55344 0.0
probBLOCKS-15-0.pddl
55348 55360 12.0 55844 55848 4.0
probBLOCKS-15-1.pddl
55348 55360 12.0 62948 62840 -108.0
probBLOCKS-16-1.pddl
55432 55460 28.0 57056 57056 0.0
probBLOCKS-16-2.pddl
55584 55620 36.0 56364 56480 116.0
probBLOCKS-17-0.pddl
55804 55868 64.0 122148 122156 8.0
Sum of diffs
844.00
464.00
Arithmetic mean of diffs
24.11
13.26
childsnack-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
54920 54936 16.0 112328 112332 4.0
child-snack_pfile01.pddl
54920 54932 12.0 115520 115560 40.0
child-snack_pfile02-2.pddl
55368 55428 60.0 344108 344128 20.0
child-snack_pfile02.pddl
55112 55164 52.0 384768 384780 12.0
child-snack_pfile03-2.pddl
56868 56764 -104.0 1360720 1360628 -92.0
child-snack_pfile03.pddl
56472 56492 20.0 1887200 1887168 -32.0
child-snack_pfile04-2.pddl
57560 57560 0.0 None None -
child-snack_pfile04.pddl
57964 57964 0.0 None None -
child-snack_pfile05-2.pddl
59300 59340 40.0 None None -
child-snack_pfile05.pddl
59308 59336 28.0 None None -
child-snack_pfile06-2.pddl
61256 61224 -32.0 None None -
child-snack_pfile06.pddl
61792 61752 -40.0 None None -
child-snack_pfile07-2.pddl
64316 64316 0.0 None None -
child-snack_pfile07.pddl
66956 66884 -72.0 None None -
child-snack_pfile08-2.pddl
68000 67932 -68.0 None None -
child-snack_pfile08.pddl
None None - None None -
child-snack_pfile09-2.pddl
None None - None None -
child-snack_pfile09.pddl
None None - None None -
child-snack_pfile10-2.pddl
None None - None None -
child-snack_pfile10.pddl
None None - None None -
Sum of diffs
-88.00
-48.00
Arithmetic mean of diffs
-5.87
-8.00
data-network-opt18-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
55108 54984 -124.0 55104 55104 0.0
p02.pddl
55200 55216 16.0 55200 55220 20.0
p03.pddl
55220 55240 20.0 55356 55356 0.0
p04.pddl
55580 55604 24.0 55844 55844 0.0
p05.pddl
55504 55520 16.0 55636 55636 0.0
p06.pddl
55584 55604 20.0 55720 55720 0.0
p07.pddl
55720 55748 28.0 286184 286192 8.0
p08.pddl
56920 56944 24.0 55724 55728 4.0
p09.pddl
55216 55236 20.0 55356 55360 4.0
p10.pddl
55480 55500 20.0 55612 55616 4.0
p11.pddl
55568 55592 24.0 55836 55740 -96.0
p12.pddl
55604 55740 136.0 55736 55744 8.0
p13.pddl
55708 55740 32.0 55980 55980 0.0
p14.pddl
56444 56480 36.0 56580 56580 0.0
p15.pddl
55880 55908 28.0 56016 56016 0.0
p16.pddl
56312 56460 148.0 57464 57464 0.0
p17.pddl
56652 56752 100.0 57048 57048 0.0
p18.pddl
60488 60540 52.0 187172 187180 8.0
p19.pddl
57084 57128 44.0 65848 65804 -44.0
p20.pddl
57932 57944 12.0 637176 637092 -84.0
Sum of diffs
676.00
-168.00
Arithmetic mean of diffs
33.80
-8.40
depot
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54664 54668 4.0 54664 54668 4.0
p02.pddl
54816 54824 8.0 54816 54816 0.0
p03.pddl
55328 55336 8.0 55348 55332 -16.0
p04.pddl
55448 55544 96.0 55580 55460 -120.0
p05.pddl
71448 71456 8.0 55948 55948 0.0
p06.pddl
2115660 2115624 -36.0 57556 57560 4.0
p07.pddl
55088 55108 20.0 64528 64552 24.0
p08.pddl
56960 56968 8.0 56240 56280 40.0
p09.pddl
65252 65260 8.0 148196 148168 -28.0
p10.pddl
57656 57664 8.0 55720 55720 0.0
p11.pddl
62268 62272 4.0 57064 57084 20.0
p12.pddl
71592 71596 4.0 None None -
p13.pddl
56112 56232 120.0 56104 56104 0.0
p14.pddl
57736 57840 104.0 227184 227184 0.0
p15.pddl
172964 172972 8.0 2253968 2254008 40.0
p16.pddl
56488 56504 16.0 232844 232872 28.0
p17.pddl
58464 58588 124.0 60628 60636 8.0
p18.pddl
62496 62656 160.0 None None -
p19.pddl
64940 64940 0.0 2629032 2629060 28.0
p20.pddl
None None - 80464 80456 -8.0
p21.pddl
66196 66440 244.0 1159076 1159116 40.0
p22.pddl
None None - None None -
Sum of diffs
916.00
64.00
Arithmetic mean of diffs
45.80
3.37
driverlog
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54528 54532 4.0 54528 54532 4.0
p02.pddl
55208 55216 8.0 54660 54536 -124.0
p03.pddl
54668 54668 0.0 54660 54668 8.0
p04.pddl
55336 55344 8.0 54660 54668 8.0
p05.pddl
55604 55612 8.0 55188 55196 8.0
p06.pddl
54660 54668 8.0 54660 54668 8.0
p07.pddl
54660 54672 12.0 54660 54668 8.0
p08.pddl
56264 56272 8.0 54776 54660 -116.0
p09.pddl
54792 54796 4.0 54792 54796 4.0
p10.pddl
54796 54808 12.0 54928 54932 4.0
p11.pddl
54812 54824 12.0 54944 54948 4.0
p12.pddl
56964 56972 8.0 55116 55116 0.0
p13.pddl
55808 55860 52.0 55288 55292 4.0
p14.pddl
55208 55228 20.0 55280 55280 0.0
p15.pddl
55896 55928 32.0 60460 60472 12.0
p16.pddl
74252 74260 8.0 89796 89848 52.0
p17.pddl
57920 57860 -60.0 None None -
p18.pddl
82416 82424 8.0 199924 199932 8.0
p19.pddl
85640 85572 -68.0 699512 699568 56.0
p20.pddl
80204 80212 8.0 278528 278552 24.0
Sum of diffs
92.00
-28.00
Arithmetic mean of diffs
4.60
-1.47
elevators-opt08-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54656 54664 8.0 54656 54664 8.0
p02.pddl
54820 54832 12.0 54824 54824 0.0
p03.pddl
54812 54820 8.0 54812 54816 4.0
p04.pddl
54852 54800 -52.0 55052 55120 68.0
p05.pddl
54836 54844 8.0 54836 54836 0.0
p06.pddl
54952 54932 -20.0 55192 55200 8.0
p07.pddl
54792 54804 12.0 54924 54928 4.0
p08.pddl
55056 55060 4.0 55080 55092 12.0
p09.pddl
55048 55060 12.0 55456 55480 24.0
p10.pddl
55080 55096 16.0 55608 55604 -4.0
p11.pddl
54816 54824 8.0 54816 54820 4.0
p12.pddl
54848 54860 12.0 54848 54852 4.0
p13.pddl
54844 54856 12.0 54844 54848 4.0
p14.pddl
54952 54932 -20.0 55052 55056 4.0
p15.pddl
54940 54952 12.0 54940 54944 4.0
p16.pddl
55052 55068 16.0 55720 55800 80.0
p17.pddl
55068 55064 -4.0 55068 55072 4.0
p18.pddl
55088 55104 16.0 55088 55092 4.0
p19.pddl
55060 55076 16.0 55060 55192 132.0
p20.pddl
55124 55144 20.0 55128 55128 0.0
p21.pddl
54832 54840 8.0 55096 55104 8.0
p22.pddl
54816 54828 12.0 56404 56392 -12.0
p23.pddl
54932 54944 12.0 55592 55592 0.0
p24.pddl
55056 55068 12.0 58216 58220 4.0
p25.pddl
54932 55064 132.0 55224 55232 8.0
p26.pddl
55100 55116 16.0 55100 55108 8.0
p27.pddl
55060 55076 16.0 55584 55588 4.0
p28.pddl
55148 55200 52.0 55672 55672 0.0
p29.pddl
55092 55112 20.0 55892 55892 0.0
p30.pddl
55352 55376 24.0 63276 63284 8.0
Sum of diffs
400.00
392.00
Arithmetic mean of diffs
13.33
13.07
elevators-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54816 54824 8.0 54816 54820 4.0
p02.pddl
54832 54840 8.0 55096 55104 8.0
p03.pddl
54848 54860 12.0 54848 54852 4.0
p04.pddl
54812 54820 8.0 54812 54816 4.0
p05.pddl
54844 54856 12.0 54844 54848 4.0
p06.pddl
54852 54800 -52.0 55052 55120 68.0
p07.pddl
55100 55116 16.0 55100 55108 8.0
p08.pddl
54836 54844 8.0 54836 54836 0.0
p09.pddl
54816 54828 12.0 56404 56392 -12.0
p10.pddl
54952 54932 -20.0 55052 55056 4.0
p11.pddl
55148 55200 52.0 55672 55672 0.0
p12.pddl
54952 54932 -20.0 55192 55200 8.0
p13.pddl
54792 54804 12.0 54924 54928 4.0
p14.pddl
55056 55060 4.0 55080 55092 12.0
p15.pddl
55048 55060 12.0 55456 55480 24.0
p16.pddl
54940 54952 12.0 54940 54944 4.0
p17.pddl
55068 55064 -4.0 55068 55072 4.0
p18.pddl
55088 55104 16.0 55088 55092 4.0
p19.pddl
54932 54944 12.0 55592 55592 0.0
p20.pddl
55056 55068 12.0 58216 58220 4.0
Sum of diffs
120.00
156.00
Arithmetic mean of diffs
6.00
7.80
floortile-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
54792 54800 8.0 84296 84332 36.0
opt-p01-002.pddl
54660 54668 8.0 71784 71812 28.0
opt-p02-003.pddl
135432 135444 12.0 None None -
opt-p02-004.pddl
98448 98460 12.0 None None -
opt-p03-005.pddl
126844 126904 60.0 None None -
opt-p03-006.pddl
595776 595708 -68.0 None None -
opt-p04-007.pddl
792028 792036 8.0 None None -
opt-p04-008.pddl
2077740 2077748 8.0 None None -
opt-p05-009.pddl
451124 451080 -44.0 None None -
opt-p05-010.pddl
None None - None None -
opt-p06-011.pddl
None None - None None -
opt-p06-012.pddl
None None - None None -
opt-p07-013.pddl
None None - None None -
opt-p07-014.pddl
None None - None None -
opt-p08-015.pddl
None None - None None -
opt-p08-016.pddl
None None - None None -
opt-p09-017.pddl
None None - None None -
opt-p09-018.pddl
None None - None None -
opt-p10-019.pddl
None None - None None -
opt-p10-020.pddl
None None - None None -
Sum of diffs
4.00
64.00
Arithmetic mean of diffs
0.44
32.00
floortile-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
123356 123352 -4.0 None None -
p01-4-4-2.pddl
1152156 1152172 16.0 None None -
p01-5-3-2.pddl
837844 837796 -48.0 None None -
p01-5-4-2.pddl
None None - None None -
p01-5-5-2.pddl
None None - None None -
p01-6-4-2.pddl
None None - None None -
p01-6-5-2.pddl
None None - None None -
p02-4-4-2.pddl
1306056 1306072 16.0 None None -
p02-5-3-2.pddl
443800 443836 36.0 None None -
p02-5-4-2.pddl
None None - None None -
p02-5-5-2.pddl
None None - None None -
p02-6-4-2.pddl
None None - None None -
p02-6-5-2.pddl
None None - None None -
p03-4-3-2.pddl
129448 129484 36.0 None None -
p03-4-4-2.pddl
1119224 1119224 0.0 None None -
p03-5-3-2.pddl
480512 480500 -12.0 None None -
p03-5-4-2.pddl
1132212 1132128 -84.0 None None -
p03-5-5-2.pddl
None None - None None -
p03-6-4-2.pddl
None None - None None -
p03-6-5-2.pddl
None None - None None -
Sum of diffs
-44.00
None
Arithmetic mean of diffs
-4.89
None
freecell
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
55060 55064 4.0 55048 55068 20.0
p02.pddl
55980 56012 32.0 55980 56012 32.0
p03.pddl
56196 56236 40.0 56324 56260 -64.0
p04.pddl
56648 56656 8.0 56648 56652 4.0
p05.pddl
57980 58052 72.0 58124 58128 4.0
p06.pddl
60132 60260 128.0 60328 60328 0.0
p07.pddl
60144 60272 128.0 60324 60324 0.0
p08.pddl
61724 61892 168.0 61876 61880 4.0
p09.pddl
61752 61924 172.0 61944 61944 0.0
p10.pddl
65504 65672 168.0 65508 65508 0.0
p11.pddl
65520 65744 224.0 65528 65528 0.0
p12.pddl
65504 65672 168.0 65604 65520 -84.0
p13.pddl
67168 67432 264.0 67660 67660 0.0
p14.pddl
67200 67432 232.0 67640 67640 0.0
p15.pddl
70492 70900 408.0 71036 71040 4.0
p16.pddl
70488 70880 392.0 71028 71028 0.0
p17.pddl
77464 77928 464.0 78272 78276 4.0
p18.pddl
77508 77936 428.0 78028 78032 4.0
p19.pddl
80548 81040 492.0 81196 81200 4.0
p20.pddl
80528 81020 492.0 81344 81344 0.0
probfreecell-2-1.pddl
57976 58012 36.0 58116 58116 0.0
probfreecell-2-2.pddl
57972 58012 40.0 58124 58108 -16.0
probfreecell-2-3.pddl
57976 58008 32.0 58108 58112 4.0
probfreecell-2-4.pddl
57980 58020 40.0 58116 58120 4.0
probfreecell-2-5.pddl
57972 58012 40.0 58112 58120 8.0
probfreecell-3-1.pddl
60400 60520 120.0 60668 60668 0.0
probfreecell-3-2.pddl
60388 60504 116.0 60652 60656 4.0
probfreecell-3-3.pddl
60388 60504 116.0 60592 60596 4.0
probfreecell-3-4.pddl
60396 60512 116.0 60660 60664 4.0
probfreecell-3-5.pddl
60396 60508 112.0 60564 60696 132.0
probfreecell-4-1.pddl
61624 61768 144.0 61892 61892 0.0
probfreecell-4-2.pddl
61612 61756 144.0 61888 61892 4.0
probfreecell-4-3.pddl
61600 61736 136.0 61884 61884 0.0
probfreecell-4-4.pddl
61628 61756 128.0 61880 61884 4.0
probfreecell-4-5.pddl
61608 61748 140.0 61980 61980 0.0
probfreecell-5-1.pddl
65400 65608 208.0 65720 65720 0.0
probfreecell-5-2.pddl
65380 65596 216.0 65648 65652 4.0
probfreecell-5-3.pddl
65360 65576 216.0 65760 65760 0.0
probfreecell-5-4.pddl
65416 65536 120.0 65752 65756 4.0
probfreecell-5-5.pddl
65376 65564 188.0 65776 65776 0.0
probfreecell-6-1.pddl
66536 66772 236.0 66848 66852 4.0
probfreecell-6-2.pddl
66528 66764 236.0 66932 66924 -8.0
probfreecell-6-3.pddl
66528 66816 288.0 67144 67144 0.0
probfreecell-6-4.pddl
66528 66752 224.0 67028 67032 4.0
probfreecell-6-5.pddl
66512 66836 324.0 67000 67000 0.0
probfreecell-7-1.pddl
67736 67996 260.0 68272 68360 88.0
probfreecell-7-2.pddl
67768 67996 228.0 68248 68248 0.0
probfreecell-7-3.pddl
67736 67996 260.0 68468 68468 0.0
probfreecell-7-4.pddl
67740 68016 276.0 68316 68316 0.0
probfreecell-7-5.pddl
67728 67988 260.0 68240 68244 4.0
probfreecell-8-1.pddl
69280 69296 16.0 69784 69784 0.0
probfreecell-8-2.pddl
69260 69280 20.0 69432 69436 4.0
probfreecell-8-3.pddl
69284 69300 16.0 69408 69408 0.0
probfreecell-8-4.pddl
69248 69264 16.0 69564 69568 4.0
probfreecell-8-5.pddl
69272 69292 20.0 69524 69524 0.0
probfreecell-9-1.pddl
71096 71504 408.0 72300 72300 0.0
probfreecell-9-2.pddl
71068 71476 408.0 72016 72020 4.0
probfreecell-9-3.pddl
71208 71612 404.0 72000 72004 4.0
probfreecell-9-4.pddl
71116 71524 408.0 72076 72076 0.0
probfreecell-9-5.pddl
71100 71508 408.0 71912 71916 4.0
probfreecell-10-1.pddl
76440 76872 432.0 77328 77328 0.0
probfreecell-10-2.pddl
76400 76832 432.0 77116 76988 -128.0
probfreecell-10-3.pddl
76548 76980 432.0 77232 77232 0.0
probfreecell-10-4.pddl
76436 76868 432.0 77060 77060 0.0
probfreecell-10-5.pddl
76456 76892 436.0 77012 77016 4.0
probfreecell-11-1.pddl
77704 78096 392.0 78548 78548 0.0
probfreecell-11-2.pddl
77756 78208 452.0 78676 78676 0.0
probfreecell-11-3.pddl
77696 78096 400.0 78484 78484 0.0
probfreecell-11-4.pddl
77640 78096 456.0 78516 78516 0.0
probfreecell-11-5.pddl
None None - 78632 78636 4.0
probfreecell-12-1.pddl
78940 79368 428.0 79768 79772 4.0
probfreecell-12-2.pddl
78888 79372 484.0 79792 79792 0.0
probfreecell-12-3.pddl
78936 79424 488.0 80064 80064 0.0
probfreecell-12-4.pddl
78908 79456 548.0 79640 79644 4.0
probfreecell-12-5.pddl
147852 147860 8.0 79728 79732 4.0
probfreecell-13-1.pddl
80168 80684 516.0 80936 80940 4.0
probfreecell-13-2.pddl
80168 80624 456.0 81036 81040 4.0
probfreecell-13-3.pddl
80132 80632 500.0 80856 80860 4.0
probfreecell-13-4.pddl
80148 80652 504.0 80804 80804 0.0
probfreecell-13-5.pddl
134232 134248 16.0 115688 115700 12.0
Sum of diffs
19420.00
120.00
Arithmetic mean of diffs
245.82
1.50
ged-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
54660 54668 8.0 54660 54672 12.0
d-1-3.pddl
55184 55204 20.0 55308 55316 8.0
d-1-4.pddl
54660 54668 8.0 54660 54672 12.0
d-1-8.pddl
55560 55584 24.0 55560 55560 0.0
d-2-1.pddl
54660 54668 8.0 54660 54672 12.0
d-2-3.pddl
54952 55076 124.0 55072 55088 16.0
d-2-4.pddl
54840 54852 12.0 54840 54844 4.0
d-2-8.pddl
56244 56252 8.0 56376 56376 0.0
d-3-1.pddl
55184 55204 20.0 55308 55312 4.0
d-3-2.pddl
54952 55076 124.0 55072 55088 16.0
d-3-4.pddl
55564 55584 20.0 55560 55560 0.0
d-4-2.pddl
54840 54852 12.0 54840 54844 4.0
d-4-3.pddl
55564 55584 20.0 55560 55560 0.0
d-4-8.pddl
56244 56252 8.0 56376 56376 0.0
d-7-5.pddl
55560 55584 24.0 55560 55560 0.0
d-7-6.pddl
55184 55204 20.0 55308 55312 4.0
d-8-1.pddl
55560 55584 24.0 55560 55560 0.0
d-8-2.pddl
56244 56252 8.0 56376 56376 0.0
d-8-4.pddl
56244 56252 8.0 56376 56376 0.0
d-8-9.pddl
56240 56244 4.0 56372 56376 4.0
Sum of diffs
504.00
96.00
Arithmetic mean of diffs
25.20
4.80
grid
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
56168 56204 36.0 56568 56572 4.0
prob02.pddl
57128 57232 104.0 57680 57684 4.0
prob03.pddl
58912 59108 196.0 None None -
prob04.pddl
61596 61612 16.0 62720 62720 0.0
prob05.pddl
64224 64508 284.0 186560 186564 4.0
Sum of diffs
636.00
12.00
Arithmetic mean of diffs
127.20
3.00
gripper
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
54528 54536 8.0 54528 54536 8.0
prob02.pddl
54528 54536 8.0 54528 54536 8.0
prob03.pddl
54660 54664 4.0 54660 54532 -128.0
prob04.pddl
54660 54668 8.0 54660 54668 8.0
prob05.pddl
54664 54672 8.0 54664 54668 4.0
prob06.pddl
54664 54672 8.0 54664 54668 4.0
prob07.pddl
54672 54680 8.0 54672 54676 4.0
prob08.pddl
54664 54672 8.0 54664 54668 4.0
prob09.pddl
54780 54788 8.0 54656 54664 8.0
prob10.pddl
54780 54796 16.0 54780 54668 -112.0
prob11.pddl
54772 54784 12.0 54776 54788 12.0
prob12.pddl
54780 54792 12.0 54784 54792 8.0
prob13.pddl
54788 54788 0.0 54920 54924 4.0
prob14.pddl
54788 54796 8.0 55056 55064 8.0
prob15.pddl
54832 54844 12.0 55236 55232 -4.0
prob16.pddl
54840 54852 12.0 55504 55508 4.0
prob17.pddl
54848 54932 84.0 55644 55644 0.0
prob18.pddl
54924 54940 16.0 55844 55796 -48.0
prob19.pddl
54932 54948 16.0 55992 56000 8.0
prob20.pddl
54940 54956 16.0 56264 56276 12.0
Sum of diffs
272.00
-188.00
Arithmetic mean of diffs
13.60
-9.40
hiking-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
54680 54684 4.0 54680 54684 4.0
ptesting-1-2-4.pddl
54780 54792 12.0 54780 54804 24.0
ptesting-1-2-5.pddl
55228 55232 4.0 54960 54960 0.0
ptesting-1-2-7.pddl
58192 58196 4.0 56640 56640 0.0
ptesting-1-2-8.pddl
61344 61344 0.0 58704 58732 28.0
ptesting-2-2-3.pddl
55204 55220 16.0 55208 55208 0.0
ptesting-2-2-4.pddl
56656 56688 32.0 58756 58740 -16.0
ptesting-2-2-5.pddl
59096 59096 0.0 68456 68464 8.0
ptesting-2-2-6.pddl
62844 62852 8.0 70208 70216 8.0
ptesting-2-2-7.pddl
71268 71280 12.0 110848 110864 16.0
ptesting-2-2-8.pddl
77052 77060 8.0 112048 112040 -8.0
ptesting-2-3-4.pddl
57864 57900 36.0 59060 59064 4.0
ptesting-2-3-5.pddl
61744 61752 8.0 70624 70604 -20.0
ptesting-2-3-6.pddl
66968 66984 16.0 112484 112484 0.0
ptesting-2-3-7.pddl
78352 78364 12.0 116856 116760 -96.0
ptesting-2-4-3.pddl
55848 55872 24.0 55836 55840 4.0
ptesting-2-4-4.pddl
58664 58620 -44.0 62200 62136 -64.0
ptesting-2-4-5.pddl
65464 65480 16.0 75796 75788 -8.0
ptesting-2-4-6.pddl
69720 69732 12.0 111540 111572 32.0
ptesting-2-4-7.pddl
79516 79524 8.0 195012 195024 12.0
Sum of diffs
188.00
-72.00
Arithmetic mean of diffs
9.40
-3.60
logistics00
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
54528 54536 8.0 54528 54536 8.0
probLOGISTICS-4-1.pddl
54528 54536 8.0 54528 54536 8.0
probLOGISTICS-4-2.pddl
54528 54536 8.0 54528 54536 8.0
probLOGISTICS-5-0.pddl
54660 54536 -124.0 54528 54536 8.0
probLOGISTICS-5-1.pddl
54528 54536 8.0 54528 54536 8.0
probLOGISTICS-5-2.pddl
54528 54536 8.0 54528 54536 8.0
probLOGISTICS-6-0.pddl
54656 54536 -120.0 54656 54536 -120.0
probLOGISTICS-6-1.pddl
54656 54536 -120.0 54656 54536 -120.0
probLOGISTICS-6-2.pddl
54656 54536 -120.0 54656 54536 -120.0
probLOGISTICS-6-9.pddl
54656 54536 -120.0 54656 54536 -120.0
probLOGISTICS-7-0.pddl
54660 54668 8.0 54660 54668 8.0
probLOGISTICS-7-1.pddl
54660 54668 8.0 54660 54668 8.0
probLOGISTICS-8-0.pddl
54668 54672 4.0 54668 54668 0.0
probLOGISTICS-8-1.pddl
54668 54672 4.0 54668 54668 0.0
probLOGISTICS-9-0.pddl
54672 54680 8.0 54660 54676 16.0
probLOGISTICS-9-1.pddl
54672 54680 8.0 54660 54676 16.0
probLOGISTICS-10-0.pddl
54784 54784 0.0 54784 54784 0.0
probLOGISTICS-10-1.pddl
54784 54784 0.0 54784 54784 0.0
probLOGISTICS-11-0.pddl
54780 54792 12.0 54780 54788 8.0
probLOGISTICS-11-1.pddl
54780 54792 12.0 54780 54788 8.0
probLOGISTICS-12-0.pddl
54788 54788 0.0 54788 54792 4.0
probLOGISTICS-12-1.pddl
54788 54788 0.0 54788 54792 4.0
probLOGISTICS-13-0.pddl
55064 55064 0.0 56112 56120 8.0
probLOGISTICS-13-1.pddl
55064 55064 0.0 55844 55844 0.0
probLOGISTICS-14-0.pddl
54928 54936 8.0 56116 56124 8.0
probLOGISTICS-14-1.pddl
55060 55072 12.0 57048 57064 16.0
probLOGISTICS-15-0.pddl
55312 55324 12.0 57160 57180 20.0
probLOGISTICS-15-1.pddl
55064 55072 8.0 57840 57848 8.0
Sum of diffs
-460.00
-300.00
Arithmetic mean of diffs
-16.43
-10.71
logistics98
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
54792 54796 4.0 55324 55324 0.0
prob02.pddl
55012 55100 88.0 68684 68708 24.0
prob03.pddl
55920 55884 -36.0 524380 524380 0.0
prob04.pddl
57196 57228 32.0 None None -
prob05.pddl
54792 54792 0.0 54792 54792 0.0
prob06.pddl
58448 58448 0.0 None None -
prob07.pddl
55360 55384 24.0 126544 126572 28.0
prob08.pddl
56580 56624 44.0 None None -
prob09.pddl
62388 62372 -16.0 None None -
prob10.pddl
61732 61792 60.0 2365836 2365848 12.0
prob11.pddl
55332 55344 12.0 177176 177224 48.0
prob12.pddl
60188 60216 28.0 None None -
prob13.pddl
63640 63660 20.0 None None -
prob14.pddl
63404 63468 64.0 None None -
prob15.pddl
56648 56704 56.0 190488 190412 -76.0
prob16.pddl
58448 58400 -48.0 None None -
prob17.pddl
56112 56224 112.0 None None -
prob18.pddl
102488 102504 16.0 None None -
prob19.pddl
79564 79460 -104.0 None None -
prob20.pddl
104756 104732 -24.0 None None -
prob21.pddl
75992 76064 72.0 None None -
prob22.pddl
404536 404540 4.0 None None -
prob23.pddl
59884 59928 44.0 2785112 2785124 12.0
prob24.pddl
62196 62324 128.0 None None -
prob25.pddl
163728 163744 16.0 None None -
prob26.pddl
116216 116220 4.0 None None -
prob27.pddl
121624 121580 -44.0 None None -
prob28.pddl
1303816 1303824 8.0 None None -
prob29.pddl
203348 203352 4.0 None None -
prob30.pddl
146592 146568 -24.0 None None -
prob31.pddl
54668 54676 8.0 54668 54672 4.0
prob32.pddl
54660 54668 8.0 54660 54668 8.0
prob33.pddl
54792 54796 4.0 54792 54796 4.0
prob34.pddl
55084 55100 16.0 82428 82456 28.0
prob35.pddl
54936 54952 16.0 56664 56656 -8.0
Sum of diffs
596.00
84.00
Arithmetic mean of diffs
17.03
6.00
miconic
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
54528 54536 8.0 54528 54536 8.0
s1-1.pddl
54528 54536 8.0 54528 54536 8.0
s1-2.pddl
54528 54536 8.0 54528 54536 8.0
s1-3.pddl
54528 54536 8.0 54528 54536 8.0
s1-4.pddl
54528 54536 8.0 54528 54536 8.0
s2-0.pddl
54528 54536 8.0 54528 54536 8.0
s2-1.pddl
54528 54536 8.0 54528 54536 8.0
s2-2.pddl
54528 54536 8.0 54528 54536 8.0
s2-3.pddl
54528 54536 8.0 54528 54536 8.0
s2-4.pddl
54528 54536 8.0 54528 54536 8.0
s3-0.pddl
54528 54532 4.0 54528 54532 4.0
s3-1.pddl
54528 54532 4.0 54528 54532 4.0
s3-2.pddl
54528 54532 4.0 54528 54532 4.0
s3-3.pddl
54528 54532 4.0 54528 54532 4.0
s3-4.pddl
54528 54532 4.0 54528 54532 4.0
s4-0.pddl
54528 54536 8.0 54528 54536 8.0
s4-1.pddl
54528 54536 8.0 54528 54536 8.0
s4-2.pddl
54528 54536 8.0 54528 54536 8.0
s4-3.pddl
54528 54536 8.0 54528 54536 8.0
s4-4.pddl
54528 54536 8.0 54528 54536 8.0
s5-0.pddl
54660 54536 -124.0 54524 54536 12.0
s5-1.pddl
54656 54536 -120.0 54524 54536 12.0
s5-2.pddl
54524 54536 12.0 54524 54536 12.0
s5-3.pddl
54660 54536 -124.0 54524 54536 12.0
s5-4.pddl
54660 54536 -124.0 54524 54536 12.0
s6-0.pddl
54660 54668 8.0 54528 54536 8.0
s6-1.pddl
54660 54668 8.0 54660 54536 -124.0
s6-2.pddl
54660 54668 8.0 54660 54536 -124.0
s6-3.pddl
54660 54668 8.0 54660 54536 -124.0
s6-4.pddl
54660 54668 8.0 54660 54536 -124.0
s7-0.pddl
54664 54668 4.0 54664 54668 4.0
s7-1.pddl
54664 54668 4.0 54664 54668 4.0
s7-2.pddl
54664 54668 4.0 54664 54668 4.0
s7-3.pddl
54664 54668 4.0 54664 54668 4.0
s7-4.pddl
54664 54668 4.0 54664 54668 4.0
s8-0.pddl
54668 54672 4.0 54668 54668 0.0
s8-1.pddl
54668 54672 4.0 54668 54668 0.0
s8-2.pddl
54668 54672 4.0 54668 54668 0.0
s8-3.pddl
54668 54672 4.0 54668 54668 0.0
s8-4.pddl
54668 54672 4.0 54668 54668 0.0
s9-0.pddl
54664 54672 8.0 54660 54668 8.0
s9-1.pddl
54664 54672 8.0 54660 54668 8.0
s9-2.pddl
54664 54672 8.0 54660 54668 8.0
s9-3.pddl
54664 54672 8.0 54660 54668 8.0
s9-4.pddl
54664 54672 8.0 54660 54668 8.0
s10-0.pddl
54788 54784 -4.0 54664 54664 0.0
s10-1.pddl
54788 54784 -4.0 54664 54664 0.0
s10-2.pddl
54788 54784 -4.0 54664 54664 0.0
s10-3.pddl
54788 54784 -4.0 54664 54664 0.0
s10-4.pddl
54788 54784 -4.0 54664 54664 0.0
s11-0.pddl
54788 54800 12.0 54792 54792 0.0
s11-1.pddl
54788 54800 12.0 54792 54792 0.0
s11-2.pddl
54788 54800 12.0 54792 54792 0.0
s11-3.pddl
54788 54800 12.0 54792 54792 0.0
s11-4.pddl
54788 54800 12.0 54792 54792 0.0
s12-0.pddl
54828 54836 8.0 54828 54828 0.0
s12-1.pddl
54828 54836 8.0 54828 54828 0.0
s12-2.pddl
54828 54836 8.0 54828 54828 0.0
s12-3.pddl
54828 54836 8.0 54828 54828 0.0
s12-4.pddl
54828 54836 8.0 54828 54828 0.0
s13-0.pddl
54848 54856 8.0 54848 54848 0.0
s13-1.pddl
54848 54856 8.0 54848 54848 0.0
s13-2.pddl
54848 54856 8.0 54848 54848 0.0
s13-3.pddl
54848 54856 8.0 54848 54848 0.0
s13-4.pddl
54848 54856 8.0 54848 54848 0.0
s14-0.pddl
54940 54944 4.0 54936 54936 0.0
s14-1.pddl
54940 54944 4.0 54936 54936 0.0
s14-2.pddl
54940 54944 4.0 54936 54936 0.0
s14-3.pddl
54936 54944 8.0 54936 54936 0.0
s14-4.pddl
54940 54944 4.0 54936 54936 0.0
s15-0.pddl
54956 54968 12.0 54956 54960 4.0
s15-1.pddl
54956 54968 12.0 54956 54960 4.0
s15-2.pddl
54956 54968 12.0 54956 54960 4.0
s15-3.pddl
54956 54968 12.0 54956 54960 4.0
s15-4.pddl
54956 54968 12.0 54956 54960 4.0
s16-0.pddl
55084 55092 8.0 55080 55084 4.0
s16-1.pddl
55084 55092 8.0 55080 55084 4.0
s16-2.pddl
55084 55092 8.0 55080 55084 4.0
s16-3.pddl
55084 55092 8.0 55080 55084 4.0
s16-4.pddl
55084 55092 8.0 55080 55084 4.0
s17-0.pddl
55100 55116 16.0 55096 55112 16.0
s17-1.pddl
55096 55112 16.0 55096 55112 16.0
s17-2.pddl
55096 55112 16.0 55096 55112 16.0
s17-3.pddl
55244 55264 20.0 55096 55112 16.0
s17-4.pddl
55096 55112 16.0 55096 55112 16.0
s18-0.pddl
55232 55252 20.0 55104 55120 16.0
s18-1.pddl
55232 55252 20.0 55104 55120 16.0
s18-2.pddl
55232 55252 20.0 55104 55120 16.0
s18-3.pddl
55232 55252 20.0 55104 55120 16.0
s18-4.pddl
55232 55256 24.0 55104 55120 16.0
s19-0.pddl
55296 55320 24.0 55164 55168 4.0
s19-1.pddl
55300 55316 16.0 55164 55168 4.0
s19-2.pddl
55296 55320 24.0 55164 55168 4.0
s19-3.pddl
55424 55452 28.0 55164 55168 4.0
s19-4.pddl
55296 55316 20.0 55164 55168 4.0
s20-0.pddl
55460 55348 -112.0 55200 55200 0.0
s20-1.pddl
55472 55496 24.0 55196 55196 0.0
s20-2.pddl
55328 55348 20.0 55196 55196 0.0
s20-3.pddl
55328 55348 20.0 55200 55200 0.0
s20-4.pddl
55464 55352 -112.0 55204 55204 0.0
s21-0.pddl
55628 55644 16.0 55232 55236 4.0
s21-1.pddl
55624 55640 16.0 55232 55236 4.0
s21-2.pddl
55360 55372 12.0 55360 55360 0.0
s21-3.pddl
55500 55500 0.0 55276 55276 0.0
s21-4.pddl
55496 55376 -120.0 55236 55240 4.0
s22-0.pddl
55776 55772 -4.0 55376 55396 20.0
s22-1.pddl
55672 55764 92.0 55376 55396 20.0
s22-2.pddl
55776 55776 0.0 55376 55396 20.0
s22-3.pddl
55764 55768 4.0 55376 55396 20.0
s22-4.pddl
55640 55760 120.0 55376 55396 20.0
s23-0.pddl
56012 55900 -112.0 55596 55528 -68.0
s23-1.pddl
55876 55896 20.0 55596 55528 -68.0
s23-2.pddl
55740 55760 20.0 55596 55528 -68.0
s23-3.pddl
55728 55748 20.0 55596 55528 -68.0
s23-4.pddl
55876 55764 -112.0 55596 55528 -68.0
s24-0.pddl
55892 55908 16.0 55620 55620 0.0
s24-1.pddl
56024 56040 16.0 55620 55620 0.0
s24-2.pddl
56016 56044 28.0 55620 55620 0.0
s24-3.pddl
56032 56040 8.0 55620 55620 0.0
s24-4.pddl
56028 56048 20.0 55620 55620 0.0
s25-0.pddl
56176 56072 -104.0 55652 55660 8.0
s25-1.pddl
56320 56336 16.0 55652 55660 8.0
s25-2.pddl
56056 56080 24.0 55652 55660 8.0
s25-3.pddl
56316 56340 24.0 55652 55660 8.0
s25-4.pddl
56320 56344 24.0 55652 55660 8.0
s26-0.pddl
56496 56508 12.0 55724 55724 0.0
s26-1.pddl
56232 56244 12.0 55724 55724 0.0
s26-2.pddl
56620 56612 -8.0 55708 55712 4.0
s26-3.pddl
56492 56480 -12.0 55708 55712 4.0
s26-4.pddl
56220 56240 20.0 55724 55728 4.0
s27-0.pddl
56760 56792 32.0 55736 55868 132.0
s27-1.pddl
56512 56520 8.0 55736 55868 132.0
s27-2.pddl
56764 56792 28.0 55868 55868 0.0
s27-3.pddl
56504 56524 20.0 55736 55868 132.0
s27-4.pddl
56632 56652 20.0 55736 55868 132.0
s28-0.pddl
57072 57088 16.0 55920 55920 0.0
s28-1.pddl
56808 56816 8.0 55920 55920 0.0
s28-2.pddl
56936 56960 24.0 55920 55920 0.0
s28-3.pddl
56400 56420 20.0 55920 55920 0.0
s28-4.pddl
56800 56816 16.0 55916 55920 4.0
s29-0.pddl
56828 56836 8.0 55900 55972 72.0
s29-1.pddl
56696 56704 8.0 55900 55972 72.0
s29-2.pddl
56972 56972 0.0 55900 55972 72.0
s29-3.pddl
57236 57244 8.0 55896 55972 76.0
s29-4.pddl
57368 57368 0.0 55900 55972 72.0
s30-0.pddl
56924 56972 48.0 55992 56060 68.0
s30-1.pddl
57188 57208 20.0 56028 55964 -64.0
s30-2.pddl
57052 57108 56.0 55992 56060 68.0
s30-3.pddl
57448 57468 20.0 56028 55964 -64.0
s30-4.pddl
57308 57216 -92.0 55992 56060 68.0
Sum of diffs
500.00
788.00
Arithmetic mean of diffs
3.33
5.25
movie
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
54528 54532 4.0 54528 54532 4.0
prob02.pddl
54528 54532 4.0 54528 54532 4.0
prob03.pddl
54524 54536 12.0 54524 54536 12.0
prob04.pddl
54524 54532 8.0 54524 54532 8.0
prob05.pddl
54524 54532 8.0 54524 54532 8.0
prob06.pddl
54528 54532 4.0 54528 54532 4.0
prob07.pddl
54524 54536 12.0 54524 54536 12.0
prob08.pddl
54524 54536 12.0 54524 54536 12.0
prob09.pddl
54528 54536 8.0 54528 54536 8.0
prob10.pddl
54528 54536 8.0 54528 54536 8.0
prob11.pddl
54528 54536 8.0 54528 54536 8.0
prob12.pddl
54528 54536 8.0 54528 54536 8.0
prob13.pddl
54528 54536 8.0 54528 54536 8.0
prob14.pddl
54528 54536 8.0 54528 54536 8.0
prob15.pddl
54528 54536 8.0 54528 54536 8.0
prob16.pddl
54524 54536 12.0 54524 54536 12.0
prob17.pddl
54528 54536 8.0 54528 54536 8.0
prob18.pddl
54528 54536 8.0 54528 54536 8.0
prob19.pddl
54528 54536 8.0 54528 54536 8.0
prob20.pddl
54528 54536 8.0 54528 54536 8.0
prob21.pddl
54528 54536 8.0 54528 54536 8.0
prob22.pddl
54528 54536 8.0 54528 54536 8.0
prob23.pddl
54524 54536 12.0 54524 54536 12.0
prob24.pddl
54528 54536 8.0 54528 54536 8.0
prob25.pddl
54528 54536 8.0 54528 54536 8.0
prob26.pddl
54524 54536 12.0 54524 54536 12.0
prob27.pddl
54528 54536 8.0 54528 54536 8.0
prob28.pddl
54528 54532 4.0 54528 54532 4.0
prob29.pddl
54528 54532 4.0 54528 54532 4.0
prob30.pddl
54656 54536 -120.0 54524 54536 12.0
Sum of diffs
116.00
248.00
Arithmetic mean of diffs
3.87
8.27
mprime
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
55352 55352 0.0 55340 55356 16.0
prob02.pddl
57648 57744 96.0 180848 180884 36.0
prob03.pddl
56608 56524 -84.0 63012 63016 4.0
prob04.pddl
55468 55496 28.0 55472 55472 0.0
prob05.pddl
56668 56684 16.0 176672 176564 -108.0
prob06.pddl
69492 69784 292.0 None None -
prob07.pddl
55744 55748 4.0 59700 59732 32.0
prob08.pddl
61416 61552 136.0 None None -
prob09.pddl
56484 56512 28.0 63044 63056 12.0
prob10.pddl
84548 85076 528.0 None None -
prob11.pddl
55520 55548 28.0 55652 55600 -52.0
prob12.pddl
56208 56304 96.0 111676 111692 16.0
prob13.pddl
84232 84784 552.0 None None -
prob14.pddl
90740 90996 256.0 None None -
prob15.pddl
82616 83160 544.0 None None -
prob16.pddl
58852 59008 156.0 118712 118720 8.0
prob17.pddl
69712 70004 292.0 831224 831192 -32.0
prob18.pddl
72300 72460 160.0 None None -
prob19.pddl
63924 63968 44.0 None None -
prob20.pddl
82448 82956 508.0 None None -
prob21.pddl
63680 63924 244.0 668708 668644 -64.0
prob22.pddl
84588 85112 524.0 None None -
prob23.pddl
68588 68864 276.0 None None -
prob24.pddl
69924 70200 276.0 None None -
prob25.pddl
54796 54804 8.0 54796 54860 64.0
prob26.pddl
57932 57960 28.0 651544 651652 108.0
prob27.pddl
58680 58816 136.0 59120 59124 4.0
prob28.pddl
55344 55348 4.0 55340 55360 20.0
prob29.pddl
57788 57808 20.0 59824 59832 8.0
prob30.pddl
70076 70400 324.0 None None -
prob31.pddl
58332 58448 116.0 59044 59044 0.0
prob32.pddl
55752 55764 12.0 73096 73104 8.0
prob33.pddl
67880 68156 276.0 None None -
prob34.pddl
58284 58328 44.0 59660 59660 0.0
prob35.pddl
55352 55372 20.0 55720 55728 8.0
Sum of diffs
5988.00
88.00
Arithmetic mean of diffs
171.09
4.19
mystery
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
54668 54676 8.0 54668 54672 4.0
prob02.pddl
56840 56932 92.0 66204 66336 132.0
prob03.pddl
55604 55600 -4.0 55864 55872 8.0
prob04.pddl
1001304 1001172 -132.0 1783024 1783036 12.0
prob05.pddl
None None - None None -
prob06.pddl
71320 71328 8.0 None None -
prob07.pddl
54528 54536 8.0 None None -
prob08.pddl
None None - None None -
prob09.pddl
676632 676652 20.0 56452 56452 0.0
prob10.pddl
80524 80952 428.0 None None -
prob11.pddl
54828 54836 8.0 54828 54828 0.0
prob12.pddl
153016 153032 16.0 160776 160688 -88.0
prob13.pddl
67592 67864 272.0 None None -
prob14.pddl
83868 84384 516.0 None None -
prob15.pddl
66988 67200 212.0 394160 394196 36.0
prob16.pddl
None None - None None -
prob17.pddl
66972 67224 252.0 68256 68256 0.0
prob18.pddl
54528 54536 8.0 None None -
prob19.pddl
58680 58672 -8.0 97792 97804 12.0
prob20.pddl
58856 58952 96.0 1063648 1063708 60.0
prob21.pddl
None None - None None -
prob22.pddl
None None - None None -
prob23.pddl
None None - None None -
prob24.pddl
None None - None None -
prob25.pddl
54664 54672 8.0 54668 54668 0.0
prob26.pddl
55548 55576 28.0 57288 57428 140.0
prob27.pddl
55420 55444 24.0 55424 55508 84.0
prob28.pddl
54660 54668 8.0 54660 54672 12.0
prob29.pddl
55452 55472 20.0 55588 55600 12.0
prob30.pddl
57000 57028 28.0 65320 65308 -12.0
Sum of diffs
1916.00
412.00
Arithmetic mean of diffs
83.30
24.24
nomystery-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54816 54824 8.0 54816 54820 4.0
p02.pddl
55360 55428 68.0 55360 55372 12.0
p03.pddl
55100 55116 16.0 55100 55104 4.0
p04.pddl
55684 55708 24.0 67212 67216 4.0
p05.pddl
56968 57120 152.0 888760 888768 8.0
p06.pddl
58468 58628 160.0 None None -
p07.pddl
58472 58636 164.0 None None -
p08.pddl
59132 59272 140.0 None None -
p09.pddl
61104 61228 124.0 60864 60864 0.0
p10.pddl
58944 58964 20.0 None None -
p11.pddl
54664 54672 8.0 54660 54668 8.0
p12.pddl
55092 55104 12.0 55224 55228 4.0
p13.pddl
54948 54960 12.0 56192 56188 -4.0
p14.pddl
55876 55884 8.0 69696 69696 0.0
p15.pddl
56480 56500 20.0 69844 69884 40.0
p16.pddl
None None - None None -
p17.pddl
57168 57272 104.0 None None -
p18.pddl
None None - None None -
p19.pddl
58964 59064 100.0 None None -
p20.pddl
None None - None None -
Sum of diffs
1140.00
80.00
Arithmetic mean of diffs
67.06
7.27
openstacks-opt08-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54528 54536 8.0 54528 54536 8.0
p02.pddl
54660 54664 4.0 54660 54664 4.0
p03.pddl
54660 54668 8.0 54660 54668 8.0
p04.pddl
54660 54696 36.0 54660 54692 32.0
p05.pddl
54672 54680 8.0 54672 54672 0.0
p06.pddl
54656 54668 12.0 54656 54672 16.0
p07.pddl
54784 54784 0.0 54784 54784 0.0
p08.pddl
54808 54816 8.0 54808 54808 0.0
p09.pddl
54824 54832 8.0 54824 54824 0.0
p10.pddl
54840 54848 8.0 54840 54840 0.0
p11.pddl
54924 54936 12.0 54924 54928 4.0
p12.pddl
55048 55060 12.0 55048 55052 4.0
p13.pddl
55068 55068 0.0 55068 55068 0.0
p14.pddl
55052 55068 16.0 55052 55064 12.0
p15.pddl
55204 55092 -112.0 55208 55080 -128.0
p16.pddl
55232 55248 16.0 55232 55232 0.0
p17.pddl
55248 55312 64.0 55248 55252 4.0
p18.pddl
55320 55340 20.0 55324 55280 -44.0
p19.pddl
55476 55488 12.0 55476 55488 12.0
p20.pddl
55496 55516 20.0 55496 55504 8.0
p21.pddl
55500 55580 80.0 55500 55524 24.0
p22.pddl
55700 55720 20.0 55700 55700 0.0
p23.pddl
55724 55740 16.0 55724 55728 4.0
p24.pddl
55748 55744 -4.0 55748 55752 4.0
p25.pddl
55828 55852 24.0 55828 55752 -76.0
p26.pddl
55856 55880 24.0 55868 55868 0.0
p27.pddl
55900 56016 116.0 55904 55904 0.0
p28.pddl
56288 56316 28.0 56296 56296 0.0
p29.pddl
56444 56424 -20.0 56444 56468 24.0
p30.pddl
56412 56456 44.0 56544 56464 -80.0
Sum of diffs
488.00
-160.00
Arithmetic mean of diffs
16.27
-5.33
openstacks-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54656 54668 12.0 54656 54672 16.0
p02.pddl
54784 54784 0.0 54784 54784 0.0
p03.pddl
54808 54816 8.0 54808 54808 0.0
p04.pddl
54824 54832 8.0 54824 54824 0.0
p05.pddl
54840 54848 8.0 54840 54840 0.0
p06.pddl
54924 54936 12.0 54924 54928 4.0
p07.pddl
55048 55060 12.0 55048 55052 4.0
p08.pddl
55068 55068 0.0 55068 55068 0.0
p09.pddl
55052 55068 16.0 55052 55064 12.0
p10.pddl
55700 55720 20.0 55700 55700 0.0
p11.pddl
55204 55092 -112.0 55208 55080 -128.0
p12.pddl
55232 55248 16.0 55232 55232 0.0
p13.pddl
55248 55312 64.0 55248 55252 4.0
p14.pddl
55320 55340 20.0 55324 55280 -44.0
p15.pddl
55476 55488 12.0 55476 55488 12.0
p16.pddl
55500 55580 80.0 55500 55524 24.0
p17.pddl
55496 55516 20.0 55496 55504 8.0
p18.pddl
55724 55740 16.0 55724 55728 4.0
p19.pddl
55748 55744 -4.0 55748 55752 4.0
p20.pddl
55828 55852 24.0 55828 55752 -76.0
Sum of diffs
232.00
-156.00
Arithmetic mean of diffs
11.60
-7.80
openstacks-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
55228 55244 16.0 55228 55232 4.0
p20_2.pddl
55228 55248 20.0 55232 55232 0.0
p20_3.pddl
55236 55252 16.0 55236 55236 0.0
p25_1.pddl
55504 55580 76.0 55508 55524 16.0
p25_3.pddl
55636 55612 -24.0 55636 55644 8.0
p30_1.pddl
55852 55880 28.0 55852 55856 4.0
p30_2.pddl
55856 55880 24.0 55860 55864 4.0
p30_3.pddl
56036 56016 -20.0 56044 56040 -4.0
p35_1.pddl
56580 56588 8.0 56588 56588 0.0
p35_2.pddl
56584 56592 8.0 56584 56584 0.0
p35_3.pddl
56736 56748 12.0 56736 56800 64.0
p40_1.pddl
56916 56928 12.0 56932 56936 4.0
p40_2.pddl
56920 56936 16.0 56920 56924 4.0
p40_3.pddl
57208 57184 -24.0 57208 57212 4.0
p45_1.pddl
57296 57436 140.0 57416 57416 0.0
p45_2.pddl
57392 57440 48.0 57424 57436 12.0
p45_3.pddl
57808 57868 60.0 57844 57844 0.0
p50_1.pddl
58280 58392 112.0 58428 58432 4.0
p50_2.pddl
58416 58404 -12.0 58452 58452 0.0
p50_3.pddl
58744 58824 80.0 58888 58888 0.0
Sum of diffs
596.00
124.00
Arithmetic mean of diffs
29.80
6.20
openstacks-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54664 54668 4.0 54664 54668 4.0
p02.pddl
54664 54668 4.0 54664 54668 4.0
p03.pddl
54664 54668 4.0 54664 54668 4.0
p04.pddl
54664 54668 4.0 54664 54668 4.0
p05.pddl
54664 54668 4.0 54664 54668 4.0
p06.pddl
54852 54932 80.0 54852 54856 4.0
p07.pddl
54852 54932 80.0 54852 54856 4.0
p08.pddl
56044 56072 28.0 55912 55916 4.0
p09.pddl
56064 56080 16.0 55924 55928 4.0
p10.pddl
56388 56488 100.0 56400 56412 12.0
p11.pddl
56388 56488 100.0 56400 56412 12.0
p12.pddl
56520 56528 8.0 56520 56536 16.0
p13.pddl
56652 56676 24.0 56520 56536 16.0
p14.pddl
56652 56672 20.0 56520 56536 16.0
p15.pddl
56664 56712 48.0 56672 56672 0.0
p16.pddl
56664 56708 44.0 56668 56668 0.0
p17.pddl
57232 57288 56.0 57104 57104 0.0
p18.pddl
59696 59856 160.0 59560 59564 4.0
p19.pddl
57152 57276 124.0 57032 57032 0.0
p20.pddl
58432 58564 132.0 58432 58432 0.0
p21.pddl
58432 58564 132.0 58432 58432 0.0
p22.pddl
58828 58828 0.0 58696 58700 4.0
p23.pddl
58804 58856 52.0 58820 58720 -100.0
p24.pddl
82880 83068 188.0 78520 78392 -128.0
p25.pddl
75336 75524 188.0 75928 75912 -16.0
p26.pddl
64712 64884 172.0 64580 64628 48.0
p27.pddl
81224 81708 484.0 81172 81176 4.0
p28.pddl
224224 224912 688.0 218052 218068 16.0
p29.pddl
205008 205696 688.0 190444 190428 -16.0
p30.pddl
96596 97288 692.0 96428 96432 4.0
Sum of diffs
4324.00
-72.00
Arithmetic mean of diffs
144.13
-2.40
organic-synthesis-opt18-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
55336 55424 88.0 55340 55340 0.0
p02.pddl
55440 55464 24.0 55440 55440 0.0
p03.pddl
73864 74144 280.0 72812 72812 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
54528 54532 4.0 54528 54532 4.0
p08.pddl
None None - None None -
p09.pddl
89636 89932 296.0 90360 90364 4.0
p10.pddl
90516 91648 1132.0 91236 91240 4.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
69668 69864 196.0 69800 69804 4.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
2020.00
16.00
Arithmetic mean of diffs
288.57
2.29
organic-synthesis-split-opt18-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
56420 56512 92.0 56684 56684 0.0
p02.pddl
57904 58020 116.0 58304 58308 4.0
p03.pddl
77256 77772 516.0 89832 89844 12.0
p04.pddl
65976 66260 284.0 96112 96116 4.0
p05.pddl
81104 81824 720.0 84404 84404 0.0
p06.pddl
83704 84508 804.0 858680 858668 -12.0
p07.pddl
54824 54836 12.0 54824 54824 0.0
p08.pddl
108144 109572 1428.0 3259500 3259508 8.0
p09.pddl
60344 60504 160.0 60872 60880 8.0
p10.pddl
60380 60588 208.0 63644 63636 -8.0
p11.pddl
78124 78772 648.0 None None -
p12.pddl
79716 80480 764.0 None None -
p13.pddl
157188 159972 2784.0 None None -
p14.pddl
62288 62520 232.0 63268 63268 0.0
p15.pddl
None None - None None -
p16.pddl
243892 247892 4000.0 None None -
p17.pddl
290100 295588 5488.0 None None -
p18.pddl
None None - None None -
p19.pddl
141500 143184 1684.0 None None -
p20.pddl
329464 329496 32.0 None None -
Sum of diffs
19972.00
16.00
Arithmetic mean of diffs
1109.56
1.45
parcprinter-08-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54528 54536 8.0 54528 54536 8.0
p02.pddl
54660 54668 8.0 54660 54668 8.0
p03.pddl
54660 54664 4.0 54660 54664 4.0
p04.pddl
54780 54788 8.0 54780 54792 12.0
p05.pddl
54920 54920 0.0 54920 54920 0.0
p06.pddl
54920 54924 4.0 54920 54932 12.0
p07.pddl
55060 55060 0.0 55060 55076 16.0
p08.pddl
55056 55200 144.0 55188 55200 12.0
p09.pddl
55208 55232 24.0 55212 55216 4.0
p10.pddl
55220 55252 32.0 55228 55228 0.0
p11.pddl
54656 54668 12.0 54656 54668 12.0
p12.pddl
54668 54676 8.0 54672 54672 0.0
p13.pddl
54784 54792 8.0 56236 56248 12.0
p14.pddl
54924 54932 8.0 120624 120616 -8.0
p15.pddl
54940 54956 16.0 None None -
p16.pddl
55056 55056 0.0 None None -
p17.pddl
55228 55248 20.0 None None -
p18.pddl
55388 55404 16.0 None None -
p19.pddl
55496 55516 20.0 None None -
p20.pddl
55752 55788 36.0 None None -
p21.pddl
54528 54536 8.0 54528 54536 8.0
p22.pddl
54660 54668 8.0 54660 54668 8.0
p23.pddl
54668 54676 8.0 54672 54672 0.0
p24.pddl
54792 54800 8.0 54792 54800 8.0
p25.pddl
54784 54924 140.0 92132 92136 4.0
p26.pddl
54920 54932 12.0 54920 54800 -120.0
p27.pddl
55072 55084 12.0 54936 54940 4.0
p28.pddl
55084 55068 -16.0 54952 54956 4.0
p29.pddl
55192 55204 12.0 None None -
p30.pddl
55364 55392 28.0 None None -
Sum of diffs
596.00
8.00
Arithmetic mean of diffs
19.87
0.36
parcprinter-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54660 54668 8.0 54660 54668 8.0
p02.pddl
54660 54668 8.0 54660 54668 8.0
p03.pddl
54668 54676 8.0 54672 54672 0.0
p04.pddl
54780 54788 8.0 54780 54792 12.0
p05.pddl
54668 54676 8.0 54672 54672 0.0
p06.pddl
54920 54924 4.0 54920 54932 12.0
p07.pddl
54920 54920 0.0 54920 54920 0.0
p08.pddl
54792 54800 8.0 54792 54800 8.0
p09.pddl
54784 54792 8.0 56236 56248 12.0
p10.pddl
54784 54924 140.0 92132 92136 4.0
p11.pddl
54920 54932 12.0 54920 54800 -120.0
p12.pddl
54924 54932 8.0 120624 120616 -8.0
p13.pddl
55060 55060 0.0 55060 55076 16.0
p14.pddl
55056 55200 144.0 55188 55200 12.0
p15.pddl
55208 55232 24.0 55212 55216 4.0
p16.pddl
55220 55252 32.0 55228 55228 0.0
p17.pddl
54940 54956 16.0 None None -
p18.pddl
55056 55056 0.0 None None -
p19.pddl
55228 55248 20.0 None None -
p20.pddl
55072 55084 12.0 54936 54940 4.0
Sum of diffs
468.00
-28.00
Arithmetic mean of diffs
23.40
-1.65
parking-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
58936 58972 36.0 None None -
pfile03-012.pddl
59068 59104 36.0 None None -
pfile04-013.pddl
62224 62384 160.0 None None -
pfile04-014.pddl
62224 62384 160.0 None None -
pfile04-015.pddl
62224 62384 160.0 None None -
pfile04-016.pddl
62224 62384 160.0 None None -
pfile05-017.pddl
64796 65044 248.0 None None -
pfile05-018.pddl
64800 64912 112.0 None None -
pfile05-019.pddl
64792 65052 260.0 None None -
pfile05-020.pddl
64792 65048 256.0 None None -
pfile06-021.pddl
69880 70120 240.0 None None -
pfile06-022.pddl
69880 70116 236.0 None None -
pfile06-023.pddl
69876 70120 244.0 None None -
pfile06-024.pddl
69876 70116 240.0 None None -
pfile07-025.pddl
74624 75016 392.0 None None -
pfile07-026.pddl
74492 74888 396.0 None None -
pfile07-027.pddl
74624 75020 396.0 None None -
pfile07-028.pddl
74624 75016 392.0 None None -
pfile08-029.pddl
83604 84076 472.0 None None -
pfile08-030.pddl
83584 84072 488.0 None None -
Sum of diffs
5084.00
None
Arithmetic mean of diffs
254.20
None
parking-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
59068 59104 36.0 None None -
p_12_7-02.pddl
59068 59104 36.0 100132 100148 16.0
p_12_7-03.pddl
59068 59104 36.0 None None -
p_12_7-04.pddl
59068 59104 36.0 None None -
p_14_8-01.pddl
62224 62384 160.0 None None -
p_14_8-02.pddl
62224 62384 160.0 None None -
p_14_8-03.pddl
62224 62384 160.0 None None -
p_14_8-04.pddl
62224 62384 160.0 None None -
p_16_9-01.pddl
64792 64920 128.0 None None -
p_16_9-02.pddl
64796 64912 116.0 None None -
p_16_9-03.pddl
64792 64916 124.0 None None -
p_16_9-04.pddl
64792 65048 256.0 None None -
p_18_10-01.pddl
70008 70252 244.0 None None -
p_18_10-02.pddl
69876 70116 240.0 None None -
p_18_10-03.pddl
69876 70120 244.0 None None -
p_18_10-04.pddl
69876 70116 240.0 None None -
p_20_11-01.pddl
74624 75020 396.0 None None -
p_20_11-02.pddl
74488 74884 396.0 None None -
p_20_11-03.pddl
74620 75016 396.0 None None -
p_20_11-04.pddl
74624 75016 392.0 None None -
Sum of diffs
3956.00
16.00
Arithmetic mean of diffs
197.80
16.00
pathways-noneg
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54528 54536 8.0 54528 54536 8.0
p02.pddl
54660 54668 8.0 54660 54668 8.0
p03.pddl
54668 54676 8.0 54668 54672 4.0
p04.pddl
54660 54668 8.0 54928 54936 8.0
p05.pddl
54792 54792 0.0 72444 72356 -88.0
p06.pddl
54936 54940 4.0 415844 415836 -8.0
p07.pddl
55092 55116 24.0 2398168 2398236 68.0
p08.pddl
55384 55268 -116.0 None None -
p09.pddl
55208 55236 28.0 460344 460352 8.0
p10.pddl
None None - None None -
p11.pddl
55404 55432 28.0 1488140 1488148 8.0
p12.pddl
55520 55536 16.0 None None -
p13.pddl
55680 55772 92.0 None None -
p14.pddl
55820 55888 68.0 None None -
p15.pddl
55688 55636 -52.0 None None -
p16.pddl
None None - None None -
p17.pddl
56368 56400 32.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
59212 59220 8.0 None None -
p24.pddl
59076 58968 -108.0 None None -
p25.pddl
59260 59180 -80.0 None None -
p26.pddl
59132 59084 -48.0 None None -
p27.pddl
60536 60504 -32.0 None None -
p28.pddl
58868 58908 40.0 None None -
p29.pddl
62380 62420 40.0 None None -
p30.pddl
63024 62928 -96.0 None None -
Sum of diffs
-120.00
16.00
Arithmetic mean of diffs
-5.22
1.78
pegsol-08-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54688 54692 4.0 54688 54688 0.0
p02.pddl
54800 54812 12.0 54800 54804 4.0
p03.pddl
54800 54812 12.0 54800 54804 4.0
p04.pddl
54800 54812 12.0 54800 54804 4.0
p05.pddl
54688 54692 4.0 54688 54688 0.0
p06.pddl
54800 54812 12.0 54800 54804 4.0
p07.pddl
54800 54812 12.0 54800 54804 4.0
p08.pddl
54800 54812 12.0 54800 54804 4.0
p09.pddl
54800 54812 12.0 54800 54804 4.0
p10.pddl
54800 54812 12.0 54800 54804 4.0
p11.pddl
54800 54812 12.0 54800 54804 4.0
p12.pddl
54800 54812 12.0 54800 54804 4.0
p13.pddl
54800 54812 12.0 55460 55468 8.0
p14.pddl
54800 54812 12.0 55064 55072 8.0
p15.pddl
54800 54812 12.0 54800 54804 4.0
p16.pddl
54800 54812 12.0 54800 54804 4.0
p17.pddl
56000 56000 0.0 56256 56256 0.0
p18.pddl
54800 54812 12.0 54800 54804 4.0
p19.pddl
54800 54812 12.0 55068 55068 0.0
p20.pddl
54800 54812 12.0 54800 54804 4.0
p21.pddl
54800 54812 12.0 55464 55468 4.0
p22.pddl
54800 54812 12.0 54800 54804 4.0
p23.pddl
54800 54812 12.0 56396 56404 8.0
p24.pddl
54800 54812 12.0 55460 55464 4.0
p25.pddl
54800 54812 12.0 55068 55068 0.0
p26.pddl
54800 54812 12.0 56400 56404 4.0
p27.pddl
58544 58536 -8.0 54800 54804 4.0
p28.pddl
64756 64760 4.0 108164 108164 0.0
p29.pddl
613448 613544 96.0 62820 62824 4.0
p30.pddl
65628 65636 8.0 981796 981812 16.0
Sum of diffs
384.00
120.00
Arithmetic mean of diffs
12.80
4.00
pegsol-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54800 54812 12.0 54800 54804 4.0
p02.pddl
56000 56000 0.0 56256 56256 0.0
p03.pddl
54800 54812 12.0 54800 54804 4.0
p04.pddl
54800 54812 12.0 55068 55068 0.0
p05.pddl
54800 54812 12.0 56940 56812 -128.0
p06.pddl
54800 54812 12.0 54800 54804 4.0
p07.pddl
54800 54812 12.0 54800 54804 4.0
p08.pddl
54800 54812 12.0 54800 54804 4.0
p09.pddl
54800 54812 12.0 54932 54936 4.0
p10.pddl
54800 54812 12.0 55464 55468 4.0
p11.pddl
54800 54812 12.0 54800 54804 4.0
p12.pddl
54800 54812 12.0 55068 55068 0.0
p13.pddl
54800 54812 12.0 56396 56404 8.0
p14.pddl
54800 54812 12.0 55460 55464 4.0
p15.pddl
54800 54812 12.0 55068 55068 0.0
p16.pddl
54800 54812 12.0 56400 56404 4.0
p17.pddl
58544 58536 -8.0 54800 54804 4.0
p18.pddl
64756 64760 4.0 108164 108164 0.0
p19.pddl
613448 613544 96.0 62820 62824 4.0
p20.pddl
65628 65636 8.0 981796 981812 16.0
Sum of diffs
280.00
-56.00
Arithmetic mean of diffs
14.00
-2.80
petri-net-alignment-opt18-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
57052 57004 -48.0 56932 56928 -4.0
p02.pddl
58460 58456 -4.0 57920 57948 28.0
p03.pddl
60064 60116 52.0 59052 59144 92.0
p04.pddl
60348 60412 64.0 59328 59316 -12.0
p05.pddl
58180 58220 40.0 57780 57784 4.0
p06.pddl
60464 60520 56.0 59336 59288 -48.0
p07.pddl
59796 59876 80.0 59004 58904 -100.0
p08.pddl
60464 60528 64.0 59320 59320 0.0
p09.pddl
60060 60128 68.0 59188 59188 0.0
p10.pddl
63588 63664 76.0 61516 61520 4.0
p11.pddl
61380 61516 136.0 60020 60036 16.0
p12.pddl
66956 67040 84.0 63788 63820 32.0
p13.pddl
63472 63532 60.0 61388 61388 0.0
p14.pddl
63880 63920 40.0 61772 61740 -32.0
p15.pddl
63364 63404 40.0 61252 61252 0.0
p16.pddl
65492 65492 0.0 62716 62720 4.0
p17.pddl
66424 66524 100.0 63400 63408 8.0
p18.pddl
65492 65492 0.0 62720 62732 12.0
p19.pddl
66292 66416 124.0 63404 63400 -4.0
p20.pddl
67104 67180 76.0 63816 63820 4.0
Sum of diffs
1108.00
4.00
Arithmetic mean of diffs
55.40
0.20
pipesworld-notankage
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
54792 54796 4.0 54784 54800 16.0
p02-net1-b6-g4.pddl
54792 54796 4.0 54784 54800 16.0
p03-net1-b8-g3.pddl
54836 54848 12.0 54968 54968 0.0
p04-net1-b8-g5.pddl
54968 54980 12.0 54968 54968 0.0
p05-net1-b10-g4.pddl
55188 55192 4.0 55188 55192 4.0
p06-net1-b10-g6.pddl
55324 55392 68.0 55188 55192 4.0
p07-net1-b12-g5.pddl
55284 55312 28.0 55284 55316 32.0
p08-net1-b12-g7.pddl
55284 55316 32.0 55284 55316 32.0
p09-net1-b14-g6.pddl
55524 55556 32.0 55524 55468 -56.0
p10-net1-b14-g8.pddl
55524 55556 32.0 55524 55468 -56.0
p11-net2-b10-g2.pddl
56488 56496 8.0 55728 55728 0.0
p12-net2-b10-g4.pddl
56440 56448 8.0 55728 55728 0.0
p13-net2-b12-g3.pddl
56048 56144 96.0 57344 57368 24.0
p14-net2-b12-g5.pddl
56192 56176 -16.0 56328 56328 0.0
p15-net2-b14-g4.pddl
56064 56152 88.0 57532 57532 0.0
p16-net2-b14-g6.pddl
59268 59280 12.0 95668 95696 28.0
p17-net2-b16-g5.pddl
59312 59320 8.0 56940 56940 0.0
p18-net2-b16-g7.pddl
61396 61404 8.0 56936 56960 24.0
p19-net2-b18-g6.pddl
57616 57720 104.0 57900 57884 -16.0
p20-net2-b18-g8.pddl
64960 64964 4.0 59668 59672 4.0
p21-net3-b12-g2.pddl
56220 56380 160.0 56484 56488 4.0
p22-net3-b12-g4.pddl
65632 65636 4.0 64768 64760 -8.0
p23-net3-b14-g3.pddl
57276 57324 48.0 58284 58292 8.0
p24-net3-b14-g5.pddl
60940 60948 8.0 87848 87856 8.0
p25-net3-b16-g5.pddl
57924 58024 100.0 87600 87608 8.0
p26-net3-b16-g7.pddl
66640 66652 12.0 60024 60036 12.0
p27-net3-b18-g6.pddl
66516 66516 0.0 831124 831136 12.0
p28-net3-b18-g7.pddl
67536 67544 8.0 513000 513012 12.0
p29-net3-b20-g6.pddl
60288 60308 20.0 361820 361816 -4.0
p30-net3-b20-g8.pddl
68704 68704 0.0 77152 77152 0.0
p31-net4-b14-g3.pddl
57784 57892 108.0 61068 61076 8.0
p32-net4-b14-g5.pddl
59308 59316 8.0 58600 58612 12.0
p33-net4-b16-g5.pddl
58320 58328 8.0 64096 64104 8.0
p34-net4-b16-g6.pddl
65772 65780 8.0 74384 74392 8.0
p35-net4-b18-g4.pddl
61940 61948 8.0 855476 855488 12.0
p36-net4-b18-g6.pddl
60256 60408 152.0 2570732 2570844 112.0
p37-net4-b20-g5.pddl
60688 60836 148.0 None None -
p38-net4-b20-g7.pddl
67256 67256 0.0 767116 767132 16.0
p39-net4-b22-g7.pddl
62148 62412 264.0 None None -
p40-net4-b22-g8.pddl
62152 62412 260.0 2904348 2904372 24.0
p41-net5-b22-g2.pddl
65364 65676 312.0 205568 205576 8.0
p42-net5-b22-g4.pddl
None None - None None -
p43-net5-b24-g3.pddl
None None - None None -
p44-net5-b24-g5.pddl
None None - None None -
p45-net5-b26-g4.pddl
None None - None None -
p46-net5-b26-g6.pddl
None None - None None -
p47-net5-b28-g5.pddl
None None - None None -
p48-net5-b28-g7.pddl
None None - None None -
p49-net5-b30-g6.pddl
75204 75732 528.0 None None -
p50-net5-b30-g8.pddl
86604 86608 4.0 None None -
Sum of diffs
2716.00
316.00
Arithmetic mean of diffs
63.16
8.10
pipesworld-tankage
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
54664 54672 8.0 54796 54680 -116.0
p02-net1-b6-g4-t50.pddl
54800 54804 4.0 54796 54680 -116.0
p03-net1-b8-g3-t80.pddl
55544 55568 24.0 55544 55588 44.0
p04-net1-b8-g5-t80.pddl
55548 55568 20.0 55544 55588 44.0
p05-net1-b10-g4-t50.pddl
55596 55704 108.0 55732 55732 0.0
p06-net1-b10-g6-t50.pddl
55728 55704 -24.0 55728 55728 0.0
p07-net1-b12-g5-t80.pddl
58200 58288 88.0 58332 58336 4.0
p08-net1-b12-g7-t80.pddl
58332 58420 88.0 58332 58332 0.0
p09-net1-b14-g6-t50.pddl
65840 65848 8.0 63348 63356 8.0
p10-net1-b14-g8-t50.pddl
58908 58916 8.0 58940 58916 -24.0
p11-net2-b10-g2-t30.pddl
56652 56668 16.0 57900 57892 -8.0
p12-net2-b10-g4-t60.pddl
58068 58184 116.0 61196 61200 4.0
p13-net2-b12-g3-t70.pddl
58960 59128 168.0 519764 519776 12.0
p14-net2-b12-g5-t30.pddl
57912 57928 16.0 71628 71640 12.0
p15-net2-b14-g4-t30.pddl
57784 57932 148.0 96004 95992 -12.0
p16-net2-b14-g6-t80.pddl
61832 61972 140.0 None None -
p17-net2-b16-g5-t20.pddl
58364 58468 104.0 121848 121852 4.0
p18-net2-b16-g7-t60.pddl
62568 62752 184.0 365564 365580 16.0
p19-net2-b18-g6-t60.pddl
65956 66160 204.0 321904 321912 8.0
p20-net2-b18-g8-t90.pddl
71756 72112 356.0 None None -
p21-net3-b12-g2-t60.pddl
58644 58772 128.0 65104 65112 8.0
p22-net3-b12-g4-t60.pddl
723204 723204 0.0 296308 296400 92.0
p23-net3-b14-g3-t60.pddl
63504 63684 180.0 None None -
p24-net3-b14-g5-t60.pddl
63612 63816 204.0 None None -
p25-net3-b16-g5-t60.pddl
71892 72232 340.0 None None -
p26-net3-b16-g7-t70.pddl
88512 88520 8.0 None None -
p27-net3-b18-g6-t70.pddl
77276 77664 388.0 None None -
p28-net3-b18-g7-t70.pddl
744876 744884 8.0 None None -
p29-net3-b20-g6-t70.pddl
84000 84596 596.0 None None -
p30-net3-b20-g8-t70.pddl
85636 86288 652.0 None None -
p31-net4-b14-g3-t20.pddl
83120 83132 12.0 63632 63612 -20.0
p32-net4-b14-g5-t30.pddl
61984 62056 72.0 606332 606356 24.0
p33-net4-b16-g5-t60.pddl
67056 67300 244.0 None None -
p34-net4-b16-g6-t60.pddl
70308 70636 328.0 None None -
p35-net4-b18-g4-t90.pddl
100768 101604 836.0 None None -
p36-net4-b18-g6-t90.pddl
105348 105356 8.0 None None -
p37-net4-b20-g5-t60.pddl
83260 83876 616.0 None None -
p38-net4-b20-g7-t60.pddl
83404 84016 612.0 None None -
p39-net4-b22-g7-t50.pddl
100040 100844 804.0 None None -
p40-net4-b22-g8-t50.pddl
100008 100852 844.0 None None -
p41-net5-b22-g2-t20.pddl
72572 72992 420.0 None None -
p42-net5-b22-g4-t50.pddl
None None - None None -
p43-net5-b24-g3-t80.pddl
None None - None None -
p44-net5-b24-g5-t80.pddl
None None - None None -
p45-net5-b26-g4-t50.pddl
None None - None None -
p46-net5-b26-g6-t50.pddl
None None - None None -
p47-net5-b28-g5-t50.pddl
None None - None None -
p48-net5-b28-g7-t50.pddl
None None - None None -
p49-net5-b30-g6-t50.pddl
170184 172504 2320.0 None None -
p50-net5-b30-g8-t50.pddl
170588 172908 2320.0 None None -
Sum of diffs
13724.00
-16.00
Arithmetic mean of diffs
319.16
-0.73
psr-small
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
54528 54536 8.0 54528 54536 8.0
p02-s5-n1-l3-f30.pddl
54528 54532 4.0 54528 54532 4.0
p03-s7-n1-l3-f70.pddl
54524 54532 8.0 54524 54532 8.0
p04-s8-n1-l4-f10.pddl
54528 54536 8.0 54528 54536 8.0
p05-s9-n1-l4-f30.pddl
54524 54536 12.0 54524 54536 12.0
p06-s10-n1-l4-f50.pddl
54528 54536 8.0 54528 54536 8.0
p07-s11-n1-l4-f70.pddl
54524 54532 8.0 54524 54532 8.0
p08-s12-n1-l5-f10.pddl
54524 54536 12.0 54524 54536 12.0
p09-s13-n1-l5-f30.pddl
54524 54532 8.0 54524 54532 8.0
p10-s17-n2-l2-f30.pddl
54656 54536 -120.0 54656 54668 12.0
p11-s18-n2-l2-f50.pddl
54524 54536 12.0 54524 54536 12.0
p12-s21-n2-l3-f30.pddl
54524 54536 12.0 54524 54536 12.0
p13-s22-n2-l3-f50.pddl
54524 54536 12.0 54524 54536 12.0
p14-s23-n2-l3-f70.pddl
54524 54532 8.0 54524 54532 8.0
p15-s24-n2-l4-f10.pddl
55196 55204 8.0 55592 55600 8.0
p16-s29-n2-l5-f30.pddl
54660 54536 -124.0 54660 54668 8.0
p17-s30-n2-l5-f50.pddl
54528 54532 4.0 54528 54532 4.0
p18-s31-n2-l5-f70.pddl
54528 54536 8.0 54528 54536 8.0
p19-s33-n3-l2-f30.pddl
54664 54672 8.0 54664 54668 4.0
p20-s34-n3-l2-f50.pddl
54524 54536 12.0 54524 54536 12.0
p21-s35-n3-l2-f70.pddl
54524 54536 12.0 54524 54536 12.0
p22-s37-n3-l3-f30.pddl
54660 54668 8.0 54664 54668 4.0
p23-s38-n3-l3-f50.pddl
54524 54536 12.0 54524 54536 12.0
p24-s39-n3-l3-f70.pddl
54524 54536 12.0 54524 54536 12.0
p25-s40-n3-l4-f10.pddl
67148 67220 72.0 65968 65968 0.0
p26-s41-n3-l4-f30.pddl
54528 54536 8.0 54528 54536 8.0
p27-s42-n3-l4-f50.pddl
54528 54536 8.0 54528 54536 8.0
p28-s43-n3-l4-f70.pddl
54528 54536 8.0 54528 54536 8.0
p29-s45-n3-l5-f30.pddl
54668 54676 8.0 54668 54672 4.0
p30-s46-n3-l5-f50.pddl
54664 54536 -128.0 54660 54668 8.0
p31-s49-n4-l2-f30.pddl
55192 55204 12.0 57820 57708 -112.0
p32-s50-n4-l2-f50.pddl
54528 54536 8.0 54528 54536 8.0
p33-s51-n4-l2-f70.pddl
54660 54668 8.0 54660 54668 8.0
p34-s55-n4-l3-f70.pddl
54528 54536 8.0 54528 54536 8.0
p35-s57-n5-l2-f30.pddl
54664 54672 8.0 68084 68100 16.0
p36-s65-n6-l2-f30.pddl
54792 54796 4.0 106628 106604 -24.0
p37-s67-n6-l2-f70.pddl
54664 54536 -128.0 54660 54668 8.0
p38-s78-n3-l3-f50.pddl
54528 54536 8.0 54528 54536 8.0
p39-s79-n3-l3-f70.pddl
54664 54536 -128.0 54660 54668 8.0
p40-s80-n3-l4-f10.pddl
55352 55364 12.0 301788 301788 0.0
p41-s81-n3-l4-f30.pddl
54528 54536 8.0 54528 54536 8.0
p42-s82-n3-l4-f50.pddl
54656 54536 -120.0 54656 54668 12.0
p43-s83-n3-l4-f70.pddl
54524 54536 12.0 54524 54536 12.0
p44-s89-n4-l2-f30.pddl
54656 54668 12.0 54656 54668 12.0
p45-s94-n4-l3-f50.pddl
54528 54536 8.0 54528 54536 8.0
p46-s97-n5-l2-f30.pddl
54660 54668 8.0 57848 57868 20.0
p47-s98-n5-l2-f50.pddl
54664 54536 -128.0 54660 54668 8.0
p48-s101-n5-l3-f30.pddl
54660 54668 8.0 54792 54672 -120.0
p49-s105-n6-l2-f30.pddl
54780 54668 -112.0 54780 54792 12.0
p50-s107-n6-l2-f70.pddl
54660 54536 -124.0 54660 54536 -124.0
Sum of diffs
-680.00
28.00
Arithmetic mean of diffs
-13.60
0.56
rovers
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54528 54536 8.0 54528 54536 8.0
p02.pddl
54528 54536 8.0 54528 54536 8.0
p03.pddl
54524 54536 12.0 54524 54536 12.0
p04.pddl
54524 54536 12.0 54524 54536 12.0
p05.pddl
54664 54668 4.0 54664 54668 4.0
p06.pddl
54672 54680 8.0 54672 54676 4.0
p07.pddl
54664 54672 8.0 54664 54668 4.0
p08.pddl
54656 54664 8.0 54916 54924 8.0
p09.pddl
54796 54792 -4.0 57940 57948 8.0
p10.pddl
54792 54796 4.0 61632 61648 16.0
p11.pddl
54792 54792 0.0 55588 55584 -4.0
p12.pddl
54656 54668 12.0 54916 54928 12.0
p13.pddl
54820 54928 108.0 56536 56540 4.0
p14.pddl
54792 54800 8.0 58340 58280 -60.0
p15.pddl
54936 54944 8.0 61604 61596 -8.0
p16.pddl
54808 54820 12.0 61892 61884 -8.0
p17.pddl
55192 55212 20.0 172872 172872 0.0
p18.pddl
55328 55352 24.0 1335688 1335680 -8.0
p19.pddl
55884 55900 16.0 None None -
p20.pddl
56456 56500 44.0 None None -
p21.pddl
56828 56884 56.0 None None -
p22.pddl
56748 56856 108.0 1222088 1222096 8.0
p23.pddl
57336 57264 -72.0 None None -
p24.pddl
58228 58236 8.0 None None -
p25.pddl
56524 56544 20.0 104064 104064 0.0
p26.pddl
56080 56112 32.0 None None -
p27.pddl
57028 57096 68.0 None None -
p28.pddl
58436 58460 24.0 None None -
p29.pddl
58584 58624 40.0 None None -
p30.pddl
59200 59208 8.0 None None -
p31.pddl
60284 60260 -24.0 None None -
p32.pddl
65160 65096 -64.0 None None -
p33.pddl
71380 71388 8.0 None None -
p34.pddl
64484 64392 -92.0 None None -
p35.pddl
82984 82996 12.0 None None -
p36.pddl
70324 70260 -64.0 None None -
p37.pddl
100712 100716 4.0 None None -
p38.pddl
91520 91528 8.0 None None -
p39.pddl
88080 88092 12.0 None None -
p40.pddl
110168 110044 -124.0 None None -
Sum of diffs
288.00
20.00
Arithmetic mean of diffs
7.20
1.00
satellite
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
54528 54536 8.0 54528 54536 8.0
p02-pfile2.pddl
54524 54536 12.0 54524 54536 12.0
p03-pfile3.pddl
54660 54668 8.0 54660 54668 8.0
p04-pfile4.pddl
54660 54680 20.0 54660 54676 16.0
p05-pfile5.pddl
54788 54796 8.0 56788 56800 12.0
p06-pfile6.pddl
54792 54796 4.0 55320 55332 12.0
p07-pfile7.pddl
54820 54932 112.0 63068 63068 0.0
p08-pfile8.pddl
54976 54988 12.0 122044 122068 24.0
p09-pfile9.pddl
55204 55220 16.0 184428 184312 -116.0
p10-pfile10.pddl
55248 55300 52.0 499500 499540 40.0
p11-pfile11.pddl
55524 55544 20.0 275636 275644 8.0
p12-pfile12.pddl
56116 56144 28.0 1111136 1111120 -16.0
p13-pfile13.pddl
57576 57564 -12.0 None None -
p14-pfile14.pddl
56292 56324 32.0 1328088 1328100 12.0
p15-pfile15.pddl
57200 57208 8.0 None None -
p16-pfile16.pddl
57348 57456 108.0 None None -
p17-pfile17.pddl
58520 58432 -88.0 None None -
p18-pfile18.pddl
55984 56012 28.0 None None -
p19-pfile19.pddl
56352 56380 28.0 None None -
p20-pfile20.pddl
59440 59372 -68.0 None None -
p21-HC-pfile1.pddl
59056 59024 -32.0 392160 392156 -4.0
p22-HC-pfile2.pddl
61096 61184 88.0 None None -
p23-HC-pfile3.pddl
66304 66292 -12.0 429400 429408 8.0
p24-HC-pfile4.pddl
80624 80624 0.0 None None -
p25-HC-pfile5.pddl
89180 89204 24.0 None None -
p26-HC-pfile6.pddl
78452 78460 8.0 None None -
p27-HC-pfile7.pddl
81036 81064 28.0 None None -
p28-HC-pfile8.pddl
178492 178500 8.0 None None -
p29-HC-pfile9.pddl
142508 142516 8.0 None None -
p30-HC-pfile10.pddl
311088 311088 0.0 None None -
p31-HC-pfile11.pddl
284716 284724 8.0 None None -
p32-HC-pfile12.pddl
756524 756216 -308.0 None None -
p33-HC-pfile13.pddl
1536764 1536772 8.0 None None -
p34-HC-pfile14.pddl
150180 151264 1084.0 None None -
p35-HC-pfile15.pddl
332892 333008 116.0 None None -
p36-HC-pfile16.pddl
231600 233744 2144.0 None None -
Sum of diffs
3508.00
24.00
Arithmetic mean of diffs
97.44
1.60
scanalyzer-08-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54928 54940 12.0 54928 54960 32.0
p02.pddl
54832 54840 8.0 54836 54836 0.0
p03.pddl
54812 54820 8.0 54816 54816 0.0
p04.pddl
56116 56144 28.0 56132 56132 0.0
p05.pddl
55364 55428 64.0 55364 55384 20.0
p06.pddl
55192 55208 16.0 55192 55196 4.0
p07.pddl
57932 57968 36.0 57944 57944 0.0
p08.pddl
56300 56336 36.0 56432 56436 4.0
p09.pddl
56180 56184 4.0 56312 56316 4.0
p10.pddl
61648 61828 180.0 61904 61908 4.0
p11.pddl
58188 58308 120.0 58512 58512 0.0
p12.pddl
58000 57980 -20.0 58168 58172 4.0
p13.pddl
67768 68032 264.0 67992 67996 4.0
p14.pddl
61312 61436 124.0 61728 61732 4.0
p15.pddl
60960 61068 108.0 61188 61188 0.0
p16.pddl
78780 79208 428.0 79464 79464 0.0
p17.pddl
67048 67292 244.0 67820 67820 0.0
p18.pddl
63888 63784 -104.0 64552 64552 0.0
p19.pddl
88076 88880 804.0 89280 89284 4.0
p20.pddl
71084 71492 408.0 72564 72568 4.0
p21.pddl
70048 70360 312.0 71232 71236 4.0
p22.pddl
55192 55204 12.0 55192 55192 0.0
p23.pddl
55192 55204 12.0 55192 55192 0.0
p24.pddl
55192 55204 12.0 55192 55192 0.0
p25.pddl
91244 91824 580.0 91780 91780 0.0
p26.pddl
84004 84492 488.0 84380 84380 0.0
p27.pddl
81400 81804 404.0 81792 81804 12.0
p28.pddl
537864 547856 9992.0 547076 547076 0.0
p29.pddl
337208 343008 5800.0 342528 342528 0.0
p30.pddl
307692 312404 4712.0 312312 312316 4.0
Sum of diffs
25092.00
108.00
Arithmetic mean of diffs
836.40
3.60
scanalyzer-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
55192 55204 12.0 55192 55192 0.0
p02.pddl
54832 54840 8.0 54836 54836 0.0
p03.pddl
54812 54820 8.0 54816 54816 0.0
p04.pddl
56116 56144 28.0 56132 56132 0.0
p05.pddl
57932 57968 36.0 57944 57944 0.0
p06.pddl
55364 55428 64.0 55364 55384 20.0
p07.pddl
88076 88880 804.0 89280 89284 4.0
p08.pddl
61648 61828 180.0 61904 61908 4.0
p09.pddl
67768 68032 264.0 67992 67996 4.0
p10.pddl
78780 79208 428.0 79464 79464 0.0
p11.pddl
91244 91824 580.0 91780 91780 0.0
p12.pddl
55192 55208 16.0 55192 55196 4.0
p13.pddl
81400 81804 404.0 81792 81804 12.0
p14.pddl
84004 84492 488.0 84380 84380 0.0
p15.pddl
56300 56336 36.0 56432 56436 4.0
p16.pddl
58188 58308 120.0 58512 58512 0.0
p17.pddl
61312 61436 124.0 61728 61732 4.0
p18.pddl
67048 67292 244.0 67820 67820 0.0
p19.pddl
71084 71492 408.0 72564 72568 4.0
p20.pddl
537864 547856 9992.0 547076 547076 0.0
Sum of diffs
14244.00
60.00
Arithmetic mean of diffs
712.20
3.00
snake-opt18-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
66248 66508 260.0 66684 66684 0.0
p02.pddl
66808 67100 292.0 75704 75712 8.0
p03.pddl
68236 68232 -4.0 106560 106552 -8.0
p04.pddl
65608 65788 180.0 65936 65936 0.0
p05.pddl
65656 65824 168.0 66216 66216 0.0
p06.pddl
70556 70900 344.0 82260 82260 0.0
p07.pddl
233516 233516 0.0 877828 877844 16.0
p08.pddl
None None - 3170848 3170868 20.0
p09.pddl
69684 69936 252.0 70276 70276 0.0
p10.pddl
70024 70416 392.0 70636 70576 -60.0
p11.pddl
79824 80256 432.0 106208 106208 0.0
p12.pddl
114252 114264 12.0 1199728 1199748 20.0
p13.pddl
81628 82184 556.0 None None -
p14.pddl
None None - None None -
p15.pddl
78848 79260 412.0 80116 80120 4.0
p16.pddl
85696 86624 928.0 827816 827816 0.0
p17.pddl
164348 164388 40.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
84784 85508 724.0 86024 86024 0.0
Sum of diffs
4988.00
0.00
Arithmetic mean of diffs
311.75
0.00
sokoban-opt08-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54780 54796 16.0 54780 54800 20.0
p02.pddl
54660 54668 8.0 54792 54800 8.0
p03.pddl
54668 54676 8.0 54672 54672 0.0
p04.pddl
54928 54940 12.0 55060 54992 -68.0
p05.pddl
56172 56132 -40.0 None None -
p06.pddl
54804 54816 12.0 55332 55464 132.0
p07.pddl
55060 55072 12.0 58324 58320 -4.0
p08.pddl
57440 57460 20.0 262944 262928 -16.0
p09.pddl
55076 55080 4.0 110736 110744 8.0
p10.pddl
55340 55364 24.0 82712 82704 -8.0
p11.pddl
60740 60752 12.0 69768 69776 8.0
p12.pddl
55756 55768 12.0 329588 329604 16.0
p13.pddl
103552 103552 0.0 312180 312188 8.0
p14.pddl
54808 54824 16.0 56940 56940 0.0
p15.pddl
61852 61844 -8.0 202676 202672 -4.0
p16.pddl
57264 57272 8.0 63580 63580 0.0
p17.pddl
54924 54940 16.0 59064 58968 -96.0
p18.pddl
57776 57800 24.0 354008 354028 20.0
p19.pddl
62400 62392 -8.0 650264 650280 16.0
p20.pddl
55224 55300 76.0 59444 59444 0.0
p21.pddl
56448 56552 104.0 56716 56732 16.0
p22.pddl
60796 60796 0.0 514824 514820 -4.0
p23.pddl
55076 55096 20.0 88508 88516 8.0
p24.pddl
68564 68600 36.0 None None -
p25.pddl
643964 643972 8.0 None None -
p26.pddl
59732 59736 4.0 None None -
p27.pddl
56356 56364 8.0 56848 56840 -8.0
p28.pddl
251488 251496 8.0 918232 918244 12.0
p29.pddl
56980 57156 176.0 None None -
p30.pddl
None None - None None -
Sum of diffs
588.00
64.00
Arithmetic mean of diffs
20.28
2.67
sokoban-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54804 54816 12.0 55332 55464 132.0
p02.pddl
54924 54940 16.0 59064 58968 -96.0
p03.pddl
54808 54824 16.0 56940 56940 0.0
p04.pddl
54928 54940 12.0 55060 54992 -68.0
p05.pddl
57264 57272 8.0 63580 63580 0.0
p06.pddl
60740 60752 12.0 69768 69776 8.0
p07.pddl
55340 55364 24.0 82712 82704 -8.0
p08.pddl
55076 55080 4.0 110736 110744 8.0
p09.pddl
55060 55072 12.0 58324 58320 -4.0
p10.pddl
56172 56132 -40.0 None None -
p11.pddl
103552 103552 0.0 312180 312188 8.0
p12.pddl
55224 55300 76.0 59444 59444 0.0
p13.pddl
57440 57460 20.0 262944 262928 -16.0
p14.pddl
55756 55768 12.0 329588 329604 16.0
p15.pddl
57776 57800 24.0 354008 354028 20.0
p16.pddl
61852 61844 -8.0 202676 202672 -4.0
p17.pddl
62400 62392 -8.0 650264 650280 16.0
p18.pddl
56448 56552 104.0 56716 56732 16.0
p19.pddl
60796 60796 0.0 514824 514820 -4.0
p20.pddl
55076 55096 20.0 88508 88516 8.0
Sum of diffs
316.00
32.00
Arithmetic mean of diffs
15.80
1.68
spider-opt18-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
62020 62148 128.0 62340 62340 0.0
p02.pddl
64672 64856 184.0 65104 65104 0.0
p03.pddl
77404 76688 -716.0 76872 76872 0.0
p04.pddl
85324 85772 448.0 86092 86088 -4.0
p05.pddl
101800 102640 840.0 102496 102668 172.0
p06.pddl
136864 140692 3828.0 691236 691232 -4.0
p07.pddl
60636 60756 120.0 60832 60832 0.0
p08.pddl
64648 64816 168.0 65036 65036 0.0
p09.pddl
75200 75556 356.0 75704 75704 0.0
p10.pddl
83528 83896 368.0 125048 125048 0.0
p11.pddl
101832 102672 840.0 103268 103264 -4.0
p12.pddl
134824 136088 1264.0 289572 289640 68.0
p13.pddl
143504 144992 1488.0 146356 146356 0.0
p14.pddl
60484 60592 108.0 60644 60648 4.0
p15.pddl
64140 64304 164.0 64540 64540 0.0
p16.pddl
74976 75300 324.0 75588 75584 -4.0
p17.pddl
79716 78800 -916.0 79332 79332 0.0
p18.pddl
100780 101552 772.0 168260 168256 -4.0
p19.pddl
130752 131832 1080.0 130204 130208 4.0
p20.pddl
139692 141060 1368.0 142728 142732 4.0
Sum of diffs
12216.00
232.00
Arithmetic mean of diffs
610.80
11.60
storage
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54528 54536 8.0 54528 54536 8.0
p02.pddl
54528 54536 8.0 54528 54536 8.0
p03.pddl
54664 54664 0.0 54660 54664 4.0
p04.pddl
54664 54664 0.0 54660 54664 4.0
p05.pddl
54664 54672 8.0 54664 54696 32.0
p06.pddl
54784 54792 8.0 54784 54808 24.0
p07.pddl
54672 54680 8.0 54660 54676 16.0
p08.pddl
54820 54832 12.0 54820 54824 4.0
p09.pddl
55040 55056 16.0 55040 55044 4.0
p10.pddl
54816 54828 12.0 54816 54820 4.0
p11.pddl
55180 55216 36.0 55116 55116 0.0
p12.pddl
55324 55348 24.0 58400 58424 24.0
p13.pddl
55692 55704 12.0 54844 54976 132.0
p14.pddl
58116 58132 16.0 55208 55216 8.0
p15.pddl
56132 56208 76.0 58172 58188 16.0
p16.pddl
57052 57116 64.0 88052 88144 92.0
p17.pddl
58092 57984 -108.0 567392 567408 16.0
p18.pddl
270092 270104 12.0 None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
124068 124084 16.0 None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
228.00
396.00
Arithmetic mean of diffs
12.00
23.29
termes-opt18-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54844 54852 8.0 55372 55372 0.0
p02.pddl
55780 55916 136.0 55376 55376 0.0
p03.pddl
56236 56248 12.0 61804 61836 32.0
p04.pddl
55960 55860 -100.0 61364 61388 24.0
p05.pddl
126828 126836 8.0 160576 160576 0.0
p06.pddl
76020 76032 12.0 262816 262792 -24.0
p07.pddl
284716 284720 4.0 1703416 1703440 24.0
p08.pddl
332584 332612 28.0 454044 454060 16.0
p09.pddl
None None - None None -
p10.pddl
1103472 1103472 0.0 None None -
p11.pddl
54844 54852 8.0 57900 57900 0.0
p12.pddl
54976 54984 8.0 54848 54848 0.0
p13.pddl
55580 55584 4.0 61344 61248 -96.0
p14.pddl
55316 55324 8.0 56392 56424 32.0
p15.pddl
66824 66832 8.0 68180 68184 4.0
p16.pddl
62176 62160 -16.0 81256 81376 120.0
p17.pddl
58316 58340 24.0 57900 57892 -8.0
p18.pddl
54844 54852 8.0 54980 54980 0.0
p19.pddl
57296 57312 16.0 55600 55732 132.0
p20.pddl
58860 58868 8.0 61248 61292 44.0
Sum of diffs
184.00
300.00
Arithmetic mean of diffs
9.68
16.67
tetris-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
60976 61040 64.0 61128 61260 132.0
p01-8.pddl
69492 69840 348.0 69508 69508 0.0
p01-10.pddl
533376 533412 36.0 77872 77880 8.0
p02-4.pddl
57788 57896 108.0 57928 57928 0.0
p02-6.pddl
66284 66580 296.0 66536 66536 0.0
p02-8.pddl
69620 70088 468.0 69616 69616 0.0
p02-10.pddl
111340 111352 12.0 66856 66860 4.0
p03-4.pddl
57800 57888 88.0 57936 57908 -28.0
p03-6.pddl
60608 60768 160.0 60896 60796 -100.0
p03-8.pddl
83736 84532 796.0 84296 84300 4.0
p03-10.pddl
98628 99672 1044.0 98988 98988 0.0
p04-6.pddl
60872 61040 168.0 60988 61016 28.0
p04-8.pddl
79264 79896 632.0 79688 79692 4.0
p04-10.pddl
84960 85880 920.0 85620 85620 0.0
p05-6.pddl
60600 60760 160.0 60856 60860 4.0
p05-8.pddl
208436 208448 12.0 84536 84536 0.0
p05-10.pddl
98024 99048 1024.0 98136 98136 0.0
Sum of diffs
6336.00
56.00
Arithmetic mean of diffs
372.71
3.29
tidybot-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
60772 60880 108.0 61148 61060 -88.0
p02.pddl
66420 66628 208.0 66832 66760 -72.0
p03.pddl
66264 66476 212.0 66836 66736 -100.0
p04.pddl
66420 66628 208.0 66800 66868 68.0
p05.pddl
75796 76172 376.0 76608 76608 0.0
p06.pddl
75928 76308 380.0 76832 76836 4.0
p07.pddl
75796 76172 376.0 76464 76464 0.0
p08.pddl
314300 314320 20.0 76608 76612 4.0
p09.pddl
83504 84136 632.0 85012 85012 0.0
p10.pddl
83672 84284 612.0 85028 84972 -56.0
p11.pddl
83544 84156 612.0 84988 84988 0.0
p12.pddl
83672 84284 612.0 85060 84944 -116.0
p13.pddl
83544 84156 612.0 85016 85044 28.0
p14.pddl
106192 107300 1108.0 108352 108352 0.0
p15.pddl
None None - 108228 108228 0.0
p16.pddl
106768 107888 1120.0 109084 109084 0.0
p17.pddl
106524 107556 1032.0 108668 108664 -4.0
p18.pddl
106160 107332 1172.0 108332 108332 0.0
p19.pddl
106480 107568 1088.0 108668 108680 12.0
p20.pddl
106788 107908 1120.0 109100 109100 0.0
Sum of diffs
11608.00
-320.00
Arithmetic mean of diffs
610.95
-16.00
tidybot-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
106708 107828 1120.0 210136 210144 8.0
p02.pddl
106900 108024 1124.0 108964 108964 0.0
p03.pddl
106168 107280 1112.0 108332 108332 0.0
p04.pddl
106028 107220 1192.0 108624 108364 -260.0
p05.pddl
106216 107264 1048.0 108340 108344 4.0
p06.pddl
106880 108052 1172.0 108980 108984 4.0
p07.pddl
106216 107244 1028.0 108328 108328 0.0
p08.pddl
106216 107264 1048.0 108356 108360 4.0
p09.pddl
139104 140856 1752.0 142412 142368 -44.0
p10.pddl
139144 140896 1752.0 142464 142468 4.0
p11.pddl
83544 84156 612.0 84988 84988 0.0
p12.pddl
83672 84284 612.0 85060 84944 -116.0
p13.pddl
83544 84156 612.0 85016 85044 28.0
p14.pddl
106192 107300 1108.0 108352 108352 0.0
p15.pddl
None None - 108228 108228 0.0
p16.pddl
106768 107888 1120.0 109084 109084 0.0
p17.pddl
106524 107556 1032.0 108668 108664 -4.0
p18.pddl
106160 107332 1172.0 108332 108332 0.0
p19.pddl
106480 107568 1088.0 108668 108680 12.0
p20.pddl
106788 107908 1120.0 109100 109100 0.0
Sum of diffs
20824.00
-360.00
Arithmetic mean of diffs
1096.00
-18.00
tpp
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54528 54536 8.0 54528 54536 8.0
p02.pddl
54528 54532 4.0 54528 54532 4.0
p03.pddl
54524 54532 8.0 54524 54532 8.0
p04.pddl
54524 54536 12.0 54524 54536 12.0
p05.pddl
54660 54536 -124.0 54524 54536 12.0
p06.pddl
54660 54668 8.0 54660 54672 12.0
p07.pddl
54788 54788 0.0 54916 54924 8.0
p08.pddl
54780 54792 12.0 55440 55440 0.0
p09.pddl
54808 54824 16.0 55732 55744 12.0
p10.pddl
54932 54932 0.0 57064 57056 -8.0
p11.pddl
55116 55172 56.0 58680 58688 8.0
p12.pddl
55200 55224 24.0 62980 62988 8.0
p13.pddl
55572 55588 16.0 59544 59556 12.0
p14.pddl
55744 55748 4.0 64896 64924 28.0
p15.pddl
55840 55876 36.0 64168 64176 8.0
p16.pddl
56992 57076 84.0 117532 117524 -8.0
p17.pddl
58252 58300 48.0 853084 853100 16.0
p18.pddl
58408 58472 64.0 318752 318748 -4.0
p19.pddl
58732 58908 176.0 642032 642040 8.0
p20.pddl
59072 59108 36.0 1723784 1723804 20.0
p21.pddl
62072 62220 148.0 209588 209580 -8.0
p22.pddl
62544 62708 164.0 256368 256352 -16.0
p23.pddl
62940 63088 148.0 527660 527648 -12.0
p24.pddl
64104 64068 -36.0 402356 402388 32.0
p25.pddl
67500 67744 244.0 1351476 1351496 20.0
p26.pddl
72720 73036 316.0 1580676 1580688 12.0
p27.pddl
73376 73816 440.0 1531136 1531144 8.0
p28.pddl
74412 74748 336.0 None None -
p29.pddl
82436 83036 600.0 None None -
p30.pddl
83572 84148 576.0 None None -
Sum of diffs
3424.00
200.00
Arithmetic mean of diffs
114.13
7.41
transport-opt08-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54664 54672 8.0 54660 54668 8.0
p02.pddl
54812 54816 4.0 54812 54812 0.0
p03.pddl
55056 55056 0.0 55044 55068 24.0
p04.pddl
55208 55224 16.0 55208 55212 4.0
p05.pddl
55540 55568 28.0 55692 55692 0.0
p06.pddl
56676 56636 -40.0 56812 56812 0.0
p07.pddl
57800 57756 -44.0 60304 60312 8.0
p08.pddl
58300 58400 100.0 61448 61452 4.0
p09.pddl
59044 59104 60.0 66548 66540 -8.0
p10.pddl
59788 59796 8.0 78300 78308 8.0
p11.pddl
54688 54692 4.0 54660 54692 32.0
p12.pddl
54844 54852 8.0 54848 54848 0.0
p13.pddl
55112 55128 16.0 55116 55120 4.0
p14.pddl
55460 55464 4.0 55596 55596 0.0
p15.pddl
55848 55872 24.0 55984 56048 64.0
p16.pddl
57764 57788 24.0 70072 70040 -32.0
p17.pddl
58440 58476 36.0 112168 112152 -16.0
p18.pddl
59420 59428 8.0 129548 129588 40.0
p19.pddl
61232 61360 128.0 284496 284560 64.0
p20.pddl
62236 62372 136.0 523956 523964 8.0
p21.pddl
54664 54668 4.0 54660 54668 8.0
p22.pddl
54812 54816 4.0 54812 54812 0.0
p23.pddl
54924 55056 132.0 55056 55064 8.0
p24.pddl
55208 55224 16.0 55208 55208 0.0
p25.pddl
55564 55560 -4.0 55668 55672 4.0
p26.pddl
56668 56632 -36.0 56808 56816 8.0
p27.pddl
57812 57768 -44.0 58108 58108 0.0
p28.pddl
58312 58412 100.0 71184 71208 24.0
p29.pddl
59064 59112 48.0 67044 67060 16.0
p30.pddl
59888 59904 16.0 68208 68196 -12.0
Sum of diffs
764.00
268.00
Arithmetic mean of diffs
25.47
8.93
transport-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54924 55056 132.0 55056 55064 8.0
p02.pddl
55056 55056 0.0 55044 55068 24.0
p03.pddl
54844 54852 8.0 54848 54848 0.0
p04.pddl
55112 55128 16.0 55116 55120 4.0
p05.pddl
55208 55224 16.0 55208 55208 0.0
p06.pddl
55208 55224 16.0 55208 55212 4.0
p07.pddl
55468 55492 24.0 55476 55476 0.0
p08.pddl
55780 55844 64.0 56164 56164 0.0
p09.pddl
55580 55604 24.0 55708 55712 4.0
p10.pddl
56320 56348 28.0 56500 56516 16.0
p11.pddl
55756 55780 24.0 55884 55888 4.0
p12.pddl
56472 56504 32.0 59020 59028 8.0
p13.pddl
55784 55780 -4.0 55944 55924 -20.0
p14.pddl
56628 56664 36.0 56884 56868 -16.0
p15.pddl
56168 56308 140.0 56440 56440 0.0
p16.pddl
56788 56804 16.0 58016 58024 8.0
p17.pddl
55540 55568 28.0 55692 55692 0.0
p18.pddl
55460 55464 4.0 55596 55596 0.0
p19.pddl
55564 55560 -4.0 55668 55672 4.0
p20.pddl
56676 56636 -40.0 56812 56812 0.0
Sum of diffs
560.00
48.00
Arithmetic mean of diffs
28.00
2.40
transport-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54820 54828 8.0 54820 54824 4.0
p02.pddl
55072 55084 12.0 55072 55072 0.0
p03.pddl
55212 55224 12.0 55212 55212 0.0
p04.pddl
55764 55776 12.0 55904 55904 0.0
p05.pddl
56452 56492 40.0 59168 59184 16.0
p06.pddl
56504 56660 156.0 56924 56932 8.0
p07.pddl
55064 55080 16.0 55068 55068 0.0
p08.pddl
55580 55520 -60.0 55584 55600 16.0
p09.pddl
55856 55884 28.0 56328 56336 8.0
p10.pddl
56992 57140 148.0 71560 71580 20.0
p11.pddl
58436 58412 -24.0 97952 97900 -52.0
p12.pddl
58632 58744 112.0 131724 131732 8.0
p13.pddl
55212 55228 16.0 55212 55216 4.0
p14.pddl
55856 55888 32.0 55992 55996 4.0
p15.pddl
56612 56644 32.0 57020 57020 0.0
p16.pddl
58484 58604 120.0 74524 74436 -88.0
p17.pddl
59792 59908 116.0 90624 90748 124.0
p18.pddl
61280 61396 116.0 115640 115652 12.0
p19.pddl
61956 62112 156.0 75464 75464 0.0
p20.pddl
61956 62112 156.0 75464 75464 0.0
Sum of diffs
1204.00
84.00
Arithmetic mean of diffs
60.20
4.20
trucks-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54660 54672 12.0 54660 54668 8.0
p02.pddl
54660 54668 8.0 54920 54936 16.0
p03.pddl
54916 54924 8.0 66768 66808 40.0
p04.pddl
56152 56164 12.0 55084 55088 4.0
p05.pddl
55456 55476 20.0 55460 55492 32.0
p06.pddl
55508 55516 8.0 55640 55644 4.0
p07.pddl
55916 55932 16.0 465520 465528 8.0
p08.pddl
55652 55672 20.0 None None -
p09.pddl
56812 56708 -104.0 None None -
p10.pddl
94124 94124 0.0 None None -
p11.pddl
78292 78300 8.0 None None -
p12.pddl
377168 377180 12.0 None None -
p13.pddl
509380 509396 16.0 None None -
p14.pddl
91644 91660 16.0 None None -
p15.pddl
601332 601344 12.0 None None -
p16.pddl
3134044 3134116 72.0 None None -
p17.pddl
3378408 3378400 -8.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
None None - None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
128.00
112.00
Arithmetic mean of diffs
7.53
16.00
visitall-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
54528 54536 8.0 54528 54536 8.0
problem02-half.pddl
54528 54536 8.0 54528 54536 8.0
problem03-full.pddl
54528 54532 4.0 54528 54532 4.0
problem03-half.pddl
54524 54536 12.0 54524 54536 12.0
problem04-full.pddl
54528 54536 8.0 54528 54536 8.0
problem04-half.pddl
54528 54536 8.0 54528 54536 8.0
problem05-full.pddl
54660 54668 8.0 54660 54668 8.0
problem05-half.pddl
54664 54664 0.0 54528 54532 4.0
problem06-full.pddl
54672 54680 8.0 54672 54672 0.0
problem06-half.pddl
54660 54668 8.0 54660 54668 8.0
problem07-full.pddl
54792 54792 0.0 54660 54668 8.0
problem07-half.pddl
54664 54668 4.0 54660 54668 8.0
problem08-full.pddl
54792 54796 4.0 54784 54796 12.0
problem08-half.pddl
54780 54796 16.0 54660 54668 8.0
problem09-full.pddl
54984 54936 -48.0 54852 54856 4.0
problem09-half.pddl
54792 54796 4.0 54792 54796 4.0
problem10-full.pddl
55056 55072 16.0 54924 54956 32.0
problem10-half.pddl
54844 54856 12.0 54844 54848 4.0
problem11-full.pddl
55192 55208 16.0 54932 54948 16.0
problem11-half.pddl
54944 54956 12.0 54812 54812 0.0
Sum of diffs
108.00
164.00
Arithmetic mean of diffs
5.40
8.20
visitall-opt14-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
54660 54668 8.0 54660 54668 8.0
p-1-6.pddl
54672 54680 8.0 54672 54672 0.0
p-1-7.pddl
54792 54792 0.0 54660 54668 8.0
p-1-8.pddl
54792 54796 4.0 54784 54796 12.0
p-1-9.pddl
54984 54936 -48.0 54852 54856 4.0
p-1-10.pddl
55056 55072 16.0 54924 54956 32.0
p-1-11.pddl
55192 55208 16.0 54932 54948 16.0
p-1-12.pddl
55368 55392 24.0 55108 55108 0.0
p-1-13.pddl
55448 55460 12.0 55188 55192 4.0
p-1-14.pddl
55720 55756 36.0 55336 55340 4.0
p-1-15.pddl
55948 55988 40.0 55424 55392 -32.0
p-1-16.pddl
56240 56140 -100.0 55464 55468 4.0
p-1-17.pddl
56376 56404 28.0 55716 55720 4.0
p-1-18.pddl
56684 56736 52.0 55884 55888 4.0
p-05-5.pddl
54656 54668 12.0 54656 54536 -120.0
p-05-6.pddl
54660 54668 8.0 54660 54668 8.0
p-05-7.pddl
54660 54680 20.0 54660 54676 16.0
p-05-8.pddl
54780 54796 16.0 54656 54668 12.0
p-05-9.pddl
54788 54792 4.0 54788 54792 4.0
p-05-10.pddl
54844 54856 12.0 54844 54844 0.0
Sum of diffs
168.00
-12.00
Arithmetic mean of diffs
8.40
-0.60
woodworking-opt08-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54788 54796 8.0 54788 54792 4.0
p02.pddl
54828 54836 8.0 54828 54828 0.0
p03.pddl
55056 55064 8.0 55056 55068 12.0
p04.pddl
55300 55452 152.0 None None -
p05.pddl
56920 56852 -68.0 55600 55604 4.0
p06.pddl
55468 55604 136.0 57632 57640 8.0
p07.pddl
56176 56180 4.0 56044 56048 4.0
p08.pddl
56372 56376 4.0 None None -
p09.pddl
59936 59948 12.0 None None -
p10.pddl
56812 56824 12.0 83432 83448 16.0
p11.pddl
54660 54672 12.0 54660 54668 8.0
p12.pddl
55060 55076 16.0 55060 55064 4.0
p13.pddl
55212 55232 20.0 55212 55216 4.0
p14.pddl
55988 55996 8.0 55056 55076 20.0
p15.pddl
57184 57204 20.0 55460 55468 8.0
p16.pddl
57068 57096 28.0 None None -
p17.pddl
58388 58420 32.0 57296 57304 8.0
p18.pddl
56232 56352 120.0 60400 60400 0.0
p19.pddl
56472 56516 44.0 56472 56524 52.0
p20.pddl
61168 61200 32.0 74680 74680 0.0
p21.pddl
54664 54668 4.0 54664 54680 16.0
p22.pddl
54816 54824 8.0 54816 54820 4.0
p23.pddl
54840 54852 12.0 54840 54840 0.0
p24.pddl
56208 56216 8.0 997004 997012 8.0
p25.pddl
58176 58088 -88.0 55476 55480 4.0
p26.pddl
55584 55612 28.0 None None -
p27.pddl
58260 58288 28.0 None None -
p28.pddl
62340 62396 56.0 None None -
p29.pddl
56668 56660 -8.0 56536 56548 12.0
p30.pddl
65880 65780 -100.0 236180 236236 56.0
Sum of diffs
556.00
252.00
Arithmetic mean of diffs
18.53
10.96
woodworking-opt11-strips
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54840 54852 12.0 54840 54840 0.0
p02.pddl
55060 55076 16.0 55060 55064 4.0
p03.pddl
55212 55232 20.0 55212 55216 4.0
p04.pddl
55056 55064 8.0 55056 55068 12.0
p05.pddl
56208 56216 8.0 997004 997012 8.0
p06.pddl
55300 55452 152.0 None None -
p07.pddl
55988 55996 8.0 55056 55076 20.0
p08.pddl
58176 58088 -88.0 55476 55480 4.0
p09.pddl
56920 56852 -68.0 55600 55604 4.0
p10.pddl
57184 57204 20.0 55460 55468 8.0
p11.pddl
55584 55612 28.0 None None -
p12.pddl
57068 57096 28.0 None None -
p13.pddl
55468 55604 136.0 57632 57640 8.0
p14.pddl
58260 58288 28.0 None None -
p15.pddl
58388 58420 32.0 57296 57304 8.0
p16.pddl
56176 56180 4.0 56044 56048 4.0
p17.pddl
62340 62396 56.0 None None -
p18.pddl
56232 56352 120.0 60400 60400 0.0
p19.pddl
56372 56376 4.0 None None -
p20.pddl
56668 56660 -8.0 56536 56548 12.0
Sum of diffs
516.00
96.00
Arithmetic mean of diffs
25.80
6.86
zenotravel
Show table
memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
54660 54536 -124.0 54528 54536 8.0
p02.pddl
54660 54668 8.0 54528 54536 8.0
p03.pddl
54660 54668 8.0 54660 54668 8.0
p04.pddl
54660 54668 8.0 54660 54668 8.0
p05.pddl
54836 54844 8.0 54836 54836 0.0
p06.pddl
54840 54848 8.0 54840 54844 4.0
p07.pddl
54840 54848 8.0 54840 54844 4.0
p08.pddl
55136 55152 16.0 55140 55140 0.0
p09.pddl
55180 55196 16.0 55188 55148 -40.0
p10.pddl
55192 55208 16.0 55612 55544 -68.0
p11.pddl
55460 55448 -12.0 55880 55908 28.0
p12.pddl
55444 55460 16.0 55744 55772 28.0
p13.pddl
55576 55600 24.0 57060 57056 -4.0
p14.pddl
58144 58180 36.0 126348 126404 56.0
p15.pddl
60852 60920 68.0 88272 88280 8.0
p16.pddl
61792 61968 176.0 213156 213072 -84.0
p17.pddl
63376 63668 292.0 836144 836284 140.0
p18.pddl
67840 68124 284.0 197500 197580 80.0
p19.pddl
69424 69696 272.0 214104 214120 16.0
p20.pddl
71488 71740 252.0 346612 346624 12.0
Sum of diffs
1380.00
212.00
Arithmetic mean of diffs
69.00
10.60
run_dir
Domain-wise reports only support numeric attributes, but run_dir has type str.
agricola-opt18-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00001-00100/00001
runs-03601-03700/03655
- runs-01801-01900/01828
runs-05401-05500/05482
-
p02.pddl
runs-00001-00100/00002
runs-03601-03700/03656
- runs-01801-01900/01829
runs-05401-05500/05483
-
p03.pddl
runs-00001-00100/00003
runs-03601-03700/03657
- runs-01801-01900/01830
runs-05401-05500/05484
-
p04.pddl
runs-00001-00100/00004
runs-03601-03700/03658
- runs-01801-01900/01831
runs-05401-05500/05485
-
p05.pddl
runs-00001-00100/00005
runs-03601-03700/03659
- runs-01801-01900/01832
runs-05401-05500/05486
-
p06.pddl
runs-00001-00100/00006
runs-03601-03700/03660
- runs-01801-01900/01833
runs-05401-05500/05487
-
p07.pddl
runs-00001-00100/00007
runs-03601-03700/03661
- runs-01801-01900/01834
runs-05401-05500/05488
-
p08.pddl
runs-00001-00100/00008
runs-03601-03700/03662
- runs-01801-01900/01835
runs-05401-05500/05489
-
p09.pddl
runs-00001-00100/00009
runs-03601-03700/03663
- runs-01801-01900/01836
runs-05401-05500/05490
-
p10.pddl
runs-00001-00100/00010
runs-03601-03700/03664
- runs-01801-01900/01837
runs-05401-05500/05491
-
p11.pddl
runs-00001-00100/00011
runs-03601-03700/03665
- runs-01801-01900/01838
runs-05401-05500/05492
-
p12.pddl
runs-00001-00100/00012
runs-03601-03700/03666
- runs-01801-01900/01839
runs-05401-05500/05493
-
p13.pddl
runs-00001-00100/00013
runs-03601-03700/03667
- runs-01801-01900/01840
runs-05401-05500/05494
-
p14.pddl
runs-00001-00100/00014
runs-03601-03700/03668
- runs-01801-01900/01841
runs-05401-05500/05495
-
p15.pddl
runs-00001-00100/00015
runs-03601-03700/03669
- runs-01801-01900/01842
runs-05401-05500/05496
-
p16.pddl
runs-00001-00100/00016
runs-03601-03700/03670
- runs-01801-01900/01843
runs-05401-05500/05497
-
p17.pddl
runs-00001-00100/00017
runs-03601-03700/03671
- runs-01801-01900/01844
runs-05401-05500/05498
-
p18.pddl
runs-00001-00100/00018
runs-03601-03700/03672
- runs-01801-01900/01845
runs-05401-05500/05499
-
p19.pddl
runs-00001-00100/00019
runs-03601-03700/03673
- runs-01801-01900/01846
runs-05401-05500/05500
-
p20.pddl
runs-00001-00100/00020
runs-03601-03700/03674
- runs-01801-01900/01847
runs-05501-05600/05501
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
airport
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
runs-00001-00100/00021
runs-03601-03700/03675
- runs-01801-01900/01848
runs-05501-05600/05502
-
p02-airport1-p1.pddl
runs-00001-00100/00022
runs-03601-03700/03676
- runs-01801-01900/01849
runs-05501-05600/05503
-
p03-airport1-p2.pddl
runs-00001-00100/00023
runs-03601-03700/03677
- runs-01801-01900/01850
runs-05501-05600/05504
-
p04-airport2-p1.pddl
runs-00001-00100/00024
runs-03601-03700/03678
- runs-01801-01900/01851
runs-05501-05600/05505
-
p05-airport2-p1.pddl
runs-00001-00100/00025
runs-03601-03700/03679
- runs-01801-01900/01852
runs-05501-05600/05506
-
p06-airport2-p2.pddl
runs-00001-00100/00026
runs-03601-03700/03680
- runs-01801-01900/01853
runs-05501-05600/05507
-
p07-airport2-p2.pddl
runs-00001-00100/00027
runs-03601-03700/03681
- runs-01801-01900/01854
runs-05501-05600/05508
-
p08-airport2-p3.pddl
runs-00001-00100/00028
runs-03601-03700/03682
- runs-01801-01900/01855
runs-05501-05600/05509
-
p09-airport2-p4.pddl
runs-00001-00100/00029
runs-03601-03700/03683
- runs-01801-01900/01856
runs-05501-05600/05510
-
p10-airport3-p1.pddl
runs-00001-00100/00030
runs-03601-03700/03684
- runs-01801-01900/01857
runs-05501-05600/05511
-
p11-airport3-p1.pddl
runs-00001-00100/00031
runs-03601-03700/03685
- runs-01801-01900/01858
runs-05501-05600/05512
-
p12-airport3-p2.pddl
runs-00001-00100/00032
runs-03601-03700/03686
- runs-01801-01900/01859
runs-05501-05600/05513
-
p13-airport3-p2.pddl
runs-00001-00100/00033
runs-03601-03700/03687
- runs-01801-01900/01860
runs-05501-05600/05514
-
p14-airport3-p3.pddl
runs-00001-00100/00034
runs-03601-03700/03688
- runs-01801-01900/01861
runs-05501-05600/05515
-
p15-airport3-p3.pddl
runs-00001-00100/00035
runs-03601-03700/03689
- runs-01801-01900/01862
runs-05501-05600/05516
-
p16-airport3-p4.pddl
runs-00001-00100/00036
runs-03601-03700/03690
- runs-01801-01900/01863
runs-05501-05600/05517
-
p17-airport3-p5.pddl
runs-00001-00100/00037
runs-03601-03700/03691
- runs-01801-01900/01864
runs-05501-05600/05518
-
p18-airport3-p6.pddl
runs-00001-00100/00038
runs-03601-03700/03692
- runs-01801-01900/01865
runs-05501-05600/05519
-
p19-airport3-p6.pddl
runs-00001-00100/00039
runs-03601-03700/03693
- runs-01801-01900/01866
runs-05501-05600/05520
-
p20-airport3-p7.pddl
runs-00001-00100/00040
runs-03601-03700/03694
- runs-01801-01900/01867
runs-05501-05600/05521
-
p21-airport4halfMUC-p2.pddl
runs-00001-00100/00041
runs-03601-03700/03695
- runs-01801-01900/01868
runs-05501-05600/05522
-
p22-airport4halfMUC-p3.pddl
runs-00001-00100/00042
runs-03601-03700/03696
- runs-01801-01900/01869
runs-05501-05600/05523
-
p23-airport4halfMUC-p4.pddl
runs-00001-00100/00043
runs-03601-03700/03697
- runs-01801-01900/01870
runs-05501-05600/05524
-
p24-airport4halfMUC-p4.pddl
runs-00001-00100/00044
runs-03601-03700/03698
- runs-01801-01900/01871
runs-05501-05600/05525
-
p25-airport4halfMUC-p5.pddl
runs-00001-00100/00045
runs-03601-03700/03699
- runs-01801-01900/01872
runs-05501-05600/05526
-
p26-airport4halfMUC-p6.pddl
runs-00001-00100/00046
runs-03601-03700/03700
- runs-01801-01900/01873
runs-05501-05600/05527
-
p27-airport4halfMUC-p6.pddl
runs-00001-00100/00047
runs-03701-03800/03701
- runs-01801-01900/01874
runs-05501-05600/05528
-
p28-airport4halfMUC-p7.pddl
runs-00001-00100/00048
runs-03701-03800/03702
- runs-01801-01900/01875
runs-05501-05600/05529
-
p29-airport4halfMUC-p8.pddl
runs-00001-00100/00049
runs-03701-03800/03703
- runs-01801-01900/01876
runs-05501-05600/05530
-
p30-airport4halfMUC-p8.pddl
runs-00001-00100/00050
runs-03701-03800/03704
- runs-01801-01900/01877
runs-05501-05600/05531
-
p31-airport4halfMUC-p9.pddl
runs-00001-00100/00051
runs-03701-03800/03705
- runs-01801-01900/01878
runs-05501-05600/05532
-
p32-airport4halfMUC-p10.pddl
runs-00001-00100/00052
runs-03701-03800/03706
- runs-01801-01900/01879
runs-05501-05600/05533
-
p33-airport4halfMUC-p10.pddl
runs-00001-00100/00053
runs-03701-03800/03707
- runs-01801-01900/01880
runs-05501-05600/05534
-
p34-airport4halfMUC-p11.pddl
runs-00001-00100/00054
runs-03701-03800/03708
- runs-01801-01900/01881
runs-05501-05600/05535
-
p35-airport4halfMUC-p12.pddl
runs-00001-00100/00055
runs-03701-03800/03709
- runs-01801-01900/01882
runs-05501-05600/05536
-
p36-airport5MUC-p2.pddl
runs-00001-00100/00056
runs-03701-03800/03710
- runs-01801-01900/01883
runs-05501-05600/05537
-
p37-airport5MUC-p3.pddl
runs-00001-00100/00057
runs-03701-03800/03711
- runs-01801-01900/01884
runs-05501-05600/05538
-
p38-airport5MUC-p3.pddl
runs-00001-00100/00058
runs-03701-03800/03712
- runs-01801-01900/01885
runs-05501-05600/05539
-
p39-airport5MUC-p4.pddl
runs-00001-00100/00059
runs-03701-03800/03713
- runs-01801-01900/01886
runs-05501-05600/05540
-
p40-airport5MUC-p4.pddl
runs-00001-00100/00060
runs-03701-03800/03714
- runs-01801-01900/01887
runs-05501-05600/05541
-
p41-airport5MUC-p4.pddl
runs-00001-00100/00061
runs-03701-03800/03715
- runs-01801-01900/01888
runs-05501-05600/05542
-
p42-airport5MUC-p5.pddl
runs-00001-00100/00062
runs-03701-03800/03716
- runs-01801-01900/01889
runs-05501-05600/05543
-
p43-airport5MUC-p5.pddl
runs-00001-00100/00063
runs-03701-03800/03717
- runs-01801-01900/01890
runs-05501-05600/05544
-
p44-airport5MUC-p5.pddl
runs-00001-00100/00064
runs-03701-03800/03718
- runs-01801-01900/01891
runs-05501-05600/05545
-
p45-airport5MUC-p6.pddl
runs-00001-00100/00065
runs-03701-03800/03719
- runs-01801-01900/01892
runs-05501-05600/05546
-
p46-airport5MUC-p6.pddl
runs-00001-00100/00066
runs-03701-03800/03720
- runs-01801-01900/01893
runs-05501-05600/05547
-
p47-airport5MUC-p8.pddl
runs-00001-00100/00067
runs-03701-03800/03721
- runs-01801-01900/01894
runs-05501-05600/05548
-
p48-airport5MUC-p9.pddl
runs-00001-00100/00068
runs-03701-03800/03722
- runs-01801-01900/01895
runs-05501-05600/05549
-
p49-airport5MUC-p10.pddl
runs-00001-00100/00069
runs-03701-03800/03723
- runs-01801-01900/01896
runs-05501-05600/05550
-
p50-airport5MUC-p15.pddl
runs-00001-00100/00070
runs-03701-03800/03724
- runs-01801-01900/01897
runs-05501-05600/05551
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
barman-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
runs-00001-00100/00071
runs-03701-03800/03725
- runs-01801-01900/01898
runs-05501-05600/05552
-
pfile01-002.pddl
runs-00001-00100/00072
runs-03701-03800/03726
- runs-01801-01900/01899
runs-05501-05600/05553
-
pfile01-003.pddl
runs-00001-00100/00073
runs-03701-03800/03727
- runs-01801-01900/01900
runs-05501-05600/05554
-
pfile01-004.pddl
runs-00001-00100/00074
runs-03701-03800/03728
- runs-01901-02000/01901
runs-05501-05600/05555
-
pfile02-005.pddl
runs-00001-00100/00075
runs-03701-03800/03729
- runs-01901-02000/01902
runs-05501-05600/05556
-
pfile02-006.pddl
runs-00001-00100/00076
runs-03701-03800/03730
- runs-01901-02000/01903
runs-05501-05600/05557
-
pfile02-007.pddl
runs-00001-00100/00077
runs-03701-03800/03731
- runs-01901-02000/01904
runs-05501-05600/05558
-
pfile02-008.pddl
runs-00001-00100/00078
runs-03701-03800/03732
- runs-01901-02000/01905
runs-05501-05600/05559
-
pfile03-009.pddl
runs-00001-00100/00079
runs-03701-03800/03733
- runs-01901-02000/01906
runs-05501-05600/05560
-
pfile03-010.pddl
runs-00001-00100/00080
runs-03701-03800/03734
- runs-01901-02000/01907
runs-05501-05600/05561
-
pfile03-011.pddl
runs-00001-00100/00081
runs-03701-03800/03735
- runs-01901-02000/01908
runs-05501-05600/05562
-
pfile03-012.pddl
runs-00001-00100/00082
runs-03701-03800/03736
- runs-01901-02000/01909
runs-05501-05600/05563
-
pfile04-013.pddl
runs-00001-00100/00083
runs-03701-03800/03737
- runs-01901-02000/01910
runs-05501-05600/05564
-
pfile04-014.pddl
runs-00001-00100/00084
runs-03701-03800/03738
- runs-01901-02000/01911
runs-05501-05600/05565
-
pfile04-015.pddl
runs-00001-00100/00085
runs-03701-03800/03739
- runs-01901-02000/01912
runs-05501-05600/05566
-
pfile04-016.pddl
runs-00001-00100/00086
runs-03701-03800/03740
- runs-01901-02000/01913
runs-05501-05600/05567
-
pfile05-017.pddl
runs-00001-00100/00087
runs-03701-03800/03741
- runs-01901-02000/01914
runs-05501-05600/05568
-
pfile05-018.pddl
runs-00001-00100/00088
runs-03701-03800/03742
- runs-01901-02000/01915
runs-05501-05600/05569
-
pfile05-019.pddl
runs-00001-00100/00089
runs-03701-03800/03743
- runs-01901-02000/01916
runs-05501-05600/05570
-
pfile05-020.pddl
runs-00001-00100/00090
runs-03701-03800/03744
- runs-01901-02000/01917
runs-05501-05600/05571
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
barman-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
runs-00001-00100/00091
runs-03701-03800/03745
- runs-01901-02000/01918
runs-05501-05600/05572
-
p435-2.pddl
runs-00001-00100/00092
runs-03701-03800/03746
- runs-01901-02000/01919
runs-05501-05600/05573
-
p435-3.pddl
runs-00001-00100/00093
runs-03701-03800/03747
- runs-01901-02000/01920
runs-05501-05600/05574
-
p536-1.pddl
runs-00001-00100/00094
runs-03701-03800/03748
- runs-01901-02000/01921
runs-05501-05600/05575
-
p536-2.pddl
runs-00001-00100/00095
runs-03701-03800/03749
- runs-01901-02000/01922
runs-05501-05600/05576
-
p536-3.pddl
runs-00001-00100/00096
runs-03701-03800/03750
- runs-01901-02000/01923
runs-05501-05600/05577
-
p638-1.pddl
runs-00001-00100/00097
runs-03701-03800/03751
- runs-01901-02000/01924
runs-05501-05600/05578
-
p638-2.pddl
runs-00001-00100/00098
runs-03701-03800/03752
- runs-01901-02000/01925
runs-05501-05600/05579
-
p638-3.pddl
runs-00001-00100/00099
runs-03701-03800/03753
- runs-01901-02000/01926
runs-05501-05600/05580
-
p739-1.pddl
runs-00001-00100/00100
runs-03701-03800/03754
- runs-01901-02000/01927
runs-05501-05600/05581
-
p739-2.pddl
runs-00101-00200/00101
runs-03701-03800/03755
- runs-01901-02000/01928
runs-05501-05600/05582
-
p739-3.pddl
runs-00101-00200/00102
runs-03701-03800/03756
- runs-01901-02000/01929
runs-05501-05600/05583
-
p839-1.pddl
runs-00101-00200/00103
runs-03701-03800/03757
- runs-01901-02000/01930
runs-05501-05600/05584
-
p839-2.pddl
runs-00101-00200/00104
runs-03701-03800/03758
- runs-01901-02000/01931
runs-05501-05600/05585
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
blocks
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
runs-00101-00200/00105
runs-03701-03800/03759
- runs-01901-02000/01932
runs-05501-05600/05586
-
probBLOCKS-4-1.pddl
runs-00101-00200/00106
runs-03701-03800/03760
- runs-01901-02000/01933
runs-05501-05600/05587
-
probBLOCKS-4-2.pddl
runs-00101-00200/00107
runs-03701-03800/03761
- runs-01901-02000/01934
runs-05501-05600/05588
-
probBLOCKS-5-0.pddl
runs-00101-00200/00108
runs-03701-03800/03762
- runs-01901-02000/01935
runs-05501-05600/05589
-
probBLOCKS-5-1.pddl
runs-00101-00200/00109
runs-03701-03800/03763
- runs-01901-02000/01936
runs-05501-05600/05590
-
probBLOCKS-5-2.pddl
runs-00101-00200/00110
runs-03701-03800/03764
- runs-01901-02000/01937
runs-05501-05600/05591
-
probBLOCKS-6-0.pddl
runs-00101-00200/00111
runs-03701-03800/03765
- runs-01901-02000/01938
runs-05501-05600/05592
-
probBLOCKS-6-1.pddl
runs-00101-00200/00112
runs-03701-03800/03766
- runs-01901-02000/01939
runs-05501-05600/05593
-
probBLOCKS-6-2.pddl
runs-00101-00200/00113
runs-03701-03800/03767
- runs-01901-02000/01940
runs-05501-05600/05594
-
probBLOCKS-7-0.pddl
runs-00101-00200/00114
runs-03701-03800/03768
- runs-01901-02000/01941
runs-05501-05600/05595
-
probBLOCKS-7-1.pddl
runs-00101-00200/00115
runs-03701-03800/03769
- runs-01901-02000/01942
runs-05501-05600/05596
-
probBLOCKS-7-2.pddl
runs-00101-00200/00116
runs-03701-03800/03770
- runs-01901-02000/01943
runs-05501-05600/05597
-
probBLOCKS-8-0.pddl
runs-00101-00200/00117
runs-03701-03800/03771
- runs-01901-02000/01944
runs-05501-05600/05598
-
probBLOCKS-8-1.pddl
runs-00101-00200/00118
runs-03701-03800/03772
- runs-01901-02000/01945
runs-05501-05600/05599
-
probBLOCKS-8-2.pddl
runs-00101-00200/00119
runs-03701-03800/03773
- runs-01901-02000/01946
runs-05501-05600/05600
-
probBLOCKS-9-0.pddl
runs-00101-00200/00120
runs-03701-03800/03774
- runs-01901-02000/01947
runs-05601-05700/05601
-
probBLOCKS-9-1.pddl
runs-00101-00200/00121
runs-03701-03800/03775
- runs-01901-02000/01948
runs-05601-05700/05602
-
probBLOCKS-9-2.pddl
runs-00101-00200/00122
runs-03701-03800/03776
- runs-01901-02000/01949
runs-05601-05700/05603
-
probBLOCKS-10-0.pddl
runs-00101-00200/00123
runs-03701-03800/03777
- runs-01901-02000/01950
runs-05601-05700/05604
-
probBLOCKS-10-1.pddl
runs-00101-00200/00124
runs-03701-03800/03778
- runs-01901-02000/01951
runs-05601-05700/05605
-
probBLOCKS-10-2.pddl
runs-00101-00200/00125
runs-03701-03800/03779
- runs-01901-02000/01952
runs-05601-05700/05606
-
probBLOCKS-11-0.pddl
runs-00101-00200/00126
runs-03701-03800/03780
- runs-01901-02000/01953
runs-05601-05700/05607
-
probBLOCKS-11-1.pddl
runs-00101-00200/00127
runs-03701-03800/03781
- runs-01901-02000/01954
runs-05601-05700/05608
-
probBLOCKS-11-2.pddl
runs-00101-00200/00128
runs-03701-03800/03782
- runs-01901-02000/01955
runs-05601-05700/05609
-
probBLOCKS-12-0.pddl
runs-00101-00200/00129
runs-03701-03800/03783
- runs-01901-02000/01956
runs-05601-05700/05610
-
probBLOCKS-12-1.pddl
runs-00101-00200/00130
runs-03701-03800/03784
- runs-01901-02000/01957
runs-05601-05700/05611
-
probBLOCKS-13-0.pddl
runs-00101-00200/00131
runs-03701-03800/03785
- runs-01901-02000/01958
runs-05601-05700/05612
-
probBLOCKS-13-1.pddl
runs-00101-00200/00132
runs-03701-03800/03786
- runs-01901-02000/01959
runs-05601-05700/05613
-
probBLOCKS-14-0.pddl
runs-00101-00200/00133
runs-03701-03800/03787
- runs-01901-02000/01960
runs-05601-05700/05614
-
probBLOCKS-14-1.pddl
runs-00101-00200/00134
runs-03701-03800/03788
- runs-01901-02000/01961
runs-05601-05700/05615
-
probBLOCKS-15-0.pddl
runs-00101-00200/00135
runs-03701-03800/03789
- runs-01901-02000/01962
runs-05601-05700/05616
-
probBLOCKS-15-1.pddl
runs-00101-00200/00136
runs-03701-03800/03790
- runs-01901-02000/01963
runs-05601-05700/05617
-
probBLOCKS-16-1.pddl
runs-00101-00200/00137
runs-03701-03800/03791
- runs-01901-02000/01964
runs-05601-05700/05618
-
probBLOCKS-16-2.pddl
runs-00101-00200/00138
runs-03701-03800/03792
- runs-01901-02000/01965
runs-05601-05700/05619
-
probBLOCKS-17-0.pddl
runs-00101-00200/00139
runs-03701-03800/03793
- runs-01901-02000/01966
runs-05601-05700/05620
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
childsnack-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
runs-00101-00200/00140
runs-03701-03800/03794
- runs-01901-02000/01967
runs-05601-05700/05621
-
child-snack_pfile01.pddl
runs-00101-00200/00141
runs-03701-03800/03795
- runs-01901-02000/01968
runs-05601-05700/05622
-
child-snack_pfile02-2.pddl
runs-00101-00200/00142
runs-03701-03800/03796
- runs-01901-02000/01969
runs-05601-05700/05623
-
child-snack_pfile02.pddl
runs-00101-00200/00143
runs-03701-03800/03797
- runs-01901-02000/01970
runs-05601-05700/05624
-
child-snack_pfile03-2.pddl
runs-00101-00200/00144
runs-03701-03800/03798
- runs-01901-02000/01971
runs-05601-05700/05625
-
child-snack_pfile03.pddl
runs-00101-00200/00145
runs-03701-03800/03799
- runs-01901-02000/01972
runs-05601-05700/05626
-
child-snack_pfile04-2.pddl
runs-00101-00200/00146
runs-03701-03800/03800
- runs-01901-02000/01973
runs-05601-05700/05627
-
child-snack_pfile04.pddl
runs-00101-00200/00147
runs-03801-03900/03801
- runs-01901-02000/01974
runs-05601-05700/05628
-
child-snack_pfile05-2.pddl
runs-00101-00200/00148
runs-03801-03900/03802
- runs-01901-02000/01975
runs-05601-05700/05629
-
child-snack_pfile05.pddl
runs-00101-00200/00149
runs-03801-03900/03803
- runs-01901-02000/01976
runs-05601-05700/05630
-
child-snack_pfile06-2.pddl
runs-00101-00200/00150
runs-03801-03900/03804
- runs-01901-02000/01977
runs-05601-05700/05631
-
child-snack_pfile06.pddl
runs-00101-00200/00151
runs-03801-03900/03805
- runs-01901-02000/01978
runs-05601-05700/05632
-
child-snack_pfile07-2.pddl
runs-00101-00200/00152
runs-03801-03900/03806
- runs-01901-02000/01979
runs-05601-05700/05633
-
child-snack_pfile07.pddl
runs-00101-00200/00153
runs-03801-03900/03807
- runs-01901-02000/01980
runs-05601-05700/05634
-
child-snack_pfile08-2.pddl
runs-00101-00200/00154
runs-03801-03900/03808
- runs-01901-02000/01981
runs-05601-05700/05635
-
child-snack_pfile08.pddl
runs-00101-00200/00155
runs-03801-03900/03809
- runs-01901-02000/01982
runs-05601-05700/05636
-
child-snack_pfile09-2.pddl
runs-00101-00200/00156
runs-03801-03900/03810
- runs-01901-02000/01983
runs-05601-05700/05637
-
child-snack_pfile09.pddl
runs-00101-00200/00157
runs-03801-03900/03811
- runs-01901-02000/01984
runs-05601-05700/05638
-
child-snack_pfile10-2.pddl
runs-00101-00200/00158
runs-03801-03900/03812
- runs-01901-02000/01985
runs-05601-05700/05639
-
child-snack_pfile10.pddl
runs-00101-00200/00159
runs-03801-03900/03813
- runs-01901-02000/01986
runs-05601-05700/05640
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
data-network-opt18-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00101-00200/00160
runs-03801-03900/03814
- runs-01901-02000/01987
runs-05601-05700/05641
-
p02.pddl
runs-00101-00200/00161
runs-03801-03900/03815
- runs-01901-02000/01988
runs-05601-05700/05642
-
p03.pddl
runs-00101-00200/00162
runs-03801-03900/03816
- runs-01901-02000/01989
runs-05601-05700/05643
-
p04.pddl
runs-00101-00200/00163
runs-03801-03900/03817
- runs-01901-02000/01990
runs-05601-05700/05644
-
p05.pddl
runs-00101-00200/00164
runs-03801-03900/03818
- runs-01901-02000/01991
runs-05601-05700/05645
-
p06.pddl
runs-00101-00200/00165
runs-03801-03900/03819
- runs-01901-02000/01992
runs-05601-05700/05646
-
p07.pddl
runs-00101-00200/00166
runs-03801-03900/03820
- runs-01901-02000/01993
runs-05601-05700/05647
-
p08.pddl
runs-00101-00200/00167
runs-03801-03900/03821
- runs-01901-02000/01994
runs-05601-05700/05648
-
p09.pddl
runs-00101-00200/00168
runs-03801-03900/03822
- runs-01901-02000/01995
runs-05601-05700/05649
-
p10.pddl
runs-00101-00200/00169
runs-03801-03900/03823
- runs-01901-02000/01996
runs-05601-05700/05650
-
p11.pddl
runs-00101-00200/00170
runs-03801-03900/03824
- runs-01901-02000/01997
runs-05601-05700/05651
-
p12.pddl
runs-00101-00200/00171
runs-03801-03900/03825
- runs-01901-02000/01998
runs-05601-05700/05652
-
p13.pddl
runs-00101-00200/00172
runs-03801-03900/03826
- runs-01901-02000/01999
runs-05601-05700/05653
-
p14.pddl
runs-00101-00200/00173
runs-03801-03900/03827
- runs-01901-02000/02000
runs-05601-05700/05654
-
p15.pddl
runs-00101-00200/00174
runs-03801-03900/03828
- runs-02001-02100/02001
runs-05601-05700/05655
-
p16.pddl
runs-00101-00200/00175
runs-03801-03900/03829
- runs-02001-02100/02002
runs-05601-05700/05656
-
p17.pddl
runs-00101-00200/00176
runs-03801-03900/03830
- runs-02001-02100/02003
runs-05601-05700/05657
-
p18.pddl
runs-00101-00200/00177
runs-03801-03900/03831
- runs-02001-02100/02004
runs-05601-05700/05658
-
p19.pddl
runs-00101-00200/00178
runs-03801-03900/03832
- runs-02001-02100/02005
runs-05601-05700/05659
-
p20.pddl
runs-00101-00200/00179
runs-03801-03900/03833
- runs-02001-02100/02006
runs-05601-05700/05660
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
depot
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00101-00200/00180
runs-03801-03900/03834
- runs-02001-02100/02007
runs-05601-05700/05661
-
p02.pddl
runs-00101-00200/00181
runs-03801-03900/03835
- runs-02001-02100/02008
runs-05601-05700/05662
-
p03.pddl
runs-00101-00200/00182
runs-03801-03900/03836
- runs-02001-02100/02009
runs-05601-05700/05663
-
p04.pddl
runs-00101-00200/00183
runs-03801-03900/03837
- runs-02001-02100/02010
runs-05601-05700/05664
-
p05.pddl
runs-00101-00200/00184
runs-03801-03900/03838
- runs-02001-02100/02011
runs-05601-05700/05665
-
p06.pddl
runs-00101-00200/00185
runs-03801-03900/03839
- runs-02001-02100/02012
runs-05601-05700/05666
-
p07.pddl
runs-00101-00200/00186
runs-03801-03900/03840
- runs-02001-02100/02013
runs-05601-05700/05667
-
p08.pddl
runs-00101-00200/00187
runs-03801-03900/03841
- runs-02001-02100/02014
runs-05601-05700/05668
-
p09.pddl
runs-00101-00200/00188
runs-03801-03900/03842
- runs-02001-02100/02015
runs-05601-05700/05669
-
p10.pddl
runs-00101-00200/00189
runs-03801-03900/03843
- runs-02001-02100/02016
runs-05601-05700/05670
-
p11.pddl
runs-00101-00200/00190
runs-03801-03900/03844
- runs-02001-02100/02017
runs-05601-05700/05671
-
p12.pddl
runs-00101-00200/00191
runs-03801-03900/03845
- runs-02001-02100/02018
runs-05601-05700/05672
-
p13.pddl
runs-00101-00200/00192
runs-03801-03900/03846
- runs-02001-02100/02019
runs-05601-05700/05673
-
p14.pddl
runs-00101-00200/00193
runs-03801-03900/03847
- runs-02001-02100/02020
runs-05601-05700/05674
-
p15.pddl
runs-00101-00200/00194
runs-03801-03900/03848
- runs-02001-02100/02021
runs-05601-05700/05675
-
p16.pddl
runs-00101-00200/00195
runs-03801-03900/03849
- runs-02001-02100/02022
runs-05601-05700/05676
-
p17.pddl
runs-00101-00200/00196
runs-03801-03900/03850
- runs-02001-02100/02023
runs-05601-05700/05677
-
p18.pddl
runs-00101-00200/00197
runs-03801-03900/03851
- runs-02001-02100/02024
runs-05601-05700/05678
-
p19.pddl
runs-00101-00200/00198
runs-03801-03900/03852
- runs-02001-02100/02025
runs-05601-05700/05679
-
p20.pddl
runs-00101-00200/00199
runs-03801-03900/03853
- runs-02001-02100/02026
runs-05601-05700/05680
-
p21.pddl
runs-00101-00200/00200
runs-03801-03900/03854
- runs-02001-02100/02027
runs-05601-05700/05681
-
p22.pddl
runs-00201-00300/00201
runs-03801-03900/03855
- runs-02001-02100/02028
runs-05601-05700/05682
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
driverlog
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00201-00300/00202
runs-03801-03900/03856
- runs-02001-02100/02029
runs-05601-05700/05683
-
p02.pddl
runs-00201-00300/00203
runs-03801-03900/03857
- runs-02001-02100/02030
runs-05601-05700/05684
-
p03.pddl
runs-00201-00300/00204
runs-03801-03900/03858
- runs-02001-02100/02031
runs-05601-05700/05685
-
p04.pddl
runs-00201-00300/00205
runs-03801-03900/03859
- runs-02001-02100/02032
runs-05601-05700/05686
-
p05.pddl
runs-00201-00300/00206
runs-03801-03900/03860
- runs-02001-02100/02033
runs-05601-05700/05687
-
p06.pddl
runs-00201-00300/00207
runs-03801-03900/03861
- runs-02001-02100/02034
runs-05601-05700/05688
-
p07.pddl
runs-00201-00300/00208
runs-03801-03900/03862
- runs-02001-02100/02035
runs-05601-05700/05689
-
p08.pddl
runs-00201-00300/00209
runs-03801-03900/03863
- runs-02001-02100/02036
runs-05601-05700/05690
-
p09.pddl
runs-00201-00300/00210
runs-03801-03900/03864
- runs-02001-02100/02037
runs-05601-05700/05691
-
p10.pddl
runs-00201-00300/00211
runs-03801-03900/03865
- runs-02001-02100/02038
runs-05601-05700/05692
-
p11.pddl
runs-00201-00300/00212
runs-03801-03900/03866
- runs-02001-02100/02039
runs-05601-05700/05693
-
p12.pddl
runs-00201-00300/00213
runs-03801-03900/03867
- runs-02001-02100/02040
runs-05601-05700/05694
-
p13.pddl
runs-00201-00300/00214
runs-03801-03900/03868
- runs-02001-02100/02041
runs-05601-05700/05695
-
p14.pddl
runs-00201-00300/00215
runs-03801-03900/03869
- runs-02001-02100/02042
runs-05601-05700/05696
-
p15.pddl
runs-00201-00300/00216
runs-03801-03900/03870
- runs-02001-02100/02043
runs-05601-05700/05697
-
p16.pddl
runs-00201-00300/00217
runs-03801-03900/03871
- runs-02001-02100/02044
runs-05601-05700/05698
-
p17.pddl
runs-00201-00300/00218
runs-03801-03900/03872
- runs-02001-02100/02045
runs-05601-05700/05699
-
p18.pddl
runs-00201-00300/00219
runs-03801-03900/03873
- runs-02001-02100/02046
runs-05601-05700/05700
-
p19.pddl
runs-00201-00300/00220
runs-03801-03900/03874
- runs-02001-02100/02047
runs-05701-05800/05701
-
p20.pddl
runs-00201-00300/00221
runs-03801-03900/03875
- runs-02001-02100/02048
runs-05701-05800/05702
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
elevators-opt08-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00201-00300/00222
runs-03801-03900/03876
- runs-02001-02100/02049
runs-05701-05800/05703
-
p02.pddl
runs-00201-00300/00223
runs-03801-03900/03877
- runs-02001-02100/02050
runs-05701-05800/05704
-
p03.pddl
runs-00201-00300/00224
runs-03801-03900/03878
- runs-02001-02100/02051
runs-05701-05800/05705
-
p04.pddl
runs-00201-00300/00225
runs-03801-03900/03879
- runs-02001-02100/02052
runs-05701-05800/05706
-
p05.pddl
runs-00201-00300/00226
runs-03801-03900/03880
- runs-02001-02100/02053
runs-05701-05800/05707
-
p06.pddl
runs-00201-00300/00227
runs-03801-03900/03881
- runs-02001-02100/02054
runs-05701-05800/05708
-
p07.pddl
runs-00201-00300/00228
runs-03801-03900/03882
- runs-02001-02100/02055
runs-05701-05800/05709
-
p08.pddl
runs-00201-00300/00229
runs-03801-03900/03883
- runs-02001-02100/02056
runs-05701-05800/05710
-
p09.pddl
runs-00201-00300/00230
runs-03801-03900/03884
- runs-02001-02100/02057
runs-05701-05800/05711
-
p10.pddl
runs-00201-00300/00231
runs-03801-03900/03885
- runs-02001-02100/02058
runs-05701-05800/05712
-
p11.pddl
runs-00201-00300/00232
runs-03801-03900/03886
- runs-02001-02100/02059
runs-05701-05800/05713
-
p12.pddl
runs-00201-00300/00233
runs-03801-03900/03887
- runs-02001-02100/02060
runs-05701-05800/05714
-
p13.pddl
runs-00201-00300/00234
runs-03801-03900/03888
- runs-02001-02100/02061
runs-05701-05800/05715
-
p14.pddl
runs-00201-00300/00235
runs-03801-03900/03889
- runs-02001-02100/02062
runs-05701-05800/05716
-
p15.pddl
runs-00201-00300/00236
runs-03801-03900/03890
- runs-02001-02100/02063
runs-05701-05800/05717
-
p16.pddl
runs-00201-00300/00237
runs-03801-03900/03891
- runs-02001-02100/02064
runs-05701-05800/05718
-
p17.pddl
runs-00201-00300/00238
runs-03801-03900/03892
- runs-02001-02100/02065
runs-05701-05800/05719
-
p18.pddl
runs-00201-00300/00239
runs-03801-03900/03893
- runs-02001-02100/02066
runs-05701-05800/05720
-
p19.pddl
runs-00201-00300/00240
runs-03801-03900/03894
- runs-02001-02100/02067
runs-05701-05800/05721
-
p20.pddl
runs-00201-00300/00241
runs-03801-03900/03895
- runs-02001-02100/02068
runs-05701-05800/05722
-
p21.pddl
runs-00201-00300/00242
runs-03801-03900/03896
- runs-02001-02100/02069
runs-05701-05800/05723
-
p22.pddl
runs-00201-00300/00243
runs-03801-03900/03897
- runs-02001-02100/02070
runs-05701-05800/05724
-
p23.pddl
runs-00201-00300/00244
runs-03801-03900/03898
- runs-02001-02100/02071
runs-05701-05800/05725
-
p24.pddl
runs-00201-00300/00245
runs-03801-03900/03899
- runs-02001-02100/02072
runs-05701-05800/05726
-
p25.pddl
runs-00201-00300/00246
runs-03801-03900/03900
- runs-02001-02100/02073
runs-05701-05800/05727
-
p26.pddl
runs-00201-00300/00247
runs-03901-04000/03901
- runs-02001-02100/02074
runs-05701-05800/05728
-
p27.pddl
runs-00201-00300/00248
runs-03901-04000/03902
- runs-02001-02100/02075
runs-05701-05800/05729
-
p28.pddl
runs-00201-00300/00249
runs-03901-04000/03903
- runs-02001-02100/02076
runs-05701-05800/05730
-
p29.pddl
runs-00201-00300/00250
runs-03901-04000/03904
- runs-02001-02100/02077
runs-05701-05800/05731
-
p30.pddl
runs-00201-00300/00251
runs-03901-04000/03905
- runs-02001-02100/02078
runs-05701-05800/05732
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
elevators-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00201-00300/00252
runs-03901-04000/03906
- runs-02001-02100/02079
runs-05701-05800/05733
-
p02.pddl
runs-00201-00300/00253
runs-03901-04000/03907
- runs-02001-02100/02080
runs-05701-05800/05734
-
p03.pddl
runs-00201-00300/00254
runs-03901-04000/03908
- runs-02001-02100/02081
runs-05701-05800/05735
-
p04.pddl
runs-00201-00300/00255
runs-03901-04000/03909
- runs-02001-02100/02082
runs-05701-05800/05736
-
p05.pddl
runs-00201-00300/00256
runs-03901-04000/03910
- runs-02001-02100/02083
runs-05701-05800/05737
-
p06.pddl
runs-00201-00300/00257
runs-03901-04000/03911
- runs-02001-02100/02084
runs-05701-05800/05738
-
p07.pddl
runs-00201-00300/00258
runs-03901-04000/03912
- runs-02001-02100/02085
runs-05701-05800/05739
-
p08.pddl
runs-00201-00300/00259
runs-03901-04000/03913
- runs-02001-02100/02086
runs-05701-05800/05740
-
p09.pddl
runs-00201-00300/00260
runs-03901-04000/03914
- runs-02001-02100/02087
runs-05701-05800/05741
-
p10.pddl
runs-00201-00300/00261
runs-03901-04000/03915
- runs-02001-02100/02088
runs-05701-05800/05742
-
p11.pddl
runs-00201-00300/00262
runs-03901-04000/03916
- runs-02001-02100/02089
runs-05701-05800/05743
-
p12.pddl
runs-00201-00300/00263
runs-03901-04000/03917
- runs-02001-02100/02090
runs-05701-05800/05744
-
p13.pddl
runs-00201-00300/00264
runs-03901-04000/03918
- runs-02001-02100/02091
runs-05701-05800/05745
-
p14.pddl
runs-00201-00300/00265
runs-03901-04000/03919
- runs-02001-02100/02092
runs-05701-05800/05746
-
p15.pddl
runs-00201-00300/00266
runs-03901-04000/03920
- runs-02001-02100/02093
runs-05701-05800/05747
-
p16.pddl
runs-00201-00300/00267
runs-03901-04000/03921
- runs-02001-02100/02094
runs-05701-05800/05748
-
p17.pddl
runs-00201-00300/00268
runs-03901-04000/03922
- runs-02001-02100/02095
runs-05701-05800/05749
-
p18.pddl
runs-00201-00300/00269
runs-03901-04000/03923
- runs-02001-02100/02096
runs-05701-05800/05750
-
p19.pddl
runs-00201-00300/00270
runs-03901-04000/03924
- runs-02001-02100/02097
runs-05701-05800/05751
-
p20.pddl
runs-00201-00300/00271
runs-03901-04000/03925
- runs-02001-02100/02098
runs-05701-05800/05752
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
floortile-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
runs-00201-00300/00272
runs-03901-04000/03926
- runs-02001-02100/02099
runs-05701-05800/05753
-
opt-p01-002.pddl
runs-00201-00300/00273
runs-03901-04000/03927
- runs-02001-02100/02100
runs-05701-05800/05754
-
opt-p02-003.pddl
runs-00201-00300/00274
runs-03901-04000/03928
- runs-02101-02200/02101
runs-05701-05800/05755
-
opt-p02-004.pddl
runs-00201-00300/00275
runs-03901-04000/03929
- runs-02101-02200/02102
runs-05701-05800/05756
-
opt-p03-005.pddl
runs-00201-00300/00276
runs-03901-04000/03930
- runs-02101-02200/02103
runs-05701-05800/05757
-
opt-p03-006.pddl
runs-00201-00300/00277
runs-03901-04000/03931
- runs-02101-02200/02104
runs-05701-05800/05758
-
opt-p04-007.pddl
runs-00201-00300/00278
runs-03901-04000/03932
- runs-02101-02200/02105
runs-05701-05800/05759
-
opt-p04-008.pddl
runs-00201-00300/00279
runs-03901-04000/03933
- runs-02101-02200/02106
runs-05701-05800/05760
-
opt-p05-009.pddl
runs-00201-00300/00280
runs-03901-04000/03934
- runs-02101-02200/02107
runs-05701-05800/05761
-
opt-p05-010.pddl
runs-00201-00300/00281
runs-03901-04000/03935
- runs-02101-02200/02108
runs-05701-05800/05762
-
opt-p06-011.pddl
runs-00201-00300/00282
runs-03901-04000/03936
- runs-02101-02200/02109
runs-05701-05800/05763
-
opt-p06-012.pddl
runs-00201-00300/00283
runs-03901-04000/03937
- runs-02101-02200/02110
runs-05701-05800/05764
-
opt-p07-013.pddl
runs-00201-00300/00284
runs-03901-04000/03938
- runs-02101-02200/02111
runs-05701-05800/05765
-
opt-p07-014.pddl
runs-00201-00300/00285
runs-03901-04000/03939
- runs-02101-02200/02112
runs-05701-05800/05766
-
opt-p08-015.pddl
runs-00201-00300/00286
runs-03901-04000/03940
- runs-02101-02200/02113
runs-05701-05800/05767
-
opt-p08-016.pddl
runs-00201-00300/00287
runs-03901-04000/03941
- runs-02101-02200/02114
runs-05701-05800/05768
-
opt-p09-017.pddl
runs-00201-00300/00288
runs-03901-04000/03942
- runs-02101-02200/02115
runs-05701-05800/05769
-
opt-p09-018.pddl
runs-00201-00300/00289
runs-03901-04000/03943
- runs-02101-02200/02116
runs-05701-05800/05770
-
opt-p10-019.pddl
runs-00201-00300/00290
runs-03901-04000/03944
- runs-02101-02200/02117
runs-05701-05800/05771
-
opt-p10-020.pddl
runs-00201-00300/00291
runs-03901-04000/03945
- runs-02101-02200/02118
runs-05701-05800/05772
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
floortile-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
runs-00201-00300/00292
runs-03901-04000/03946
- runs-02101-02200/02119
runs-05701-05800/05773
-
p01-4-4-2.pddl
runs-00201-00300/00293
runs-03901-04000/03947
- runs-02101-02200/02120
runs-05701-05800/05774
-
p01-5-3-2.pddl
runs-00201-00300/00294
runs-03901-04000/03948
- runs-02101-02200/02121
runs-05701-05800/05775
-
p01-5-4-2.pddl
runs-00201-00300/00295
runs-03901-04000/03949
- runs-02101-02200/02122
runs-05701-05800/05776
-
p01-5-5-2.pddl
runs-00201-00300/00296
runs-03901-04000/03950
- runs-02101-02200/02123
runs-05701-05800/05777
-
p01-6-4-2.pddl
runs-00201-00300/00297
runs-03901-04000/03951
- runs-02101-02200/02124
runs-05701-05800/05778
-
p01-6-5-2.pddl
runs-00201-00300/00298
runs-03901-04000/03952
- runs-02101-02200/02125
runs-05701-05800/05779
-
p02-4-4-2.pddl
runs-00201-00300/00299
runs-03901-04000/03953
- runs-02101-02200/02126
runs-05701-05800/05780
-
p02-5-3-2.pddl
runs-00201-00300/00300
runs-03901-04000/03954
- runs-02101-02200/02127
runs-05701-05800/05781
-
p02-5-4-2.pddl
runs-00301-00400/00301
runs-03901-04000/03955
- runs-02101-02200/02128
runs-05701-05800/05782
-
p02-5-5-2.pddl
runs-00301-00400/00302
runs-03901-04000/03956
- runs-02101-02200/02129
runs-05701-05800/05783
-
p02-6-4-2.pddl
runs-00301-00400/00303
runs-03901-04000/03957
- runs-02101-02200/02130
runs-05701-05800/05784
-
p02-6-5-2.pddl
runs-00301-00400/00304
runs-03901-04000/03958
- runs-02101-02200/02131
runs-05701-05800/05785
-
p03-4-3-2.pddl
runs-00301-00400/00305
runs-03901-04000/03959
- runs-02101-02200/02132
runs-05701-05800/05786
-
p03-4-4-2.pddl
runs-00301-00400/00306
runs-03901-04000/03960
- runs-02101-02200/02133
runs-05701-05800/05787
-
p03-5-3-2.pddl
runs-00301-00400/00307
runs-03901-04000/03961
- runs-02101-02200/02134
runs-05701-05800/05788
-
p03-5-4-2.pddl
runs-00301-00400/00308
runs-03901-04000/03962
- runs-02101-02200/02135
runs-05701-05800/05789
-
p03-5-5-2.pddl
runs-00301-00400/00309
runs-03901-04000/03963
- runs-02101-02200/02136
runs-05701-05800/05790
-
p03-6-4-2.pddl
runs-00301-00400/00310
runs-03901-04000/03964
- runs-02101-02200/02137
runs-05701-05800/05791
-
p03-6-5-2.pddl
runs-00301-00400/00311
runs-03901-04000/03965
- runs-02101-02200/02138
runs-05701-05800/05792
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
freecell
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00301-00400/00312
runs-03901-04000/03966
- runs-02101-02200/02139
runs-05701-05800/05793
-
p02.pddl
runs-00301-00400/00313
runs-03901-04000/03967
- runs-02101-02200/02140
runs-05701-05800/05794
-
p03.pddl
runs-00301-00400/00314
runs-03901-04000/03968
- runs-02101-02200/02141
runs-05701-05800/05795
-
p04.pddl
runs-00301-00400/00315
runs-03901-04000/03969
- runs-02101-02200/02142
runs-05701-05800/05796
-
p05.pddl
runs-00301-00400/00316
runs-03901-04000/03970
- runs-02101-02200/02143
runs-05701-05800/05797
-
p06.pddl
runs-00301-00400/00317
runs-03901-04000/03971
- runs-02101-02200/02144
runs-05701-05800/05798
-
p07.pddl
runs-00301-00400/00318
runs-03901-04000/03972
- runs-02101-02200/02145
runs-05701-05800/05799
-
p08.pddl
runs-00301-00400/00319
runs-03901-04000/03973
- runs-02101-02200/02146
runs-05701-05800/05800
-
p09.pddl
runs-00301-00400/00320
runs-03901-04000/03974
- runs-02101-02200/02147
runs-05801-05900/05801
-
p10.pddl
runs-00301-00400/00321
runs-03901-04000/03975
- runs-02101-02200/02148
runs-05801-05900/05802
-
p11.pddl
runs-00301-00400/00322
runs-03901-04000/03976
- runs-02101-02200/02149
runs-05801-05900/05803
-
p12.pddl
runs-00301-00400/00323
runs-03901-04000/03977
- runs-02101-02200/02150
runs-05801-05900/05804
-
p13.pddl
runs-00301-00400/00324
runs-03901-04000/03978
- runs-02101-02200/02151
runs-05801-05900/05805
-
p14.pddl
runs-00301-00400/00325
runs-03901-04000/03979
- runs-02101-02200/02152
runs-05801-05900/05806
-
p15.pddl
runs-00301-00400/00326
runs-03901-04000/03980
- runs-02101-02200/02153
runs-05801-05900/05807
-
p16.pddl
runs-00301-00400/00327
runs-03901-04000/03981
- runs-02101-02200/02154
runs-05801-05900/05808
-
p17.pddl
runs-00301-00400/00328
runs-03901-04000/03982
- runs-02101-02200/02155
runs-05801-05900/05809
-
p18.pddl
runs-00301-00400/00329
runs-03901-04000/03983
- runs-02101-02200/02156
runs-05801-05900/05810
-
p19.pddl
runs-00301-00400/00330
runs-03901-04000/03984
- runs-02101-02200/02157
runs-05801-05900/05811
-
p20.pddl
runs-00301-00400/00331
runs-03901-04000/03985
- runs-02101-02200/02158
runs-05801-05900/05812
-
probfreecell-2-1.pddl
runs-00301-00400/00332
runs-03901-04000/03986
- runs-02101-02200/02159
runs-05801-05900/05813
-
probfreecell-2-2.pddl
runs-00301-00400/00333
runs-03901-04000/03987
- runs-02101-02200/02160
runs-05801-05900/05814
-
probfreecell-2-3.pddl
runs-00301-00400/00334
runs-03901-04000/03988
- runs-02101-02200/02161
runs-05801-05900/05815
-
probfreecell-2-4.pddl
runs-00301-00400/00335
runs-03901-04000/03989
- runs-02101-02200/02162
runs-05801-05900/05816
-
probfreecell-2-5.pddl
runs-00301-00400/00336
runs-03901-04000/03990
- runs-02101-02200/02163
runs-05801-05900/05817
-
probfreecell-3-1.pddl
runs-00301-00400/00337
runs-03901-04000/03991
- runs-02101-02200/02164
runs-05801-05900/05818
-
probfreecell-3-2.pddl
runs-00301-00400/00338
runs-03901-04000/03992
- runs-02101-02200/02165
runs-05801-05900/05819
-
probfreecell-3-3.pddl
runs-00301-00400/00339
runs-03901-04000/03993
- runs-02101-02200/02166
runs-05801-05900/05820
-
probfreecell-3-4.pddl
runs-00301-00400/00340
runs-03901-04000/03994
- runs-02101-02200/02167
runs-05801-05900/05821
-
probfreecell-3-5.pddl
runs-00301-00400/00341
runs-03901-04000/03995
- runs-02101-02200/02168
runs-05801-05900/05822
-
probfreecell-4-1.pddl
runs-00301-00400/00342
runs-03901-04000/03996
- runs-02101-02200/02169
runs-05801-05900/05823
-
probfreecell-4-2.pddl
runs-00301-00400/00343
runs-03901-04000/03997
- runs-02101-02200/02170
runs-05801-05900/05824
-
probfreecell-4-3.pddl
runs-00301-00400/00344
runs-03901-04000/03998
- runs-02101-02200/02171
runs-05801-05900/05825
-
probfreecell-4-4.pddl
runs-00301-00400/00345
runs-03901-04000/03999
- runs-02101-02200/02172
runs-05801-05900/05826
-
probfreecell-4-5.pddl
runs-00301-00400/00346
runs-03901-04000/04000
- runs-02101-02200/02173
runs-05801-05900/05827
-
probfreecell-5-1.pddl
runs-00301-00400/00347
runs-04001-04100/04001
- runs-02101-02200/02174
runs-05801-05900/05828
-
probfreecell-5-2.pddl
runs-00301-00400/00348
runs-04001-04100/04002
- runs-02101-02200/02175
runs-05801-05900/05829
-
probfreecell-5-3.pddl
runs-00301-00400/00349
runs-04001-04100/04003
- runs-02101-02200/02176
runs-05801-05900/05830
-
probfreecell-5-4.pddl
runs-00301-00400/00350
runs-04001-04100/04004
- runs-02101-02200/02177
runs-05801-05900/05831
-
probfreecell-5-5.pddl
runs-00301-00400/00351
runs-04001-04100/04005
- runs-02101-02200/02178
runs-05801-05900/05832
-
probfreecell-6-1.pddl
runs-00301-00400/00352
runs-04001-04100/04006
- runs-02101-02200/02179
runs-05801-05900/05833
-
probfreecell-6-2.pddl
runs-00301-00400/00353
runs-04001-04100/04007
- runs-02101-02200/02180
runs-05801-05900/05834
-
probfreecell-6-3.pddl
runs-00301-00400/00354
runs-04001-04100/04008
- runs-02101-02200/02181
runs-05801-05900/05835
-
probfreecell-6-4.pddl
runs-00301-00400/00355
runs-04001-04100/04009
- runs-02101-02200/02182
runs-05801-05900/05836
-
probfreecell-6-5.pddl
runs-00301-00400/00356
runs-04001-04100/04010
- runs-02101-02200/02183
runs-05801-05900/05837
-
probfreecell-7-1.pddl
runs-00301-00400/00357
runs-04001-04100/04011
- runs-02101-02200/02184
runs-05801-05900/05838
-
probfreecell-7-2.pddl
runs-00301-00400/00358
runs-04001-04100/04012
- runs-02101-02200/02185
runs-05801-05900/05839
-
probfreecell-7-3.pddl
runs-00301-00400/00359
runs-04001-04100/04013
- runs-02101-02200/02186
runs-05801-05900/05840
-
probfreecell-7-4.pddl
runs-00301-00400/00360
runs-04001-04100/04014
- runs-02101-02200/02187
runs-05801-05900/05841
-
probfreecell-7-5.pddl
runs-00301-00400/00361
runs-04001-04100/04015
- runs-02101-02200/02188
runs-05801-05900/05842
-
probfreecell-8-1.pddl
runs-00301-00400/00362
runs-04001-04100/04016
- runs-02101-02200/02189
runs-05801-05900/05843
-
probfreecell-8-2.pddl
runs-00301-00400/00363
runs-04001-04100/04017
- runs-02101-02200/02190
runs-05801-05900/05844
-
probfreecell-8-3.pddl
runs-00301-00400/00364
runs-04001-04100/04018
- runs-02101-02200/02191
runs-05801-05900/05845
-
probfreecell-8-4.pddl
runs-00301-00400/00365
runs-04001-04100/04019
- runs-02101-02200/02192
runs-05801-05900/05846
-
probfreecell-8-5.pddl
runs-00301-00400/00366
runs-04001-04100/04020
- runs-02101-02200/02193
runs-05801-05900/05847
-
probfreecell-9-1.pddl
runs-00301-00400/00367
runs-04001-04100/04021
- runs-02101-02200/02194
runs-05801-05900/05848
-
probfreecell-9-2.pddl
runs-00301-00400/00368
runs-04001-04100/04022
- runs-02101-02200/02195
runs-05801-05900/05849
-
probfreecell-9-3.pddl
runs-00301-00400/00369
runs-04001-04100/04023
- runs-02101-02200/02196
runs-05801-05900/05850
-
probfreecell-9-4.pddl
runs-00301-00400/00370
runs-04001-04100/04024
- runs-02101-02200/02197
runs-05801-05900/05851
-
probfreecell-9-5.pddl
runs-00301-00400/00371
runs-04001-04100/04025
- runs-02101-02200/02198
runs-05801-05900/05852
-
probfreecell-10-1.pddl
runs-00301-00400/00372
runs-04001-04100/04026
- runs-02101-02200/02199
runs-05801-05900/05853
-
probfreecell-10-2.pddl
runs-00301-00400/00373
runs-04001-04100/04027
- runs-02101-02200/02200
runs-05801-05900/05854
-
probfreecell-10-3.pddl
runs-00301-00400/00374
runs-04001-04100/04028
- runs-02201-02300/02201
runs-05801-05900/05855
-
probfreecell-10-4.pddl
runs-00301-00400/00375
runs-04001-04100/04029
- runs-02201-02300/02202
runs-05801-05900/05856
-
probfreecell-10-5.pddl
runs-00301-00400/00376
runs-04001-04100/04030
- runs-02201-02300/02203
runs-05801-05900/05857
-
probfreecell-11-1.pddl
runs-00301-00400/00377
runs-04001-04100/04031
- runs-02201-02300/02204
runs-05801-05900/05858
-
probfreecell-11-2.pddl
runs-00301-00400/00378
runs-04001-04100/04032
- runs-02201-02300/02205
runs-05801-05900/05859
-
probfreecell-11-3.pddl
runs-00301-00400/00379
runs-04001-04100/04033
- runs-02201-02300/02206
runs-05801-05900/05860
-
probfreecell-11-4.pddl
runs-00301-00400/00380
runs-04001-04100/04034
- runs-02201-02300/02207
runs-05801-05900/05861
-
probfreecell-11-5.pddl
runs-00301-00400/00381
runs-04001-04100/04035
- runs-02201-02300/02208
runs-05801-05900/05862
-
probfreecell-12-1.pddl
runs-00301-00400/00382
runs-04001-04100/04036
- runs-02201-02300/02209
runs-05801-05900/05863
-
probfreecell-12-2.pddl
runs-00301-00400/00383
runs-04001-04100/04037
- runs-02201-02300/02210
runs-05801-05900/05864
-
probfreecell-12-3.pddl
runs-00301-00400/00384
runs-04001-04100/04038
- runs-02201-02300/02211
runs-05801-05900/05865
-
probfreecell-12-4.pddl
runs-00301-00400/00385
runs-04001-04100/04039
- runs-02201-02300/02212
runs-05801-05900/05866
-
probfreecell-12-5.pddl
runs-00301-00400/00386
runs-04001-04100/04040
- runs-02201-02300/02213
runs-05801-05900/05867
-
probfreecell-13-1.pddl
runs-00301-00400/00387
runs-04001-04100/04041
- runs-02201-02300/02214
runs-05801-05900/05868
-
probfreecell-13-2.pddl
runs-00301-00400/00388
runs-04001-04100/04042
- runs-02201-02300/02215
runs-05801-05900/05869
-
probfreecell-13-3.pddl
runs-00301-00400/00389
runs-04001-04100/04043
- runs-02201-02300/02216
runs-05801-05900/05870
-
probfreecell-13-4.pddl
runs-00301-00400/00390
runs-04001-04100/04044
- runs-02201-02300/02217
runs-05801-05900/05871
-
probfreecell-13-5.pddl
runs-00301-00400/00391
runs-04001-04100/04045
- runs-02201-02300/02218
runs-05801-05900/05872
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
ged-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
runs-00301-00400/00392
runs-04001-04100/04046
- runs-02201-02300/02219
runs-05801-05900/05873
-
d-1-3.pddl
runs-00301-00400/00393
runs-04001-04100/04047
- runs-02201-02300/02220
runs-05801-05900/05874
-
d-1-4.pddl
runs-00301-00400/00394
runs-04001-04100/04048
- runs-02201-02300/02221
runs-05801-05900/05875
-
d-1-8.pddl
runs-00301-00400/00395
runs-04001-04100/04049
- runs-02201-02300/02222
runs-05801-05900/05876
-
d-2-1.pddl
runs-00301-00400/00396
runs-04001-04100/04050
- runs-02201-02300/02223
runs-05801-05900/05877
-
d-2-3.pddl
runs-00301-00400/00397
runs-04001-04100/04051
- runs-02201-02300/02224
runs-05801-05900/05878
-
d-2-4.pddl
runs-00301-00400/00398
runs-04001-04100/04052
- runs-02201-02300/02225
runs-05801-05900/05879
-
d-2-8.pddl
runs-00301-00400/00399
runs-04001-04100/04053
- runs-02201-02300/02226
runs-05801-05900/05880
-
d-3-1.pddl
runs-00301-00400/00400
runs-04001-04100/04054
- runs-02201-02300/02227
runs-05801-05900/05881
-
d-3-2.pddl
runs-00401-00500/00401
runs-04001-04100/04055
- runs-02201-02300/02228
runs-05801-05900/05882
-
d-3-4.pddl
runs-00401-00500/00402
runs-04001-04100/04056
- runs-02201-02300/02229
runs-05801-05900/05883
-
d-4-2.pddl
runs-00401-00500/00403
runs-04001-04100/04057
- runs-02201-02300/02230
runs-05801-05900/05884
-
d-4-3.pddl
runs-00401-00500/00404
runs-04001-04100/04058
- runs-02201-02300/02231
runs-05801-05900/05885
-
d-4-8.pddl
runs-00401-00500/00405
runs-04001-04100/04059
- runs-02201-02300/02232
runs-05801-05900/05886
-
d-7-5.pddl
runs-00401-00500/00406
runs-04001-04100/04060
- runs-02201-02300/02233
runs-05801-05900/05887
-
d-7-6.pddl
runs-00401-00500/00407
runs-04001-04100/04061
- runs-02201-02300/02234
runs-05801-05900/05888
-
d-8-1.pddl
runs-00401-00500/00408
runs-04001-04100/04062
- runs-02201-02300/02235
runs-05801-05900/05889
-
d-8-2.pddl
runs-00401-00500/00409
runs-04001-04100/04063
- runs-02201-02300/02236
runs-05801-05900/05890
-
d-8-4.pddl
runs-00401-00500/00410
runs-04001-04100/04064
- runs-02201-02300/02237
runs-05801-05900/05891
-
d-8-9.pddl
runs-00401-00500/00411
runs-04001-04100/04065
- runs-02201-02300/02238
runs-05801-05900/05892
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
grid
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
runs-00401-00500/00412
runs-04001-04100/04066
- runs-02201-02300/02239
runs-05801-05900/05893
-
prob02.pddl
runs-00401-00500/00413
runs-04001-04100/04067
- runs-02201-02300/02240
runs-05801-05900/05894
-
prob03.pddl
runs-00401-00500/00414
runs-04001-04100/04068
- runs-02201-02300/02241
runs-05801-05900/05895
-
prob04.pddl
runs-00401-00500/00415
runs-04001-04100/04069
- runs-02201-02300/02242
runs-05801-05900/05896
-
prob05.pddl
runs-00401-00500/00416
runs-04001-04100/04070
- runs-02201-02300/02243
runs-05801-05900/05897
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
gripper
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
runs-00401-00500/00417
runs-04001-04100/04071
- runs-02201-02300/02244
runs-05801-05900/05898
-
prob02.pddl
runs-00401-00500/00418
runs-04001-04100/04072
- runs-02201-02300/02245
runs-05801-05900/05899
-
prob03.pddl
runs-00401-00500/00419
runs-04001-04100/04073
- runs-02201-02300/02246
runs-05801-05900/05900
-
prob04.pddl
runs-00401-00500/00420
runs-04001-04100/04074
- runs-02201-02300/02247
runs-05901-06000/05901
-
prob05.pddl
runs-00401-00500/00421
runs-04001-04100/04075
- runs-02201-02300/02248
runs-05901-06000/05902
-
prob06.pddl
runs-00401-00500/00422
runs-04001-04100/04076
- runs-02201-02300/02249
runs-05901-06000/05903
-
prob07.pddl
runs-00401-00500/00423
runs-04001-04100/04077
- runs-02201-02300/02250
runs-05901-06000/05904
-
prob08.pddl
runs-00401-00500/00424
runs-04001-04100/04078
- runs-02201-02300/02251
runs-05901-06000/05905
-
prob09.pddl
runs-00401-00500/00425
runs-04001-04100/04079
- runs-02201-02300/02252
runs-05901-06000/05906
-
prob10.pddl
runs-00401-00500/00426
runs-04001-04100/04080
- runs-02201-02300/02253
runs-05901-06000/05907
-
prob11.pddl
runs-00401-00500/00427
runs-04001-04100/04081
- runs-02201-02300/02254
runs-05901-06000/05908
-
prob12.pddl
runs-00401-00500/00428
runs-04001-04100/04082
- runs-02201-02300/02255
runs-05901-06000/05909
-
prob13.pddl
runs-00401-00500/00429
runs-04001-04100/04083
- runs-02201-02300/02256
runs-05901-06000/05910
-
prob14.pddl
runs-00401-00500/00430
runs-04001-04100/04084
- runs-02201-02300/02257
runs-05901-06000/05911
-
prob15.pddl
runs-00401-00500/00431
runs-04001-04100/04085
- runs-02201-02300/02258
runs-05901-06000/05912
-
prob16.pddl
runs-00401-00500/00432
runs-04001-04100/04086
- runs-02201-02300/02259
runs-05901-06000/05913
-
prob17.pddl
runs-00401-00500/00433
runs-04001-04100/04087
- runs-02201-02300/02260
runs-05901-06000/05914
-
prob18.pddl
runs-00401-00500/00434
runs-04001-04100/04088
- runs-02201-02300/02261
runs-05901-06000/05915
-
prob19.pddl
runs-00401-00500/00435
runs-04001-04100/04089
- runs-02201-02300/02262
runs-05901-06000/05916
-
prob20.pddl
runs-00401-00500/00436
runs-04001-04100/04090
- runs-02201-02300/02263
runs-05901-06000/05917
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
hiking-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
runs-00401-00500/00437
runs-04001-04100/04091
- runs-02201-02300/02264
runs-05901-06000/05918
-
ptesting-1-2-4.pddl
runs-00401-00500/00438
runs-04001-04100/04092
- runs-02201-02300/02265
runs-05901-06000/05919
-
ptesting-1-2-5.pddl
runs-00401-00500/00439
runs-04001-04100/04093
- runs-02201-02300/02266
runs-05901-06000/05920
-
ptesting-1-2-7.pddl
runs-00401-00500/00440
runs-04001-04100/04094
- runs-02201-02300/02267
runs-05901-06000/05921
-
ptesting-1-2-8.pddl
runs-00401-00500/00441
runs-04001-04100/04095
- runs-02201-02300/02268
runs-05901-06000/05922
-
ptesting-2-2-3.pddl
runs-00401-00500/00442
runs-04001-04100/04096
- runs-02201-02300/02269
runs-05901-06000/05923
-
ptesting-2-2-4.pddl
runs-00401-00500/00443
runs-04001-04100/04097
- runs-02201-02300/02270
runs-05901-06000/05924
-
ptesting-2-2-5.pddl
runs-00401-00500/00444
runs-04001-04100/04098
- runs-02201-02300/02271
runs-05901-06000/05925
-
ptesting-2-2-6.pddl
runs-00401-00500/00445
runs-04001-04100/04099
- runs-02201-02300/02272
runs-05901-06000/05926
-
ptesting-2-2-7.pddl
runs-00401-00500/00446
runs-04001-04100/04100
- runs-02201-02300/02273
runs-05901-06000/05927
-
ptesting-2-2-8.pddl
runs-00401-00500/00447
runs-04101-04200/04101
- runs-02201-02300/02274
runs-05901-06000/05928
-
ptesting-2-3-4.pddl
runs-00401-00500/00448
runs-04101-04200/04102
- runs-02201-02300/02275
runs-05901-06000/05929
-
ptesting-2-3-5.pddl
runs-00401-00500/00449
runs-04101-04200/04103
- runs-02201-02300/02276
runs-05901-06000/05930
-
ptesting-2-3-6.pddl
runs-00401-00500/00450
runs-04101-04200/04104
- runs-02201-02300/02277
runs-05901-06000/05931
-
ptesting-2-3-7.pddl
runs-00401-00500/00451
runs-04101-04200/04105
- runs-02201-02300/02278
runs-05901-06000/05932
-
ptesting-2-4-3.pddl
runs-00401-00500/00452
runs-04101-04200/04106
- runs-02201-02300/02279
runs-05901-06000/05933
-
ptesting-2-4-4.pddl
runs-00401-00500/00453
runs-04101-04200/04107
- runs-02201-02300/02280
runs-05901-06000/05934
-
ptesting-2-4-5.pddl
runs-00401-00500/00454
runs-04101-04200/04108
- runs-02201-02300/02281
runs-05901-06000/05935
-
ptesting-2-4-6.pddl
runs-00401-00500/00455
runs-04101-04200/04109
- runs-02201-02300/02282
runs-05901-06000/05936
-
ptesting-2-4-7.pddl
runs-00401-00500/00456
runs-04101-04200/04110
- runs-02201-02300/02283
runs-05901-06000/05937
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
logistics00
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
runs-00401-00500/00457
runs-04101-04200/04111
- runs-02201-02300/02284
runs-05901-06000/05938
-
probLOGISTICS-4-1.pddl
runs-00401-00500/00458
runs-04101-04200/04112
- runs-02201-02300/02285
runs-05901-06000/05939
-
probLOGISTICS-4-2.pddl
runs-00401-00500/00459
runs-04101-04200/04113
- runs-02201-02300/02286
runs-05901-06000/05940
-
probLOGISTICS-5-0.pddl
runs-00401-00500/00460
runs-04101-04200/04114
- runs-02201-02300/02287
runs-05901-06000/05941
-
probLOGISTICS-5-1.pddl
runs-00401-00500/00461
runs-04101-04200/04115
- runs-02201-02300/02288
runs-05901-06000/05942
-
probLOGISTICS-5-2.pddl
runs-00401-00500/00462
runs-04101-04200/04116
- runs-02201-02300/02289
runs-05901-06000/05943
-
probLOGISTICS-6-0.pddl
runs-00401-00500/00463
runs-04101-04200/04117
- runs-02201-02300/02290
runs-05901-06000/05944
-
probLOGISTICS-6-1.pddl
runs-00401-00500/00464
runs-04101-04200/04118
- runs-02201-02300/02291
runs-05901-06000/05945
-
probLOGISTICS-6-2.pddl
runs-00401-00500/00465
runs-04101-04200/04119
- runs-02201-02300/02292
runs-05901-06000/05946
-
probLOGISTICS-6-9.pddl
runs-00401-00500/00466
runs-04101-04200/04120
- runs-02201-02300/02293
runs-05901-06000/05947
-
probLOGISTICS-7-0.pddl
runs-00401-00500/00467
runs-04101-04200/04121
- runs-02201-02300/02294
runs-05901-06000/05948
-
probLOGISTICS-7-1.pddl
runs-00401-00500/00468
runs-04101-04200/04122
- runs-02201-02300/02295
runs-05901-06000/05949
-
probLOGISTICS-8-0.pddl
runs-00401-00500/00469
runs-04101-04200/04123
- runs-02201-02300/02296
runs-05901-06000/05950
-
probLOGISTICS-8-1.pddl
runs-00401-00500/00470
runs-04101-04200/04124
- runs-02201-02300/02297
runs-05901-06000/05951
-
probLOGISTICS-9-0.pddl
runs-00401-00500/00471
runs-04101-04200/04125
- runs-02201-02300/02298
runs-05901-06000/05952
-
probLOGISTICS-9-1.pddl
runs-00401-00500/00472
runs-04101-04200/04126
- runs-02201-02300/02299
runs-05901-06000/05953
-
probLOGISTICS-10-0.pddl
runs-00401-00500/00473
runs-04101-04200/04127
- runs-02201-02300/02300
runs-05901-06000/05954
-
probLOGISTICS-10-1.pddl
runs-00401-00500/00474
runs-04101-04200/04128
- runs-02301-02400/02301
runs-05901-06000/05955
-
probLOGISTICS-11-0.pddl
runs-00401-00500/00475
runs-04101-04200/04129
- runs-02301-02400/02302
runs-05901-06000/05956
-
probLOGISTICS-11-1.pddl
runs-00401-00500/00476
runs-04101-04200/04130
- runs-02301-02400/02303
runs-05901-06000/05957
-
probLOGISTICS-12-0.pddl
runs-00401-00500/00477
runs-04101-04200/04131
- runs-02301-02400/02304
runs-05901-06000/05958
-
probLOGISTICS-12-1.pddl
runs-00401-00500/00478
runs-04101-04200/04132
- runs-02301-02400/02305
runs-05901-06000/05959
-
probLOGISTICS-13-0.pddl
runs-00401-00500/00479
runs-04101-04200/04133
- runs-02301-02400/02306
runs-05901-06000/05960
-
probLOGISTICS-13-1.pddl
runs-00401-00500/00480
runs-04101-04200/04134
- runs-02301-02400/02307
runs-05901-06000/05961
-
probLOGISTICS-14-0.pddl
runs-00401-00500/00481
runs-04101-04200/04135
- runs-02301-02400/02308
runs-05901-06000/05962
-
probLOGISTICS-14-1.pddl
runs-00401-00500/00482
runs-04101-04200/04136
- runs-02301-02400/02309
runs-05901-06000/05963
-
probLOGISTICS-15-0.pddl
runs-00401-00500/00483
runs-04101-04200/04137
- runs-02301-02400/02310
runs-05901-06000/05964
-
probLOGISTICS-15-1.pddl
runs-00401-00500/00484
runs-04101-04200/04138
- runs-02301-02400/02311
runs-05901-06000/05965
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
logistics98
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
runs-00401-00500/00485
runs-04101-04200/04139
- runs-02301-02400/02312
runs-05901-06000/05966
-
prob02.pddl
runs-00401-00500/00486
runs-04101-04200/04140
- runs-02301-02400/02313
runs-05901-06000/05967
-
prob03.pddl
runs-00401-00500/00487
runs-04101-04200/04141
- runs-02301-02400/02314
runs-05901-06000/05968
-
prob04.pddl
runs-00401-00500/00488
runs-04101-04200/04142
- runs-02301-02400/02315
runs-05901-06000/05969
-
prob05.pddl
runs-00401-00500/00489
runs-04101-04200/04143
- runs-02301-02400/02316
runs-05901-06000/05970
-
prob06.pddl
runs-00401-00500/00490
runs-04101-04200/04144
- runs-02301-02400/02317
runs-05901-06000/05971
-
prob07.pddl
runs-00401-00500/00491
runs-04101-04200/04145
- runs-02301-02400/02318
runs-05901-06000/05972
-
prob08.pddl
runs-00401-00500/00492
runs-04101-04200/04146
- runs-02301-02400/02319
runs-05901-06000/05973
-
prob09.pddl
runs-00401-00500/00493
runs-04101-04200/04147
- runs-02301-02400/02320
runs-05901-06000/05974
-
prob10.pddl
runs-00401-00500/00494
runs-04101-04200/04148
- runs-02301-02400/02321
runs-05901-06000/05975
-
prob11.pddl
runs-00401-00500/00495
runs-04101-04200/04149
- runs-02301-02400/02322
runs-05901-06000/05976
-
prob12.pddl
runs-00401-00500/00496
runs-04101-04200/04150
- runs-02301-02400/02323
runs-05901-06000/05977
-
prob13.pddl
runs-00401-00500/00497
runs-04101-04200/04151
- runs-02301-02400/02324
runs-05901-06000/05978
-
prob14.pddl
runs-00401-00500/00498
runs-04101-04200/04152
- runs-02301-02400/02325
runs-05901-06000/05979
-
prob15.pddl
runs-00401-00500/00499
runs-04101-04200/04153
- runs-02301-02400/02326
runs-05901-06000/05980
-
prob16.pddl
runs-00401-00500/00500
runs-04101-04200/04154
- runs-02301-02400/02327
runs-05901-06000/05981
-
prob17.pddl
runs-00501-00600/00501
runs-04101-04200/04155
- runs-02301-02400/02328
runs-05901-06000/05982
-
prob18.pddl
runs-00501-00600/00502
runs-04101-04200/04156
- runs-02301-02400/02329
runs-05901-06000/05983
-
prob19.pddl
runs-00501-00600/00503
runs-04101-04200/04157
- runs-02301-02400/02330
runs-05901-06000/05984
-
prob20.pddl
runs-00501-00600/00504
runs-04101-04200/04158
- runs-02301-02400/02331
runs-05901-06000/05985
-
prob21.pddl
runs-00501-00600/00505
runs-04101-04200/04159
- runs-02301-02400/02332
runs-05901-06000/05986
-
prob22.pddl
runs-00501-00600/00506
runs-04101-04200/04160
- runs-02301-02400/02333
runs-05901-06000/05987
-
prob23.pddl
runs-00501-00600/00507
runs-04101-04200/04161
- runs-02301-02400/02334
runs-05901-06000/05988
-
prob24.pddl
runs-00501-00600/00508
runs-04101-04200/04162
- runs-02301-02400/02335
runs-05901-06000/05989
-
prob25.pddl
runs-00501-00600/00509
runs-04101-04200/04163
- runs-02301-02400/02336
runs-05901-06000/05990
-
prob26.pddl
runs-00501-00600/00510
runs-04101-04200/04164
- runs-02301-02400/02337
runs-05901-06000/05991
-
prob27.pddl
runs-00501-00600/00511
runs-04101-04200/04165
- runs-02301-02400/02338
runs-05901-06000/05992
-
prob28.pddl
runs-00501-00600/00512
runs-04101-04200/04166
- runs-02301-02400/02339
runs-05901-06000/05993
-
prob29.pddl
runs-00501-00600/00513
runs-04101-04200/04167
- runs-02301-02400/02340
runs-05901-06000/05994
-
prob30.pddl
runs-00501-00600/00514
runs-04101-04200/04168
- runs-02301-02400/02341
runs-05901-06000/05995
-
prob31.pddl
runs-00501-00600/00515
runs-04101-04200/04169
- runs-02301-02400/02342
runs-05901-06000/05996
-
prob32.pddl
runs-00501-00600/00516
runs-04101-04200/04170
- runs-02301-02400/02343
runs-05901-06000/05997
-
prob33.pddl
runs-00501-00600/00517
runs-04101-04200/04171
- runs-02301-02400/02344
runs-05901-06000/05998
-
prob34.pddl
runs-00501-00600/00518
runs-04101-04200/04172
- runs-02301-02400/02345
runs-05901-06000/05999
-
prob35.pddl
runs-00501-00600/00519
runs-04101-04200/04173
- runs-02301-02400/02346
runs-05901-06000/06000
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
miconic
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
runs-00501-00600/00520
runs-04101-04200/04174
- runs-02301-02400/02347
runs-06001-06100/06001
-
s1-1.pddl
runs-00501-00600/00521
runs-04101-04200/04175
- runs-02301-02400/02348
runs-06001-06100/06002
-
s1-2.pddl
runs-00501-00600/00522
runs-04101-04200/04176
- runs-02301-02400/02349
runs-06001-06100/06003
-
s1-3.pddl
runs-00501-00600/00523
runs-04101-04200/04177
- runs-02301-02400/02350
runs-06001-06100/06004
-
s1-4.pddl
runs-00501-00600/00524
runs-04101-04200/04178
- runs-02301-02400/02351
runs-06001-06100/06005
-
s2-0.pddl
runs-00501-00600/00525
runs-04101-04200/04179
- runs-02301-02400/02352
runs-06001-06100/06006
-
s2-1.pddl
runs-00501-00600/00526
runs-04101-04200/04180
- runs-02301-02400/02353
runs-06001-06100/06007
-
s2-2.pddl
runs-00501-00600/00527
runs-04101-04200/04181
- runs-02301-02400/02354
runs-06001-06100/06008
-
s2-3.pddl
runs-00501-00600/00528
runs-04101-04200/04182
- runs-02301-02400/02355
runs-06001-06100/06009
-
s2-4.pddl
runs-00501-00600/00529
runs-04101-04200/04183
- runs-02301-02400/02356
runs-06001-06100/06010
-
s3-0.pddl
runs-00501-00600/00530
runs-04101-04200/04184
- runs-02301-02400/02357
runs-06001-06100/06011
-
s3-1.pddl
runs-00501-00600/00531
runs-04101-04200/04185
- runs-02301-02400/02358
runs-06001-06100/06012
-
s3-2.pddl
runs-00501-00600/00532
runs-04101-04200/04186
- runs-02301-02400/02359
runs-06001-06100/06013
-
s3-3.pddl
runs-00501-00600/00533
runs-04101-04200/04187
- runs-02301-02400/02360
runs-06001-06100/06014
-
s3-4.pddl
runs-00501-00600/00534
runs-04101-04200/04188
- runs-02301-02400/02361
runs-06001-06100/06015
-
s4-0.pddl
runs-00501-00600/00535
runs-04101-04200/04189
- runs-02301-02400/02362
runs-06001-06100/06016
-
s4-1.pddl
runs-00501-00600/00536
runs-04101-04200/04190
- runs-02301-02400/02363
runs-06001-06100/06017
-
s4-2.pddl
runs-00501-00600/00537
runs-04101-04200/04191
- runs-02301-02400/02364
runs-06001-06100/06018
-
s4-3.pddl
runs-00501-00600/00538
runs-04101-04200/04192
- runs-02301-02400/02365
runs-06001-06100/06019
-
s4-4.pddl
runs-00501-00600/00539
runs-04101-04200/04193
- runs-02301-02400/02366
runs-06001-06100/06020
-
s5-0.pddl
runs-00501-00600/00540
runs-04101-04200/04194
- runs-02301-02400/02367
runs-06001-06100/06021
-
s5-1.pddl
runs-00501-00600/00541
runs-04101-04200/04195
- runs-02301-02400/02368
runs-06001-06100/06022
-
s5-2.pddl
runs-00501-00600/00542
runs-04101-04200/04196
- runs-02301-02400/02369
runs-06001-06100/06023
-
s5-3.pddl
runs-00501-00600/00543
runs-04101-04200/04197
- runs-02301-02400/02370
runs-06001-06100/06024
-
s5-4.pddl
runs-00501-00600/00544
runs-04101-04200/04198
- runs-02301-02400/02371
runs-06001-06100/06025
-
s6-0.pddl
runs-00501-00600/00545
runs-04101-04200/04199
- runs-02301-02400/02372
runs-06001-06100/06026
-
s6-1.pddl
runs-00501-00600/00546
runs-04101-04200/04200
- runs-02301-02400/02373
runs-06001-06100/06027
-
s6-2.pddl
runs-00501-00600/00547
runs-04201-04300/04201
- runs-02301-02400/02374
runs-06001-06100/06028
-
s6-3.pddl
runs-00501-00600/00548
runs-04201-04300/04202
- runs-02301-02400/02375
runs-06001-06100/06029
-
s6-4.pddl
runs-00501-00600/00549
runs-04201-04300/04203
- runs-02301-02400/02376
runs-06001-06100/06030
-
s7-0.pddl
runs-00501-00600/00550
runs-04201-04300/04204
- runs-02301-02400/02377
runs-06001-06100/06031
-
s7-1.pddl
runs-00501-00600/00551
runs-04201-04300/04205
- runs-02301-02400/02378
runs-06001-06100/06032
-
s7-2.pddl
runs-00501-00600/00552
runs-04201-04300/04206
- runs-02301-02400/02379
runs-06001-06100/06033
-
s7-3.pddl
runs-00501-00600/00553
runs-04201-04300/04207
- runs-02301-02400/02380
runs-06001-06100/06034
-
s7-4.pddl
runs-00501-00600/00554
runs-04201-04300/04208
- runs-02301-02400/02381
runs-06001-06100/06035
-
s8-0.pddl
runs-00501-00600/00555
runs-04201-04300/04209
- runs-02301-02400/02382
runs-06001-06100/06036
-
s8-1.pddl
runs-00501-00600/00556
runs-04201-04300/04210
- runs-02301-02400/02383
runs-06001-06100/06037
-
s8-2.pddl
runs-00501-00600/00557
runs-04201-04300/04211
- runs-02301-02400/02384
runs-06001-06100/06038
-
s8-3.pddl
runs-00501-00600/00558
runs-04201-04300/04212
- runs-02301-02400/02385
runs-06001-06100/06039
-
s8-4.pddl
runs-00501-00600/00559
runs-04201-04300/04213
- runs-02301-02400/02386
runs-06001-06100/06040
-
s9-0.pddl
runs-00501-00600/00560
runs-04201-04300/04214
- runs-02301-02400/02387
runs-06001-06100/06041
-
s9-1.pddl
runs-00501-00600/00561
runs-04201-04300/04215
- runs-02301-02400/02388
runs-06001-06100/06042
-
s9-2.pddl
runs-00501-00600/00562
runs-04201-04300/04216
- runs-02301-02400/02389
runs-06001-06100/06043
-
s9-3.pddl
runs-00501-00600/00563
runs-04201-04300/04217
- runs-02301-02400/02390
runs-06001-06100/06044
-
s9-4.pddl
runs-00501-00600/00564
runs-04201-04300/04218
- runs-02301-02400/02391
runs-06001-06100/06045
-
s10-0.pddl
runs-00501-00600/00565
runs-04201-04300/04219
- runs-02301-02400/02392
runs-06001-06100/06046
-
s10-1.pddl
runs-00501-00600/00566
runs-04201-04300/04220
- runs-02301-02400/02393
runs-06001-06100/06047
-
s10-2.pddl
runs-00501-00600/00567
runs-04201-04300/04221
- runs-02301-02400/02394
runs-06001-06100/06048
-
s10-3.pddl
runs-00501-00600/00568
runs-04201-04300/04222
- runs-02301-02400/02395
runs-06001-06100/06049
-
s10-4.pddl
runs-00501-00600/00569
runs-04201-04300/04223
- runs-02301-02400/02396
runs-06001-06100/06050
-
s11-0.pddl
runs-00501-00600/00570
runs-04201-04300/04224
- runs-02301-02400/02397
runs-06001-06100/06051
-
s11-1.pddl
runs-00501-00600/00571
runs-04201-04300/04225
- runs-02301-02400/02398
runs-06001-06100/06052
-
s11-2.pddl
runs-00501-00600/00572
runs-04201-04300/04226
- runs-02301-02400/02399
runs-06001-06100/06053
-
s11-3.pddl
runs-00501-00600/00573
runs-04201-04300/04227
- runs-02301-02400/02400
runs-06001-06100/06054
-
s11-4.pddl
runs-00501-00600/00574
runs-04201-04300/04228
- runs-02401-02500/02401
runs-06001-06100/06055
-
s12-0.pddl
runs-00501-00600/00575
runs-04201-04300/04229
- runs-02401-02500/02402
runs-06001-06100/06056
-
s12-1.pddl
runs-00501-00600/00576
runs-04201-04300/04230
- runs-02401-02500/02403
runs-06001-06100/06057
-
s12-2.pddl
runs-00501-00600/00577
runs-04201-04300/04231
- runs-02401-02500/02404
runs-06001-06100/06058
-
s12-3.pddl
runs-00501-00600/00578
runs-04201-04300/04232
- runs-02401-02500/02405
runs-06001-06100/06059
-
s12-4.pddl
runs-00501-00600/00579
runs-04201-04300/04233
- runs-02401-02500/02406
runs-06001-06100/06060
-
s13-0.pddl
runs-00501-00600/00580
runs-04201-04300/04234
- runs-02401-02500/02407
runs-06001-06100/06061
-
s13-1.pddl
runs-00501-00600/00581
runs-04201-04300/04235
- runs-02401-02500/02408
runs-06001-06100/06062
-
s13-2.pddl
runs-00501-00600/00582
runs-04201-04300/04236
- runs-02401-02500/02409
runs-06001-06100/06063
-
s13-3.pddl
runs-00501-00600/00583
runs-04201-04300/04237
- runs-02401-02500/02410
runs-06001-06100/06064
-
s13-4.pddl
runs-00501-00600/00584
runs-04201-04300/04238
- runs-02401-02500/02411
runs-06001-06100/06065
-
s14-0.pddl
runs-00501-00600/00585
runs-04201-04300/04239
- runs-02401-02500/02412
runs-06001-06100/06066
-
s14-1.pddl
runs-00501-00600/00586
runs-04201-04300/04240
- runs-02401-02500/02413
runs-06001-06100/06067
-
s14-2.pddl
runs-00501-00600/00587
runs-04201-04300/04241
- runs-02401-02500/02414
runs-06001-06100/06068
-
s14-3.pddl
runs-00501-00600/00588
runs-04201-04300/04242
- runs-02401-02500/02415
runs-06001-06100/06069
-
s14-4.pddl
runs-00501-00600/00589
runs-04201-04300/04243
- runs-02401-02500/02416
runs-06001-06100/06070
-
s15-0.pddl
runs-00501-00600/00590
runs-04201-04300/04244
- runs-02401-02500/02417
runs-06001-06100/06071
-
s15-1.pddl
runs-00501-00600/00591
runs-04201-04300/04245
- runs-02401-02500/02418
runs-06001-06100/06072
-
s15-2.pddl
runs-00501-00600/00592
runs-04201-04300/04246
- runs-02401-02500/02419
runs-06001-06100/06073
-
s15-3.pddl
runs-00501-00600/00593
runs-04201-04300/04247
- runs-02401-02500/02420
runs-06001-06100/06074
-
s15-4.pddl
runs-00501-00600/00594
runs-04201-04300/04248
- runs-02401-02500/02421
runs-06001-06100/06075
-
s16-0.pddl
runs-00501-00600/00595
runs-04201-04300/04249
- runs-02401-02500/02422
runs-06001-06100/06076
-
s16-1.pddl
runs-00501-00600/00596
runs-04201-04300/04250
- runs-02401-02500/02423
runs-06001-06100/06077
-
s16-2.pddl
runs-00501-00600/00597
runs-04201-04300/04251
- runs-02401-02500/02424
runs-06001-06100/06078
-
s16-3.pddl
runs-00501-00600/00598
runs-04201-04300/04252
- runs-02401-02500/02425
runs-06001-06100/06079
-
s16-4.pddl
runs-00501-00600/00599
runs-04201-04300/04253
- runs-02401-02500/02426
runs-06001-06100/06080
-
s17-0.pddl
runs-00501-00600/00600
runs-04201-04300/04254
- runs-02401-02500/02427
runs-06001-06100/06081
-
s17-1.pddl
runs-00601-00700/00601
runs-04201-04300/04255
- runs-02401-02500/02428
runs-06001-06100/06082
-
s17-2.pddl
runs-00601-00700/00602
runs-04201-04300/04256
- runs-02401-02500/02429
runs-06001-06100/06083
-
s17-3.pddl
runs-00601-00700/00603
runs-04201-04300/04257
- runs-02401-02500/02430
runs-06001-06100/06084
-
s17-4.pddl
runs-00601-00700/00604
runs-04201-04300/04258
- runs-02401-02500/02431
runs-06001-06100/06085
-
s18-0.pddl
runs-00601-00700/00605
runs-04201-04300/04259
- runs-02401-02500/02432
runs-06001-06100/06086
-
s18-1.pddl
runs-00601-00700/00606
runs-04201-04300/04260
- runs-02401-02500/02433
runs-06001-06100/06087
-
s18-2.pddl
runs-00601-00700/00607
runs-04201-04300/04261
- runs-02401-02500/02434
runs-06001-06100/06088
-
s18-3.pddl
runs-00601-00700/00608
runs-04201-04300/04262
- runs-02401-02500/02435
runs-06001-06100/06089
-
s18-4.pddl
runs-00601-00700/00609
runs-04201-04300/04263
- runs-02401-02500/02436
runs-06001-06100/06090
-
s19-0.pddl
runs-00601-00700/00610
runs-04201-04300/04264
- runs-02401-02500/02437
runs-06001-06100/06091
-
s19-1.pddl
runs-00601-00700/00611
runs-04201-04300/04265
- runs-02401-02500/02438
runs-06001-06100/06092
-
s19-2.pddl
runs-00601-00700/00612
runs-04201-04300/04266
- runs-02401-02500/02439
runs-06001-06100/06093
-
s19-3.pddl
runs-00601-00700/00613
runs-04201-04300/04267
- runs-02401-02500/02440
runs-06001-06100/06094
-
s19-4.pddl
runs-00601-00700/00614
runs-04201-04300/04268
- runs-02401-02500/02441
runs-06001-06100/06095
-
s20-0.pddl
runs-00601-00700/00615
runs-04201-04300/04269
- runs-02401-02500/02442
runs-06001-06100/06096
-
s20-1.pddl
runs-00601-00700/00616
runs-04201-04300/04270
- runs-02401-02500/02443
runs-06001-06100/06097
-
s20-2.pddl
runs-00601-00700/00617
runs-04201-04300/04271
- runs-02401-02500/02444
runs-06001-06100/06098
-
s20-3.pddl
runs-00601-00700/00618
runs-04201-04300/04272
- runs-02401-02500/02445
runs-06001-06100/06099
-
s20-4.pddl
runs-00601-00700/00619
runs-04201-04300/04273
- runs-02401-02500/02446
runs-06001-06100/06100
-
s21-0.pddl
runs-00601-00700/00620
runs-04201-04300/04274
- runs-02401-02500/02447
runs-06101-06200/06101
-
s21-1.pddl
runs-00601-00700/00621
runs-04201-04300/04275
- runs-02401-02500/02448
runs-06101-06200/06102
-
s21-2.pddl
runs-00601-00700/00622
runs-04201-04300/04276
- runs-02401-02500/02449
runs-06101-06200/06103
-
s21-3.pddl
runs-00601-00700/00623
runs-04201-04300/04277
- runs-02401-02500/02450
runs-06101-06200/06104
-
s21-4.pddl
runs-00601-00700/00624
runs-04201-04300/04278
- runs-02401-02500/02451
runs-06101-06200/06105
-
s22-0.pddl
runs-00601-00700/00625
runs-04201-04300/04279
- runs-02401-02500/02452
runs-06101-06200/06106
-
s22-1.pddl
runs-00601-00700/00626
runs-04201-04300/04280
- runs-02401-02500/02453
runs-06101-06200/06107
-
s22-2.pddl
runs-00601-00700/00627
runs-04201-04300/04281
- runs-02401-02500/02454
runs-06101-06200/06108
-
s22-3.pddl
runs-00601-00700/00628
runs-04201-04300/04282
- runs-02401-02500/02455
runs-06101-06200/06109
-
s22-4.pddl
runs-00601-00700/00629
runs-04201-04300/04283
- runs-02401-02500/02456
runs-06101-06200/06110
-
s23-0.pddl
runs-00601-00700/00630
runs-04201-04300/04284
- runs-02401-02500/02457
runs-06101-06200/06111
-
s23-1.pddl
runs-00601-00700/00631
runs-04201-04300/04285
- runs-02401-02500/02458
runs-06101-06200/06112
-
s23-2.pddl
runs-00601-00700/00632
runs-04201-04300/04286
- runs-02401-02500/02459
runs-06101-06200/06113
-
s23-3.pddl
runs-00601-00700/00633
runs-04201-04300/04287
- runs-02401-02500/02460
runs-06101-06200/06114
-
s23-4.pddl
runs-00601-00700/00634
runs-04201-04300/04288
- runs-02401-02500/02461
runs-06101-06200/06115
-
s24-0.pddl
runs-00601-00700/00635
runs-04201-04300/04289
- runs-02401-02500/02462
runs-06101-06200/06116
-
s24-1.pddl
runs-00601-00700/00636
runs-04201-04300/04290
- runs-02401-02500/02463
runs-06101-06200/06117
-
s24-2.pddl
runs-00601-00700/00637
runs-04201-04300/04291
- runs-02401-02500/02464
runs-06101-06200/06118
-
s24-3.pddl
runs-00601-00700/00638
runs-04201-04300/04292
- runs-02401-02500/02465
runs-06101-06200/06119
-
s24-4.pddl
runs-00601-00700/00639
runs-04201-04300/04293
- runs-02401-02500/02466
runs-06101-06200/06120
-
s25-0.pddl
runs-00601-00700/00640
runs-04201-04300/04294
- runs-02401-02500/02467
runs-06101-06200/06121
-
s25-1.pddl
runs-00601-00700/00641
runs-04201-04300/04295
- runs-02401-02500/02468
runs-06101-06200/06122
-
s25-2.pddl
runs-00601-00700/00642
runs-04201-04300/04296
- runs-02401-02500/02469
runs-06101-06200/06123
-
s25-3.pddl
runs-00601-00700/00643
runs-04201-04300/04297
- runs-02401-02500/02470
runs-06101-06200/06124
-
s25-4.pddl
runs-00601-00700/00644
runs-04201-04300/04298
- runs-02401-02500/02471
runs-06101-06200/06125
-
s26-0.pddl
runs-00601-00700/00645
runs-04201-04300/04299
- runs-02401-02500/02472
runs-06101-06200/06126
-
s26-1.pddl
runs-00601-00700/00646
runs-04201-04300/04300
- runs-02401-02500/02473
runs-06101-06200/06127
-
s26-2.pddl
runs-00601-00700/00647
runs-04301-04400/04301
- runs-02401-02500/02474
runs-06101-06200/06128
-
s26-3.pddl
runs-00601-00700/00648
runs-04301-04400/04302
- runs-02401-02500/02475
runs-06101-06200/06129
-
s26-4.pddl
runs-00601-00700/00649
runs-04301-04400/04303
- runs-02401-02500/02476
runs-06101-06200/06130
-
s27-0.pddl
runs-00601-00700/00650
runs-04301-04400/04304
- runs-02401-02500/02477
runs-06101-06200/06131
-
s27-1.pddl
runs-00601-00700/00651
runs-04301-04400/04305
- runs-02401-02500/02478
runs-06101-06200/06132
-
s27-2.pddl
runs-00601-00700/00652
runs-04301-04400/04306
- runs-02401-02500/02479
runs-06101-06200/06133
-
s27-3.pddl
runs-00601-00700/00653
runs-04301-04400/04307
- runs-02401-02500/02480
runs-06101-06200/06134
-
s27-4.pddl
runs-00601-00700/00654
runs-04301-04400/04308
- runs-02401-02500/02481
runs-06101-06200/06135
-
s28-0.pddl
runs-00601-00700/00655
runs-04301-04400/04309
- runs-02401-02500/02482
runs-06101-06200/06136
-
s28-1.pddl
runs-00601-00700/00656
runs-04301-04400/04310
- runs-02401-02500/02483
runs-06101-06200/06137
-
s28-2.pddl
runs-00601-00700/00657
runs-04301-04400/04311
- runs-02401-02500/02484
runs-06101-06200/06138
-
s28-3.pddl
runs-00601-00700/00658
runs-04301-04400/04312
- runs-02401-02500/02485
runs-06101-06200/06139
-
s28-4.pddl
runs-00601-00700/00659
runs-04301-04400/04313
- runs-02401-02500/02486
runs-06101-06200/06140
-
s29-0.pddl
runs-00601-00700/00660
runs-04301-04400/04314
- runs-02401-02500/02487
runs-06101-06200/06141
-
s29-1.pddl
runs-00601-00700/00661
runs-04301-04400/04315
- runs-02401-02500/02488
runs-06101-06200/06142
-
s29-2.pddl
runs-00601-00700/00662
runs-04301-04400/04316
- runs-02401-02500/02489
runs-06101-06200/06143
-
s29-3.pddl
runs-00601-00700/00663
runs-04301-04400/04317
- runs-02401-02500/02490
runs-06101-06200/06144
-
s29-4.pddl
runs-00601-00700/00664
runs-04301-04400/04318
- runs-02401-02500/02491
runs-06101-06200/06145
-
s30-0.pddl
runs-00601-00700/00665
runs-04301-04400/04319
- runs-02401-02500/02492
runs-06101-06200/06146
-
s30-1.pddl
runs-00601-00700/00666
runs-04301-04400/04320
- runs-02401-02500/02493
runs-06101-06200/06147
-
s30-2.pddl
runs-00601-00700/00667
runs-04301-04400/04321
- runs-02401-02500/02494
runs-06101-06200/06148
-
s30-3.pddl
runs-00601-00700/00668
runs-04301-04400/04322
- runs-02401-02500/02495
runs-06101-06200/06149
-
s30-4.pddl
runs-00601-00700/00669
runs-04301-04400/04323
- runs-02401-02500/02496
runs-06101-06200/06150
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
movie
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
runs-00601-00700/00670
runs-04301-04400/04324
- runs-02401-02500/02497
runs-06101-06200/06151
-
prob02.pddl
runs-00601-00700/00671
runs-04301-04400/04325
- runs-02401-02500/02498
runs-06101-06200/06152
-
prob03.pddl
runs-00601-00700/00672
runs-04301-04400/04326
- runs-02401-02500/02499
runs-06101-06200/06153
-
prob04.pddl
runs-00601-00700/00673
runs-04301-04400/04327
- runs-02401-02500/02500
runs-06101-06200/06154
-
prob05.pddl
runs-00601-00700/00674
runs-04301-04400/04328
- runs-02501-02600/02501
runs-06101-06200/06155
-
prob06.pddl
runs-00601-00700/00675
runs-04301-04400/04329
- runs-02501-02600/02502
runs-06101-06200/06156
-
prob07.pddl
runs-00601-00700/00676
runs-04301-04400/04330
- runs-02501-02600/02503
runs-06101-06200/06157
-
prob08.pddl
runs-00601-00700/00677
runs-04301-04400/04331
- runs-02501-02600/02504
runs-06101-06200/06158
-
prob09.pddl
runs-00601-00700/00678
runs-04301-04400/04332
- runs-02501-02600/02505
runs-06101-06200/06159
-
prob10.pddl
runs-00601-00700/00679
runs-04301-04400/04333
- runs-02501-02600/02506
runs-06101-06200/06160
-
prob11.pddl
runs-00601-00700/00680
runs-04301-04400/04334
- runs-02501-02600/02507
runs-06101-06200/06161
-
prob12.pddl
runs-00601-00700/00681
runs-04301-04400/04335
- runs-02501-02600/02508
runs-06101-06200/06162
-
prob13.pddl
runs-00601-00700/00682
runs-04301-04400/04336
- runs-02501-02600/02509
runs-06101-06200/06163
-
prob14.pddl
runs-00601-00700/00683
runs-04301-04400/04337
- runs-02501-02600/02510
runs-06101-06200/06164
-
prob15.pddl
runs-00601-00700/00684
runs-04301-04400/04338
- runs-02501-02600/02511
runs-06101-06200/06165
-
prob16.pddl
runs-00601-00700/00685
runs-04301-04400/04339
- runs-02501-02600/02512
runs-06101-06200/06166
-
prob17.pddl
runs-00601-00700/00686
runs-04301-04400/04340
- runs-02501-02600/02513
runs-06101-06200/06167
-
prob18.pddl
runs-00601-00700/00687
runs-04301-04400/04341
- runs-02501-02600/02514
runs-06101-06200/06168
-
prob19.pddl
runs-00601-00700/00688
runs-04301-04400/04342
- runs-02501-02600/02515
runs-06101-06200/06169
-
prob20.pddl
runs-00601-00700/00689
runs-04301-04400/04343
- runs-02501-02600/02516
runs-06101-06200/06170
-
prob21.pddl
runs-00601-00700/00690
runs-04301-04400/04344
- runs-02501-02600/02517
runs-06101-06200/06171
-
prob22.pddl
runs-00601-00700/00691
runs-04301-04400/04345
- runs-02501-02600/02518
runs-06101-06200/06172
-
prob23.pddl
runs-00601-00700/00692
runs-04301-04400/04346
- runs-02501-02600/02519
runs-06101-06200/06173
-
prob24.pddl
runs-00601-00700/00693
runs-04301-04400/04347
- runs-02501-02600/02520
runs-06101-06200/06174
-
prob25.pddl
runs-00601-00700/00694
runs-04301-04400/04348
- runs-02501-02600/02521
runs-06101-06200/06175
-
prob26.pddl
runs-00601-00700/00695
runs-04301-04400/04349
- runs-02501-02600/02522
runs-06101-06200/06176
-
prob27.pddl
runs-00601-00700/00696
runs-04301-04400/04350
- runs-02501-02600/02523
runs-06101-06200/06177
-
prob28.pddl
runs-00601-00700/00697
runs-04301-04400/04351
- runs-02501-02600/02524
runs-06101-06200/06178
-
prob29.pddl
runs-00601-00700/00698
runs-04301-04400/04352
- runs-02501-02600/02525
runs-06101-06200/06179
-
prob30.pddl
runs-00601-00700/00699
runs-04301-04400/04353
- runs-02501-02600/02526
runs-06101-06200/06180
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
mprime
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
runs-00601-00700/00700
runs-04301-04400/04354
- runs-02501-02600/02527
runs-06101-06200/06181
-
prob02.pddl
runs-00701-00800/00701
runs-04301-04400/04355
- runs-02501-02600/02528
runs-06101-06200/06182
-
prob03.pddl
runs-00701-00800/00702
runs-04301-04400/04356
- runs-02501-02600/02529
runs-06101-06200/06183
-
prob04.pddl
runs-00701-00800/00703
runs-04301-04400/04357
- runs-02501-02600/02530
runs-06101-06200/06184
-
prob05.pddl
runs-00701-00800/00704
runs-04301-04400/04358
- runs-02501-02600/02531
runs-06101-06200/06185
-
prob06.pddl
runs-00701-00800/00705
runs-04301-04400/04359
- runs-02501-02600/02532
runs-06101-06200/06186
-
prob07.pddl
runs-00701-00800/00706
runs-04301-04400/04360
- runs-02501-02600/02533
runs-06101-06200/06187
-
prob08.pddl
runs-00701-00800/00707
runs-04301-04400/04361
- runs-02501-02600/02534
runs-06101-06200/06188
-
prob09.pddl
runs-00701-00800/00708
runs-04301-04400/04362
- runs-02501-02600/02535
runs-06101-06200/06189
-
prob10.pddl
runs-00701-00800/00709
runs-04301-04400/04363
- runs-02501-02600/02536
runs-06101-06200/06190
-
prob11.pddl
runs-00701-00800/00710
runs-04301-04400/04364
- runs-02501-02600/02537
runs-06101-06200/06191
-
prob12.pddl
runs-00701-00800/00711
runs-04301-04400/04365
- runs-02501-02600/02538
runs-06101-06200/06192
-
prob13.pddl
runs-00701-00800/00712
runs-04301-04400/04366
- runs-02501-02600/02539
runs-06101-06200/06193
-
prob14.pddl
runs-00701-00800/00713
runs-04301-04400/04367
- runs-02501-02600/02540
runs-06101-06200/06194
-
prob15.pddl
runs-00701-00800/00714
runs-04301-04400/04368
- runs-02501-02600/02541
runs-06101-06200/06195
-
prob16.pddl
runs-00701-00800/00715
runs-04301-04400/04369
- runs-02501-02600/02542
runs-06101-06200/06196
-
prob17.pddl
runs-00701-00800/00716
runs-04301-04400/04370
- runs-02501-02600/02543
runs-06101-06200/06197
-
prob18.pddl
runs-00701-00800/00717
runs-04301-04400/04371
- runs-02501-02600/02544
runs-06101-06200/06198
-
prob19.pddl
runs-00701-00800/00718
runs-04301-04400/04372
- runs-02501-02600/02545
runs-06101-06200/06199
-
prob20.pddl
runs-00701-00800/00719
runs-04301-04400/04373
- runs-02501-02600/02546
runs-06101-06200/06200
-
prob21.pddl
runs-00701-00800/00720
runs-04301-04400/04374
- runs-02501-02600/02547
runs-06201-06300/06201
-
prob22.pddl
runs-00701-00800/00721
runs-04301-04400/04375
- runs-02501-02600/02548
runs-06201-06300/06202
-
prob23.pddl
runs-00701-00800/00722
runs-04301-04400/04376
- runs-02501-02600/02549
runs-06201-06300/06203
-
prob24.pddl
runs-00701-00800/00723
runs-04301-04400/04377
- runs-02501-02600/02550
runs-06201-06300/06204
-
prob25.pddl
runs-00701-00800/00724
runs-04301-04400/04378
- runs-02501-02600/02551
runs-06201-06300/06205
-
prob26.pddl
runs-00701-00800/00725
runs-04301-04400/04379
- runs-02501-02600/02552
runs-06201-06300/06206
-
prob27.pddl
runs-00701-00800/00726
runs-04301-04400/04380
- runs-02501-02600/02553
runs-06201-06300/06207
-
prob28.pddl
runs-00701-00800/00727
runs-04301-04400/04381
- runs-02501-02600/02554
runs-06201-06300/06208
-
prob29.pddl
runs-00701-00800/00728
runs-04301-04400/04382
- runs-02501-02600/02555
runs-06201-06300/06209
-
prob30.pddl
runs-00701-00800/00729
runs-04301-04400/04383
- runs-02501-02600/02556
runs-06201-06300/06210
-
prob31.pddl
runs-00701-00800/00730
runs-04301-04400/04384
- runs-02501-02600/02557
runs-06201-06300/06211
-
prob32.pddl
runs-00701-00800/00731
runs-04301-04400/04385
- runs-02501-02600/02558
runs-06201-06300/06212
-
prob33.pddl
runs-00701-00800/00732
runs-04301-04400/04386
- runs-02501-02600/02559
runs-06201-06300/06213
-
prob34.pddl
runs-00701-00800/00733
runs-04301-04400/04387
- runs-02501-02600/02560
runs-06201-06300/06214
-
prob35.pddl
runs-00701-00800/00734
runs-04301-04400/04388
- runs-02501-02600/02561
runs-06201-06300/06215
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
mystery
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
runs-00701-00800/00735
runs-04301-04400/04389
- runs-02501-02600/02562
runs-06201-06300/06216
-
prob02.pddl
runs-00701-00800/00736
runs-04301-04400/04390
- runs-02501-02600/02563
runs-06201-06300/06217
-
prob03.pddl
runs-00701-00800/00737
runs-04301-04400/04391
- runs-02501-02600/02564
runs-06201-06300/06218
-
prob04.pddl
runs-00701-00800/00738
runs-04301-04400/04392
- runs-02501-02600/02565
runs-06201-06300/06219
-
prob05.pddl
runs-00701-00800/00739
runs-04301-04400/04393
- runs-02501-02600/02566
runs-06201-06300/06220
-
prob06.pddl
runs-00701-00800/00740
runs-04301-04400/04394
- runs-02501-02600/02567
runs-06201-06300/06221
-
prob07.pddl
runs-00701-00800/00741
runs-04301-04400/04395
- runs-02501-02600/02568
runs-06201-06300/06222
-
prob08.pddl
runs-00701-00800/00742
runs-04301-04400/04396
- runs-02501-02600/02569
runs-06201-06300/06223
-
prob09.pddl
runs-00701-00800/00743
runs-04301-04400/04397
- runs-02501-02600/02570
runs-06201-06300/06224
-
prob10.pddl
runs-00701-00800/00744
runs-04301-04400/04398
- runs-02501-02600/02571
runs-06201-06300/06225
-
prob11.pddl
runs-00701-00800/00745
runs-04301-04400/04399
- runs-02501-02600/02572
runs-06201-06300/06226
-
prob12.pddl
runs-00701-00800/00746
runs-04301-04400/04400
- runs-02501-02600/02573
runs-06201-06300/06227
-
prob13.pddl
runs-00701-00800/00747
runs-04401-04500/04401
- runs-02501-02600/02574
runs-06201-06300/06228
-
prob14.pddl
runs-00701-00800/00748
runs-04401-04500/04402
- runs-02501-02600/02575
runs-06201-06300/06229
-
prob15.pddl
runs-00701-00800/00749
runs-04401-04500/04403
- runs-02501-02600/02576
runs-06201-06300/06230
-
prob16.pddl
runs-00701-00800/00750
runs-04401-04500/04404
- runs-02501-02600/02577
runs-06201-06300/06231
-
prob17.pddl
runs-00701-00800/00751
runs-04401-04500/04405
- runs-02501-02600/02578
runs-06201-06300/06232
-
prob18.pddl
runs-00701-00800/00752
runs-04401-04500/04406
- runs-02501-02600/02579
runs-06201-06300/06233
-
prob19.pddl
runs-00701-00800/00753
runs-04401-04500/04407
- runs-02501-02600/02580
runs-06201-06300/06234
-
prob20.pddl
runs-00701-00800/00754
runs-04401-04500/04408
- runs-02501-02600/02581
runs-06201-06300/06235
-
prob21.pddl
runs-00701-00800/00755
runs-04401-04500/04409
- runs-02501-02600/02582
runs-06201-06300/06236
-
prob22.pddl
runs-00701-00800/00756
runs-04401-04500/04410
- runs-02501-02600/02583
runs-06201-06300/06237
-
prob23.pddl
runs-00701-00800/00757
runs-04401-04500/04411
- runs-02501-02600/02584
runs-06201-06300/06238
-
prob24.pddl
runs-00701-00800/00758
runs-04401-04500/04412
- runs-02501-02600/02585
runs-06201-06300/06239
-
prob25.pddl
runs-00701-00800/00759
runs-04401-04500/04413
- runs-02501-02600/02586
runs-06201-06300/06240
-
prob26.pddl
runs-00701-00800/00760
runs-04401-04500/04414
- runs-02501-02600/02587
runs-06201-06300/06241
-
prob27.pddl
runs-00701-00800/00761
runs-04401-04500/04415
- runs-02501-02600/02588
runs-06201-06300/06242
-
prob28.pddl
runs-00701-00800/00762
runs-04401-04500/04416
- runs-02501-02600/02589
runs-06201-06300/06243
-
prob29.pddl
runs-00701-00800/00763
runs-04401-04500/04417
- runs-02501-02600/02590
runs-06201-06300/06244
-
prob30.pddl
runs-00701-00800/00764
runs-04401-04500/04418
- runs-02501-02600/02591
runs-06201-06300/06245
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
nomystery-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00701-00800/00765
runs-04401-04500/04419
- runs-02501-02600/02592
runs-06201-06300/06246
-
p02.pddl
runs-00701-00800/00766
runs-04401-04500/04420
- runs-02501-02600/02593
runs-06201-06300/06247
-
p03.pddl
runs-00701-00800/00767
runs-04401-04500/04421
- runs-02501-02600/02594
runs-06201-06300/06248
-
p04.pddl
runs-00701-00800/00768
runs-04401-04500/04422
- runs-02501-02600/02595
runs-06201-06300/06249
-
p05.pddl
runs-00701-00800/00769
runs-04401-04500/04423
- runs-02501-02600/02596
runs-06201-06300/06250
-
p06.pddl
runs-00701-00800/00770
runs-04401-04500/04424
- runs-02501-02600/02597
runs-06201-06300/06251
-
p07.pddl
runs-00701-00800/00771
runs-04401-04500/04425
- runs-02501-02600/02598
runs-06201-06300/06252
-
p08.pddl
runs-00701-00800/00772
runs-04401-04500/04426
- runs-02501-02600/02599
runs-06201-06300/06253
-
p09.pddl
runs-00701-00800/00773
runs-04401-04500/04427
- runs-02501-02600/02600
runs-06201-06300/06254
-
p10.pddl
runs-00701-00800/00774
runs-04401-04500/04428
- runs-02601-02700/02601
runs-06201-06300/06255
-
p11.pddl
runs-00701-00800/00775
runs-04401-04500/04429
- runs-02601-02700/02602
runs-06201-06300/06256
-
p12.pddl
runs-00701-00800/00776
runs-04401-04500/04430
- runs-02601-02700/02603
runs-06201-06300/06257
-
p13.pddl
runs-00701-00800/00777
runs-04401-04500/04431
- runs-02601-02700/02604
runs-06201-06300/06258
-
p14.pddl
runs-00701-00800/00778
runs-04401-04500/04432
- runs-02601-02700/02605
runs-06201-06300/06259
-
p15.pddl
runs-00701-00800/00779
runs-04401-04500/04433
- runs-02601-02700/02606
runs-06201-06300/06260
-
p16.pddl
runs-00701-00800/00780
runs-04401-04500/04434
- runs-02601-02700/02607
runs-06201-06300/06261
-
p17.pddl
runs-00701-00800/00781
runs-04401-04500/04435
- runs-02601-02700/02608
runs-06201-06300/06262
-
p18.pddl
runs-00701-00800/00782
runs-04401-04500/04436
- runs-02601-02700/02609
runs-06201-06300/06263
-
p19.pddl
runs-00701-00800/00783
runs-04401-04500/04437
- runs-02601-02700/02610
runs-06201-06300/06264
-
p20.pddl
runs-00701-00800/00784
runs-04401-04500/04438
- runs-02601-02700/02611
runs-06201-06300/06265
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
openstacks-opt08-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00701-00800/00785
runs-04401-04500/04439
- runs-02601-02700/02612
runs-06201-06300/06266
-
p02.pddl
runs-00701-00800/00786
runs-04401-04500/04440
- runs-02601-02700/02613
runs-06201-06300/06267
-
p03.pddl
runs-00701-00800/00787
runs-04401-04500/04441
- runs-02601-02700/02614
runs-06201-06300/06268
-
p04.pddl
runs-00701-00800/00788
runs-04401-04500/04442
- runs-02601-02700/02615
runs-06201-06300/06269
-
p05.pddl
runs-00701-00800/00789
runs-04401-04500/04443
- runs-02601-02700/02616
runs-06201-06300/06270
-
p06.pddl
runs-00701-00800/00790
runs-04401-04500/04444
- runs-02601-02700/02617
runs-06201-06300/06271
-
p07.pddl
runs-00701-00800/00791
runs-04401-04500/04445
- runs-02601-02700/02618
runs-06201-06300/06272
-
p08.pddl
runs-00701-00800/00792
runs-04401-04500/04446
- runs-02601-02700/02619
runs-06201-06300/06273
-
p09.pddl
runs-00701-00800/00793
runs-04401-04500/04447
- runs-02601-02700/02620
runs-06201-06300/06274
-
p10.pddl
runs-00701-00800/00794
runs-04401-04500/04448
- runs-02601-02700/02621
runs-06201-06300/06275
-
p11.pddl
runs-00701-00800/00795
runs-04401-04500/04449
- runs-02601-02700/02622
runs-06201-06300/06276
-
p12.pddl
runs-00701-00800/00796
runs-04401-04500/04450
- runs-02601-02700/02623
runs-06201-06300/06277
-
p13.pddl
runs-00701-00800/00797
runs-04401-04500/04451
- runs-02601-02700/02624
runs-06201-06300/06278
-
p14.pddl
runs-00701-00800/00798
runs-04401-04500/04452
- runs-02601-02700/02625
runs-06201-06300/06279
-
p15.pddl
runs-00701-00800/00799
runs-04401-04500/04453
- runs-02601-02700/02626
runs-06201-06300/06280
-
p16.pddl
runs-00701-00800/00800
runs-04401-04500/04454
- runs-02601-02700/02627
runs-06201-06300/06281
-
p17.pddl
runs-00801-00900/00801
runs-04401-04500/04455
- runs-02601-02700/02628
runs-06201-06300/06282
-
p18.pddl
runs-00801-00900/00802
runs-04401-04500/04456
- runs-02601-02700/02629
runs-06201-06300/06283
-
p19.pddl
runs-00801-00900/00803
runs-04401-04500/04457
- runs-02601-02700/02630
runs-06201-06300/06284
-
p20.pddl
runs-00801-00900/00804
runs-04401-04500/04458
- runs-02601-02700/02631
runs-06201-06300/06285
-
p21.pddl
runs-00801-00900/00805
runs-04401-04500/04459
- runs-02601-02700/02632
runs-06201-06300/06286
-
p22.pddl
runs-00801-00900/00806
runs-04401-04500/04460
- runs-02601-02700/02633
runs-06201-06300/06287
-
p23.pddl
runs-00801-00900/00807
runs-04401-04500/04461
- runs-02601-02700/02634
runs-06201-06300/06288
-
p24.pddl
runs-00801-00900/00808
runs-04401-04500/04462
- runs-02601-02700/02635
runs-06201-06300/06289
-
p25.pddl
runs-00801-00900/00809
runs-04401-04500/04463
- runs-02601-02700/02636
runs-06201-06300/06290
-
p26.pddl
runs-00801-00900/00810
runs-04401-04500/04464
- runs-02601-02700/02637
runs-06201-06300/06291
-
p27.pddl
runs-00801-00900/00811
runs-04401-04500/04465
- runs-02601-02700/02638
runs-06201-06300/06292
-
p28.pddl
runs-00801-00900/00812
runs-04401-04500/04466
- runs-02601-02700/02639
runs-06201-06300/06293
-
p29.pddl
runs-00801-00900/00813
runs-04401-04500/04467
- runs-02601-02700/02640
runs-06201-06300/06294
-
p30.pddl
runs-00801-00900/00814
runs-04401-04500/04468
- runs-02601-02700/02641
runs-06201-06300/06295
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
openstacks-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00801-00900/00815
runs-04401-04500/04469
- runs-02601-02700/02642
runs-06201-06300/06296
-
p02.pddl
runs-00801-00900/00816
runs-04401-04500/04470
- runs-02601-02700/02643
runs-06201-06300/06297
-
p03.pddl
runs-00801-00900/00817
runs-04401-04500/04471
- runs-02601-02700/02644
runs-06201-06300/06298
-
p04.pddl
runs-00801-00900/00818
runs-04401-04500/04472
- runs-02601-02700/02645
runs-06201-06300/06299
-
p05.pddl
runs-00801-00900/00819
runs-04401-04500/04473
- runs-02601-02700/02646
runs-06201-06300/06300
-
p06.pddl
runs-00801-00900/00820
runs-04401-04500/04474
- runs-02601-02700/02647
runs-06301-06400/06301
-
p07.pddl
runs-00801-00900/00821
runs-04401-04500/04475
- runs-02601-02700/02648
runs-06301-06400/06302
-
p08.pddl
runs-00801-00900/00822
runs-04401-04500/04476
- runs-02601-02700/02649
runs-06301-06400/06303
-
p09.pddl
runs-00801-00900/00823
runs-04401-04500/04477
- runs-02601-02700/02650
runs-06301-06400/06304
-
p10.pddl
runs-00801-00900/00824
runs-04401-04500/04478
- runs-02601-02700/02651
runs-06301-06400/06305
-
p11.pddl
runs-00801-00900/00825
runs-04401-04500/04479
- runs-02601-02700/02652
runs-06301-06400/06306
-
p12.pddl
runs-00801-00900/00826
runs-04401-04500/04480
- runs-02601-02700/02653
runs-06301-06400/06307
-
p13.pddl
runs-00801-00900/00827
runs-04401-04500/04481
- runs-02601-02700/02654
runs-06301-06400/06308
-
p14.pddl
runs-00801-00900/00828
runs-04401-04500/04482
- runs-02601-02700/02655
runs-06301-06400/06309
-
p15.pddl
runs-00801-00900/00829
runs-04401-04500/04483
- runs-02601-02700/02656
runs-06301-06400/06310
-
p16.pddl
runs-00801-00900/00830
runs-04401-04500/04484
- runs-02601-02700/02657
runs-06301-06400/06311
-
p17.pddl
runs-00801-00900/00831
runs-04401-04500/04485
- runs-02601-02700/02658
runs-06301-06400/06312
-
p18.pddl
runs-00801-00900/00832
runs-04401-04500/04486
- runs-02601-02700/02659
runs-06301-06400/06313
-
p19.pddl
runs-00801-00900/00833
runs-04401-04500/04487
- runs-02601-02700/02660
runs-06301-06400/06314
-
p20.pddl
runs-00801-00900/00834
runs-04401-04500/04488
- runs-02601-02700/02661
runs-06301-06400/06315
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
openstacks-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
runs-00801-00900/00835
runs-04401-04500/04489
- runs-02601-02700/02662
runs-06301-06400/06316
-
p20_2.pddl
runs-00801-00900/00836
runs-04401-04500/04490
- runs-02601-02700/02663
runs-06301-06400/06317
-
p20_3.pddl
runs-00801-00900/00837
runs-04401-04500/04491
- runs-02601-02700/02664
runs-06301-06400/06318
-
p25_1.pddl
runs-00801-00900/00838
runs-04401-04500/04492
- runs-02601-02700/02665
runs-06301-06400/06319
-
p25_3.pddl
runs-00801-00900/00839
runs-04401-04500/04493
- runs-02601-02700/02666
runs-06301-06400/06320
-
p30_1.pddl
runs-00801-00900/00840
runs-04401-04500/04494
- runs-02601-02700/02667
runs-06301-06400/06321
-
p30_2.pddl
runs-00801-00900/00841
runs-04401-04500/04495
- runs-02601-02700/02668
runs-06301-06400/06322
-
p30_3.pddl
runs-00801-00900/00842
runs-04401-04500/04496
- runs-02601-02700/02669
runs-06301-06400/06323
-
p35_1.pddl
runs-00801-00900/00843
runs-04401-04500/04497
- runs-02601-02700/02670
runs-06301-06400/06324
-
p35_2.pddl
runs-00801-00900/00844
runs-04401-04500/04498
- runs-02601-02700/02671
runs-06301-06400/06325
-
p35_3.pddl
runs-00801-00900/00845
runs-04401-04500/04499
- runs-02601-02700/02672
runs-06301-06400/06326
-
p40_1.pddl
runs-00801-00900/00846
runs-04401-04500/04500
- runs-02601-02700/02673
runs-06301-06400/06327
-
p40_2.pddl
runs-00801-00900/00847
runs-04501-04600/04501
- runs-02601-02700/02674
runs-06301-06400/06328
-
p40_3.pddl
runs-00801-00900/00848
runs-04501-04600/04502
- runs-02601-02700/02675
runs-06301-06400/06329
-
p45_1.pddl
runs-00801-00900/00849
runs-04501-04600/04503
- runs-02601-02700/02676
runs-06301-06400/06330
-
p45_2.pddl
runs-00801-00900/00850
runs-04501-04600/04504
- runs-02601-02700/02677
runs-06301-06400/06331
-
p45_3.pddl
runs-00801-00900/00851
runs-04501-04600/04505
- runs-02601-02700/02678
runs-06301-06400/06332
-
p50_1.pddl
runs-00801-00900/00852
runs-04501-04600/04506
- runs-02601-02700/02679
runs-06301-06400/06333
-
p50_2.pddl
runs-00801-00900/00853
runs-04501-04600/04507
- runs-02601-02700/02680
runs-06301-06400/06334
-
p50_3.pddl
runs-00801-00900/00854
runs-04501-04600/04508
- runs-02601-02700/02681
runs-06301-06400/06335
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
openstacks-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00801-00900/00855
runs-04501-04600/04509
- runs-02601-02700/02682
runs-06301-06400/06336
-
p02.pddl
runs-00801-00900/00856
runs-04501-04600/04510
- runs-02601-02700/02683
runs-06301-06400/06337
-
p03.pddl
runs-00801-00900/00857
runs-04501-04600/04511
- runs-02601-02700/02684
runs-06301-06400/06338
-
p04.pddl
runs-00801-00900/00858
runs-04501-04600/04512
- runs-02601-02700/02685
runs-06301-06400/06339
-
p05.pddl
runs-00801-00900/00859
runs-04501-04600/04513
- runs-02601-02700/02686
runs-06301-06400/06340
-
p06.pddl
runs-00801-00900/00860
runs-04501-04600/04514
- runs-02601-02700/02687
runs-06301-06400/06341
-
p07.pddl
runs-00801-00900/00861
runs-04501-04600/04515
- runs-02601-02700/02688
runs-06301-06400/06342
-
p08.pddl
runs-00801-00900/00862
runs-04501-04600/04516
- runs-02601-02700/02689
runs-06301-06400/06343
-
p09.pddl
runs-00801-00900/00863
runs-04501-04600/04517
- runs-02601-02700/02690
runs-06301-06400/06344
-
p10.pddl
runs-00801-00900/00864
runs-04501-04600/04518
- runs-02601-02700/02691
runs-06301-06400/06345
-
p11.pddl
runs-00801-00900/00865
runs-04501-04600/04519
- runs-02601-02700/02692
runs-06301-06400/06346
-
p12.pddl
runs-00801-00900/00866
runs-04501-04600/04520
- runs-02601-02700/02693
runs-06301-06400/06347
-
p13.pddl
runs-00801-00900/00867
runs-04501-04600/04521
- runs-02601-02700/02694
runs-06301-06400/06348
-
p14.pddl
runs-00801-00900/00868
runs-04501-04600/04522
- runs-02601-02700/02695
runs-06301-06400/06349
-
p15.pddl
runs-00801-00900/00869
runs-04501-04600/04523
- runs-02601-02700/02696
runs-06301-06400/06350
-
p16.pddl
runs-00801-00900/00870
runs-04501-04600/04524
- runs-02601-02700/02697
runs-06301-06400/06351
-
p17.pddl
runs-00801-00900/00871
runs-04501-04600/04525
- runs-02601-02700/02698
runs-06301-06400/06352
-
p18.pddl
runs-00801-00900/00872
runs-04501-04600/04526
- runs-02601-02700/02699
runs-06301-06400/06353
-
p19.pddl
runs-00801-00900/00873
runs-04501-04600/04527
- runs-02601-02700/02700
runs-06301-06400/06354
-
p20.pddl
runs-00801-00900/00874
runs-04501-04600/04528
- runs-02701-02800/02701
runs-06301-06400/06355
-
p21.pddl
runs-00801-00900/00875
runs-04501-04600/04529
- runs-02701-02800/02702
runs-06301-06400/06356
-
p22.pddl
runs-00801-00900/00876
runs-04501-04600/04530
- runs-02701-02800/02703
runs-06301-06400/06357
-
p23.pddl
runs-00801-00900/00877
runs-04501-04600/04531
- runs-02701-02800/02704
runs-06301-06400/06358
-
p24.pddl
runs-00801-00900/00878
runs-04501-04600/04532
- runs-02701-02800/02705
runs-06301-06400/06359
-
p25.pddl
runs-00801-00900/00879
runs-04501-04600/04533
- runs-02701-02800/02706
runs-06301-06400/06360
-
p26.pddl
runs-00801-00900/00880
runs-04501-04600/04534
- runs-02701-02800/02707
runs-06301-06400/06361
-
p27.pddl
runs-00801-00900/00881
runs-04501-04600/04535
- runs-02701-02800/02708
runs-06301-06400/06362
-
p28.pddl
runs-00801-00900/00882
runs-04501-04600/04536
- runs-02701-02800/02709
runs-06301-06400/06363
-
p29.pddl
runs-00801-00900/00883
runs-04501-04600/04537
- runs-02701-02800/02710
runs-06301-06400/06364
-
p30.pddl
runs-00801-00900/00884
runs-04501-04600/04538
- runs-02701-02800/02711
runs-06301-06400/06365
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
organic-synthesis-opt18-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00801-00900/00885
runs-04501-04600/04539
- runs-02701-02800/02712
runs-06301-06400/06366
-
p02.pddl
runs-00801-00900/00886
runs-04501-04600/04540
- runs-02701-02800/02713
runs-06301-06400/06367
-
p03.pddl
runs-00801-00900/00887
runs-04501-04600/04541
- runs-02701-02800/02714
runs-06301-06400/06368
-
p04.pddl
runs-00801-00900/00888
runs-04501-04600/04542
- runs-02701-02800/02715
runs-06301-06400/06369
-
p05.pddl
runs-00801-00900/00889
runs-04501-04600/04543
- runs-02701-02800/02716
runs-06301-06400/06370
-
p06.pddl
runs-00801-00900/00890
runs-04501-04600/04544
- runs-02701-02800/02717
runs-06301-06400/06371
-
p07.pddl
runs-00801-00900/00891
runs-04501-04600/04545
- runs-02701-02800/02718
runs-06301-06400/06372
-
p08.pddl
runs-00801-00900/00892
runs-04501-04600/04546
- runs-02701-02800/02719
runs-06301-06400/06373
-
p09.pddl
runs-00801-00900/00893
runs-04501-04600/04547
- runs-02701-02800/02720
runs-06301-06400/06374
-
p10.pddl
runs-00801-00900/00894
runs-04501-04600/04548
- runs-02701-02800/02721
runs-06301-06400/06375
-
p11.pddl
runs-00801-00900/00895
runs-04501-04600/04549
- runs-02701-02800/02722
runs-06301-06400/06376
-
p12.pddl
runs-00801-00900/00896
runs-04501-04600/04550
- runs-02701-02800/02723
runs-06301-06400/06377
-
p13.pddl
runs-00801-00900/00897
runs-04501-04600/04551
- runs-02701-02800/02724
runs-06301-06400/06378
-
p14.pddl
runs-00801-00900/00898
runs-04501-04600/04552
- runs-02701-02800/02725
runs-06301-06400/06379
-
p15.pddl
runs-00801-00900/00899
runs-04501-04600/04553
- runs-02701-02800/02726
runs-06301-06400/06380
-
p16.pddl
runs-00801-00900/00900
runs-04501-04600/04554
- runs-02701-02800/02727
runs-06301-06400/06381
-
p17.pddl
runs-00901-01000/00901
runs-04501-04600/04555
- runs-02701-02800/02728
runs-06301-06400/06382
-
p18.pddl
runs-00901-01000/00902
runs-04501-04600/04556
- runs-02701-02800/02729
runs-06301-06400/06383
-
p19.pddl
runs-00901-01000/00903
runs-04501-04600/04557
- runs-02701-02800/02730
runs-06301-06400/06384
-
p20.pddl
runs-00901-01000/00904
runs-04501-04600/04558
- runs-02701-02800/02731
runs-06301-06400/06385
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
organic-synthesis-split-opt18-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00901-01000/00905
runs-04501-04600/04559
- runs-02701-02800/02732
runs-06301-06400/06386
-
p02.pddl
runs-00901-01000/00906
runs-04501-04600/04560
- runs-02701-02800/02733
runs-06301-06400/06387
-
p03.pddl
runs-00901-01000/00907
runs-04501-04600/04561
- runs-02701-02800/02734
runs-06301-06400/06388
-
p04.pddl
runs-00901-01000/00908
runs-04501-04600/04562
- runs-02701-02800/02735
runs-06301-06400/06389
-
p05.pddl
runs-00901-01000/00909
runs-04501-04600/04563
- runs-02701-02800/02736
runs-06301-06400/06390
-
p06.pddl
runs-00901-01000/00910
runs-04501-04600/04564
- runs-02701-02800/02737
runs-06301-06400/06391
-
p07.pddl
runs-00901-01000/00911
runs-04501-04600/04565
- runs-02701-02800/02738
runs-06301-06400/06392
-
p08.pddl
runs-00901-01000/00912
runs-04501-04600/04566
- runs-02701-02800/02739
runs-06301-06400/06393
-
p09.pddl
runs-00901-01000/00913
runs-04501-04600/04567
- runs-02701-02800/02740
runs-06301-06400/06394
-
p10.pddl
runs-00901-01000/00914
runs-04501-04600/04568
- runs-02701-02800/02741
runs-06301-06400/06395
-
p11.pddl
runs-00901-01000/00915
runs-04501-04600/04569
- runs-02701-02800/02742
runs-06301-06400/06396
-
p12.pddl
runs-00901-01000/00916
runs-04501-04600/04570
- runs-02701-02800/02743
runs-06301-06400/06397
-
p13.pddl
runs-00901-01000/00917
runs-04501-04600/04571
- runs-02701-02800/02744
runs-06301-06400/06398
-
p14.pddl
runs-00901-01000/00918
runs-04501-04600/04572
- runs-02701-02800/02745
runs-06301-06400/06399
-
p15.pddl
runs-00901-01000/00919
runs-04501-04600/04573
- runs-02701-02800/02746
runs-06301-06400/06400
-
p16.pddl
runs-00901-01000/00920
runs-04501-04600/04574
- runs-02701-02800/02747
runs-06401-06500/06401
-
p17.pddl
runs-00901-01000/00921
runs-04501-04600/04575
- runs-02701-02800/02748
runs-06401-06500/06402
-
p18.pddl
runs-00901-01000/00922
runs-04501-04600/04576
- runs-02701-02800/02749
runs-06401-06500/06403
-
p19.pddl
runs-00901-01000/00923
runs-04501-04600/04577
- runs-02701-02800/02750
runs-06401-06500/06404
-
p20.pddl
runs-00901-01000/00924
runs-04501-04600/04578
- runs-02701-02800/02751
runs-06401-06500/06405
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
parcprinter-08-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00901-01000/00925
runs-04501-04600/04579
- runs-02701-02800/02752
runs-06401-06500/06406
-
p02.pddl
runs-00901-01000/00926
runs-04501-04600/04580
- runs-02701-02800/02753
runs-06401-06500/06407
-
p03.pddl
runs-00901-01000/00927
runs-04501-04600/04581
- runs-02701-02800/02754
runs-06401-06500/06408
-
p04.pddl
runs-00901-01000/00928
runs-04501-04600/04582
- runs-02701-02800/02755
runs-06401-06500/06409
-
p05.pddl
runs-00901-01000/00929
runs-04501-04600/04583
- runs-02701-02800/02756
runs-06401-06500/06410
-
p06.pddl
runs-00901-01000/00930
runs-04501-04600/04584
- runs-02701-02800/02757
runs-06401-06500/06411
-
p07.pddl
runs-00901-01000/00931
runs-04501-04600/04585
- runs-02701-02800/02758
runs-06401-06500/06412
-
p08.pddl
runs-00901-01000/00932
runs-04501-04600/04586
- runs-02701-02800/02759
runs-06401-06500/06413
-
p09.pddl
runs-00901-01000/00933
runs-04501-04600/04587
- runs-02701-02800/02760
runs-06401-06500/06414
-
p10.pddl
runs-00901-01000/00934
runs-04501-04600/04588
- runs-02701-02800/02761
runs-06401-06500/06415
-
p11.pddl
runs-00901-01000/00935
runs-04501-04600/04589
- runs-02701-02800/02762
runs-06401-06500/06416
-
p12.pddl
runs-00901-01000/00936
runs-04501-04600/04590
- runs-02701-02800/02763
runs-06401-06500/06417
-
p13.pddl
runs-00901-01000/00937
runs-04501-04600/04591
- runs-02701-02800/02764
runs-06401-06500/06418
-
p14.pddl
runs-00901-01000/00938
runs-04501-04600/04592
- runs-02701-02800/02765
runs-06401-06500/06419
-
p15.pddl
runs-00901-01000/00939
runs-04501-04600/04593
- runs-02701-02800/02766
runs-06401-06500/06420
-
p16.pddl
runs-00901-01000/00940
runs-04501-04600/04594
- runs-02701-02800/02767
runs-06401-06500/06421
-
p17.pddl
runs-00901-01000/00941
runs-04501-04600/04595
- runs-02701-02800/02768
runs-06401-06500/06422
-
p18.pddl
runs-00901-01000/00942
runs-04501-04600/04596
- runs-02701-02800/02769
runs-06401-06500/06423
-
p19.pddl
runs-00901-01000/00943
runs-04501-04600/04597
- runs-02701-02800/02770
runs-06401-06500/06424
-
p20.pddl
runs-00901-01000/00944
runs-04501-04600/04598
- runs-02701-02800/02771
runs-06401-06500/06425
-
p21.pddl
runs-00901-01000/00945
runs-04501-04600/04599
- runs-02701-02800/02772
runs-06401-06500/06426
-
p22.pddl
runs-00901-01000/00946
runs-04501-04600/04600
- runs-02701-02800/02773
runs-06401-06500/06427
-
p23.pddl
runs-00901-01000/00947
runs-04601-04700/04601
- runs-02701-02800/02774
runs-06401-06500/06428
-
p24.pddl
runs-00901-01000/00948
runs-04601-04700/04602
- runs-02701-02800/02775
runs-06401-06500/06429
-
p25.pddl
runs-00901-01000/00949
runs-04601-04700/04603
- runs-02701-02800/02776
runs-06401-06500/06430
-
p26.pddl
runs-00901-01000/00950
runs-04601-04700/04604
- runs-02701-02800/02777
runs-06401-06500/06431
-
p27.pddl
runs-00901-01000/00951
runs-04601-04700/04605
- runs-02701-02800/02778
runs-06401-06500/06432
-
p28.pddl
runs-00901-01000/00952
runs-04601-04700/04606
- runs-02701-02800/02779
runs-06401-06500/06433
-
p29.pddl
runs-00901-01000/00953
runs-04601-04700/04607
- runs-02701-02800/02780
runs-06401-06500/06434
-
p30.pddl
runs-00901-01000/00954
runs-04601-04700/04608
- runs-02701-02800/02781
runs-06401-06500/06435
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
parcprinter-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-00901-01000/00955
runs-04601-04700/04609
- runs-02701-02800/02782
runs-06401-06500/06436
-
p02.pddl
runs-00901-01000/00956
runs-04601-04700/04610
- runs-02701-02800/02783
runs-06401-06500/06437
-
p03.pddl
runs-00901-01000/00957
runs-04601-04700/04611
- runs-02701-02800/02784
runs-06401-06500/06438
-
p04.pddl
runs-00901-01000/00958
runs-04601-04700/04612
- runs-02701-02800/02785
runs-06401-06500/06439
-
p05.pddl
runs-00901-01000/00959
runs-04601-04700/04613
- runs-02701-02800/02786
runs-06401-06500/06440
-
p06.pddl
runs-00901-01000/00960
runs-04601-04700/04614
- runs-02701-02800/02787
runs-06401-06500/06441
-
p07.pddl
runs-00901-01000/00961
runs-04601-04700/04615
- runs-02701-02800/02788
runs-06401-06500/06442
-
p08.pddl
runs-00901-01000/00962
runs-04601-04700/04616
- runs-02701-02800/02789
runs-06401-06500/06443
-
p09.pddl
runs-00901-01000/00963
runs-04601-04700/04617
- runs-02701-02800/02790
runs-06401-06500/06444
-
p10.pddl
runs-00901-01000/00964
runs-04601-04700/04618
- runs-02701-02800/02791
runs-06401-06500/06445
-
p11.pddl
runs-00901-01000/00965
runs-04601-04700/04619
- runs-02701-02800/02792
runs-06401-06500/06446
-
p12.pddl
runs-00901-01000/00966
runs-04601-04700/04620
- runs-02701-02800/02793
runs-06401-06500/06447
-
p13.pddl
runs-00901-01000/00967
runs-04601-04700/04621
- runs-02701-02800/02794
runs-06401-06500/06448
-
p14.pddl
runs-00901-01000/00968
runs-04601-04700/04622
- runs-02701-02800/02795
runs-06401-06500/06449
-
p15.pddl
runs-00901-01000/00969
runs-04601-04700/04623
- runs-02701-02800/02796
runs-06401-06500/06450
-
p16.pddl
runs-00901-01000/00970
runs-04601-04700/04624
- runs-02701-02800/02797
runs-06401-06500/06451
-
p17.pddl
runs-00901-01000/00971
runs-04601-04700/04625
- runs-02701-02800/02798
runs-06401-06500/06452
-
p18.pddl
runs-00901-01000/00972
runs-04601-04700/04626
- runs-02701-02800/02799
runs-06401-06500/06453
-
p19.pddl
runs-00901-01000/00973
runs-04601-04700/04627
- runs-02701-02800/02800
runs-06401-06500/06454
-
p20.pddl
runs-00901-01000/00974
runs-04601-04700/04628
- runs-02801-02900/02801
runs-06401-06500/06455
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
parking-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
runs-00901-01000/00975
runs-04601-04700/04629
- runs-02801-02900/02802
runs-06401-06500/06456
-
pfile03-012.pddl
runs-00901-01000/00976
runs-04601-04700/04630
- runs-02801-02900/02803
runs-06401-06500/06457
-
pfile04-013.pddl
runs-00901-01000/00977
runs-04601-04700/04631
- runs-02801-02900/02804
runs-06401-06500/06458
-
pfile04-014.pddl
runs-00901-01000/00978
runs-04601-04700/04632
- runs-02801-02900/02805
runs-06401-06500/06459
-
pfile04-015.pddl
runs-00901-01000/00979
runs-04601-04700/04633
- runs-02801-02900/02806
runs-06401-06500/06460
-
pfile04-016.pddl
runs-00901-01000/00980
runs-04601-04700/04634
- runs-02801-02900/02807
runs-06401-06500/06461
-
pfile05-017.pddl
runs-00901-01000/00981
runs-04601-04700/04635
- runs-02801-02900/02808
runs-06401-06500/06462
-
pfile05-018.pddl
runs-00901-01000/00982
runs-04601-04700/04636
- runs-02801-02900/02809
runs-06401-06500/06463
-
pfile05-019.pddl
runs-00901-01000/00983
runs-04601-04700/04637
- runs-02801-02900/02810
runs-06401-06500/06464
-
pfile05-020.pddl
runs-00901-01000/00984
runs-04601-04700/04638
- runs-02801-02900/02811
runs-06401-06500/06465
-
pfile06-021.pddl
runs-00901-01000/00985
runs-04601-04700/04639
- runs-02801-02900/02812
runs-06401-06500/06466
-
pfile06-022.pddl
runs-00901-01000/00986
runs-04601-04700/04640
- runs-02801-02900/02813
runs-06401-06500/06467
-
pfile06-023.pddl
runs-00901-01000/00987
runs-04601-04700/04641
- runs-02801-02900/02814
runs-06401-06500/06468
-
pfile06-024.pddl
runs-00901-01000/00988
runs-04601-04700/04642
- runs-02801-02900/02815
runs-06401-06500/06469
-
pfile07-025.pddl
runs-00901-01000/00989
runs-04601-04700/04643
- runs-02801-02900/02816
runs-06401-06500/06470
-
pfile07-026.pddl
runs-00901-01000/00990
runs-04601-04700/04644
- runs-02801-02900/02817
runs-06401-06500/06471
-
pfile07-027.pddl
runs-00901-01000/00991
runs-04601-04700/04645
- runs-02801-02900/02818
runs-06401-06500/06472
-
pfile07-028.pddl
runs-00901-01000/00992
runs-04601-04700/04646
- runs-02801-02900/02819
runs-06401-06500/06473
-
pfile08-029.pddl
runs-00901-01000/00993
runs-04601-04700/04647
- runs-02801-02900/02820
runs-06401-06500/06474
-
pfile08-030.pddl
runs-00901-01000/00994
runs-04601-04700/04648
- runs-02801-02900/02821
runs-06401-06500/06475
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
parking-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
runs-00901-01000/00995
runs-04601-04700/04649
- runs-02801-02900/02822
runs-06401-06500/06476
-
p_12_7-02.pddl
runs-00901-01000/00996
runs-04601-04700/04650
- runs-02801-02900/02823
runs-06401-06500/06477
-
p_12_7-03.pddl
runs-00901-01000/00997
runs-04601-04700/04651
- runs-02801-02900/02824
runs-06401-06500/06478
-
p_12_7-04.pddl
runs-00901-01000/00998
runs-04601-04700/04652
- runs-02801-02900/02825
runs-06401-06500/06479
-
p_14_8-01.pddl
runs-00901-01000/00999
runs-04601-04700/04653
- runs-02801-02900/02826
runs-06401-06500/06480
-
p_14_8-02.pddl
runs-00901-01000/01000
runs-04601-04700/04654
- runs-02801-02900/02827
runs-06401-06500/06481
-
p_14_8-03.pddl
runs-01001-01100/01001
runs-04601-04700/04655
- runs-02801-02900/02828
runs-06401-06500/06482
-
p_14_8-04.pddl
runs-01001-01100/01002
runs-04601-04700/04656
- runs-02801-02900/02829
runs-06401-06500/06483
-
p_16_9-01.pddl
runs-01001-01100/01003
runs-04601-04700/04657
- runs-02801-02900/02830
runs-06401-06500/06484
-
p_16_9-02.pddl
runs-01001-01100/01004
runs-04601-04700/04658
- runs-02801-02900/02831
runs-06401-06500/06485
-
p_16_9-03.pddl
runs-01001-01100/01005
runs-04601-04700/04659
- runs-02801-02900/02832
runs-06401-06500/06486
-
p_16_9-04.pddl
runs-01001-01100/01006
runs-04601-04700/04660
- runs-02801-02900/02833
runs-06401-06500/06487
-
p_18_10-01.pddl
runs-01001-01100/01007
runs-04601-04700/04661
- runs-02801-02900/02834
runs-06401-06500/06488
-
p_18_10-02.pddl
runs-01001-01100/01008
runs-04601-04700/04662
- runs-02801-02900/02835
runs-06401-06500/06489
-
p_18_10-03.pddl
runs-01001-01100/01009
runs-04601-04700/04663
- runs-02801-02900/02836
runs-06401-06500/06490
-
p_18_10-04.pddl
runs-01001-01100/01010
runs-04601-04700/04664
- runs-02801-02900/02837
runs-06401-06500/06491
-
p_20_11-01.pddl
runs-01001-01100/01011
runs-04601-04700/04665
- runs-02801-02900/02838
runs-06401-06500/06492
-
p_20_11-02.pddl
runs-01001-01100/01012
runs-04601-04700/04666
- runs-02801-02900/02839
runs-06401-06500/06493
-
p_20_11-03.pddl
runs-01001-01100/01013
runs-04601-04700/04667
- runs-02801-02900/02840
runs-06401-06500/06494
-
p_20_11-04.pddl
runs-01001-01100/01014
runs-04601-04700/04668
- runs-02801-02900/02841
runs-06401-06500/06495
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
pathways-noneg
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01001-01100/01015
runs-04601-04700/04669
- runs-02801-02900/02842
runs-06401-06500/06496
-
p02.pddl
runs-01001-01100/01016
runs-04601-04700/04670
- runs-02801-02900/02843
runs-06401-06500/06497
-
p03.pddl
runs-01001-01100/01017
runs-04601-04700/04671
- runs-02801-02900/02844
runs-06401-06500/06498
-
p04.pddl
runs-01001-01100/01018
runs-04601-04700/04672
- runs-02801-02900/02845
runs-06401-06500/06499
-
p05.pddl
runs-01001-01100/01019
runs-04601-04700/04673
- runs-02801-02900/02846
runs-06401-06500/06500
-
p06.pddl
runs-01001-01100/01020
runs-04601-04700/04674
- runs-02801-02900/02847
runs-06501-06600/06501
-
p07.pddl
runs-01001-01100/01021
runs-04601-04700/04675
- runs-02801-02900/02848
runs-06501-06600/06502
-
p08.pddl
runs-01001-01100/01022
runs-04601-04700/04676
- runs-02801-02900/02849
runs-06501-06600/06503
-
p09.pddl
runs-01001-01100/01023
runs-04601-04700/04677
- runs-02801-02900/02850
runs-06501-06600/06504
-
p10.pddl
runs-01001-01100/01024
runs-04601-04700/04678
- runs-02801-02900/02851
runs-06501-06600/06505
-
p11.pddl
runs-01001-01100/01025
runs-04601-04700/04679
- runs-02801-02900/02852
runs-06501-06600/06506
-
p12.pddl
runs-01001-01100/01026
runs-04601-04700/04680
- runs-02801-02900/02853
runs-06501-06600/06507
-
p13.pddl
runs-01001-01100/01027
runs-04601-04700/04681
- runs-02801-02900/02854
runs-06501-06600/06508
-
p14.pddl
runs-01001-01100/01028
runs-04601-04700/04682
- runs-02801-02900/02855
runs-06501-06600/06509
-
p15.pddl
runs-01001-01100/01029
runs-04601-04700/04683
- runs-02801-02900/02856
runs-06501-06600/06510
-
p16.pddl
runs-01001-01100/01030
runs-04601-04700/04684
- runs-02801-02900/02857
runs-06501-06600/06511
-
p17.pddl
runs-01001-01100/01031
runs-04601-04700/04685
- runs-02801-02900/02858
runs-06501-06600/06512
-
p18.pddl
runs-01001-01100/01032
runs-04601-04700/04686
- runs-02801-02900/02859
runs-06501-06600/06513
-
p19.pddl
runs-01001-01100/01033
runs-04601-04700/04687
- runs-02801-02900/02860
runs-06501-06600/06514
-
p20.pddl
runs-01001-01100/01034
runs-04601-04700/04688
- runs-02801-02900/02861
runs-06501-06600/06515
-
p21.pddl
runs-01001-01100/01035
runs-04601-04700/04689
- runs-02801-02900/02862
runs-06501-06600/06516
-
p22.pddl
runs-01001-01100/01036
runs-04601-04700/04690
- runs-02801-02900/02863
runs-06501-06600/06517
-
p23.pddl
runs-01001-01100/01037
runs-04601-04700/04691
- runs-02801-02900/02864
runs-06501-06600/06518
-
p24.pddl
runs-01001-01100/01038
runs-04601-04700/04692
- runs-02801-02900/02865
runs-06501-06600/06519
-
p25.pddl
runs-01001-01100/01039
runs-04601-04700/04693
- runs-02801-02900/02866
runs-06501-06600/06520
-
p26.pddl
runs-01001-01100/01040
runs-04601-04700/04694
- runs-02801-02900/02867
runs-06501-06600/06521
-
p27.pddl
runs-01001-01100/01041
runs-04601-04700/04695
- runs-02801-02900/02868
runs-06501-06600/06522
-
p28.pddl
runs-01001-01100/01042
runs-04601-04700/04696
- runs-02801-02900/02869
runs-06501-06600/06523
-
p29.pddl
runs-01001-01100/01043
runs-04601-04700/04697
- runs-02801-02900/02870
runs-06501-06600/06524
-
p30.pddl
runs-01001-01100/01044
runs-04601-04700/04698
- runs-02801-02900/02871
runs-06501-06600/06525
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
pegsol-08-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01001-01100/01045
runs-04601-04700/04699
- runs-02801-02900/02872
runs-06501-06600/06526
-
p02.pddl
runs-01001-01100/01046
runs-04601-04700/04700
- runs-02801-02900/02873
runs-06501-06600/06527
-
p03.pddl
runs-01001-01100/01047
runs-04701-04800/04701
- runs-02801-02900/02874
runs-06501-06600/06528
-
p04.pddl
runs-01001-01100/01048
runs-04701-04800/04702
- runs-02801-02900/02875
runs-06501-06600/06529
-
p05.pddl
runs-01001-01100/01049
runs-04701-04800/04703
- runs-02801-02900/02876
runs-06501-06600/06530
-
p06.pddl
runs-01001-01100/01050
runs-04701-04800/04704
- runs-02801-02900/02877
runs-06501-06600/06531
-
p07.pddl
runs-01001-01100/01051
runs-04701-04800/04705
- runs-02801-02900/02878
runs-06501-06600/06532
-
p08.pddl
runs-01001-01100/01052
runs-04701-04800/04706
- runs-02801-02900/02879
runs-06501-06600/06533
-
p09.pddl
runs-01001-01100/01053
runs-04701-04800/04707
- runs-02801-02900/02880
runs-06501-06600/06534
-
p10.pddl
runs-01001-01100/01054
runs-04701-04800/04708
- runs-02801-02900/02881
runs-06501-06600/06535
-
p11.pddl
runs-01001-01100/01055
runs-04701-04800/04709
- runs-02801-02900/02882
runs-06501-06600/06536
-
p12.pddl
runs-01001-01100/01056
runs-04701-04800/04710
- runs-02801-02900/02883
runs-06501-06600/06537
-
p13.pddl
runs-01001-01100/01057
runs-04701-04800/04711
- runs-02801-02900/02884
runs-06501-06600/06538
-
p14.pddl
runs-01001-01100/01058
runs-04701-04800/04712
- runs-02801-02900/02885
runs-06501-06600/06539
-
p15.pddl
runs-01001-01100/01059
runs-04701-04800/04713
- runs-02801-02900/02886
runs-06501-06600/06540
-
p16.pddl
runs-01001-01100/01060
runs-04701-04800/04714
- runs-02801-02900/02887
runs-06501-06600/06541
-
p17.pddl
runs-01001-01100/01061
runs-04701-04800/04715
- runs-02801-02900/02888
runs-06501-06600/06542
-
p18.pddl
runs-01001-01100/01062
runs-04701-04800/04716
- runs-02801-02900/02889
runs-06501-06600/06543
-
p19.pddl
runs-01001-01100/01063
runs-04701-04800/04717
- runs-02801-02900/02890
runs-06501-06600/06544
-
p20.pddl
runs-01001-01100/01064
runs-04701-04800/04718
- runs-02801-02900/02891
runs-06501-06600/06545
-
p21.pddl
runs-01001-01100/01065
runs-04701-04800/04719
- runs-02801-02900/02892
runs-06501-06600/06546
-
p22.pddl
runs-01001-01100/01066
runs-04701-04800/04720
- runs-02801-02900/02893
runs-06501-06600/06547
-
p23.pddl
runs-01001-01100/01067
runs-04701-04800/04721
- runs-02801-02900/02894
runs-06501-06600/06548
-
p24.pddl
runs-01001-01100/01068
runs-04701-04800/04722
- runs-02801-02900/02895
runs-06501-06600/06549
-
p25.pddl
runs-01001-01100/01069
runs-04701-04800/04723
- runs-02801-02900/02896
runs-06501-06600/06550
-
p26.pddl
runs-01001-01100/01070
runs-04701-04800/04724
- runs-02801-02900/02897
runs-06501-06600/06551
-
p27.pddl
runs-01001-01100/01071
runs-04701-04800/04725
- runs-02801-02900/02898
runs-06501-06600/06552
-
p28.pddl
runs-01001-01100/01072
runs-04701-04800/04726
- runs-02801-02900/02899
runs-06501-06600/06553
-
p29.pddl
runs-01001-01100/01073
runs-04701-04800/04727
- runs-02801-02900/02900
runs-06501-06600/06554
-
p30.pddl
runs-01001-01100/01074
runs-04701-04800/04728
- runs-02901-03000/02901
runs-06501-06600/06555
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
pegsol-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01001-01100/01075
runs-04701-04800/04729
- runs-02901-03000/02902
runs-06501-06600/06556
-
p02.pddl
runs-01001-01100/01076
runs-04701-04800/04730
- runs-02901-03000/02903
runs-06501-06600/06557
-
p03.pddl
runs-01001-01100/01077
runs-04701-04800/04731
- runs-02901-03000/02904
runs-06501-06600/06558
-
p04.pddl
runs-01001-01100/01078
runs-04701-04800/04732
- runs-02901-03000/02905
runs-06501-06600/06559
-
p05.pddl
runs-01001-01100/01079
runs-04701-04800/04733
- runs-02901-03000/02906
runs-06501-06600/06560
-
p06.pddl
runs-01001-01100/01080
runs-04701-04800/04734
- runs-02901-03000/02907
runs-06501-06600/06561
-
p07.pddl
runs-01001-01100/01081
runs-04701-04800/04735
- runs-02901-03000/02908
runs-06501-06600/06562
-
p08.pddl
runs-01001-01100/01082
runs-04701-04800/04736
- runs-02901-03000/02909
runs-06501-06600/06563
-
p09.pddl
runs-01001-01100/01083
runs-04701-04800/04737
- runs-02901-03000/02910
runs-06501-06600/06564
-
p10.pddl
runs-01001-01100/01084
runs-04701-04800/04738
- runs-02901-03000/02911
runs-06501-06600/06565
-
p11.pddl
runs-01001-01100/01085
runs-04701-04800/04739
- runs-02901-03000/02912
runs-06501-06600/06566
-
p12.pddl
runs-01001-01100/01086
runs-04701-04800/04740
- runs-02901-03000/02913
runs-06501-06600/06567
-
p13.pddl
runs-01001-01100/01087
runs-04701-04800/04741
- runs-02901-03000/02914
runs-06501-06600/06568
-
p14.pddl
runs-01001-01100/01088
runs-04701-04800/04742
- runs-02901-03000/02915
runs-06501-06600/06569
-
p15.pddl
runs-01001-01100/01089
runs-04701-04800/04743
- runs-02901-03000/02916
runs-06501-06600/06570
-
p16.pddl
runs-01001-01100/01090
runs-04701-04800/04744
- runs-02901-03000/02917
runs-06501-06600/06571
-
p17.pddl
runs-01001-01100/01091
runs-04701-04800/04745
- runs-02901-03000/02918
runs-06501-06600/06572
-
p18.pddl
runs-01001-01100/01092
runs-04701-04800/04746
- runs-02901-03000/02919
runs-06501-06600/06573
-
p19.pddl
runs-01001-01100/01093
runs-04701-04800/04747
- runs-02901-03000/02920
runs-06501-06600/06574
-
p20.pddl
runs-01001-01100/01094
runs-04701-04800/04748
- runs-02901-03000/02921
runs-06501-06600/06575
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
petri-net-alignment-opt18-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01001-01100/01095
runs-04701-04800/04749
- runs-02901-03000/02922
runs-06501-06600/06576
-
p02.pddl
runs-01001-01100/01096
runs-04701-04800/04750
- runs-02901-03000/02923
runs-06501-06600/06577
-
p03.pddl
runs-01001-01100/01097
runs-04701-04800/04751
- runs-02901-03000/02924
runs-06501-06600/06578
-
p04.pddl
runs-01001-01100/01098
runs-04701-04800/04752
- runs-02901-03000/02925
runs-06501-06600/06579
-
p05.pddl
runs-01001-01100/01099
runs-04701-04800/04753
- runs-02901-03000/02926
runs-06501-06600/06580
-
p06.pddl
runs-01001-01100/01100
runs-04701-04800/04754
- runs-02901-03000/02927
runs-06501-06600/06581
-
p07.pddl
runs-01101-01200/01101
runs-04701-04800/04755
- runs-02901-03000/02928
runs-06501-06600/06582
-
p08.pddl
runs-01101-01200/01102
runs-04701-04800/04756
- runs-02901-03000/02929
runs-06501-06600/06583
-
p09.pddl
runs-01101-01200/01103
runs-04701-04800/04757
- runs-02901-03000/02930
runs-06501-06600/06584
-
p10.pddl
runs-01101-01200/01104
runs-04701-04800/04758
- runs-02901-03000/02931
runs-06501-06600/06585
-
p11.pddl
runs-01101-01200/01105
runs-04701-04800/04759
- runs-02901-03000/02932
runs-06501-06600/06586
-
p12.pddl
runs-01101-01200/01106
runs-04701-04800/04760
- runs-02901-03000/02933
runs-06501-06600/06587
-
p13.pddl
runs-01101-01200/01107
runs-04701-04800/04761
- runs-02901-03000/02934
runs-06501-06600/06588
-
p14.pddl
runs-01101-01200/01108
runs-04701-04800/04762
- runs-02901-03000/02935
runs-06501-06600/06589
-
p15.pddl
runs-01101-01200/01109
runs-04701-04800/04763
- runs-02901-03000/02936
runs-06501-06600/06590
-
p16.pddl
runs-01101-01200/01110
runs-04701-04800/04764
- runs-02901-03000/02937
runs-06501-06600/06591
-
p17.pddl
runs-01101-01200/01111
runs-04701-04800/04765
- runs-02901-03000/02938
runs-06501-06600/06592
-
p18.pddl
runs-01101-01200/01112
runs-04701-04800/04766
- runs-02901-03000/02939
runs-06501-06600/06593
-
p19.pddl
runs-01101-01200/01113
runs-04701-04800/04767
- runs-02901-03000/02940
runs-06501-06600/06594
-
p20.pddl
runs-01101-01200/01114
runs-04701-04800/04768
- runs-02901-03000/02941
runs-06501-06600/06595
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
pipesworld-notankage
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
runs-01101-01200/01115
runs-04701-04800/04769
- runs-02901-03000/02942
runs-06501-06600/06596
-
p02-net1-b6-g4.pddl
runs-01101-01200/01116
runs-04701-04800/04770
- runs-02901-03000/02943
runs-06501-06600/06597
-
p03-net1-b8-g3.pddl
runs-01101-01200/01117
runs-04701-04800/04771
- runs-02901-03000/02944
runs-06501-06600/06598
-
p04-net1-b8-g5.pddl
runs-01101-01200/01118
runs-04701-04800/04772
- runs-02901-03000/02945
runs-06501-06600/06599
-
p05-net1-b10-g4.pddl
runs-01101-01200/01119
runs-04701-04800/04773
- runs-02901-03000/02946
runs-06501-06600/06600
-
p06-net1-b10-g6.pddl
runs-01101-01200/01120
runs-04701-04800/04774
- runs-02901-03000/02947
runs-06601-06700/06601
-
p07-net1-b12-g5.pddl
runs-01101-01200/01121
runs-04701-04800/04775
- runs-02901-03000/02948
runs-06601-06700/06602
-
p08-net1-b12-g7.pddl
runs-01101-01200/01122
runs-04701-04800/04776
- runs-02901-03000/02949
runs-06601-06700/06603
-
p09-net1-b14-g6.pddl
runs-01101-01200/01123
runs-04701-04800/04777
- runs-02901-03000/02950
runs-06601-06700/06604
-
p10-net1-b14-g8.pddl
runs-01101-01200/01124
runs-04701-04800/04778
- runs-02901-03000/02951
runs-06601-06700/06605
-
p11-net2-b10-g2.pddl
runs-01101-01200/01125
runs-04701-04800/04779
- runs-02901-03000/02952
runs-06601-06700/06606
-
p12-net2-b10-g4.pddl
runs-01101-01200/01126
runs-04701-04800/04780
- runs-02901-03000/02953
runs-06601-06700/06607
-
p13-net2-b12-g3.pddl
runs-01101-01200/01127
runs-04701-04800/04781
- runs-02901-03000/02954
runs-06601-06700/06608
-
p14-net2-b12-g5.pddl
runs-01101-01200/01128
runs-04701-04800/04782
- runs-02901-03000/02955
runs-06601-06700/06609
-
p15-net2-b14-g4.pddl
runs-01101-01200/01129
runs-04701-04800/04783
- runs-02901-03000/02956
runs-06601-06700/06610
-
p16-net2-b14-g6.pddl
runs-01101-01200/01130
runs-04701-04800/04784
- runs-02901-03000/02957
runs-06601-06700/06611
-
p17-net2-b16-g5.pddl
runs-01101-01200/01131
runs-04701-04800/04785
- runs-02901-03000/02958
runs-06601-06700/06612
-
p18-net2-b16-g7.pddl
runs-01101-01200/01132
runs-04701-04800/04786
- runs-02901-03000/02959
runs-06601-06700/06613
-
p19-net2-b18-g6.pddl
runs-01101-01200/01133
runs-04701-04800/04787
- runs-02901-03000/02960
runs-06601-06700/06614
-
p20-net2-b18-g8.pddl
runs-01101-01200/01134
runs-04701-04800/04788
- runs-02901-03000/02961
runs-06601-06700/06615
-
p21-net3-b12-g2.pddl
runs-01101-01200/01135
runs-04701-04800/04789
- runs-02901-03000/02962
runs-06601-06700/06616
-
p22-net3-b12-g4.pddl
runs-01101-01200/01136
runs-04701-04800/04790
- runs-02901-03000/02963
runs-06601-06700/06617
-
p23-net3-b14-g3.pddl
runs-01101-01200/01137
runs-04701-04800/04791
- runs-02901-03000/02964
runs-06601-06700/06618
-
p24-net3-b14-g5.pddl
runs-01101-01200/01138
runs-04701-04800/04792
- runs-02901-03000/02965
runs-06601-06700/06619
-
p25-net3-b16-g5.pddl
runs-01101-01200/01139
runs-04701-04800/04793
- runs-02901-03000/02966
runs-06601-06700/06620
-
p26-net3-b16-g7.pddl
runs-01101-01200/01140
runs-04701-04800/04794
- runs-02901-03000/02967
runs-06601-06700/06621
-
p27-net3-b18-g6.pddl
runs-01101-01200/01141
runs-04701-04800/04795
- runs-02901-03000/02968
runs-06601-06700/06622
-
p28-net3-b18-g7.pddl
runs-01101-01200/01142
runs-04701-04800/04796
- runs-02901-03000/02969
runs-06601-06700/06623
-
p29-net3-b20-g6.pddl
runs-01101-01200/01143
runs-04701-04800/04797
- runs-02901-03000/02970
runs-06601-06700/06624
-
p30-net3-b20-g8.pddl
runs-01101-01200/01144
runs-04701-04800/04798
- runs-02901-03000/02971
runs-06601-06700/06625
-
p31-net4-b14-g3.pddl
runs-01101-01200/01145
runs-04701-04800/04799
- runs-02901-03000/02972
runs-06601-06700/06626
-
p32-net4-b14-g5.pddl
runs-01101-01200/01146
runs-04701-04800/04800
- runs-02901-03000/02973
runs-06601-06700/06627
-
p33-net4-b16-g5.pddl
runs-01101-01200/01147
runs-04801-04900/04801
- runs-02901-03000/02974
runs-06601-06700/06628
-
p34-net4-b16-g6.pddl
runs-01101-01200/01148
runs-04801-04900/04802
- runs-02901-03000/02975
runs-06601-06700/06629
-
p35-net4-b18-g4.pddl
runs-01101-01200/01149
runs-04801-04900/04803
- runs-02901-03000/02976
runs-06601-06700/06630
-
p36-net4-b18-g6.pddl
runs-01101-01200/01150
runs-04801-04900/04804
- runs-02901-03000/02977
runs-06601-06700/06631
-
p37-net4-b20-g5.pddl
runs-01101-01200/01151
runs-04801-04900/04805
- runs-02901-03000/02978
runs-06601-06700/06632
-
p38-net4-b20-g7.pddl
runs-01101-01200/01152
runs-04801-04900/04806
- runs-02901-03000/02979
runs-06601-06700/06633
-
p39-net4-b22-g7.pddl
runs-01101-01200/01153
runs-04801-04900/04807
- runs-02901-03000/02980
runs-06601-06700/06634
-
p40-net4-b22-g8.pddl
runs-01101-01200/01154
runs-04801-04900/04808
- runs-02901-03000/02981
runs-06601-06700/06635
-
p41-net5-b22-g2.pddl
runs-01101-01200/01155
runs-04801-04900/04809
- runs-02901-03000/02982
runs-06601-06700/06636
-
p42-net5-b22-g4.pddl
runs-01101-01200/01156
runs-04801-04900/04810
- runs-02901-03000/02983
runs-06601-06700/06637
-
p43-net5-b24-g3.pddl
runs-01101-01200/01157
runs-04801-04900/04811
- runs-02901-03000/02984
runs-06601-06700/06638
-
p44-net5-b24-g5.pddl
runs-01101-01200/01158
runs-04801-04900/04812
- runs-02901-03000/02985
runs-06601-06700/06639
-
p45-net5-b26-g4.pddl
runs-01101-01200/01159
runs-04801-04900/04813
- runs-02901-03000/02986
runs-06601-06700/06640
-
p46-net5-b26-g6.pddl
runs-01101-01200/01160
runs-04801-04900/04814
- runs-02901-03000/02987
runs-06601-06700/06641
-
p47-net5-b28-g5.pddl
runs-01101-01200/01161
runs-04801-04900/04815
- runs-02901-03000/02988
runs-06601-06700/06642
-
p48-net5-b28-g7.pddl
runs-01101-01200/01162
runs-04801-04900/04816
- runs-02901-03000/02989
runs-06601-06700/06643
-
p49-net5-b30-g6.pddl
runs-01101-01200/01163
runs-04801-04900/04817
- runs-02901-03000/02990
runs-06601-06700/06644
-
p50-net5-b30-g8.pddl
runs-01101-01200/01164
runs-04801-04900/04818
- runs-02901-03000/02991
runs-06601-06700/06645
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
pipesworld-tankage
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
runs-01101-01200/01165
runs-04801-04900/04819
- runs-02901-03000/02992
runs-06601-06700/06646
-
p02-net1-b6-g4-t50.pddl
runs-01101-01200/01166
runs-04801-04900/04820
- runs-02901-03000/02993
runs-06601-06700/06647
-
p03-net1-b8-g3-t80.pddl
runs-01101-01200/01167
runs-04801-04900/04821
- runs-02901-03000/02994
runs-06601-06700/06648
-
p04-net1-b8-g5-t80.pddl
runs-01101-01200/01168
runs-04801-04900/04822
- runs-02901-03000/02995
runs-06601-06700/06649
-
p05-net1-b10-g4-t50.pddl
runs-01101-01200/01169
runs-04801-04900/04823
- runs-02901-03000/02996
runs-06601-06700/06650
-
p06-net1-b10-g6-t50.pddl
runs-01101-01200/01170
runs-04801-04900/04824
- runs-02901-03000/02997
runs-06601-06700/06651
-
p07-net1-b12-g5-t80.pddl
runs-01101-01200/01171
runs-04801-04900/04825
- runs-02901-03000/02998
runs-06601-06700/06652
-
p08-net1-b12-g7-t80.pddl
runs-01101-01200/01172
runs-04801-04900/04826
- runs-02901-03000/02999
runs-06601-06700/06653
-
p09-net1-b14-g6-t50.pddl
runs-01101-01200/01173
runs-04801-04900/04827
- runs-02901-03000/03000
runs-06601-06700/06654
-
p10-net1-b14-g8-t50.pddl
runs-01101-01200/01174
runs-04801-04900/04828
- runs-03001-03100/03001
runs-06601-06700/06655
-
p11-net2-b10-g2-t30.pddl
runs-01101-01200/01175
runs-04801-04900/04829
- runs-03001-03100/03002
runs-06601-06700/06656
-
p12-net2-b10-g4-t60.pddl
runs-01101-01200/01176
runs-04801-04900/04830
- runs-03001-03100/03003
runs-06601-06700/06657
-
p13-net2-b12-g3-t70.pddl
runs-01101-01200/01177
runs-04801-04900/04831
- runs-03001-03100/03004
runs-06601-06700/06658
-
p14-net2-b12-g5-t30.pddl
runs-01101-01200/01178
runs-04801-04900/04832
- runs-03001-03100/03005
runs-06601-06700/06659
-
p15-net2-b14-g4-t30.pddl
runs-01101-01200/01179
runs-04801-04900/04833
- runs-03001-03100/03006
runs-06601-06700/06660
-
p16-net2-b14-g6-t80.pddl
runs-01101-01200/01180
runs-04801-04900/04834
- runs-03001-03100/03007
runs-06601-06700/06661
-
p17-net2-b16-g5-t20.pddl
runs-01101-01200/01181
runs-04801-04900/04835
- runs-03001-03100/03008
runs-06601-06700/06662
-
p18-net2-b16-g7-t60.pddl
runs-01101-01200/01182
runs-04801-04900/04836
- runs-03001-03100/03009
runs-06601-06700/06663
-
p19-net2-b18-g6-t60.pddl
runs-01101-01200/01183
runs-04801-04900/04837
- runs-03001-03100/03010
runs-06601-06700/06664
-
p20-net2-b18-g8-t90.pddl
runs-01101-01200/01184
runs-04801-04900/04838
- runs-03001-03100/03011
runs-06601-06700/06665
-
p21-net3-b12-g2-t60.pddl
runs-01101-01200/01185
runs-04801-04900/04839
- runs-03001-03100/03012
runs-06601-06700/06666
-
p22-net3-b12-g4-t60.pddl
runs-01101-01200/01186
runs-04801-04900/04840
- runs-03001-03100/03013
runs-06601-06700/06667
-
p23-net3-b14-g3-t60.pddl
runs-01101-01200/01187
runs-04801-04900/04841
- runs-03001-03100/03014
runs-06601-06700/06668
-
p24-net3-b14-g5-t60.pddl
runs-01101-01200/01188
runs-04801-04900/04842
- runs-03001-03100/03015
runs-06601-06700/06669
-
p25-net3-b16-g5-t60.pddl
runs-01101-01200/01189
runs-04801-04900/04843
- runs-03001-03100/03016
runs-06601-06700/06670
-
p26-net3-b16-g7-t70.pddl
runs-01101-01200/01190
runs-04801-04900/04844
- runs-03001-03100/03017
runs-06601-06700/06671
-
p27-net3-b18-g6-t70.pddl
runs-01101-01200/01191
runs-04801-04900/04845
- runs-03001-03100/03018
runs-06601-06700/06672
-
p28-net3-b18-g7-t70.pddl
runs-01101-01200/01192
runs-04801-04900/04846
- runs-03001-03100/03019
runs-06601-06700/06673
-
p29-net3-b20-g6-t70.pddl
runs-01101-01200/01193
runs-04801-04900/04847
- runs-03001-03100/03020
runs-06601-06700/06674
-
p30-net3-b20-g8-t70.pddl
runs-01101-01200/01194
runs-04801-04900/04848
- runs-03001-03100/03021
runs-06601-06700/06675
-
p31-net4-b14-g3-t20.pddl
runs-01101-01200/01195
runs-04801-04900/04849
- runs-03001-03100/03022
runs-06601-06700/06676
-
p32-net4-b14-g5-t30.pddl
runs-01101-01200/01196
runs-04801-04900/04850
- runs-03001-03100/03023
runs-06601-06700/06677
-
p33-net4-b16-g5-t60.pddl
runs-01101-01200/01197
runs-04801-04900/04851
- runs-03001-03100/03024
runs-06601-06700/06678
-
p34-net4-b16-g6-t60.pddl
runs-01101-01200/01198
runs-04801-04900/04852
- runs-03001-03100/03025
runs-06601-06700/06679
-
p35-net4-b18-g4-t90.pddl
runs-01101-01200/01199
runs-04801-04900/04853
- runs-03001-03100/03026
runs-06601-06700/06680
-
p36-net4-b18-g6-t90.pddl
runs-01101-01200/01200
runs-04801-04900/04854
- runs-03001-03100/03027
runs-06601-06700/06681
-
p37-net4-b20-g5-t60.pddl
runs-01201-01300/01201
runs-04801-04900/04855
- runs-03001-03100/03028
runs-06601-06700/06682
-
p38-net4-b20-g7-t60.pddl
runs-01201-01300/01202
runs-04801-04900/04856
- runs-03001-03100/03029
runs-06601-06700/06683
-
p39-net4-b22-g7-t50.pddl
runs-01201-01300/01203
runs-04801-04900/04857
- runs-03001-03100/03030
runs-06601-06700/06684
-
p40-net4-b22-g8-t50.pddl
runs-01201-01300/01204
runs-04801-04900/04858
- runs-03001-03100/03031
runs-06601-06700/06685
-
p41-net5-b22-g2-t20.pddl
runs-01201-01300/01205
runs-04801-04900/04859
- runs-03001-03100/03032
runs-06601-06700/06686
-
p42-net5-b22-g4-t50.pddl
runs-01201-01300/01206
runs-04801-04900/04860
- runs-03001-03100/03033
runs-06601-06700/06687
-
p43-net5-b24-g3-t80.pddl
runs-01201-01300/01207
runs-04801-04900/04861
- runs-03001-03100/03034
runs-06601-06700/06688
-
p44-net5-b24-g5-t80.pddl
runs-01201-01300/01208
runs-04801-04900/04862
- runs-03001-03100/03035
runs-06601-06700/06689
-
p45-net5-b26-g4-t50.pddl
runs-01201-01300/01209
runs-04801-04900/04863
- runs-03001-03100/03036
runs-06601-06700/06690
-
p46-net5-b26-g6-t50.pddl
runs-01201-01300/01210
runs-04801-04900/04864
- runs-03001-03100/03037
runs-06601-06700/06691
-
p47-net5-b28-g5-t50.pddl
runs-01201-01300/01211
runs-04801-04900/04865
- runs-03001-03100/03038
runs-06601-06700/06692
-
p48-net5-b28-g7-t50.pddl
runs-01201-01300/01212
runs-04801-04900/04866
- runs-03001-03100/03039
runs-06601-06700/06693
-
p49-net5-b30-g6-t50.pddl
runs-01201-01300/01213
runs-04801-04900/04867
- runs-03001-03100/03040
runs-06601-06700/06694
-
p50-net5-b30-g8-t50.pddl
runs-01201-01300/01214
runs-04801-04900/04868
- runs-03001-03100/03041
runs-06601-06700/06695
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
psr-small
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
runs-01201-01300/01215
runs-04801-04900/04869
- runs-03001-03100/03042
runs-06601-06700/06696
-
p02-s5-n1-l3-f30.pddl
runs-01201-01300/01216
runs-04801-04900/04870
- runs-03001-03100/03043
runs-06601-06700/06697
-
p03-s7-n1-l3-f70.pddl
runs-01201-01300/01217
runs-04801-04900/04871
- runs-03001-03100/03044
runs-06601-06700/06698
-
p04-s8-n1-l4-f10.pddl
runs-01201-01300/01218
runs-04801-04900/04872
- runs-03001-03100/03045
runs-06601-06700/06699
-
p05-s9-n1-l4-f30.pddl
runs-01201-01300/01219
runs-04801-04900/04873
- runs-03001-03100/03046
runs-06601-06700/06700
-
p06-s10-n1-l4-f50.pddl
runs-01201-01300/01220
runs-04801-04900/04874
- runs-03001-03100/03047
runs-06701-06800/06701
-
p07-s11-n1-l4-f70.pddl
runs-01201-01300/01221
runs-04801-04900/04875
- runs-03001-03100/03048
runs-06701-06800/06702
-
p08-s12-n1-l5-f10.pddl
runs-01201-01300/01222
runs-04801-04900/04876
- runs-03001-03100/03049
runs-06701-06800/06703
-
p09-s13-n1-l5-f30.pddl
runs-01201-01300/01223
runs-04801-04900/04877
- runs-03001-03100/03050
runs-06701-06800/06704
-
p10-s17-n2-l2-f30.pddl
runs-01201-01300/01224
runs-04801-04900/04878
- runs-03001-03100/03051
runs-06701-06800/06705
-
p11-s18-n2-l2-f50.pddl
runs-01201-01300/01225
runs-04801-04900/04879
- runs-03001-03100/03052
runs-06701-06800/06706
-
p12-s21-n2-l3-f30.pddl
runs-01201-01300/01226
runs-04801-04900/04880
- runs-03001-03100/03053
runs-06701-06800/06707
-
p13-s22-n2-l3-f50.pddl
runs-01201-01300/01227
runs-04801-04900/04881
- runs-03001-03100/03054
runs-06701-06800/06708
-
p14-s23-n2-l3-f70.pddl
runs-01201-01300/01228
runs-04801-04900/04882
- runs-03001-03100/03055
runs-06701-06800/06709
-
p15-s24-n2-l4-f10.pddl
runs-01201-01300/01229
runs-04801-04900/04883
- runs-03001-03100/03056
runs-06701-06800/06710
-
p16-s29-n2-l5-f30.pddl
runs-01201-01300/01230
runs-04801-04900/04884
- runs-03001-03100/03057
runs-06701-06800/06711
-
p17-s30-n2-l5-f50.pddl
runs-01201-01300/01231
runs-04801-04900/04885
- runs-03001-03100/03058
runs-06701-06800/06712
-
p18-s31-n2-l5-f70.pddl
runs-01201-01300/01232
runs-04801-04900/04886
- runs-03001-03100/03059
runs-06701-06800/06713
-
p19-s33-n3-l2-f30.pddl
runs-01201-01300/01233
runs-04801-04900/04887
- runs-03001-03100/03060
runs-06701-06800/06714
-
p20-s34-n3-l2-f50.pddl
runs-01201-01300/01234
runs-04801-04900/04888
- runs-03001-03100/03061
runs-06701-06800/06715
-
p21-s35-n3-l2-f70.pddl
runs-01201-01300/01235
runs-04801-04900/04889
- runs-03001-03100/03062
runs-06701-06800/06716
-
p22-s37-n3-l3-f30.pddl
runs-01201-01300/01236
runs-04801-04900/04890
- runs-03001-03100/03063
runs-06701-06800/06717
-
p23-s38-n3-l3-f50.pddl
runs-01201-01300/01237
runs-04801-04900/04891
- runs-03001-03100/03064
runs-06701-06800/06718
-
p24-s39-n3-l3-f70.pddl
runs-01201-01300/01238
runs-04801-04900/04892
- runs-03001-03100/03065
runs-06701-06800/06719
-
p25-s40-n3-l4-f10.pddl
runs-01201-01300/01239
runs-04801-04900/04893
- runs-03001-03100/03066
runs-06701-06800/06720
-
p26-s41-n3-l4-f30.pddl
runs-01201-01300/01240
runs-04801-04900/04894
- runs-03001-03100/03067
runs-06701-06800/06721
-
p27-s42-n3-l4-f50.pddl
runs-01201-01300/01241
runs-04801-04900/04895
- runs-03001-03100/03068
runs-06701-06800/06722
-
p28-s43-n3-l4-f70.pddl
runs-01201-01300/01242
runs-04801-04900/04896
- runs-03001-03100/03069
runs-06701-06800/06723
-
p29-s45-n3-l5-f30.pddl
runs-01201-01300/01243
runs-04801-04900/04897
- runs-03001-03100/03070
runs-06701-06800/06724
-
p30-s46-n3-l5-f50.pddl
runs-01201-01300/01244
runs-04801-04900/04898
- runs-03001-03100/03071
runs-06701-06800/06725
-
p31-s49-n4-l2-f30.pddl
runs-01201-01300/01245
runs-04801-04900/04899
- runs-03001-03100/03072
runs-06701-06800/06726
-
p32-s50-n4-l2-f50.pddl
runs-01201-01300/01246
runs-04801-04900/04900
- runs-03001-03100/03073
runs-06701-06800/06727
-
p33-s51-n4-l2-f70.pddl
runs-01201-01300/01247
runs-04901-05000/04901
- runs-03001-03100/03074
runs-06701-06800/06728
-
p34-s55-n4-l3-f70.pddl
runs-01201-01300/01248
runs-04901-05000/04902
- runs-03001-03100/03075
runs-06701-06800/06729
-
p35-s57-n5-l2-f30.pddl
runs-01201-01300/01249
runs-04901-05000/04903
- runs-03001-03100/03076
runs-06701-06800/06730
-
p36-s65-n6-l2-f30.pddl
runs-01201-01300/01250
runs-04901-05000/04904
- runs-03001-03100/03077
runs-06701-06800/06731
-
p37-s67-n6-l2-f70.pddl
runs-01201-01300/01251
runs-04901-05000/04905
- runs-03001-03100/03078
runs-06701-06800/06732
-
p38-s78-n3-l3-f50.pddl
runs-01201-01300/01252
runs-04901-05000/04906
- runs-03001-03100/03079
runs-06701-06800/06733
-
p39-s79-n3-l3-f70.pddl
runs-01201-01300/01253
runs-04901-05000/04907
- runs-03001-03100/03080
runs-06701-06800/06734
-
p40-s80-n3-l4-f10.pddl
runs-01201-01300/01254
runs-04901-05000/04908
- runs-03001-03100/03081
runs-06701-06800/06735
-
p41-s81-n3-l4-f30.pddl
runs-01201-01300/01255
runs-04901-05000/04909
- runs-03001-03100/03082
runs-06701-06800/06736
-
p42-s82-n3-l4-f50.pddl
runs-01201-01300/01256
runs-04901-05000/04910
- runs-03001-03100/03083
runs-06701-06800/06737
-
p43-s83-n3-l4-f70.pddl
runs-01201-01300/01257
runs-04901-05000/04911
- runs-03001-03100/03084
runs-06701-06800/06738
-
p44-s89-n4-l2-f30.pddl
runs-01201-01300/01258
runs-04901-05000/04912
- runs-03001-03100/03085
runs-06701-06800/06739
-
p45-s94-n4-l3-f50.pddl
runs-01201-01300/01259
runs-04901-05000/04913
- runs-03001-03100/03086
runs-06701-06800/06740
-
p46-s97-n5-l2-f30.pddl
runs-01201-01300/01260
runs-04901-05000/04914
- runs-03001-03100/03087
runs-06701-06800/06741
-
p47-s98-n5-l2-f50.pddl
runs-01201-01300/01261
runs-04901-05000/04915
- runs-03001-03100/03088
runs-06701-06800/06742
-
p48-s101-n5-l3-f30.pddl
runs-01201-01300/01262
runs-04901-05000/04916
- runs-03001-03100/03089
runs-06701-06800/06743
-
p49-s105-n6-l2-f30.pddl
runs-01201-01300/01263
runs-04901-05000/04917
- runs-03001-03100/03090
runs-06701-06800/06744
-
p50-s107-n6-l2-f70.pddl
runs-01201-01300/01264
runs-04901-05000/04918
- runs-03001-03100/03091
runs-06701-06800/06745
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
rovers
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01201-01300/01265
runs-04901-05000/04919
- runs-03001-03100/03092
runs-06701-06800/06746
-
p02.pddl
runs-01201-01300/01266
runs-04901-05000/04920
- runs-03001-03100/03093
runs-06701-06800/06747
-
p03.pddl
runs-01201-01300/01267
runs-04901-05000/04921
- runs-03001-03100/03094
runs-06701-06800/06748
-
p04.pddl
runs-01201-01300/01268
runs-04901-05000/04922
- runs-03001-03100/03095
runs-06701-06800/06749
-
p05.pddl
runs-01201-01300/01269
runs-04901-05000/04923
- runs-03001-03100/03096
runs-06701-06800/06750
-
p06.pddl
runs-01201-01300/01270
runs-04901-05000/04924
- runs-03001-03100/03097
runs-06701-06800/06751
-
p07.pddl
runs-01201-01300/01271
runs-04901-05000/04925
- runs-03001-03100/03098
runs-06701-06800/06752
-
p08.pddl
runs-01201-01300/01272
runs-04901-05000/04926
- runs-03001-03100/03099
runs-06701-06800/06753
-
p09.pddl
runs-01201-01300/01273
runs-04901-05000/04927
- runs-03001-03100/03100
runs-06701-06800/06754
-
p10.pddl
runs-01201-01300/01274
runs-04901-05000/04928
- runs-03101-03200/03101
runs-06701-06800/06755
-
p11.pddl
runs-01201-01300/01275
runs-04901-05000/04929
- runs-03101-03200/03102
runs-06701-06800/06756
-
p12.pddl
runs-01201-01300/01276
runs-04901-05000/04930
- runs-03101-03200/03103
runs-06701-06800/06757
-
p13.pddl
runs-01201-01300/01277
runs-04901-05000/04931
- runs-03101-03200/03104
runs-06701-06800/06758
-
p14.pddl
runs-01201-01300/01278
runs-04901-05000/04932
- runs-03101-03200/03105
runs-06701-06800/06759
-
p15.pddl
runs-01201-01300/01279
runs-04901-05000/04933
- runs-03101-03200/03106
runs-06701-06800/06760
-
p16.pddl
runs-01201-01300/01280
runs-04901-05000/04934
- runs-03101-03200/03107
runs-06701-06800/06761
-
p17.pddl
runs-01201-01300/01281
runs-04901-05000/04935
- runs-03101-03200/03108
runs-06701-06800/06762
-
p18.pddl
runs-01201-01300/01282
runs-04901-05000/04936
- runs-03101-03200/03109
runs-06701-06800/06763
-
p19.pddl
runs-01201-01300/01283
runs-04901-05000/04937
- runs-03101-03200/03110
runs-06701-06800/06764
-
p20.pddl
runs-01201-01300/01284
runs-04901-05000/04938
- runs-03101-03200/03111
runs-06701-06800/06765
-
p21.pddl
runs-01201-01300/01285
runs-04901-05000/04939
- runs-03101-03200/03112
runs-06701-06800/06766
-
p22.pddl
runs-01201-01300/01286
runs-04901-05000/04940
- runs-03101-03200/03113
runs-06701-06800/06767
-
p23.pddl
runs-01201-01300/01287
runs-04901-05000/04941
- runs-03101-03200/03114
runs-06701-06800/06768
-
p24.pddl
runs-01201-01300/01288
runs-04901-05000/04942
- runs-03101-03200/03115
runs-06701-06800/06769
-
p25.pddl
runs-01201-01300/01289
runs-04901-05000/04943
- runs-03101-03200/03116
runs-06701-06800/06770
-
p26.pddl
runs-01201-01300/01290
runs-04901-05000/04944
- runs-03101-03200/03117
runs-06701-06800/06771
-
p27.pddl
runs-01201-01300/01291
runs-04901-05000/04945
- runs-03101-03200/03118
runs-06701-06800/06772
-
p28.pddl
runs-01201-01300/01292
runs-04901-05000/04946
- runs-03101-03200/03119
runs-06701-06800/06773
-
p29.pddl
runs-01201-01300/01293
runs-04901-05000/04947
- runs-03101-03200/03120
runs-06701-06800/06774
-
p30.pddl
runs-01201-01300/01294
runs-04901-05000/04948
- runs-03101-03200/03121
runs-06701-06800/06775
-
p31.pddl
runs-01201-01300/01295
runs-04901-05000/04949
- runs-03101-03200/03122
runs-06701-06800/06776
-
p32.pddl
runs-01201-01300/01296
runs-04901-05000/04950
- runs-03101-03200/03123
runs-06701-06800/06777
-
p33.pddl
runs-01201-01300/01297
runs-04901-05000/04951
- runs-03101-03200/03124
runs-06701-06800/06778
-
p34.pddl
runs-01201-01300/01298
runs-04901-05000/04952
- runs-03101-03200/03125
runs-06701-06800/06779
-
p35.pddl
runs-01201-01300/01299
runs-04901-05000/04953
- runs-03101-03200/03126
runs-06701-06800/06780
-
p36.pddl
runs-01201-01300/01300
runs-04901-05000/04954
- runs-03101-03200/03127
runs-06701-06800/06781
-
p37.pddl
runs-01301-01400/01301
runs-04901-05000/04955
- runs-03101-03200/03128
runs-06701-06800/06782
-
p38.pddl
runs-01301-01400/01302
runs-04901-05000/04956
- runs-03101-03200/03129
runs-06701-06800/06783
-
p39.pddl
runs-01301-01400/01303
runs-04901-05000/04957
- runs-03101-03200/03130
runs-06701-06800/06784
-
p40.pddl
runs-01301-01400/01304
runs-04901-05000/04958
- runs-03101-03200/03131
runs-06701-06800/06785
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
satellite
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
runs-01301-01400/01305
runs-04901-05000/04959
- runs-03101-03200/03132
runs-06701-06800/06786
-
p02-pfile2.pddl
runs-01301-01400/01306
runs-04901-05000/04960
- runs-03101-03200/03133
runs-06701-06800/06787
-
p03-pfile3.pddl
runs-01301-01400/01307
runs-04901-05000/04961
- runs-03101-03200/03134
runs-06701-06800/06788
-
p04-pfile4.pddl
runs-01301-01400/01308
runs-04901-05000/04962
- runs-03101-03200/03135
runs-06701-06800/06789
-
p05-pfile5.pddl
runs-01301-01400/01309
runs-04901-05000/04963
- runs-03101-03200/03136
runs-06701-06800/06790
-
p06-pfile6.pddl
runs-01301-01400/01310
runs-04901-05000/04964
- runs-03101-03200/03137
runs-06701-06800/06791
-
p07-pfile7.pddl
runs-01301-01400/01311
runs-04901-05000/04965
- runs-03101-03200/03138
runs-06701-06800/06792
-
p08-pfile8.pddl
runs-01301-01400/01312
runs-04901-05000/04966
- runs-03101-03200/03139
runs-06701-06800/06793
-
p09-pfile9.pddl
runs-01301-01400/01313
runs-04901-05000/04967
- runs-03101-03200/03140
runs-06701-06800/06794
-
p10-pfile10.pddl
runs-01301-01400/01314
runs-04901-05000/04968
- runs-03101-03200/03141
runs-06701-06800/06795
-
p11-pfile11.pddl
runs-01301-01400/01315
runs-04901-05000/04969
- runs-03101-03200/03142
runs-06701-06800/06796
-
p12-pfile12.pddl
runs-01301-01400/01316
runs-04901-05000/04970
- runs-03101-03200/03143
runs-06701-06800/06797
-
p13-pfile13.pddl
runs-01301-01400/01317
runs-04901-05000/04971
- runs-03101-03200/03144
runs-06701-06800/06798
-
p14-pfile14.pddl
runs-01301-01400/01318
runs-04901-05000/04972
- runs-03101-03200/03145
runs-06701-06800/06799
-
p15-pfile15.pddl
runs-01301-01400/01319
runs-04901-05000/04973
- runs-03101-03200/03146
runs-06701-06800/06800
-
p16-pfile16.pddl
runs-01301-01400/01320
runs-04901-05000/04974
- runs-03101-03200/03147
runs-06801-06900/06801
-
p17-pfile17.pddl
runs-01301-01400/01321
runs-04901-05000/04975
- runs-03101-03200/03148
runs-06801-06900/06802
-
p18-pfile18.pddl
runs-01301-01400/01322
runs-04901-05000/04976
- runs-03101-03200/03149
runs-06801-06900/06803
-
p19-pfile19.pddl
runs-01301-01400/01323
runs-04901-05000/04977
- runs-03101-03200/03150
runs-06801-06900/06804
-
p20-pfile20.pddl
runs-01301-01400/01324
runs-04901-05000/04978
- runs-03101-03200/03151
runs-06801-06900/06805
-
p21-HC-pfile1.pddl
runs-01301-01400/01325
runs-04901-05000/04979
- runs-03101-03200/03152
runs-06801-06900/06806
-
p22-HC-pfile2.pddl
runs-01301-01400/01326
runs-04901-05000/04980
- runs-03101-03200/03153
runs-06801-06900/06807
-
p23-HC-pfile3.pddl
runs-01301-01400/01327
runs-04901-05000/04981
- runs-03101-03200/03154
runs-06801-06900/06808
-
p24-HC-pfile4.pddl
runs-01301-01400/01328
runs-04901-05000/04982
- runs-03101-03200/03155
runs-06801-06900/06809
-
p25-HC-pfile5.pddl
runs-01301-01400/01329
runs-04901-05000/04983
- runs-03101-03200/03156
runs-06801-06900/06810
-
p26-HC-pfile6.pddl
runs-01301-01400/01330
runs-04901-05000/04984
- runs-03101-03200/03157
runs-06801-06900/06811
-
p27-HC-pfile7.pddl
runs-01301-01400/01331
runs-04901-05000/04985
- runs-03101-03200/03158
runs-06801-06900/06812
-
p28-HC-pfile8.pddl
runs-01301-01400/01332
runs-04901-05000/04986
- runs-03101-03200/03159
runs-06801-06900/06813
-
p29-HC-pfile9.pddl
runs-01301-01400/01333
runs-04901-05000/04987
- runs-03101-03200/03160
runs-06801-06900/06814
-
p30-HC-pfile10.pddl
runs-01301-01400/01334
runs-04901-05000/04988
- runs-03101-03200/03161
runs-06801-06900/06815
-
p31-HC-pfile11.pddl
runs-01301-01400/01335
runs-04901-05000/04989
- runs-03101-03200/03162
runs-06801-06900/06816
-
p32-HC-pfile12.pddl
runs-01301-01400/01336
runs-04901-05000/04990
- runs-03101-03200/03163
runs-06801-06900/06817
-
p33-HC-pfile13.pddl
runs-01301-01400/01337
runs-04901-05000/04991
- runs-03101-03200/03164
runs-06801-06900/06818
-
p34-HC-pfile14.pddl
runs-01301-01400/01338
runs-04901-05000/04992
- runs-03101-03200/03165
runs-06801-06900/06819
-
p35-HC-pfile15.pddl
runs-01301-01400/01339
runs-04901-05000/04993
- runs-03101-03200/03166
runs-06801-06900/06820
-
p36-HC-pfile16.pddl
runs-01301-01400/01340
runs-04901-05000/04994
- runs-03101-03200/03167
runs-06801-06900/06821
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
scanalyzer-08-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01301-01400/01341
runs-04901-05000/04995
- runs-03101-03200/03168
runs-06801-06900/06822
-
p02.pddl
runs-01301-01400/01342
runs-04901-05000/04996
- runs-03101-03200/03169
runs-06801-06900/06823
-
p03.pddl
runs-01301-01400/01343
runs-04901-05000/04997
- runs-03101-03200/03170
runs-06801-06900/06824
-
p04.pddl
runs-01301-01400/01344
runs-04901-05000/04998
- runs-03101-03200/03171
runs-06801-06900/06825
-
p05.pddl
runs-01301-01400/01345
runs-04901-05000/04999
- runs-03101-03200/03172
runs-06801-06900/06826
-
p06.pddl
runs-01301-01400/01346
runs-04901-05000/05000
- runs-03101-03200/03173
runs-06801-06900/06827
-
p07.pddl
runs-01301-01400/01347
runs-05001-05100/05001
- runs-03101-03200/03174
runs-06801-06900/06828
-
p08.pddl
runs-01301-01400/01348
runs-05001-05100/05002
- runs-03101-03200/03175
runs-06801-06900/06829
-
p09.pddl
runs-01301-01400/01349
runs-05001-05100/05003
- runs-03101-03200/03176
runs-06801-06900/06830
-
p10.pddl
runs-01301-01400/01350
runs-05001-05100/05004
- runs-03101-03200/03177
runs-06801-06900/06831
-
p11.pddl
runs-01301-01400/01351
runs-05001-05100/05005
- runs-03101-03200/03178
runs-06801-06900/06832
-
p12.pddl
runs-01301-01400/01352
runs-05001-05100/05006
- runs-03101-03200/03179
runs-06801-06900/06833
-
p13.pddl
runs-01301-01400/01353
runs-05001-05100/05007
- runs-03101-03200/03180
runs-06801-06900/06834
-
p14.pddl
runs-01301-01400/01354
runs-05001-05100/05008
- runs-03101-03200/03181
runs-06801-06900/06835
-
p15.pddl
runs-01301-01400/01355
runs-05001-05100/05009
- runs-03101-03200/03182
runs-06801-06900/06836
-
p16.pddl
runs-01301-01400/01356
runs-05001-05100/05010
- runs-03101-03200/03183
runs-06801-06900/06837
-
p17.pddl
runs-01301-01400/01357
runs-05001-05100/05011
- runs-03101-03200/03184
runs-06801-06900/06838
-
p18.pddl
runs-01301-01400/01358
runs-05001-05100/05012
- runs-03101-03200/03185
runs-06801-06900/06839
-
p19.pddl
runs-01301-01400/01359
runs-05001-05100/05013
- runs-03101-03200/03186
runs-06801-06900/06840
-
p20.pddl
runs-01301-01400/01360
runs-05001-05100/05014
- runs-03101-03200/03187
runs-06801-06900/06841
-
p21.pddl
runs-01301-01400/01361
runs-05001-05100/05015
- runs-03101-03200/03188
runs-06801-06900/06842
-
p22.pddl
runs-01301-01400/01362
runs-05001-05100/05016
- runs-03101-03200/03189
runs-06801-06900/06843
-
p23.pddl
runs-01301-01400/01363
runs-05001-05100/05017
- runs-03101-03200/03190
runs-06801-06900/06844
-
p24.pddl
runs-01301-01400/01364
runs-05001-05100/05018
- runs-03101-03200/03191
runs-06801-06900/06845
-
p25.pddl
runs-01301-01400/01365
runs-05001-05100/05019
- runs-03101-03200/03192
runs-06801-06900/06846
-
p26.pddl
runs-01301-01400/01366
runs-05001-05100/05020
- runs-03101-03200/03193
runs-06801-06900/06847
-
p27.pddl
runs-01301-01400/01367
runs-05001-05100/05021
- runs-03101-03200/03194
runs-06801-06900/06848
-
p28.pddl
runs-01301-01400/01368
runs-05001-05100/05022
- runs-03101-03200/03195
runs-06801-06900/06849
-
p29.pddl
runs-01301-01400/01369
runs-05001-05100/05023
- runs-03101-03200/03196
runs-06801-06900/06850
-
p30.pddl
runs-01301-01400/01370
runs-05001-05100/05024
- runs-03101-03200/03197
runs-06801-06900/06851
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
scanalyzer-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01301-01400/01371
runs-05001-05100/05025
- runs-03101-03200/03198
runs-06801-06900/06852
-
p02.pddl
runs-01301-01400/01372
runs-05001-05100/05026
- runs-03101-03200/03199
runs-06801-06900/06853
-
p03.pddl
runs-01301-01400/01373
runs-05001-05100/05027
- runs-03101-03200/03200
runs-06801-06900/06854
-
p04.pddl
runs-01301-01400/01374
runs-05001-05100/05028
- runs-03201-03300/03201
runs-06801-06900/06855
-
p05.pddl
runs-01301-01400/01375
runs-05001-05100/05029
- runs-03201-03300/03202
runs-06801-06900/06856
-
p06.pddl
runs-01301-01400/01376
runs-05001-05100/05030
- runs-03201-03300/03203
runs-06801-06900/06857
-
p07.pddl
runs-01301-01400/01377
runs-05001-05100/05031
- runs-03201-03300/03204
runs-06801-06900/06858
-
p08.pddl
runs-01301-01400/01378
runs-05001-05100/05032
- runs-03201-03300/03205
runs-06801-06900/06859
-
p09.pddl
runs-01301-01400/01379
runs-05001-05100/05033
- runs-03201-03300/03206
runs-06801-06900/06860
-
p10.pddl
runs-01301-01400/01380
runs-05001-05100/05034
- runs-03201-03300/03207
runs-06801-06900/06861
-
p11.pddl
runs-01301-01400/01381
runs-05001-05100/05035
- runs-03201-03300/03208
runs-06801-06900/06862
-
p12.pddl
runs-01301-01400/01382
runs-05001-05100/05036
- runs-03201-03300/03209
runs-06801-06900/06863
-
p13.pddl
runs-01301-01400/01383
runs-05001-05100/05037
- runs-03201-03300/03210
runs-06801-06900/06864
-
p14.pddl
runs-01301-01400/01384
runs-05001-05100/05038
- runs-03201-03300/03211
runs-06801-06900/06865
-
p15.pddl
runs-01301-01400/01385
runs-05001-05100/05039
- runs-03201-03300/03212
runs-06801-06900/06866
-
p16.pddl
runs-01301-01400/01386
runs-05001-05100/05040
- runs-03201-03300/03213
runs-06801-06900/06867
-
p17.pddl
runs-01301-01400/01387
runs-05001-05100/05041
- runs-03201-03300/03214
runs-06801-06900/06868
-
p18.pddl
runs-01301-01400/01388
runs-05001-05100/05042
- runs-03201-03300/03215
runs-06801-06900/06869
-
p19.pddl
runs-01301-01400/01389
runs-05001-05100/05043
- runs-03201-03300/03216
runs-06801-06900/06870
-
p20.pddl
runs-01301-01400/01390
runs-05001-05100/05044
- runs-03201-03300/03217
runs-06801-06900/06871
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
snake-opt18-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01301-01400/01391
runs-05001-05100/05045
- runs-03201-03300/03218
runs-06801-06900/06872
-
p02.pddl
runs-01301-01400/01392
runs-05001-05100/05046
- runs-03201-03300/03219
runs-06801-06900/06873
-
p03.pddl
runs-01301-01400/01393
runs-05001-05100/05047
- runs-03201-03300/03220
runs-06801-06900/06874
-
p04.pddl
runs-01301-01400/01394
runs-05001-05100/05048
- runs-03201-03300/03221
runs-06801-06900/06875
-
p05.pddl
runs-01301-01400/01395
runs-05001-05100/05049
- runs-03201-03300/03222
runs-06801-06900/06876
-
p06.pddl
runs-01301-01400/01396
runs-05001-05100/05050
- runs-03201-03300/03223
runs-06801-06900/06877
-
p07.pddl
runs-01301-01400/01397
runs-05001-05100/05051
- runs-03201-03300/03224
runs-06801-06900/06878
-
p08.pddl
runs-01301-01400/01398
runs-05001-05100/05052
- runs-03201-03300/03225
runs-06801-06900/06879
-
p09.pddl
runs-01301-01400/01399
runs-05001-05100/05053
- runs-03201-03300/03226
runs-06801-06900/06880
-
p10.pddl
runs-01301-01400/01400
runs-05001-05100/05054
- runs-03201-03300/03227
runs-06801-06900/06881
-
p11.pddl
runs-01401-01500/01401
runs-05001-05100/05055
- runs-03201-03300/03228
runs-06801-06900/06882
-
p12.pddl
runs-01401-01500/01402
runs-05001-05100/05056
- runs-03201-03300/03229
runs-06801-06900/06883
-
p13.pddl
runs-01401-01500/01403
runs-05001-05100/05057
- runs-03201-03300/03230
runs-06801-06900/06884
-
p14.pddl
runs-01401-01500/01404
runs-05001-05100/05058
- runs-03201-03300/03231
runs-06801-06900/06885
-
p15.pddl
runs-01401-01500/01405
runs-05001-05100/05059
- runs-03201-03300/03232
runs-06801-06900/06886
-
p16.pddl
runs-01401-01500/01406
runs-05001-05100/05060
- runs-03201-03300/03233
runs-06801-06900/06887
-
p17.pddl
runs-01401-01500/01407
runs-05001-05100/05061
- runs-03201-03300/03234
runs-06801-06900/06888
-
p18.pddl
runs-01401-01500/01408
runs-05001-05100/05062
- runs-03201-03300/03235
runs-06801-06900/06889
-
p19.pddl
runs-01401-01500/01409
runs-05001-05100/05063
- runs-03201-03300/03236
runs-06801-06900/06890
-
p20.pddl
runs-01401-01500/01410
runs-05001-05100/05064
- runs-03201-03300/03237
runs-06801-06900/06891
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
sokoban-opt08-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01401-01500/01411
runs-05001-05100/05065
- runs-03201-03300/03238
runs-06801-06900/06892
-
p02.pddl
runs-01401-01500/01412
runs-05001-05100/05066
- runs-03201-03300/03239
runs-06801-06900/06893
-
p03.pddl
runs-01401-01500/01413
runs-05001-05100/05067
- runs-03201-03300/03240
runs-06801-06900/06894
-
p04.pddl
runs-01401-01500/01414
runs-05001-05100/05068
- runs-03201-03300/03241
runs-06801-06900/06895
-
p05.pddl
runs-01401-01500/01415
runs-05001-05100/05069
- runs-03201-03300/03242
runs-06801-06900/06896
-
p06.pddl
runs-01401-01500/01416
runs-05001-05100/05070
- runs-03201-03300/03243
runs-06801-06900/06897
-
p07.pddl
runs-01401-01500/01417
runs-05001-05100/05071
- runs-03201-03300/03244
runs-06801-06900/06898
-
p08.pddl
runs-01401-01500/01418
runs-05001-05100/05072
- runs-03201-03300/03245
runs-06801-06900/06899
-
p09.pddl
runs-01401-01500/01419
runs-05001-05100/05073
- runs-03201-03300/03246
runs-06801-06900/06900
-
p10.pddl
runs-01401-01500/01420
runs-05001-05100/05074
- runs-03201-03300/03247
runs-06901-07000/06901
-
p11.pddl
runs-01401-01500/01421
runs-05001-05100/05075
- runs-03201-03300/03248
runs-06901-07000/06902
-
p12.pddl
runs-01401-01500/01422
runs-05001-05100/05076
- runs-03201-03300/03249
runs-06901-07000/06903
-
p13.pddl
runs-01401-01500/01423
runs-05001-05100/05077
- runs-03201-03300/03250
runs-06901-07000/06904
-
p14.pddl
runs-01401-01500/01424
runs-05001-05100/05078
- runs-03201-03300/03251
runs-06901-07000/06905
-
p15.pddl
runs-01401-01500/01425
runs-05001-05100/05079
- runs-03201-03300/03252
runs-06901-07000/06906
-
p16.pddl
runs-01401-01500/01426
runs-05001-05100/05080
- runs-03201-03300/03253
runs-06901-07000/06907
-
p17.pddl
runs-01401-01500/01427
runs-05001-05100/05081
- runs-03201-03300/03254
runs-06901-07000/06908
-
p18.pddl
runs-01401-01500/01428
runs-05001-05100/05082
- runs-03201-03300/03255
runs-06901-07000/06909
-
p19.pddl
runs-01401-01500/01429
runs-05001-05100/05083
- runs-03201-03300/03256
runs-06901-07000/06910
-
p20.pddl
runs-01401-01500/01430
runs-05001-05100/05084
- runs-03201-03300/03257
runs-06901-07000/06911
-
p21.pddl
runs-01401-01500/01431
runs-05001-05100/05085
- runs-03201-03300/03258
runs-06901-07000/06912
-
p22.pddl
runs-01401-01500/01432
runs-05001-05100/05086
- runs-03201-03300/03259
runs-06901-07000/06913
-
p23.pddl
runs-01401-01500/01433
runs-05001-05100/05087
- runs-03201-03300/03260
runs-06901-07000/06914
-
p24.pddl
runs-01401-01500/01434
runs-05001-05100/05088
- runs-03201-03300/03261
runs-06901-07000/06915
-
p25.pddl
runs-01401-01500/01435
runs-05001-05100/05089
- runs-03201-03300/03262
runs-06901-07000/06916
-
p26.pddl
runs-01401-01500/01436
runs-05001-05100/05090
- runs-03201-03300/03263
runs-06901-07000/06917
-
p27.pddl
runs-01401-01500/01437
runs-05001-05100/05091
- runs-03201-03300/03264
runs-06901-07000/06918
-
p28.pddl
runs-01401-01500/01438
runs-05001-05100/05092
- runs-03201-03300/03265
runs-06901-07000/06919
-
p29.pddl
runs-01401-01500/01439
runs-05001-05100/05093
- runs-03201-03300/03266
runs-06901-07000/06920
-
p30.pddl
runs-01401-01500/01440
runs-05001-05100/05094
- runs-03201-03300/03267
runs-06901-07000/06921
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
sokoban-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01401-01500/01441
runs-05001-05100/05095
- runs-03201-03300/03268
runs-06901-07000/06922
-
p02.pddl
runs-01401-01500/01442
runs-05001-05100/05096
- runs-03201-03300/03269
runs-06901-07000/06923
-
p03.pddl
runs-01401-01500/01443
runs-05001-05100/05097
- runs-03201-03300/03270
runs-06901-07000/06924
-
p04.pddl
runs-01401-01500/01444
runs-05001-05100/05098
- runs-03201-03300/03271
runs-06901-07000/06925
-
p05.pddl
runs-01401-01500/01445
runs-05001-05100/05099
- runs-03201-03300/03272
runs-06901-07000/06926
-
p06.pddl
runs-01401-01500/01446
runs-05001-05100/05100
- runs-03201-03300/03273
runs-06901-07000/06927
-
p07.pddl
runs-01401-01500/01447
runs-05101-05200/05101
- runs-03201-03300/03274
runs-06901-07000/06928
-
p08.pddl
runs-01401-01500/01448
runs-05101-05200/05102
- runs-03201-03300/03275
runs-06901-07000/06929
-
p09.pddl
runs-01401-01500/01449
runs-05101-05200/05103
- runs-03201-03300/03276
runs-06901-07000/06930
-
p10.pddl
runs-01401-01500/01450
runs-05101-05200/05104
- runs-03201-03300/03277
runs-06901-07000/06931
-
p11.pddl
runs-01401-01500/01451
runs-05101-05200/05105
- runs-03201-03300/03278
runs-06901-07000/06932
-
p12.pddl
runs-01401-01500/01452
runs-05101-05200/05106
- runs-03201-03300/03279
runs-06901-07000/06933
-
p13.pddl
runs-01401-01500/01453
runs-05101-05200/05107
- runs-03201-03300/03280
runs-06901-07000/06934
-
p14.pddl
runs-01401-01500/01454
runs-05101-05200/05108
- runs-03201-03300/03281
runs-06901-07000/06935
-
p15.pddl
runs-01401-01500/01455
runs-05101-05200/05109
- runs-03201-03300/03282
runs-06901-07000/06936
-
p16.pddl
runs-01401-01500/01456
runs-05101-05200/05110
- runs-03201-03300/03283
runs-06901-07000/06937
-
p17.pddl
runs-01401-01500/01457
runs-05101-05200/05111
- runs-03201-03300/03284
runs-06901-07000/06938
-
p18.pddl
runs-01401-01500/01458
runs-05101-05200/05112
- runs-03201-03300/03285
runs-06901-07000/06939
-
p19.pddl
runs-01401-01500/01459
runs-05101-05200/05113
- runs-03201-03300/03286
runs-06901-07000/06940
-
p20.pddl
runs-01401-01500/01460
runs-05101-05200/05114
- runs-03201-03300/03287
runs-06901-07000/06941
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
spider-opt18-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01401-01500/01461
runs-05101-05200/05115
- runs-03201-03300/03288
runs-06901-07000/06942
-
p02.pddl
runs-01401-01500/01462
runs-05101-05200/05116
- runs-03201-03300/03289
runs-06901-07000/06943
-
p03.pddl
runs-01401-01500/01463
runs-05101-05200/05117
- runs-03201-03300/03290
runs-06901-07000/06944
-
p04.pddl
runs-01401-01500/01464
runs-05101-05200/05118
- runs-03201-03300/03291
runs-06901-07000/06945
-
p05.pddl
runs-01401-01500/01465
runs-05101-05200/05119
- runs-03201-03300/03292
runs-06901-07000/06946
-
p06.pddl
runs-01401-01500/01466
runs-05101-05200/05120
- runs-03201-03300/03293
runs-06901-07000/06947
-
p07.pddl
runs-01401-01500/01467
runs-05101-05200/05121
- runs-03201-03300/03294
runs-06901-07000/06948
-
p08.pddl
runs-01401-01500/01468
runs-05101-05200/05122
- runs-03201-03300/03295
runs-06901-07000/06949
-
p09.pddl
runs-01401-01500/01469
runs-05101-05200/05123
- runs-03201-03300/03296
runs-06901-07000/06950
-
p10.pddl
runs-01401-01500/01470
runs-05101-05200/05124
- runs-03201-03300/03297
runs-06901-07000/06951
-
p11.pddl
runs-01401-01500/01471
runs-05101-05200/05125
- runs-03201-03300/03298
runs-06901-07000/06952
-
p12.pddl
runs-01401-01500/01472
runs-05101-05200/05126
- runs-03201-03300/03299
runs-06901-07000/06953
-
p13.pddl
runs-01401-01500/01473
runs-05101-05200/05127
- runs-03201-03300/03300
runs-06901-07000/06954
-
p14.pddl
runs-01401-01500/01474
runs-05101-05200/05128
- runs-03301-03400/03301
runs-06901-07000/06955
-
p15.pddl
runs-01401-01500/01475
runs-05101-05200/05129
- runs-03301-03400/03302
runs-06901-07000/06956
-
p16.pddl
runs-01401-01500/01476
runs-05101-05200/05130
- runs-03301-03400/03303
runs-06901-07000/06957
-
p17.pddl
runs-01401-01500/01477
runs-05101-05200/05131
- runs-03301-03400/03304
runs-06901-07000/06958
-
p18.pddl
runs-01401-01500/01478
runs-05101-05200/05132
- runs-03301-03400/03305
runs-06901-07000/06959
-
p19.pddl
runs-01401-01500/01479
runs-05101-05200/05133
- runs-03301-03400/03306
runs-06901-07000/06960
-
p20.pddl
runs-01401-01500/01480
runs-05101-05200/05134
- runs-03301-03400/03307
runs-06901-07000/06961
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
storage
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01401-01500/01481
runs-05101-05200/05135
- runs-03301-03400/03308
runs-06901-07000/06962
-
p02.pddl
runs-01401-01500/01482
runs-05101-05200/05136
- runs-03301-03400/03309
runs-06901-07000/06963
-
p03.pddl
runs-01401-01500/01483
runs-05101-05200/05137
- runs-03301-03400/03310
runs-06901-07000/06964
-
p04.pddl
runs-01401-01500/01484
runs-05101-05200/05138
- runs-03301-03400/03311
runs-06901-07000/06965
-
p05.pddl
runs-01401-01500/01485
runs-05101-05200/05139
- runs-03301-03400/03312
runs-06901-07000/06966
-
p06.pddl
runs-01401-01500/01486
runs-05101-05200/05140
- runs-03301-03400/03313
runs-06901-07000/06967
-
p07.pddl
runs-01401-01500/01487
runs-05101-05200/05141
- runs-03301-03400/03314
runs-06901-07000/06968
-
p08.pddl
runs-01401-01500/01488
runs-05101-05200/05142
- runs-03301-03400/03315
runs-06901-07000/06969
-
p09.pddl
runs-01401-01500/01489
runs-05101-05200/05143
- runs-03301-03400/03316
runs-06901-07000/06970
-
p10.pddl
runs-01401-01500/01490
runs-05101-05200/05144
- runs-03301-03400/03317
runs-06901-07000/06971
-
p11.pddl
runs-01401-01500/01491
runs-05101-05200/05145
- runs-03301-03400/03318
runs-06901-07000/06972
-
p12.pddl
runs-01401-01500/01492
runs-05101-05200/05146
- runs-03301-03400/03319
runs-06901-07000/06973
-
p13.pddl
runs-01401-01500/01493
runs-05101-05200/05147
- runs-03301-03400/03320
runs-06901-07000/06974
-
p14.pddl
runs-01401-01500/01494
runs-05101-05200/05148
- runs-03301-03400/03321
runs-06901-07000/06975
-
p15.pddl
runs-01401-01500/01495
runs-05101-05200/05149
- runs-03301-03400/03322
runs-06901-07000/06976
-
p16.pddl
runs-01401-01500/01496
runs-05101-05200/05150
- runs-03301-03400/03323
runs-06901-07000/06977
-
p17.pddl
runs-01401-01500/01497
runs-05101-05200/05151
- runs-03301-03400/03324
runs-06901-07000/06978
-
p18.pddl
runs-01401-01500/01498
runs-05101-05200/05152
- runs-03301-03400/03325
runs-06901-07000/06979
-
p19.pddl
runs-01401-01500/01499
runs-05101-05200/05153
- runs-03301-03400/03326
runs-06901-07000/06980
-
p20.pddl
runs-01401-01500/01500
runs-05101-05200/05154
- runs-03301-03400/03327
runs-06901-07000/06981
-
p21.pddl
runs-01501-01600/01501
runs-05101-05200/05155
- runs-03301-03400/03328
runs-06901-07000/06982
-
p22.pddl
runs-01501-01600/01502
runs-05101-05200/05156
- runs-03301-03400/03329
runs-06901-07000/06983
-
p23.pddl
runs-01501-01600/01503
runs-05101-05200/05157
- runs-03301-03400/03330
runs-06901-07000/06984
-
p24.pddl
runs-01501-01600/01504
runs-05101-05200/05158
- runs-03301-03400/03331
runs-06901-07000/06985
-
p25.pddl
runs-01501-01600/01505
runs-05101-05200/05159
- runs-03301-03400/03332
runs-06901-07000/06986
-
p26.pddl
runs-01501-01600/01506
runs-05101-05200/05160
- runs-03301-03400/03333
runs-06901-07000/06987
-
p27.pddl
runs-01501-01600/01507
runs-05101-05200/05161
- runs-03301-03400/03334
runs-06901-07000/06988
-
p28.pddl
runs-01501-01600/01508
runs-05101-05200/05162
- runs-03301-03400/03335
runs-06901-07000/06989
-
p29.pddl
runs-01501-01600/01509
runs-05101-05200/05163
- runs-03301-03400/03336
runs-06901-07000/06990
-
p30.pddl
runs-01501-01600/01510
runs-05101-05200/05164
- runs-03301-03400/03337
runs-06901-07000/06991
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
termes-opt18-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01501-01600/01511
runs-05101-05200/05165
- runs-03301-03400/03338
runs-06901-07000/06992
-
p02.pddl
runs-01501-01600/01512
runs-05101-05200/05166
- runs-03301-03400/03339
runs-06901-07000/06993
-
p03.pddl
runs-01501-01600/01513
runs-05101-05200/05167
- runs-03301-03400/03340
runs-06901-07000/06994
-
p04.pddl
runs-01501-01600/01514
runs-05101-05200/05168
- runs-03301-03400/03341
runs-06901-07000/06995
-
p05.pddl
runs-01501-01600/01515
runs-05101-05200/05169
- runs-03301-03400/03342
runs-06901-07000/06996
-
p06.pddl
runs-01501-01600/01516
runs-05101-05200/05170
- runs-03301-03400/03343
runs-06901-07000/06997
-
p07.pddl
runs-01501-01600/01517
runs-05101-05200/05171
- runs-03301-03400/03344
runs-06901-07000/06998
-
p08.pddl
runs-01501-01600/01518
runs-05101-05200/05172
- runs-03301-03400/03345
runs-06901-07000/06999
-
p09.pddl
runs-01501-01600/01519
runs-05101-05200/05173
- runs-03301-03400/03346
runs-06901-07000/07000
-
p10.pddl
runs-01501-01600/01520
runs-05101-05200/05174
- runs-03301-03400/03347
runs-07001-07100/07001
-
p11.pddl
runs-01501-01600/01521
runs-05101-05200/05175
- runs-03301-03400/03348
runs-07001-07100/07002
-
p12.pddl
runs-01501-01600/01522
runs-05101-05200/05176
- runs-03301-03400/03349
runs-07001-07100/07003
-
p13.pddl
runs-01501-01600/01523
runs-05101-05200/05177
- runs-03301-03400/03350
runs-07001-07100/07004
-
p14.pddl
runs-01501-01600/01524
runs-05101-05200/05178
- runs-03301-03400/03351
runs-07001-07100/07005
-
p15.pddl
runs-01501-01600/01525
runs-05101-05200/05179
- runs-03301-03400/03352
runs-07001-07100/07006
-
p16.pddl
runs-01501-01600/01526
runs-05101-05200/05180
- runs-03301-03400/03353
runs-07001-07100/07007
-
p17.pddl
runs-01501-01600/01527
runs-05101-05200/05181
- runs-03301-03400/03354
runs-07001-07100/07008
-
p18.pddl
runs-01501-01600/01528
runs-05101-05200/05182
- runs-03301-03400/03355
runs-07001-07100/07009
-
p19.pddl
runs-01501-01600/01529
runs-05101-05200/05183
- runs-03301-03400/03356
runs-07001-07100/07010
-
p20.pddl
runs-01501-01600/01530
runs-05101-05200/05184
- runs-03301-03400/03357
runs-07001-07100/07011
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
tetris-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
runs-01501-01600/01531
runs-05101-05200/05185
- runs-03301-03400/03358
runs-07001-07100/07012
-
p01-8.pddl
runs-01501-01600/01532
runs-05101-05200/05186
- runs-03301-03400/03359
runs-07001-07100/07013
-
p01-10.pddl
runs-01501-01600/01533
runs-05101-05200/05187
- runs-03301-03400/03360
runs-07001-07100/07014
-
p02-4.pddl
runs-01501-01600/01534
runs-05101-05200/05188
- runs-03301-03400/03361
runs-07001-07100/07015
-
p02-6.pddl
runs-01501-01600/01535
runs-05101-05200/05189
- runs-03301-03400/03362
runs-07001-07100/07016
-
p02-8.pddl
runs-01501-01600/01536
runs-05101-05200/05190
- runs-03301-03400/03363
runs-07001-07100/07017
-
p02-10.pddl
runs-01501-01600/01537
runs-05101-05200/05191
- runs-03301-03400/03364
runs-07001-07100/07018
-
p03-4.pddl
runs-01501-01600/01538
runs-05101-05200/05192
- runs-03301-03400/03365
runs-07001-07100/07019
-
p03-6.pddl
runs-01501-01600/01539
runs-05101-05200/05193
- runs-03301-03400/03366
runs-07001-07100/07020
-
p03-8.pddl
runs-01501-01600/01540
runs-05101-05200/05194
- runs-03301-03400/03367
runs-07001-07100/07021
-
p03-10.pddl
runs-01501-01600/01541
runs-05101-05200/05195
- runs-03301-03400/03368
runs-07001-07100/07022
-
p04-6.pddl
runs-01501-01600/01542
runs-05101-05200/05196
- runs-03301-03400/03369
runs-07001-07100/07023
-
p04-8.pddl
runs-01501-01600/01543
runs-05101-05200/05197
- runs-03301-03400/03370
runs-07001-07100/07024
-
p04-10.pddl
runs-01501-01600/01544
runs-05101-05200/05198
- runs-03301-03400/03371
runs-07001-07100/07025
-
p05-6.pddl
runs-01501-01600/01545
runs-05101-05200/05199
- runs-03301-03400/03372
runs-07001-07100/07026
-
p05-8.pddl
runs-01501-01600/01546
runs-05101-05200/05200
- runs-03301-03400/03373
runs-07001-07100/07027
-
p05-10.pddl
runs-01501-01600/01547
runs-05201-05300/05201
- runs-03301-03400/03374
runs-07001-07100/07028
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
tidybot-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01501-01600/01548
runs-05201-05300/05202
- runs-03301-03400/03375
runs-07001-07100/07029
-
p02.pddl
runs-01501-01600/01549
runs-05201-05300/05203
- runs-03301-03400/03376
runs-07001-07100/07030
-
p03.pddl
runs-01501-01600/01550
runs-05201-05300/05204
- runs-03301-03400/03377
runs-07001-07100/07031
-
p04.pddl
runs-01501-01600/01551
runs-05201-05300/05205
- runs-03301-03400/03378
runs-07001-07100/07032
-
p05.pddl
runs-01501-01600/01552
runs-05201-05300/05206
- runs-03301-03400/03379
runs-07001-07100/07033
-
p06.pddl
runs-01501-01600/01553
runs-05201-05300/05207
- runs-03301-03400/03380
runs-07001-07100/07034
-
p07.pddl
runs-01501-01600/01554
runs-05201-05300/05208
- runs-03301-03400/03381
runs-07001-07100/07035
-
p08.pddl
runs-01501-01600/01555
runs-05201-05300/05209
- runs-03301-03400/03382
runs-07001-07100/07036
-
p09.pddl
runs-01501-01600/01556
runs-05201-05300/05210
- runs-03301-03400/03383
runs-07001-07100/07037
-
p10.pddl
runs-01501-01600/01557
runs-05201-05300/05211
- runs-03301-03400/03384
runs-07001-07100/07038
-
p11.pddl
runs-01501-01600/01558
runs-05201-05300/05212
- runs-03301-03400/03385
runs-07001-07100/07039
-
p12.pddl
runs-01501-01600/01559
runs-05201-05300/05213
- runs-03301-03400/03386
runs-07001-07100/07040
-
p13.pddl
runs-01501-01600/01560
runs-05201-05300/05214
- runs-03301-03400/03387
runs-07001-07100/07041
-
p14.pddl
runs-01501-01600/01561
runs-05201-05300/05215
- runs-03301-03400/03388
runs-07001-07100/07042
-
p15.pddl
runs-01501-01600/01562
runs-05201-05300/05216
- runs-03301-03400/03389
runs-07001-07100/07043
-
p16.pddl
runs-01501-01600/01563
runs-05201-05300/05217
- runs-03301-03400/03390
runs-07001-07100/07044
-
p17.pddl
runs-01501-01600/01564
runs-05201-05300/05218
- runs-03301-03400/03391
runs-07001-07100/07045
-
p18.pddl
runs-01501-01600/01565
runs-05201-05300/05219
- runs-03301-03400/03392
runs-07001-07100/07046
-
p19.pddl
runs-01501-01600/01566
runs-05201-05300/05220
- runs-03301-03400/03393
runs-07001-07100/07047
-
p20.pddl
runs-01501-01600/01567
runs-05201-05300/05221
- runs-03301-03400/03394
runs-07001-07100/07048
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
tidybot-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01501-01600/01568
runs-05201-05300/05222
- runs-03301-03400/03395
runs-07001-07100/07049
-
p02.pddl
runs-01501-01600/01569
runs-05201-05300/05223
- runs-03301-03400/03396
runs-07001-07100/07050
-
p03.pddl
runs-01501-01600/01570
runs-05201-05300/05224
- runs-03301-03400/03397
runs-07001-07100/07051
-
p04.pddl
runs-01501-01600/01571
runs-05201-05300/05225
- runs-03301-03400/03398
runs-07001-07100/07052
-
p05.pddl
runs-01501-01600/01572
runs-05201-05300/05226
- runs-03301-03400/03399
runs-07001-07100/07053
-
p06.pddl
runs-01501-01600/01573
runs-05201-05300/05227
- runs-03301-03400/03400
runs-07001-07100/07054
-
p07.pddl
runs-01501-01600/01574
runs-05201-05300/05228
- runs-03401-03500/03401
runs-07001-07100/07055
-
p08.pddl
runs-01501-01600/01575
runs-05201-05300/05229
- runs-03401-03500/03402
runs-07001-07100/07056
-
p09.pddl
runs-01501-01600/01576
runs-05201-05300/05230
- runs-03401-03500/03403
runs-07001-07100/07057
-
p10.pddl
runs-01501-01600/01577
runs-05201-05300/05231
- runs-03401-03500/03404
runs-07001-07100/07058
-
p11.pddl
runs-01501-01600/01578
runs-05201-05300/05232
- runs-03401-03500/03405
runs-07001-07100/07059
-
p12.pddl
runs-01501-01600/01579
runs-05201-05300/05233
- runs-03401-03500/03406
runs-07001-07100/07060
-
p13.pddl
runs-01501-01600/01580
runs-05201-05300/05234
- runs-03401-03500/03407
runs-07001-07100/07061
-
p14.pddl
runs-01501-01600/01581
runs-05201-05300/05235
- runs-03401-03500/03408
runs-07001-07100/07062
-
p15.pddl
runs-01501-01600/01582
runs-05201-05300/05236
- runs-03401-03500/03409
runs-07001-07100/07063
-
p16.pddl
runs-01501-01600/01583
runs-05201-05300/05237
- runs-03401-03500/03410
runs-07001-07100/07064
-
p17.pddl
runs-01501-01600/01584
runs-05201-05300/05238
- runs-03401-03500/03411
runs-07001-07100/07065
-
p18.pddl
runs-01501-01600/01585
runs-05201-05300/05239
- runs-03401-03500/03412
runs-07001-07100/07066
-
p19.pddl
runs-01501-01600/01586
runs-05201-05300/05240
- runs-03401-03500/03413
runs-07001-07100/07067
-
p20.pddl
runs-01501-01600/01587
runs-05201-05300/05241
- runs-03401-03500/03414
runs-07001-07100/07068
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
tpp
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01501-01600/01588
runs-05201-05300/05242
- runs-03401-03500/03415
runs-07001-07100/07069
-
p02.pddl
runs-01501-01600/01589
runs-05201-05300/05243
- runs-03401-03500/03416
runs-07001-07100/07070
-
p03.pddl
runs-01501-01600/01590
runs-05201-05300/05244
- runs-03401-03500/03417
runs-07001-07100/07071
-
p04.pddl
runs-01501-01600/01591
runs-05201-05300/05245
- runs-03401-03500/03418
runs-07001-07100/07072
-
p05.pddl
runs-01501-01600/01592
runs-05201-05300/05246
- runs-03401-03500/03419
runs-07001-07100/07073
-
p06.pddl
runs-01501-01600/01593
runs-05201-05300/05247
- runs-03401-03500/03420
runs-07001-07100/07074
-
p07.pddl
runs-01501-01600/01594
runs-05201-05300/05248
- runs-03401-03500/03421
runs-07001-07100/07075
-
p08.pddl
runs-01501-01600/01595
runs-05201-05300/05249
- runs-03401-03500/03422
runs-07001-07100/07076
-
p09.pddl
runs-01501-01600/01596
runs-05201-05300/05250
- runs-03401-03500/03423
runs-07001-07100/07077
-
p10.pddl
runs-01501-01600/01597
runs-05201-05300/05251
- runs-03401-03500/03424
runs-07001-07100/07078
-
p11.pddl
runs-01501-01600/01598
runs-05201-05300/05252
- runs-03401-03500/03425
runs-07001-07100/07079
-
p12.pddl
runs-01501-01600/01599
runs-05201-05300/05253
- runs-03401-03500/03426
runs-07001-07100/07080
-
p13.pddl
runs-01501-01600/01600
runs-05201-05300/05254
- runs-03401-03500/03427
runs-07001-07100/07081
-
p14.pddl
runs-01601-01700/01601
runs-05201-05300/05255
- runs-03401-03500/03428
runs-07001-07100/07082
-
p15.pddl
runs-01601-01700/01602
runs-05201-05300/05256
- runs-03401-03500/03429
runs-07001-07100/07083
-
p16.pddl
runs-01601-01700/01603
runs-05201-05300/05257
- runs-03401-03500/03430
runs-07001-07100/07084
-
p17.pddl
runs-01601-01700/01604
runs-05201-05300/05258
- runs-03401-03500/03431
runs-07001-07100/07085
-
p18.pddl
runs-01601-01700/01605
runs-05201-05300/05259
- runs-03401-03500/03432
runs-07001-07100/07086
-
p19.pddl
runs-01601-01700/01606
runs-05201-05300/05260
- runs-03401-03500/03433
runs-07001-07100/07087
-
p20.pddl
runs-01601-01700/01607
runs-05201-05300/05261
- runs-03401-03500/03434
runs-07001-07100/07088
-
p21.pddl
runs-01601-01700/01608
runs-05201-05300/05262
- runs-03401-03500/03435
runs-07001-07100/07089
-
p22.pddl
runs-01601-01700/01609
runs-05201-05300/05263
- runs-03401-03500/03436
runs-07001-07100/07090
-
p23.pddl
runs-01601-01700/01610
runs-05201-05300/05264
- runs-03401-03500/03437
runs-07001-07100/07091
-
p24.pddl
runs-01601-01700/01611
runs-05201-05300/05265
- runs-03401-03500/03438
runs-07001-07100/07092
-
p25.pddl
runs-01601-01700/01612
runs-05201-05300/05266
- runs-03401-03500/03439
runs-07001-07100/07093
-
p26.pddl
runs-01601-01700/01613
runs-05201-05300/05267
- runs-03401-03500/03440
runs-07001-07100/07094
-
p27.pddl
runs-01601-01700/01614
runs-05201-05300/05268
- runs-03401-03500/03441
runs-07001-07100/07095
-
p28.pddl
runs-01601-01700/01615
runs-05201-05300/05269
- runs-03401-03500/03442
runs-07001-07100/07096
-
p29.pddl
runs-01601-01700/01616
runs-05201-05300/05270
- runs-03401-03500/03443
runs-07001-07100/07097
-
p30.pddl
runs-01601-01700/01617
runs-05201-05300/05271
- runs-03401-03500/03444
runs-07001-07100/07098
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
transport-opt08-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01601-01700/01618
runs-05201-05300/05272
- runs-03401-03500/03445
runs-07001-07100/07099
-
p02.pddl
runs-01601-01700/01619
runs-05201-05300/05273
- runs-03401-03500/03446
runs-07001-07100/07100
-
p03.pddl
runs-01601-01700/01620
runs-05201-05300/05274
- runs-03401-03500/03447
runs-07101-07200/07101
-
p04.pddl
runs-01601-01700/01621
runs-05201-05300/05275
- runs-03401-03500/03448
runs-07101-07200/07102
-
p05.pddl
runs-01601-01700/01622
runs-05201-05300/05276
- runs-03401-03500/03449
runs-07101-07200/07103
-
p06.pddl
runs-01601-01700/01623
runs-05201-05300/05277
- runs-03401-03500/03450
runs-07101-07200/07104
-
p07.pddl
runs-01601-01700/01624
runs-05201-05300/05278
- runs-03401-03500/03451
runs-07101-07200/07105
-
p08.pddl
runs-01601-01700/01625
runs-05201-05300/05279
- runs-03401-03500/03452
runs-07101-07200/07106
-
p09.pddl
runs-01601-01700/01626
runs-05201-05300/05280
- runs-03401-03500/03453
runs-07101-07200/07107
-
p10.pddl
runs-01601-01700/01627
runs-05201-05300/05281
- runs-03401-03500/03454
runs-07101-07200/07108
-
p11.pddl
runs-01601-01700/01628
runs-05201-05300/05282
- runs-03401-03500/03455
runs-07101-07200/07109
-
p12.pddl
runs-01601-01700/01629
runs-05201-05300/05283
- runs-03401-03500/03456
runs-07101-07200/07110
-
p13.pddl
runs-01601-01700/01630
runs-05201-05300/05284
- runs-03401-03500/03457
runs-07101-07200/07111
-
p14.pddl
runs-01601-01700/01631
runs-05201-05300/05285
- runs-03401-03500/03458
runs-07101-07200/07112
-
p15.pddl
runs-01601-01700/01632
runs-05201-05300/05286
- runs-03401-03500/03459
runs-07101-07200/07113
-
p16.pddl
runs-01601-01700/01633
runs-05201-05300/05287
- runs-03401-03500/03460
runs-07101-07200/07114
-
p17.pddl
runs-01601-01700/01634
runs-05201-05300/05288
- runs-03401-03500/03461
runs-07101-07200/07115
-
p18.pddl
runs-01601-01700/01635
runs-05201-05300/05289
- runs-03401-03500/03462
runs-07101-07200/07116
-
p19.pddl
runs-01601-01700/01636
runs-05201-05300/05290
- runs-03401-03500/03463
runs-07101-07200/07117
-
p20.pddl
runs-01601-01700/01637
runs-05201-05300/05291
- runs-03401-03500/03464
runs-07101-07200/07118
-
p21.pddl
runs-01601-01700/01638
runs-05201-05300/05292
- runs-03401-03500/03465
runs-07101-07200/07119
-
p22.pddl
runs-01601-01700/01639
runs-05201-05300/05293
- runs-03401-03500/03466
runs-07101-07200/07120
-
p23.pddl
runs-01601-01700/01640
runs-05201-05300/05294
- runs-03401-03500/03467
runs-07101-07200/07121
-
p24.pddl
runs-01601-01700/01641
runs-05201-05300/05295
- runs-03401-03500/03468
runs-07101-07200/07122
-
p25.pddl
runs-01601-01700/01642
runs-05201-05300/05296
- runs-03401-03500/03469
runs-07101-07200/07123
-
p26.pddl
runs-01601-01700/01643
runs-05201-05300/05297
- runs-03401-03500/03470
runs-07101-07200/07124
-
p27.pddl
runs-01601-01700/01644
runs-05201-05300/05298
- runs-03401-03500/03471
runs-07101-07200/07125
-
p28.pddl
runs-01601-01700/01645
runs-05201-05300/05299
- runs-03401-03500/03472
runs-07101-07200/07126
-
p29.pddl
runs-01601-01700/01646
runs-05201-05300/05300
- runs-03401-03500/03473
runs-07101-07200/07127
-
p30.pddl
runs-01601-01700/01647
runs-05301-05400/05301
- runs-03401-03500/03474
runs-07101-07200/07128
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
transport-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01601-01700/01648
runs-05301-05400/05302
- runs-03401-03500/03475
runs-07101-07200/07129
-
p02.pddl
runs-01601-01700/01649
runs-05301-05400/05303
- runs-03401-03500/03476
runs-07101-07200/07130
-
p03.pddl
runs-01601-01700/01650
runs-05301-05400/05304
- runs-03401-03500/03477
runs-07101-07200/07131
-
p04.pddl
runs-01601-01700/01651
runs-05301-05400/05305
- runs-03401-03500/03478
runs-07101-07200/07132
-
p05.pddl
runs-01601-01700/01652
runs-05301-05400/05306
- runs-03401-03500/03479
runs-07101-07200/07133
-
p06.pddl
runs-01601-01700/01653
runs-05301-05400/05307
- runs-03401-03500/03480
runs-07101-07200/07134
-
p07.pddl
runs-01601-01700/01654
runs-05301-05400/05308
- runs-03401-03500/03481
runs-07101-07200/07135
-
p08.pddl
runs-01601-01700/01655
runs-05301-05400/05309
- runs-03401-03500/03482
runs-07101-07200/07136
-
p09.pddl
runs-01601-01700/01656
runs-05301-05400/05310
- runs-03401-03500/03483
runs-07101-07200/07137
-
p10.pddl
runs-01601-01700/01657
runs-05301-05400/05311
- runs-03401-03500/03484
runs-07101-07200/07138
-
p11.pddl
runs-01601-01700/01658
runs-05301-05400/05312
- runs-03401-03500/03485
runs-07101-07200/07139
-
p12.pddl
runs-01601-01700/01659
runs-05301-05400/05313
- runs-03401-03500/03486
runs-07101-07200/07140
-
p13.pddl
runs-01601-01700/01660
runs-05301-05400/05314
- runs-03401-03500/03487
runs-07101-07200/07141
-
p14.pddl
runs-01601-01700/01661
runs-05301-05400/05315
- runs-03401-03500/03488
runs-07101-07200/07142
-
p15.pddl
runs-01601-01700/01662
runs-05301-05400/05316
- runs-03401-03500/03489
runs-07101-07200/07143
-
p16.pddl
runs-01601-01700/01663
runs-05301-05400/05317
- runs-03401-03500/03490
runs-07101-07200/07144
-
p17.pddl
runs-01601-01700/01664
runs-05301-05400/05318
- runs-03401-03500/03491
runs-07101-07200/07145
-
p18.pddl
runs-01601-01700/01665
runs-05301-05400/05319
- runs-03401-03500/03492
runs-07101-07200/07146
-
p19.pddl
runs-01601-01700/01666
runs-05301-05400/05320
- runs-03401-03500/03493
runs-07101-07200/07147
-
p20.pddl
runs-01601-01700/01667
runs-05301-05400/05321
- runs-03401-03500/03494
runs-07101-07200/07148
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
transport-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01601-01700/01668
runs-05301-05400/05322
- runs-03401-03500/03495
runs-07101-07200/07149
-
p02.pddl
runs-01601-01700/01669
runs-05301-05400/05323
- runs-03401-03500/03496
runs-07101-07200/07150
-
p03.pddl
runs-01601-01700/01670
runs-05301-05400/05324
- runs-03401-03500/03497
runs-07101-07200/07151
-
p04.pddl
runs-01601-01700/01671
runs-05301-05400/05325
- runs-03401-03500/03498
runs-07101-07200/07152
-
p05.pddl
runs-01601-01700/01672
runs-05301-05400/05326
- runs-03401-03500/03499
runs-07101-07200/07153
-
p06.pddl
runs-01601-01700/01673
runs-05301-05400/05327
- runs-03401-03500/03500
runs-07101-07200/07154
-
p07.pddl
runs-01601-01700/01674
runs-05301-05400/05328
- runs-03501-03600/03501
runs-07101-07200/07155
-
p08.pddl
runs-01601-01700/01675
runs-05301-05400/05329
- runs-03501-03600/03502
runs-07101-07200/07156
-
p09.pddl
runs-01601-01700/01676
runs-05301-05400/05330
- runs-03501-03600/03503
runs-07101-07200/07157
-
p10.pddl
runs-01601-01700/01677
runs-05301-05400/05331
- runs-03501-03600/03504
runs-07101-07200/07158
-
p11.pddl
runs-01601-01700/01678
runs-05301-05400/05332
- runs-03501-03600/03505
runs-07101-07200/07159
-
p12.pddl
runs-01601-01700/01679
runs-05301-05400/05333
- runs-03501-03600/03506
runs-07101-07200/07160
-
p13.pddl
runs-01601-01700/01680
runs-05301-05400/05334
- runs-03501-03600/03507
runs-07101-07200/07161
-
p14.pddl
runs-01601-01700/01681
runs-05301-05400/05335
- runs-03501-03600/03508
runs-07101-07200/07162
-
p15.pddl
runs-01601-01700/01682
runs-05301-05400/05336
- runs-03501-03600/03509
runs-07101-07200/07163
-
p16.pddl
runs-01601-01700/01683
runs-05301-05400/05337
- runs-03501-03600/03510
runs-07101-07200/07164
-
p17.pddl
runs-01601-01700/01684
runs-05301-05400/05338
- runs-03501-03600/03511
runs-07101-07200/07165
-
p18.pddl
runs-01601-01700/01685
runs-05301-05400/05339
- runs-03501-03600/03512
runs-07101-07200/07166
-
p19.pddl
runs-01601-01700/01686
runs-05301-05400/05340
- runs-03501-03600/03513
runs-07101-07200/07167
-
p20.pddl
runs-01601-01700/01687
runs-05301-05400/05341
- runs-03501-03600/03514
runs-07101-07200/07168
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
trucks-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01601-01700/01688
runs-05301-05400/05342
- runs-03501-03600/03515
runs-07101-07200/07169
-
p02.pddl
runs-01601-01700/01689
runs-05301-05400/05343
- runs-03501-03600/03516
runs-07101-07200/07170
-
p03.pddl
runs-01601-01700/01690
runs-05301-05400/05344
- runs-03501-03600/03517
runs-07101-07200/07171
-
p04.pddl
runs-01601-01700/01691
runs-05301-05400/05345
- runs-03501-03600/03518
runs-07101-07200/07172
-
p05.pddl
runs-01601-01700/01692
runs-05301-05400/05346
- runs-03501-03600/03519
runs-07101-07200/07173
-
p06.pddl
runs-01601-01700/01693
runs-05301-05400/05347
- runs-03501-03600/03520
runs-07101-07200/07174
-
p07.pddl
runs-01601-01700/01694
runs-05301-05400/05348
- runs-03501-03600/03521
runs-07101-07200/07175
-
p08.pddl
runs-01601-01700/01695
runs-05301-05400/05349
- runs-03501-03600/03522
runs-07101-07200/07176
-
p09.pddl
runs-01601-01700/01696
runs-05301-05400/05350
- runs-03501-03600/03523
runs-07101-07200/07177
-
p10.pddl
runs-01601-01700/01697
runs-05301-05400/05351
- runs-03501-03600/03524
runs-07101-07200/07178
-
p11.pddl
runs-01601-01700/01698
runs-05301-05400/05352
- runs-03501-03600/03525
runs-07101-07200/07179
-
p12.pddl
runs-01601-01700/01699
runs-05301-05400/05353
- runs-03501-03600/03526
runs-07101-07200/07180
-
p13.pddl
runs-01601-01700/01700
runs-05301-05400/05354
- runs-03501-03600/03527
runs-07101-07200/07181
-
p14.pddl
runs-01701-01800/01701
runs-05301-05400/05355
- runs-03501-03600/03528
runs-07101-07200/07182
-
p15.pddl
runs-01701-01800/01702
runs-05301-05400/05356
- runs-03501-03600/03529
runs-07101-07200/07183
-
p16.pddl
runs-01701-01800/01703
runs-05301-05400/05357
- runs-03501-03600/03530
runs-07101-07200/07184
-
p17.pddl
runs-01701-01800/01704
runs-05301-05400/05358
- runs-03501-03600/03531
runs-07101-07200/07185
-
p18.pddl
runs-01701-01800/01705
runs-05301-05400/05359
- runs-03501-03600/03532
runs-07101-07200/07186
-
p19.pddl
runs-01701-01800/01706
runs-05301-05400/05360
- runs-03501-03600/03533
runs-07101-07200/07187
-
p20.pddl
runs-01701-01800/01707
runs-05301-05400/05361
- runs-03501-03600/03534
runs-07101-07200/07188
-
p21.pddl
runs-01701-01800/01708
runs-05301-05400/05362
- runs-03501-03600/03535
runs-07101-07200/07189
-
p22.pddl
runs-01701-01800/01709
runs-05301-05400/05363
- runs-03501-03600/03536
runs-07101-07200/07190
-
p23.pddl
runs-01701-01800/01710
runs-05301-05400/05364
- runs-03501-03600/03537
runs-07101-07200/07191
-
p24.pddl
runs-01701-01800/01711
runs-05301-05400/05365
- runs-03501-03600/03538
runs-07101-07200/07192
-
p25.pddl
runs-01701-01800/01712
runs-05301-05400/05366
- runs-03501-03600/03539
runs-07101-07200/07193
-
p26.pddl
runs-01701-01800/01713
runs-05301-05400/05367
- runs-03501-03600/03540
runs-07101-07200/07194
-
p27.pddl
runs-01701-01800/01714
runs-05301-05400/05368
- runs-03501-03600/03541
runs-07101-07200/07195
-
p28.pddl
runs-01701-01800/01715
runs-05301-05400/05369
- runs-03501-03600/03542
runs-07101-07200/07196
-
p29.pddl
runs-01701-01800/01716
runs-05301-05400/05370
- runs-03501-03600/03543
runs-07101-07200/07197
-
p30.pddl
runs-01701-01800/01717
runs-05301-05400/05371
- runs-03501-03600/03544
runs-07101-07200/07198
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
visitall-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
runs-01701-01800/01718
runs-05301-05400/05372
- runs-03501-03600/03545
runs-07101-07200/07199
-
problem02-half.pddl
runs-01701-01800/01719
runs-05301-05400/05373
- runs-03501-03600/03546
runs-07101-07200/07200
-
problem03-full.pddl
runs-01701-01800/01720
runs-05301-05400/05374
- runs-03501-03600/03547
runs-07201-07300/07201
-
problem03-half.pddl
runs-01701-01800/01721
runs-05301-05400/05375
- runs-03501-03600/03548
runs-07201-07300/07202
-
problem04-full.pddl
runs-01701-01800/01722
runs-05301-05400/05376
- runs-03501-03600/03549
runs-07201-07300/07203
-
problem04-half.pddl
runs-01701-01800/01723
runs-05301-05400/05377
- runs-03501-03600/03550
runs-07201-07300/07204
-
problem05-full.pddl
runs-01701-01800/01724
runs-05301-05400/05378
- runs-03501-03600/03551
runs-07201-07300/07205
-
problem05-half.pddl
runs-01701-01800/01725
runs-05301-05400/05379
- runs-03501-03600/03552
runs-07201-07300/07206
-
problem06-full.pddl
runs-01701-01800/01726
runs-05301-05400/05380
- runs-03501-03600/03553
runs-07201-07300/07207
-
problem06-half.pddl
runs-01701-01800/01727
runs-05301-05400/05381
- runs-03501-03600/03554
runs-07201-07300/07208
-
problem07-full.pddl
runs-01701-01800/01728
runs-05301-05400/05382
- runs-03501-03600/03555
runs-07201-07300/07209
-
problem07-half.pddl
runs-01701-01800/01729
runs-05301-05400/05383
- runs-03501-03600/03556
runs-07201-07300/07210
-
problem08-full.pddl
runs-01701-01800/01730
runs-05301-05400/05384
- runs-03501-03600/03557
runs-07201-07300/07211
-
problem08-half.pddl
runs-01701-01800/01731
runs-05301-05400/05385
- runs-03501-03600/03558
runs-07201-07300/07212
-
problem09-full.pddl
runs-01701-01800/01732
runs-05301-05400/05386
- runs-03501-03600/03559
runs-07201-07300/07213
-
problem09-half.pddl
runs-01701-01800/01733
runs-05301-05400/05387
- runs-03501-03600/03560
runs-07201-07300/07214
-
problem10-full.pddl
runs-01701-01800/01734
runs-05301-05400/05388
- runs-03501-03600/03561
runs-07201-07300/07215
-
problem10-half.pddl
runs-01701-01800/01735
runs-05301-05400/05389
- runs-03501-03600/03562
runs-07201-07300/07216
-
problem11-full.pddl
runs-01701-01800/01736
runs-05301-05400/05390
- runs-03501-03600/03563
runs-07201-07300/07217
-
problem11-half.pddl
runs-01701-01800/01737
runs-05301-05400/05391
- runs-03501-03600/03564
runs-07201-07300/07218
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
visitall-opt14-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
runs-01701-01800/01738
runs-05301-05400/05392
- runs-03501-03600/03565
runs-07201-07300/07219
-
p-1-6.pddl
runs-01701-01800/01739
runs-05301-05400/05393
- runs-03501-03600/03566
runs-07201-07300/07220
-
p-1-7.pddl
runs-01701-01800/01740
runs-05301-05400/05394
- runs-03501-03600/03567
runs-07201-07300/07221
-
p-1-8.pddl
runs-01701-01800/01741
runs-05301-05400/05395
- runs-03501-03600/03568
runs-07201-07300/07222
-
p-1-9.pddl
runs-01701-01800/01742
runs-05301-05400/05396
- runs-03501-03600/03569
runs-07201-07300/07223
-
p-1-10.pddl
runs-01701-01800/01743
runs-05301-05400/05397
- runs-03501-03600/03570
runs-07201-07300/07224
-
p-1-11.pddl
runs-01701-01800/01744
runs-05301-05400/05398
- runs-03501-03600/03571
runs-07201-07300/07225
-
p-1-12.pddl
runs-01701-01800/01745
runs-05301-05400/05399
- runs-03501-03600/03572
runs-07201-07300/07226
-
p-1-13.pddl
runs-01701-01800/01746
runs-05301-05400/05400
- runs-03501-03600/03573
runs-07201-07300/07227
-
p-1-14.pddl
runs-01701-01800/01747
runs-05401-05500/05401
- runs-03501-03600/03574
runs-07201-07300/07228
-
p-1-15.pddl
runs-01701-01800/01748
runs-05401-05500/05402
- runs-03501-03600/03575
runs-07201-07300/07229
-
p-1-16.pddl
runs-01701-01800/01749
runs-05401-05500/05403
- runs-03501-03600/03576
runs-07201-07300/07230
-
p-1-17.pddl
runs-01701-01800/01750
runs-05401-05500/05404
- runs-03501-03600/03577
runs-07201-07300/07231
-
p-1-18.pddl
runs-01701-01800/01751
runs-05401-05500/05405
- runs-03501-03600/03578
runs-07201-07300/07232
-
p-05-5.pddl
runs-01701-01800/01752
runs-05401-05500/05406
- runs-03501-03600/03579
runs-07201-07300/07233
-
p-05-6.pddl
runs-01701-01800/01753
runs-05401-05500/05407
- runs-03501-03600/03580
runs-07201-07300/07234
-
p-05-7.pddl
runs-01701-01800/01754
runs-05401-05500/05408
- runs-03501-03600/03581
runs-07201-07300/07235
-
p-05-8.pddl
runs-01701-01800/01755
runs-05401-05500/05409
- runs-03501-03600/03582
runs-07201-07300/07236
-
p-05-9.pddl
runs-01701-01800/01756
runs-05401-05500/05410
- runs-03501-03600/03583
runs-07201-07300/07237
-
p-05-10.pddl
runs-01701-01800/01757
runs-05401-05500/05411
- runs-03501-03600/03584
runs-07201-07300/07238
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
woodworking-opt08-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01701-01800/01758
runs-05401-05500/05412
- runs-03501-03600/03585
runs-07201-07300/07239
-
p02.pddl
runs-01701-01800/01759
runs-05401-05500/05413
- runs-03501-03600/03586
runs-07201-07300/07240
-
p03.pddl
runs-01701-01800/01760
runs-05401-05500/05414
- runs-03501-03600/03587
runs-07201-07300/07241
-
p04.pddl
runs-01701-01800/01761
runs-05401-05500/05415
- runs-03501-03600/03588
runs-07201-07300/07242
-
p05.pddl
runs-01701-01800/01762
runs-05401-05500/05416
- runs-03501-03600/03589
runs-07201-07300/07243
-
p06.pddl
runs-01701-01800/01763
runs-05401-05500/05417
- runs-03501-03600/03590
runs-07201-07300/07244
-
p07.pddl
runs-01701-01800/01764
runs-05401-05500/05418
- runs-03501-03600/03591
runs-07201-07300/07245
-
p08.pddl
runs-01701-01800/01765
runs-05401-05500/05419
- runs-03501-03600/03592
runs-07201-07300/07246
-
p09.pddl
runs-01701-01800/01766
runs-05401-05500/05420
- runs-03501-03600/03593
runs-07201-07300/07247
-
p10.pddl
runs-01701-01800/01767
runs-05401-05500/05421
- runs-03501-03600/03594
runs-07201-07300/07248
-
p11.pddl
runs-01701-01800/01768
runs-05401-05500/05422
- runs-03501-03600/03595
runs-07201-07300/07249
-
p12.pddl
runs-01701-01800/01769
runs-05401-05500/05423
- runs-03501-03600/03596
runs-07201-07300/07250
-
p13.pddl
runs-01701-01800/01770
runs-05401-05500/05424
- runs-03501-03600/03597
runs-07201-07300/07251
-
p14.pddl
runs-01701-01800/01771
runs-05401-05500/05425
- runs-03501-03600/03598
runs-07201-07300/07252
-
p15.pddl
runs-01701-01800/01772
runs-05401-05500/05426
- runs-03501-03600/03599
runs-07201-07300/07253
-
p16.pddl
runs-01701-01800/01773
runs-05401-05500/05427
- runs-03501-03600/03600
runs-07201-07300/07254
-
p17.pddl
runs-01701-01800/01774
runs-05401-05500/05428
- runs-03601-03700/03601
runs-07201-07300/07255
-
p18.pddl
runs-01701-01800/01775
runs-05401-05500/05429
- runs-03601-03700/03602
runs-07201-07300/07256
-
p19.pddl
runs-01701-01800/01776
runs-05401-05500/05430
- runs-03601-03700/03603
runs-07201-07300/07257
-
p20.pddl
runs-01701-01800/01777
runs-05401-05500/05431
- runs-03601-03700/03604
runs-07201-07300/07258
-
p21.pddl
runs-01701-01800/01778
runs-05401-05500/05432
- runs-03601-03700/03605
runs-07201-07300/07259
-
p22.pddl
runs-01701-01800/01779
runs-05401-05500/05433
- runs-03601-03700/03606
runs-07201-07300/07260
-
p23.pddl
runs-01701-01800/01780
runs-05401-05500/05434
- runs-03601-03700/03607
runs-07201-07300/07261
-
p24.pddl
runs-01701-01800/01781
runs-05401-05500/05435
- runs-03601-03700/03608
runs-07201-07300/07262
-
p25.pddl
runs-01701-01800/01782
runs-05401-05500/05436
- runs-03601-03700/03609
runs-07201-07300/07263
-
p26.pddl
runs-01701-01800/01783
runs-05401-05500/05437
- runs-03601-03700/03610
runs-07201-07300/07264
-
p27.pddl
runs-01701-01800/01784
runs-05401-05500/05438
- runs-03601-03700/03611
runs-07201-07300/07265
-
p28.pddl
runs-01701-01800/01785
runs-05401-05500/05439
- runs-03601-03700/03612
runs-07201-07300/07266
-
p29.pddl
runs-01701-01800/01786
runs-05401-05500/05440
- runs-03601-03700/03613
runs-07201-07300/07267
-
p30.pddl
runs-01701-01800/01787
runs-05401-05500/05441
- runs-03601-03700/03614
runs-07201-07300/07268
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
woodworking-opt11-strips
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01701-01800/01788
runs-05401-05500/05442
- runs-03601-03700/03615
runs-07201-07300/07269
-
p02.pddl
runs-01701-01800/01789
runs-05401-05500/05443
- runs-03601-03700/03616
runs-07201-07300/07270
-
p03.pddl
runs-01701-01800/01790
runs-05401-05500/05444
- runs-03601-03700/03617
runs-07201-07300/07271
-
p04.pddl
runs-01701-01800/01791
runs-05401-05500/05445
- runs-03601-03700/03618
runs-07201-07300/07272
-
p05.pddl
runs-01701-01800/01792
runs-05401-05500/05446
- runs-03601-03700/03619
runs-07201-07300/07273
-
p06.pddl
runs-01701-01800/01793
runs-05401-05500/05447
- runs-03601-03700/03620
runs-07201-07300/07274
-
p07.pddl
runs-01701-01800/01794
runs-05401-05500/05448
- runs-03601-03700/03621
runs-07201-07300/07275
-
p08.pddl
runs-01701-01800/01795
runs-05401-05500/05449
- runs-03601-03700/03622
runs-07201-07300/07276
-
p09.pddl
runs-01701-01800/01796
runs-05401-05500/05450
- runs-03601-03700/03623
runs-07201-07300/07277
-
p10.pddl
runs-01701-01800/01797
runs-05401-05500/05451
- runs-03601-03700/03624
runs-07201-07300/07278
-
p11.pddl
runs-01701-01800/01798
runs-05401-05500/05452
- runs-03601-03700/03625
runs-07201-07300/07279
-
p12.pddl
runs-01701-01800/01799
runs-05401-05500/05453
- runs-03601-03700/03626
runs-07201-07300/07280
-
p13.pddl
runs-01701-01800/01800
runs-05401-05500/05454
- runs-03601-03700/03627
runs-07201-07300/07281
-
p14.pddl
runs-01801-01900/01801
runs-05401-05500/05455
- runs-03601-03700/03628
runs-07201-07300/07282
-
p15.pddl
runs-01801-01900/01802
runs-05401-05500/05456
- runs-03601-03700/03629
runs-07201-07300/07283
-
p16.pddl
runs-01801-01900/01803
runs-05401-05500/05457
- runs-03601-03700/03630
runs-07201-07300/07284
-
p17.pddl
runs-01801-01900/01804
runs-05401-05500/05458
- runs-03601-03700/03631
runs-07201-07300/07285
-
p18.pddl
runs-01801-01900/01805
runs-05401-05500/05459
- runs-03601-03700/03632
runs-07201-07300/07286
-
p19.pddl
runs-01801-01900/01806
runs-05401-05500/05460
- runs-03601-03700/03633
runs-07201-07300/07287
-
p20.pddl
runs-01801-01900/01807
runs-05401-05500/05461
- runs-03601-03700/03634
runs-07201-07300/07288
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
zenotravel
Show table
run_dir
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
runs-01801-01900/01808
runs-05401-05500/05462
- runs-03601-03700/03635
runs-07201-07300/07289
-
p02.pddl
runs-01801-01900/01809
runs-05401-05500/05463
- runs-03601-03700/03636
runs-07201-07300/07290
-
p03.pddl
runs-01801-01900/01810
runs-05401-05500/05464
- runs-03601-03700/03637
runs-07201-07300/07291
-
p04.pddl
runs-01801-01900/01811
runs-05401-05500/05465
- runs-03601-03700/03638
runs-07201-07300/07292
-
p05.pddl
runs-01801-01900/01812
runs-05401-05500/05466
- runs-03601-03700/03639
runs-07201-07300/07293
-
p06.pddl
runs-01801-01900/01813
runs-05401-05500/05467
- runs-03601-03700/03640
runs-07201-07300/07294
-
p07.pddl
runs-01801-01900/01814
runs-05401-05500/05468
- runs-03601-03700/03641
runs-07201-07300/07295
-
p08.pddl
runs-01801-01900/01815
runs-05401-05500/05469
- runs-03601-03700/03642
runs-07201-07300/07296
-
p09.pddl
runs-01801-01900/01816
runs-05401-05500/05470
- runs-03601-03700/03643
runs-07201-07300/07297
-
p10.pddl
runs-01801-01900/01817
runs-05401-05500/05471
- runs-03601-03700/03644
runs-07201-07300/07298
-
p11.pddl
runs-01801-01900/01818
runs-05401-05500/05472
- runs-03601-03700/03645
runs-07201-07300/07299
-
p12.pddl
runs-01801-01900/01819
runs-05401-05500/05473
- runs-03601-03700/03646
runs-07201-07300/07300
-
p13.pddl
runs-01801-01900/01820
runs-05401-05500/05474
- runs-03601-03700/03647
runs-07301-07400/07301
-
p14.pddl
runs-01801-01900/01821
runs-05401-05500/05475
- runs-03601-03700/03648
runs-07301-07400/07302
-
p15.pddl
runs-01801-01900/01822
runs-05401-05500/05476
- runs-03601-03700/03649
runs-07301-07400/07303
-
p16.pddl
runs-01801-01900/01823
runs-05401-05500/05477
- runs-03601-03700/03650
runs-07301-07400/07304
-
p17.pddl
runs-01801-01900/01824
runs-05401-05500/05478
- runs-03601-03700/03651
runs-07301-07400/07305
-
p18.pddl
runs-01801-01900/01825
runs-05401-05500/05479
- runs-03601-03700/03652
runs-07301-07400/07306
-
p19.pddl
runs-01801-01900/01826
runs-05401-05500/05480
- runs-03601-03700/03653
runs-07301-07400/07307
-
p20.pddl
runs-01801-01900/01827
runs-05401-05500/05481
- runs-03601-03700/03654
runs-07301-07400/07308
-
Sum of diffs
None
None
Arithmetic mean of diffs
None
None
score_evaluations
Show table
The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9068 0.9068 0.0 0.2137 0.2137 0.0
p02.pddl
0.7365 0.7365 0.0 0.2042 0.2042 0.0
p03.pddl
0.8665 0.8665 0.0 0.1976 0.1976 0.0
p04.pddl
0.8476 0.8476 0.0 0.1924 0.1924 0.0
p05.pddl
0.8804 0.8804 0.0 0.2173 0.2173 0.0
p06.pddl
0.8918 0.8918 0.0 0.1487 0.1487 0.0
p07.pddl
0.6977 0.6977 0.0 0.2057 0.2057 0.0
p08.pddl
0.8678 0.8678 0.0 0.1738 0.1738 0.0
p09.pddl
0.8694 0.8694 0.0 0.1688 0.1688 0.0
p10.pddl
0.6948 0.6948 0.0 0.2286 0.2286 0.0
p11.pddl
0.8384 0.8384 0.0 0.1859 0.1859 0.0
p12.pddl
0.7903 0.7903 0.0 0.1935 0.1935 0.0
p13.pddl
0.8210 0.8210 0.0 0.2225 0.2225 0.0
p14.pddl
0.8498 0.8498 0.0 0.2055 0.2055 0.0
p15.pddl
0.7104 0.7104 0.0 0.1678 0.1678 0.0
p16.pddl
0.8414 0.8414 0.0 0.1805 0.1805 0.0
p17.pddl
0.8210 0.8210 0.0 0.1861 0.1861 0.0
p18.pddl
0.6131 0.6131 0.0 0.1793 0.1793 0.0
p19.pddl
0.8350 0.8350 0.0 0.2126 0.2126 0.0
p20.pddl
0.7876 0.7876 0.0 0.1827 0.1827 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
airport
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-airport1-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-airport1-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-airport2-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-airport2-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-airport2-p2.pddl
0.9858 0.9858 0.0 0.9906 0.9906 0.0
p07-airport2-p2.pddl
0.9927 0.9927 0.0 0.9830 0.9830 0.0
p08-airport2-p3.pddl
0.7525 0.7525 0.0 0.8179 0.8179 0.0
p09-airport2-p4.pddl
0.7150 0.7150 0.0 0.4961 0.4961 0.0
p10-airport3-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-airport3-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-airport3-p2.pddl
0.9149 0.9149 0.0 0.9968 0.9968 0.0
p13-airport3-p2.pddl
0.9858 0.9858 0.0 0.9968 0.9968 0.0
p14-airport3-p3.pddl
0.5359 0.5359 0.0 0.9018 0.9018 0.0
p15-airport3-p3.pddl
0.7568 0.7568 0.0 0.8426 0.8426 0.0
p16-airport3-p4.pddl
0.3260 0.3260 0.0 0.4633 0.4633 0.0
p17-airport3-p5.pddl
0.4601 0.4601 0.0 0.1458 0.1458 0.0
p18-airport3-p6.pddl
0.3314 0.3314 0.0 -0.0000 -0.0000 0.0
p19-airport3-p6.pddl
0.4429 0.4429 0.0 -0.0000 -0.0000 0.0
p20-airport3-p7.pddl
0.2428 0.2428 0.0 -0.0000 -0.0000 0.0
p21-airport4halfMUC-p2.pddl
0.7510 0.7510 0.0 0.8814 0.8814 0.0
p22-airport4halfMUC-p3.pddl
0.2320 0.2320 0.0 0.7908 0.7908 0.0
p23-airport4halfMUC-p4.pddl
0.1910 0.1910 0.0 0.7477 0.7477 0.0
p24-airport4halfMUC-p4.pddl
0.2176 0.2176 0.0 0.7404 0.7404 0.0
p25-airport4halfMUC-p5.pddl
0.1964 0.1964 0.0 0 0 0.0
p26-airport4halfMUC-p6.pddl
0 0 0.0 0 0 0.0
p27-airport4halfMUC-p6.pddl
0.2045 0.2045 0.0 0 0 0.0
p28-airport4halfMUC-p7.pddl
0 0 0.0 0 0 0.0
p29-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p30-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p31-airport4halfMUC-p9.pddl
0 0 0.0 0 0 0.0
p32-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p33-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p34-airport4halfMUC-p11.pddl
0 0 0.0 0 0 0.0
p35-airport4halfMUC-p12.pddl
0 0 0.0 0 0 0.0
p36-airport5MUC-p2.pddl
0.9027 0.9027 0.0 0.7581 0.7581 0.0
p37-airport5MUC-p3.pddl
0.2571 0.2571 0.0 0.0135 0.0135 0.0
p38-airport5MUC-p3.pddl
0.2245 0.2245 0.0 0.2464 0.2464 0.0
p39-airport5MUC-p4.pddl
0.2161 0.2161 0.0 0 0 0.0
p40-airport5MUC-p4.pddl
0.4411 0.4411 0.0 0.0151 0.0151 0.0
p41-airport5MUC-p4.pddl
0.2285 0.2285 0.0 0 0 0.0
p42-airport5MUC-p5.pddl
0 0 0.0 0 0 0.0
p43-airport5MUC-p5.pddl
0.2145 0.2145 0.0 0.1788 0.1788 0.0
p44-airport5MUC-p5.pddl
0.1924 0.1924 0.0 0 0 0.0
p45-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p46-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p47-airport5MUC-p8.pddl
0 0 0.0 0 0 0.0
p48-airport5MUC-p9.pddl
0 0 0.0 0 0 0.0
p49-airport5MUC-p10.pddl
0 0 0.0 0 0 0.0
p50-airport5MUC-p15.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
barman-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
0.6817 0.6817 0.0 0.4011 0.4011 0.0
pfile01-002.pddl
0.7617 0.7617 0.0 0.4298 0.4298 0.0
pfile01-003.pddl
0.7610 0.7610 0.0 0.4301 0.4301 0.0
pfile01-004.pddl
0.7598 0.7598 0.0 0.4298 0.4298 0.0
pfile02-005.pddl
0.6742 0.6742 0.0 0.2701 0.2701 0.0
pfile02-006.pddl
0.7097 0.7097 0.0 0.0234 0.0234 0.0
pfile02-007.pddl
0.6835 0.6835 0.0 0.2706 0.2706 0.0
pfile02-008.pddl
0.6887 0.6887 0.0 0.2455 0.2455 0.0
pfile03-009.pddl
0.6440 0.6440 0.0 0.1269 0.1269 0.0
pfile03-010.pddl
0.5831 0.5831 0.0 0.1262 0.1262 0.0
pfile03-011.pddl
0.6348 0.6348 0.0 0.1170 0.1170 0.0
pfile03-012.pddl
0.5911 0.5911 0.0 0.1168 0.1168 0.0
pfile04-013.pddl
0.5719 0.5719 0.0 -0.0000 -0.0000 0.0
pfile04-014.pddl
0.5698 0.5698 0.0 -0.0000 -0.0000 0.0
pfile04-015.pddl
0.5314 0.5314 0.0 -0.0000 -0.0000 0.0
pfile04-016.pddl
0.5297 0.5297 0.0 -0.0000 -0.0000 0.0
pfile05-017.pddl
0.5541 0.5541 0.0 -0.0000 -0.0000 0.0
pfile05-018.pddl
0.5534 0.5534 0.0 -0.0000 -0.0000 0.0
pfile05-019.pddl
0.5490 0.5490 0.0 -0.0000 -0.0000 0.0
pfile05-020.pddl
0.5687 0.5687 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
barman-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
0.6756 0.6756 0.0 0.0235 0.0235 0.0
p435-2.pddl
0.6289 0.6289 0.0 0.2690 0.2690 0.0
p435-3.pddl
0.6764 0.6764 0.0 0.0233 0.0233 0.0
p536-1.pddl
0.6387 0.6387 0.0 -0.0000 -0.0000 0.0
p536-2.pddl
0.5814 0.5814 0.0 0.1260 0.1260 0.0
p536-3.pddl
0.6441 0.6441 0.0 0.1269 0.1269 0.0
p638-1.pddl
0.5946 0.5946 0.0 -0.0000 -0.0000 0.0
p638-2.pddl
0.6269 0.6269 0.0 -0.0000 -0.0000 0.0
p638-3.pddl
0.5627 0.5627 0.0 -0.0000 -0.0000 0.0
p739-1.pddl
0.5703 0.5703 0.0 -0.0000 -0.0000 0.0
p739-2.pddl
0.5057 0.5057 0.0 -0.0000 -0.0000 0.0
p739-3.pddl
0.5445 0.5445 0.0 -0.0000 -0.0000 0.0
p839-1.pddl
0.5106 0.5106 0.0 -0.0000 -0.0000 0.0
p839-2.pddl
0.5210 0.5210 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
blocks
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-1.pddl
1.0000 1.0000 0.0 0.9811 0.9811 0.0
probBLOCKS-5-2.pddl
1.0000 1.0000 0.0 0.9338 0.9338 0.0
probBLOCKS-6-0.pddl
1.0000 1.0000 0.0 0.8996 0.8996 0.0
probBLOCKS-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-6-2.pddl
0.9937 0.9937 0.0 0.9724 0.9724 0.0
probBLOCKS-7-0.pddl
1.0000 1.0000 0.0 0.7478 0.7478 0.0
probBLOCKS-7-1.pddl
0.9411 0.9411 0.0 0.7464 0.7464 0.0
probBLOCKS-7-2.pddl
0.9450 0.9450 0.0 0.7993 0.7993 0.0
probBLOCKS-8-0.pddl
0.9732 0.9732 0.0 0.8313 0.8313 0.0
probBLOCKS-8-1.pddl
0.9858 0.9858 0.0 0.6900 0.6900 0.0
probBLOCKS-8-2.pddl
1.0000 1.0000 0.0 0.8914 0.8914 0.0
probBLOCKS-9-0.pddl
0.8562 0.8562 0.0 0.6488 0.6488 0.0
probBLOCKS-9-1.pddl
0.8411 0.8411 0.0 0.6414 0.6414 0.0
probBLOCKS-9-2.pddl
0.9362 0.9362 0.0 0.6619 0.6619 0.0
probBLOCKS-10-0.pddl
0.8652 0.8652 0.0 0.8649 0.8649 0.0
probBLOCKS-10-1.pddl
0.8627 0.8627 0.0 0.5149 0.5149 0.0
probBLOCKS-10-2.pddl
0.8421 0.8421 0.0 0.5833 0.5833 0.0
probBLOCKS-11-0.pddl
0.9280 0.9280 0.0 0.6023 0.6023 0.0
probBLOCKS-11-1.pddl
0.8468 0.8468 0.0 0.4779 0.4779 0.0
probBLOCKS-11-2.pddl
0.8922 0.8922 0.0 0.6633 0.6633 0.0
probBLOCKS-12-0.pddl
0.8343 0.8343 0.0 0.5563 0.5563 0.0
probBLOCKS-12-1.pddl
0.8324 0.8324 0.0 0.4866 0.4866 0.0
probBLOCKS-13-0.pddl
0.7249 0.7249 0.0 0.5348 0.5348 0.0
probBLOCKS-13-1.pddl
0.7515 0.7515 0.0 0.5279 0.5279 0.0
probBLOCKS-14-0.pddl
0.8506 0.8506 0.0 0.5773 0.5773 0.0
probBLOCKS-14-1.pddl
0.8073 0.8073 0.0 0.4989 0.4989 0.0
probBLOCKS-15-0.pddl
0.6629 0.6629 0.0 0.4462 0.4462 0.0
probBLOCKS-15-1.pddl
0.7875 0.7875 0.0 0.2089 0.2089 0.0
probBLOCKS-16-1.pddl
0.7553 0.7553 0.0 0.3812 0.3812 0.0
probBLOCKS-16-2.pddl
0.5578 0.5578 0.0 0.4027 0.4027 0.0
probBLOCKS-17-0.pddl
0.5468 0.5468 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
childsnack-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
0.8710 0.8710 0.0 -0.0000 -0.0000 0.0
child-snack_pfile01.pddl
0.9100 0.9100 0.0 -0.0000 -0.0000 0.0
child-snack_pfile02-2.pddl
0.8577 0.8577 0.0 -0.0000 -0.0000 0.0
child-snack_pfile02.pddl
0.8855 0.8855 0.0 -0.0000 -0.0000 0.0
child-snack_pfile03-2.pddl
0.7539 0.7539 0.0 -0.0000 -0.0000 0.0
child-snack_pfile03.pddl
0.7873 0.7873 0.0 -0.0000 -0.0000 0.0
child-snack_pfile04-2.pddl
0.8055 0.8055 0.0 0 0 0.0
child-snack_pfile04.pddl
0.7798 0.7798 0.0 0 0 0.0
child-snack_pfile05-2.pddl
0.7611 0.7611 0.0 0 0 0.0
child-snack_pfile05.pddl
0.7752 0.7752 0.0 0 0 0.0
child-snack_pfile06-2.pddl
0.7801 0.7801 0.0 0 0 0.0
child-snack_pfile06.pddl
0.7657 0.7657 0.0 0 0 0.0
child-snack_pfile07-2.pddl
0.7585 0.7585 0.0 0 0 0.0
child-snack_pfile07.pddl
0.7193 0.7193 0.0 0 0 0.0
child-snack_pfile08-2.pddl
0.7352 0.7352 0.0 0 0 0.0
child-snack_pfile08.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
data-network-opt18-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9286 0.9286 0.0
p02.pddl
1.0000 1.0000 0.0 0.9560 0.9560 0.0
p03.pddl
1.0000 1.0000 0.0 0.7168 0.7168 0.0
p04.pddl
1.0000 1.0000 0.0 0.8416 0.8416 0.0
p05.pddl
1.0000 1.0000 0.0 0.6359 0.6359 0.0
p06.pddl
1.0000 1.0000 0.0 0.6534 0.6534 0.0
p07.pddl
0.8814 0.8814 0.0 -0.0000 -0.0000 0.0
p08.pddl
0.5158 0.5158 0.0 0.5485 0.5485 0.0
p09.pddl
1.0000 1.0000 0.0 0.7369 0.7369 0.0
p10.pddl
1.0000 1.0000 0.0 0.8429 0.8429 0.0
p11.pddl
1.0000 1.0000 0.0 0.7087 0.7087 0.0
p12.pddl
1.0000 1.0000 0.0 0.6948 0.6948 0.0
p13.pddl
1.0000 1.0000 0.0 0.8014 0.8014 0.0
p14.pddl
0.6373 0.6373 0.0 0.6443 0.6443 0.0
p15.pddl
1.0000 1.0000 0.0 0.5956 0.5956 0.0
p16.pddl
0.8597 0.8597 0.0 0.3540 0.3540 0.0
p17.pddl
1.0000 1.0000 0.0 0.5641 0.5641 0.0
p18.pddl
0.4842 0.4842 0.0 -0.0000 -0.0000 0.0
p19.pddl
1.0000 1.0000 0.0 0.1945 0.1945 0.0
p20.pddl
0.6286 0.6286 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
depot
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9724 0.9724 0.0
p02.pddl
1.0000 1.0000 0.0 0.9100 0.9100 0.0
p03.pddl
0.5376 0.5376 0.0 0.4672 0.4672 0.0
p04.pddl
0.6117 0.6117 0.0 0.7541 0.7541 0.0
p05.pddl
0.2138 0.2138 0.0 0.7106 0.7106 0.0
p06.pddl
-0.0000 -0.0000 0.0 0.6280 0.6280 0.0
p07.pddl
0.7433 0.7433 0.0 0.1695 0.1695 0.0
p08.pddl
0.4700 0.4700 0.0 0.5158 0.5158 0.0
p09.pddl
0.3086 0.3086 0.0 -0.0000 -0.0000 0.0
p10.pddl
0.4485 0.4485 0.0 0.5388 0.5388 0.0
p11.pddl
0.3747 0.3747 0.0 0.5047 0.5047 0.0
p12.pddl
0.3093 0.3093 0.0 0 0 0.0
p13.pddl
0.9247 0.9247 0.0 0.7475 0.7475 0.0
p14.pddl
0.7451 0.7451 0.0 -0.0000 -0.0000 0.0
p15.pddl
0.0653 0.0653 0.0 -0.0000 -0.0000 0.0
p16.pddl
0.8898 0.8898 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.9292 0.9292 0.0 0.2718 0.2718 0.0
p18.pddl
0.7230 0.7230 0.0 0 0 0.0
p19.pddl
0.3947 0.3947 0.0 -0.0000 -0.0000 0.0
p20.pddl
0 0 0.0 0.1348 0.1348 0.0
p21.pddl
0.8511 0.8511 0.0 -0.0000 -0.0000 0.0
p22.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
driverlog
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.5059 0.5059 0.0 0.7684 0.7684 0.0
p03.pddl
1.0000 1.0000 0.0 0.8277 0.8277 0.0
p04.pddl
0.5155 0.5155 0.0 0.6524 0.6524 0.0
p05.pddl
0.5069 0.5069 0.0 0.4401 0.4401 0.0
p06.pddl
0.7369 0.7369 0.0 0.8522 0.8522 0.0
p07.pddl
1.0000 1.0000 0.0 0.6990 0.6990 0.0
p08.pddl
0.4824 0.4824 0.0 0.6022 0.6022 0.0
p09.pddl
0.7300 0.7300 0.0 0.6759 0.6759 0.0
p10.pddl
0.9650 0.9650 0.0 0.6314 0.6314 0.0
p11.pddl
0.8979 0.8979 0.0 0.6481 0.6481 0.0
p12.pddl
0.4666 0.4666 0.0 0.5995 0.5995 0.0
p13.pddl
0.5428 0.5428 0.0 0.5630 0.5630 0.0
p14.pddl
0.8603 0.8603 0.0 0.4935 0.4935 0.0
p15.pddl
0.8257 0.8257 0.0 0.2412 0.2412 0.0
p16.pddl
0.2792 0.2792 0.0 0.0652 0.0652 0.0
p17.pddl
0.6323 0.6323 0.0 0 0 0.0
p18.pddl
0.2708 0.2708 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.2616 0.2616 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.3514 0.3514 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
elevators-opt08-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9699 0.9699 0.0 0.6935 0.6935 0.0
p02.pddl
1.0000 1.0000 0.0 0.7295 0.7295 0.0
p03.pddl
0.9877 0.9877 0.0 0.7529 0.7529 0.0
p04.pddl
0.9682 0.9682 0.0 0.4722 0.4722 0.0
p05.pddl
0.9437 0.9437 0.0 0.5973 0.5973 0.0
p06.pddl
0.9005 0.9005 0.0 0.4703 0.4703 0.0
p07.pddl
0.8988 0.8988 0.0 0.6120 0.6120 0.0
p08.pddl
0.9897 0.9897 0.0 0.5086 0.5086 0.0
p09.pddl
0.8386 0.8386 0.0 0.4364 0.4364 0.0
p10.pddl
0.8730 0.8730 0.0 0.4369 0.4369 0.0
p11.pddl
0.9897 0.9897 0.0 0.6408 0.6408 0.0
p12.pddl
0.9682 0.9682 0.0 0.6142 0.6142 0.0
p13.pddl
0.9897 0.9897 0.0 0.7215 0.7215 0.0
p14.pddl
0.9258 0.9258 0.0 0.5340 0.5340 0.0
p15.pddl
0.9237 0.9237 0.0 0.6592 0.6592 0.0
p16.pddl
0.8615 0.8615 0.0 0.4008 0.4008 0.0
p17.pddl
0.8545 0.8545 0.0 0.6346 0.6346 0.0
p18.pddl
0.9174 0.9174 0.0 0.5106 0.5106 0.0
p19.pddl
0.8517 0.8517 0.0 0.5273 0.5273 0.0
p20.pddl
0.8996 0.8996 0.0 0.5263 0.5263 0.0
p21.pddl
1.0000 1.0000 0.0 0.4636 0.4636 0.0
p22.pddl
1.0000 1.0000 0.0 0.3475 0.3475 0.0
p23.pddl
0.9715 0.9715 0.0 0.4166 0.4166 0.0
p24.pddl
0.9077 0.9077 0.0 0.2836 0.2836 0.0
p25.pddl
0.9303 0.9303 0.0 0.4646 0.4646 0.0
p26.pddl
1.0000 1.0000 0.0 0.5700 0.5700 0.0
p27.pddl
0.8416 0.8416 0.0 0.4537 0.4537 0.0
p28.pddl
0.9096 0.9096 0.0 0.4151 0.4151 0.0
p29.pddl
0.8452 0.8452 0.0 0.3937 0.3937 0.0
p30.pddl
0.8334 0.8334 0.0 0.1839 0.1839 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
elevators-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9897 0.9897 0.0 0.6408 0.6408 0.0
p02.pddl
1.0000 1.0000 0.0 0.4636 0.4636 0.0
p03.pddl
0.9682 0.9682 0.0 0.6142 0.6142 0.0
p04.pddl
0.9877 0.9877 0.0 0.7529 0.7529 0.0
p05.pddl
0.9897 0.9897 0.0 0.7215 0.7215 0.0
p06.pddl
0.9682 0.9682 0.0 0.4722 0.4722 0.0
p07.pddl
1.0000 1.0000 0.0 0.5700 0.5700 0.0
p08.pddl
0.9437 0.9437 0.0 0.5973 0.5973 0.0
p09.pddl
1.0000 1.0000 0.0 0.3475 0.3475 0.0
p10.pddl
0.9258 0.9258 0.0 0.5340 0.5340 0.0
p11.pddl
0.9096 0.9096 0.0 0.4151 0.4151 0.0
p12.pddl
0.9005 0.9005 0.0 0.4703 0.4703 0.0
p13.pddl
0.8988 0.8988 0.0 0.6120 0.6120 0.0
p14.pddl
0.9897 0.9897 0.0 0.5086 0.5086 0.0
p15.pddl
0.8386 0.8386 0.0 0.4364 0.4364 0.0
p16.pddl
0.9237 0.9237 0.0 0.6592 0.6592 0.0
p17.pddl
0.8545 0.8545 0.0 0.6346 0.6346 0.0
p18.pddl
0.9174 0.9174 0.0 0.5106 0.5106 0.0
p19.pddl
0.9715 0.9715 0.0 0.4166 0.4166 0.0
p20.pddl
0.9077 0.9077 0.0 0.2836 0.2836 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
floortile-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
0.5943 0.5943 0.0 0.0402 0.0402 0.0
opt-p01-002.pddl
0.9200 0.9200 0.0 0.0937 0.0937 0.0
opt-p02-003.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p02-004.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p03-005.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p03-006.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p04-007.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p04-008.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p05-009.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p05-010.pddl
0 0 0.0 0 0 0.0
opt-p06-011.pddl
0 0 0.0 0 0 0.0
opt-p06-012.pddl
0 0 0.0 0 0 0.0
opt-p07-013.pddl
0 0 0.0 0 0 0.0
opt-p07-014.pddl
0 0 0.0 0 0 0.0
opt-p08-015.pddl
0 0 0.0 0 0 0.0
opt-p08-016.pddl
0 0 0.0 0 0 0.0
opt-p09-017.pddl
0 0 0.0 0 0 0.0
opt-p09-018.pddl
0 0 0.0 0 0 0.0
opt-p10-019.pddl
0 0 0.0 0 0 0.0
opt-p10-020.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
floortile-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p01-4-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p01-5-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p01-5-4-2.pddl
0 0 0.0 0 0 0.0
p01-5-5-2.pddl
0 0 0.0 0 0 0.0
p01-6-4-2.pddl
0 0 0.0 0 0 0.0
p01-6-5-2.pddl
0 0 0.0 0 0 0.0
p02-4-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p02-5-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p02-5-4-2.pddl
0 0 0.0 0 0 0.0
p02-5-5-2.pddl
0 0 0.0 0 0 0.0
p02-6-4-2.pddl
0 0 0.0 0 0 0.0
p02-6-5-2.pddl
0 0 0.0 0 0 0.0
p03-4-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-4-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-5-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-5-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-5-5-2.pddl
0 0 0.0 0 0 0.0
p03-6-4-2.pddl
0 0 0.0 0 0 0.0
p03-6-5-2.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
freecell
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.9553 0.9553 0.0
p04.pddl
0.9650 0.9650 0.0 0.9221 0.9221 0.0
p05.pddl
1.0000 1.0000 0.0 0.9091 0.9091 0.0
p06.pddl
0.9503 0.9503 0.0 0.8779 0.8779 0.0
p07.pddl
0.6607 0.6607 0.0 0.6379 0.6379 0.0
p08.pddl
0.9450 0.9450 0.0 0.8394 0.8394 0.0
p09.pddl
0.9315 0.9315 0.0 0.8511 0.8511 0.0
p10.pddl
0.7436 0.7436 0.0 0.7842 0.7842 0.0
p11.pddl
0.5547 0.5547 0.0 0.6066 0.6066 0.0
p12.pddl
0.9362 0.9362 0.0 0.8463 0.8463 0.0
p13.pddl
0.5462 0.5462 0.0 0.7646 0.7646 0.0
p14.pddl
0.8829 0.8829 0.0 0.7087 0.7087 0.0
p15.pddl
0.7956 0.7956 0.0 0.7802 0.7802 0.0
p16.pddl
0.8103 0.8103 0.0 0.6872 0.6872 0.0
p17.pddl
0.8414 0.8414 0.0 0.7845 0.7845 0.0
p18.pddl
0.6548 0.6548 0.0 0.3620 0.3620 0.0
p19.pddl
0.3883 0.3883 0.0 0.3671 0.3671 0.0
p20.pddl
0.7342 0.7342 0.0 0.4154 0.4154 0.0
probfreecell-2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-1.pddl
1.0000 1.0000 0.0 0.9947 0.9947 0.0
probfreecell-3-2.pddl
1.0000 1.0000 0.0 0.9658 0.9658 0.0
probfreecell-3-3.pddl
1.0000 1.0000 0.0 0.9749 0.9749 0.0
probfreecell-3-4.pddl
1.0000 1.0000 0.0 0.9567 0.9567 0.0
probfreecell-3-5.pddl
1.0000 1.0000 0.0 0.9699 0.9699 0.0
probfreecell-4-1.pddl
1.0000 1.0000 0.0 0.9292 0.9292 0.0
probfreecell-4-2.pddl
1.0000 1.0000 0.0 0.9303 0.9303 0.0
probfreecell-4-3.pddl
1.0000 1.0000 0.0 0.9332 0.9332 0.0
probfreecell-4-4.pddl
1.0000 1.0000 0.0 0.9139 0.9139 0.0
probfreecell-4-5.pddl
1.0000 1.0000 0.0 0.9269 0.9269 0.0
probfreecell-5-1.pddl
1.0000 1.0000 0.0 0.8681 0.8681 0.0
probfreecell-5-2.pddl
1.0000 1.0000 0.0 0.8844 0.8844 0.0
probfreecell-5-3.pddl
1.0000 1.0000 0.0 0.9005 0.9005 0.0
probfreecell-5-4.pddl
1.0000 1.0000 0.0 0.8789 0.8789 0.0
probfreecell-5-5.pddl
1.0000 1.0000 0.0 0.8906 0.8906 0.0
probfreecell-6-1.pddl
1.0000 1.0000 0.0 0.8591 0.8591 0.0
probfreecell-6-2.pddl
1.0000 1.0000 0.0 0.8621 0.8621 0.0
probfreecell-6-3.pddl
1.0000 1.0000 0.0 0.8591 0.8591 0.0
probfreecell-6-4.pddl
1.0000 1.0000 0.0 0.8577 0.8577 0.0
probfreecell-6-5.pddl
0.9978 0.9978 0.0 0.8489 0.8489 0.0
probfreecell-7-1.pddl
0.9574 0.9574 0.0 0.8279 0.8279 0.0
probfreecell-7-2.pddl
1.0000 1.0000 0.0 0.8565 0.8565 0.0
probfreecell-7-3.pddl
0.9604 0.9604 0.0 0.8242 0.8242 0.0
probfreecell-7-4.pddl
0.9411 0.9411 0.0 0.8233 0.8233 0.0
probfreecell-7-5.pddl
0.9699 0.9699 0.0 0.8133 0.8133 0.0
probfreecell-8-1.pddl
0.8765 0.8765 0.0 0.8382 0.8382 0.0
probfreecell-8-2.pddl
0.9574 0.9574 0.0 0.8145 0.8145 0.0
probfreecell-8-3.pddl
0.9350 0.9350 0.0 0.8272 0.8272 0.0
probfreecell-8-4.pddl
0.9437 0.9437 0.0 0.8167 0.8167 0.0
probfreecell-8-5.pddl
0.8844 0.8844 0.0 0.7858 0.7858 0.0
probfreecell-9-1.pddl
0.8710 0.8710 0.0 0.7836 0.7836 0.0
probfreecell-9-2.pddl
0.9105 0.9105 0.0 0.7812 0.7812 0.0
probfreecell-9-3.pddl
0.9292 0.9292 0.0 0.8060 0.8060 0.0
probfreecell-9-4.pddl
0.8844 0.8844 0.0 0.7990 0.7990 0.0
probfreecell-9-5.pddl
0.8684 0.8684 0.0 0.7612 0.7612 0.0
probfreecell-10-1.pddl
0.6080 0.6080 0.0 0.6290 0.6290 0.0
probfreecell-10-2.pddl
0.8829 0.8829 0.0 0.7058 0.7058 0.0
probfreecell-10-3.pddl
0.8534 0.8534 0.0 0.5542 0.5542 0.0
probfreecell-10-4.pddl
0.8345 0.8345 0.0 0.5721 0.5721 0.0
probfreecell-10-5.pddl
0.7297 0.7297 0.0 0.7373 0.7373 0.0
probfreecell-11-1.pddl
0.8163 0.8163 0.0 0.4347 0.4347 0.0
probfreecell-11-2.pddl
0.7798 0.7798 0.0 0.3420 0.3420 0.0
probfreecell-11-3.pddl
0.8169 0.8169 0.0 0.5166 0.5166 0.0
probfreecell-11-4.pddl
0.8067 0.8067 0.0 0.7281 0.7281 0.0
probfreecell-11-5.pddl
0 0 0.0 0.7055 0.7055 0.0
probfreecell-12-1.pddl
0.3651 0.3651 0.0 0.3856 0.3856 0.0
probfreecell-12-2.pddl
0.7040 0.7040 0.0 0.5253 0.5253 0.0
probfreecell-12-3.pddl
0.8609 0.8609 0.0 0.5847 0.5847 0.0
probfreecell-12-4.pddl
0.7542 0.7542 0.0 0.4886 0.4886 0.0
probfreecell-12-5.pddl
-0.0000 -0.0000 0.0 0.4480 0.4480 0.0
probfreecell-13-1.pddl
0.2876 0.2876 0.0 0.4011 0.4011 0.0
probfreecell-13-2.pddl
0.3695 0.3695 0.0 0.3878 0.3878 0.0
probfreecell-13-3.pddl
0.7606 0.7606 0.0 0.5540 0.5540 0.0
probfreecell-13-4.pddl
0.5110 0.5110 0.0 0.5642 0.5642 0.0
probfreecell-13-5.pddl
-0.0000 -0.0000 0.0 0.0583 0.0583 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
ged-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-8.pddl
1.0000 1.0000 0.0 0.9707 0.9707 0.0
d-3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-4.pddl
1.0000 1.0000 0.0 0.9793 0.9793 0.0
d-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-3.pddl
1.0000 1.0000 0.0 0.9784 0.9784 0.0
d-4-8.pddl
1.0000 1.0000 0.0 0.9707 0.9707 0.0
d-7-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-7-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-1.pddl
1.0000 1.0000 0.0 0.9989 0.9989 0.0
d-8-2.pddl
1.0000 1.0000 0.0 0.9658 0.9658 0.0
d-8-4.pddl
1.0000 1.0000 0.0 0.9674 0.9674 0.0
d-8-9.pddl
0.9411 0.9411 0.0 0.9189 0.9189 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
grid
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 0.9839 0.9839 0.0
prob02.pddl
0.9820 0.9820 0.0 0.6616 0.6616 0.0
prob03.pddl
0.8357 0.8357 0.0 0 0 0.0
prob04.pddl
0.8996 0.8996 0.0 0.6604 0.6604 0.0
prob05.pddl
0.7318 0.7318 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
gripper
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 0.9443 0.9443 0.0
prob03.pddl
1.0000 1.0000 0.0 0.8684 0.8684 0.0
prob04.pddl
1.0000 1.0000 0.0 0.8075 0.8075 0.0
prob05.pddl
0.9937 0.9937 0.0 0.7565 0.7565 0.0
prob06.pddl
0.9766 0.9766 0.0 0.7126 0.7126 0.0
prob07.pddl
0.9619 0.9619 0.0 0.6741 0.6741 0.0
prob08.pddl
0.9490 0.9490 0.0 0.6397 0.6397 0.0
prob09.pddl
0.9374 0.9374 0.0 0.6087 0.6087 0.0
prob10.pddl
0.9269 0.9269 0.0 0.5804 0.5804 0.0
prob11.pddl
0.9174 0.9174 0.0 0.5545 0.5545 0.0
prob12.pddl
0.9086 0.9086 0.0 0.5304 0.5304 0.0
prob13.pddl
0.9005 0.9005 0.0 0.5080 0.5080 0.0
prob14.pddl
0.8930 0.8930 0.0 0.4871 0.4871 0.0
prob15.pddl
0.8859 0.8859 0.0 0.4675 0.4675 0.0
prob16.pddl
0.8793 0.8793 0.0 0.4490 0.4490 0.0
prob17.pddl
0.8730 0.8730 0.0 0.4314 0.4314 0.0
prob18.pddl
0.8671 0.8671 0.0 0.4148 0.4148 0.0
prob19.pddl
0.8615 0.8615 0.0 0.3990 0.3990 0.0
prob20.pddl
0.8562 0.8562 0.0 0.3840 0.3840 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
hiking-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
0.8894 0.8894 0.0 0.8169 0.8169 0.0
ptesting-1-2-4.pddl
0.6934 0.6934 0.0 0.6465 0.6465 0.0
ptesting-1-2-5.pddl
0.5616 0.5616 0.0 0.5266 0.5266 0.0
ptesting-1-2-7.pddl
0.4112 0.4112 0.0 0.3305 0.3305 0.0
ptesting-1-2-8.pddl
0.3528 0.3528 0.0 0.2541 0.2541 0.0
ptesting-2-2-3.pddl
1.0000 1.0000 0.0 0.5023 0.5023 0.0
ptesting-2-2-4.pddl
0.5616 0.5616 0.0 0.2587 0.2587 0.0
ptesting-2-2-5.pddl
0.4654 0.4654 0.0 0.1491 0.1491 0.0
ptesting-2-2-6.pddl
0.4105 0.4105 0.0 0.1189 0.1189 0.0
ptesting-2-2-7.pddl
0.3294 0.3294 0.0 0.0025 0.0025 0.0
ptesting-2-2-8.pddl
0.3223 0.3223 0.0 0.0034 0.0034 0.0
ptesting-2-3-4.pddl
0.5257 0.5257 0.0 0.2597 0.2597 0.0
ptesting-2-3-5.pddl
0.4543 0.4543 0.0 0.1268 0.1268 0.0
ptesting-2-3-6.pddl
0.3902 0.3902 0.0 0.0090 0.0090 0.0
ptesting-2-3-7.pddl
0.3210 0.3210 0.0 -0.0000 -0.0000 0.0
ptesting-2-4-3.pddl
1.0000 1.0000 0.0 0.4029 0.4029 0.0
ptesting-2-4-4.pddl
0.5206 0.5206 0.0 0.2128 0.2128 0.0
ptesting-2-4-5.pddl
0.4116 0.4116 0.0 0.0884 0.0884 0.0
ptesting-2-4-6.pddl
0.3958 0.3958 0.0 -0.0000 -0.0000 0.0
ptesting-2-4-7.pddl
0.3311 0.3311 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
logistics00
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
1.0000 1.0000 0.0 0.9362 0.9362 0.0
probLOGISTICS-4-1.pddl
1.0000 1.0000 0.0 0.9674 0.9674 0.0
probLOGISTICS-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-5-0.pddl
0.9839 0.9839 0.0 0.9040 0.9040 0.0
probLOGISTICS-5-1.pddl
1.0000 1.0000 0.0 0.9612 0.9612 0.0
probLOGISTICS-5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-0.pddl
0.9937 0.9937 0.0 0.9091 0.9091 0.0
probLOGISTICS-6-1.pddl
1.0000 1.0000 0.0 0.9699 0.9699 0.0
probLOGISTICS-6-2.pddl
0.9877 0.9877 0.0 0.9082 0.9082 0.0
probLOGISTICS-6-9.pddl
0.9766 0.9766 0.0 0.9179 0.9179 0.0
probLOGISTICS-7-0.pddl
0.9226 0.9226 0.0 0.8118 0.8118 0.0
probLOGISTICS-7-1.pddl
0.8640 0.8640 0.0 0.7836 0.7836 0.0
probLOGISTICS-8-0.pddl
0.9574 0.9574 0.0 0.8270 0.8270 0.0
probLOGISTICS-8-1.pddl
0.8963 0.8963 0.0 0.7705 0.7705 0.0
probLOGISTICS-9-0.pddl
0.9215 0.9215 0.0 0.7830 0.7830 0.0
probLOGISTICS-9-1.pddl
0.9666 0.9666 0.0 0.8185 0.8185 0.0
probLOGISTICS-10-0.pddl
0.8568 0.8568 0.0 0.7340 0.7340 0.0
probLOGISTICS-10-1.pddl
0.8971 0.8971 0.0 0.7359 0.7359 0.0
probLOGISTICS-11-0.pddl
0.8717 0.8717 0.0 0.7085 0.7085 0.0
probLOGISTICS-11-1.pddl
0.8080 0.8080 0.0 0.6924 0.6924 0.0
probLOGISTICS-12-0.pddl
0.8800 0.8800 0.0 0.7319 0.7319 0.0
probLOGISTICS-12-1.pddl
0.7991 0.7991 0.0 0.6557 0.6557 0.0
probLOGISTICS-13-0.pddl
0.7412 0.7412 0.0 0.3970 0.3970 0.0
probLOGISTICS-13-1.pddl
0.7631 0.7631 0.0 0.4082 0.4082 0.0
probLOGISTICS-14-0.pddl
0.8047 0.8047 0.0 0.3832 0.3832 0.0
probLOGISTICS-14-1.pddl
0.7689 0.7689 0.0 0.3485 0.3485 0.0
probLOGISTICS-15-0.pddl
0.7254 0.7254 0.0 0.3450 0.3450 0.0
probLOGISTICS-15-1.pddl
0.7833 0.7833 0.0 0.3110 0.3110 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
logistics98
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.9399 0.9399 0.0 0.4410 0.4410 0.0
prob02.pddl
0.8800 0.8800 0.0 0.1497 0.1497 0.0
prob03.pddl
0.8479 0.8479 0.0 -0.0000 -0.0000 0.0
prob04.pddl
0.7565 0.7565 0.0 0 0 0.0
prob05.pddl
0.9784 0.9784 0.0 0.5713 0.5713 0.0
prob06.pddl
0.6792 0.6792 0.0 0 0 0.0
prob07.pddl
0.8545 0.8545 0.0 -0.0000 -0.0000 0.0
prob08.pddl
0.8545 0.8545 0.0 0 0 0.0
prob09.pddl
0.6481 0.6481 0.0 0 0 0.0
prob10.pddl
0.6176 0.6176 0.0 -0.0000 -0.0000 0.0
prob11.pddl
0.9386 0.9386 0.0 -0.0000 -0.0000 0.0
prob12.pddl
0.8426 0.8426 0.0 0 0 0.0
prob13.pddl
0.7263 0.7263 0.0 0 0 0.0
prob14.pddl
0.6343 0.6343 0.0 0 0 0.0
prob15.pddl
0.6636 0.6636 0.0 -0.0000 -0.0000 0.0
prob16.pddl
0.8023 0.8023 0.0 0 0 0.0
prob17.pddl
0.8710 0.8710 0.0 0 0 0.0
prob18.pddl
0.4949 0.4949 0.0 0 0 0.0
prob19.pddl
0.5568 0.5568 0.0 0 0 0.0
prob20.pddl
0.4981 0.4981 0.0 0 0 0.0
prob21.pddl
0.6255 0.6255 0.0 0 0 0.0
prob22.pddl
0.2789 0.2789 0.0 0 0 0.0
prob23.pddl
0.6166 0.6166 0.0 -0.0000 -0.0000 0.0
prob24.pddl
0.8266 0.8266 0.0 0 0 0.0
prob25.pddl
0.4598 0.4598 0.0 0 0 0.0
prob26.pddl
0.4265 0.4265 0.0 0 0 0.0
prob27.pddl
0.4799 0.4799 0.0 0 0 0.0
prob28.pddl
0.2558 0.2558 0.0 0 0 0.0
prob29.pddl
0.3744 0.3744 0.0 0 0 0.0
prob30.pddl
0.5144 0.5144 0.0 0 0 0.0
prob31.pddl
1.0000 1.0000 0.0 0.6911 0.6911 0.0
prob32.pddl
1.0000 1.0000 0.0 0.7444 0.7444 0.0
prob33.pddl
0.9858 0.9858 0.0 0.5844 0.5844 0.0
prob34.pddl
0.7734 0.7734 0.0 0.0748 0.0748 0.0
prob35.pddl
0.9749 0.9749 0.0 0.3552 0.3552 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
miconic
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-0.pddl
1.0000 1.0000 0.0 0.9927 0.9927 0.0
s5-1.pddl
1.0000 1.0000 0.0 0.9947 0.9947 0.0
s5-2.pddl
1.0000 1.0000 0.0 0.9887 0.9887 0.0
s5-3.pddl
1.0000 1.0000 0.0 0.9811 0.9811 0.0
s5-4.pddl
0.9937 0.9937 0.0 0.9947 0.9947 0.0
s6-0.pddl
0.9802 0.9802 0.0 0.9430 0.9430 0.0
s6-1.pddl
1.0000 1.0000 0.0 0.9476 0.9476 0.0
s6-2.pddl
0.9699 0.9699 0.0 0.9517 0.9517 0.0
s6-3.pddl
0.9957 0.9957 0.0 0.9497 0.9497 0.0
s6-4.pddl
0.9732 0.9732 0.0 0.9430 0.9430 0.0
s7-0.pddl
0.9937 0.9937 0.0 0.9100 0.9100 0.0
s7-1.pddl
0.9362 0.9362 0.0 0.9134 0.9134 0.0
s7-2.pddl
1.0000 1.0000 0.0 0.9096 0.9096 0.0
s7-3.pddl
0.9666 0.9666 0.0 0.9200 0.9200 0.0
s7-4.pddl
0.9450 0.9450 0.0 0.9253 0.9253 0.0
s8-0.pddl
0.9682 0.9682 0.0 0.8852 0.8852 0.0
s8-1.pddl
0.9326 0.9326 0.0 0.8724 0.8724 0.0
s8-2.pddl
0.9134 0.9134 0.0 0.8814 0.8814 0.0
s8-3.pddl
0.9164 0.9164 0.0 0.8934 0.8934 0.0
s8-4.pddl
0.9437 0.9437 0.0 0.8922 0.8922 0.0
s9-0.pddl
0.8988 0.8988 0.0 0.8624 0.8624 0.0
s9-1.pddl
0.8954 0.8954 0.0 0.8582 0.8582 0.0
s9-2.pddl
0.9014 0.9014 0.0 0.8556 0.8556 0.0
s9-3.pddl
0.9154 0.9154 0.0 0.8675 0.8675 0.0
s9-4.pddl
0.9386 0.9386 0.0 0.8536 0.8536 0.0
s10-0.pddl
0.8852 0.8852 0.0 0.8331 0.8331 0.0
s10-1.pddl
0.8996 0.8996 0.0 0.8292 0.8292 0.0
s10-2.pddl
0.8852 0.8852 0.0 0.8279 0.8279 0.0
s10-3.pddl
0.9205 0.9205 0.0 0.8379 0.8379 0.0
s10-4.pddl
0.8971 0.8971 0.0 0.8329 0.8329 0.0
s11-0.pddl
0.8640 0.8640 0.0 0.8055 0.8055 0.0
s11-1.pddl
0.8946 0.8946 0.0 0.8124 0.8124 0.0
s11-2.pddl
0.8468 0.8468 0.0 0.8214 0.8214 0.0
s11-3.pddl
0.8678 0.8678 0.0 0.8179 0.8179 0.0
s11-4.pddl
0.8744 0.8744 0.0 0.8153 0.8153 0.0
s12-0.pddl
0.9124 0.9124 0.0 0.7963 0.7963 0.0
s12-1.pddl
0.8489 0.8489 0.0 0.7870 0.7870 0.0
s12-2.pddl
0.8500 0.8500 0.0 0.7876 0.7876 0.0
s12-3.pddl
0.8603 0.8603 0.0 0.7906 0.7906 0.0
s12-4.pddl
0.8334 0.8334 0.0 0.8010 0.8010 0.0
s13-0.pddl
0.8214 0.8214 0.0 0.7759 0.7759 0.0
s13-1.pddl
0.8432 0.8432 0.0 0.7827 0.7827 0.0
s13-2.pddl
0.8231 0.8231 0.0 0.7878 0.7878 0.0
s13-3.pddl
0.8545 0.8545 0.0 0.7802 0.7802 0.0
s13-4.pddl
0.8568 0.8568 0.0 0.7760 0.7760 0.0
s14-0.pddl
0.8534 0.8534 0.0 0.7665 0.7665 0.0
s14-1.pddl
0.8193 0.8193 0.0 0.7607 0.7607 0.0
s14-2.pddl
0.8193 0.8193 0.0 0.7608 0.7608 0.0
s14-3.pddl
0.8442 0.8442 0.0 0.7498 0.7498 0.0
s14-4.pddl
0.8288 0.8288 0.0 0.7599 0.7599 0.0
s15-0.pddl
0.8301 0.8301 0.0 0.7451 0.7451 0.0
s15-1.pddl
0.7787 0.7787 0.0 0.7412 0.7412 0.0
s15-2.pddl
0.7954 0.7954 0.0 0.7502 0.7502 0.0
s15-3.pddl
0.8055 0.8055 0.0 0.7439 0.7439 0.0
s15-4.pddl
0.8069 0.8069 0.0 0.7457 0.7457 0.0
s16-0.pddl
0.7985 0.7985 0.0 0.7332 0.7332 0.0
s16-1.pddl
0.8023 0.8023 0.0 0.7350 0.7350 0.0
s16-2.pddl
0.7721 0.7721 0.0 0.7349 0.7349 0.0
s16-3.pddl
0.7919 0.7919 0.0 0.7299 0.7299 0.0
s16-4.pddl
0.7906 0.7906 0.0 0.7368 0.7368 0.0
s17-0.pddl
0.7742 0.7742 0.0 0.7198 0.7198 0.0
s17-1.pddl
0.7974 0.7974 0.0 0.7196 0.7196 0.0
s17-2.pddl
0.7767 0.7767 0.0 0.7101 0.7101 0.0
s17-3.pddl
0.7649 0.7649 0.0 0.7279 0.7279 0.0
s17-4.pddl
0.7981 0.7981 0.0 0.7196 0.7196 0.0
s18-0.pddl
0.7759 0.7759 0.0 0.7000 0.7000 0.0
s18-1.pddl
0.7839 0.7839 0.0 0.7035 0.7035 0.0
s18-2.pddl
0.7705 0.7705 0.0 0.7023 0.7023 0.0
s18-3.pddl
0.7576 0.7576 0.0 0.7021 0.7021 0.0
s18-4.pddl
0.7721 0.7721 0.0 0.7048 0.7048 0.0
s19-0.pddl
0.7491 0.7491 0.0 0.6840 0.6840 0.0
s19-1.pddl
0.7600 0.7600 0.0 0.6958 0.6958 0.0
s19-2.pddl
0.7496 0.7496 0.0 0.6977 0.6977 0.0
s19-3.pddl
0.7422 0.7422 0.0 0.6960 0.6960 0.0
s19-4.pddl
0.7531 0.7531 0.0 0.6939 0.6939 0.0
s20-0.pddl
0.7524 0.7524 0.0 0.6813 0.6813 0.0
s20-1.pddl
0.7445 0.7445 0.0 0.6835 0.6835 0.0
s20-2.pddl
0.7538 0.7538 0.0 0.6801 0.6801 0.0
s20-3.pddl
0.7588 0.7588 0.0 0.6738 0.6738 0.0
s20-4.pddl
0.7556 0.7556 0.0 0.6806 0.6806 0.0
s21-0.pddl
0.7279 0.7279 0.0 0.6775 0.6775 0.0
s21-1.pddl
0.7350 0.7350 0.0 0.6643 0.6643 0.0
s21-2.pddl
0.7694 0.7694 0.0 0.6697 0.6697 0.0
s21-3.pddl
0.7509 0.7509 0.0 0.6742 0.6742 0.0
s21-4.pddl
0.7664 0.7664 0.0 0.6698 0.6698 0.0
s22-0.pddl
0.7149 0.7149 0.0 0.6633 0.6633 0.0
s22-1.pddl
0.7217 0.7217 0.0 0.6557 0.6557 0.0
s22-2.pddl
0.7240 0.7240 0.0 0.6555 0.6555 0.0
s22-3.pddl
0.7227 0.7227 0.0 0.6671 0.6671 0.0
s22-4.pddl
0.7324 0.7324 0.0 0.6657 0.6657 0.0
s23-0.pddl
0.7076 0.7076 0.0 0.6496 0.6496 0.0
s23-1.pddl
0.7244 0.7244 0.0 0.6549 0.6549 0.0
s23-2.pddl
0.7339 0.7339 0.0 0.6472 0.6472 0.0
s23-3.pddl
0.7328 0.7328 0.0 0.6502 0.6502 0.0
s23-4.pddl
0.7265 0.7265 0.0 0.6532 0.6532 0.0
s24-0.pddl
0.7239 0.7239 0.0 0.6436 0.6436 0.0
s24-1.pddl
0.7138 0.7138 0.0 0.6416 0.6416 0.0
s24-2.pddl
0.7071 0.7071 0.0 0.6443 0.6443 0.0
s24-3.pddl
0.7119 0.7119 0.0 0.6428 0.6428 0.0
s24-4.pddl
0.7089 0.7089 0.0 0.6416 0.6416 0.0
s25-0.pddl
0.7064 0.7064 0.0 0.6299 0.6299 0.0
s25-1.pddl
0.6868 0.6868 0.0 0.6343 0.6343 0.0
s25-2.pddl
0.7184 0.7184 0.0 0.6261 0.6261 0.0
s25-3.pddl
0.6914 0.6914 0.0 0.6331 0.6331 0.0
s25-4.pddl
0.6896 0.6896 0.0 0.6321 0.6321 0.0
s26-0.pddl
0.6857 0.6857 0.0 0.6266 0.6266 0.0
s26-1.pddl
0.6987 0.6987 0.0 0.6215 0.6215 0.0
s26-2.pddl
0.6733 0.6733 0.0 0.6268 0.6268 0.0
s26-3.pddl
0.6856 0.6856 0.0 0.6271 0.6271 0.0
s26-4.pddl
0.7082 0.7082 0.0 0.6208 0.6208 0.0
s27-0.pddl
0.6720 0.6720 0.0 0.6198 0.6198 0.0
s27-1.pddl
0.6909 0.6909 0.0 0.6146 0.6146 0.0
s27-2.pddl
0.6717 0.6717 0.0 0.6143 0.6143 0.0
s27-3.pddl
0.6859 0.6859 0.0 0.6152 0.6152 0.0
s27-4.pddl
0.6815 0.6815 0.0 0.6127 0.6127 0.0
s28-0.pddl
0.6623 0.6623 0.0 0.6074 0.6074 0.0
s28-1.pddl
0.6763 0.6763 0.0 0.6096 0.6096 0.0
s28-2.pddl
0.6651 0.6651 0.0 0.6115 0.6115 0.0
s28-3.pddl
0.6991 0.6991 0.0 0.6001 0.6001 0.0
s28-4.pddl
0.6768 0.6768 0.0 0.6128 0.6128 0.0
s29-0.pddl
0.6762 0.6762 0.0 0.6016 0.6016 0.0
s29-1.pddl
0.6839 0.6839 0.0 0.5990 0.5990 0.0
s29-2.pddl
0.6670 0.6670 0.0 0.5970 0.5970 0.0
s29-3.pddl
0.6532 0.6532 0.0 0.5978 0.5978 0.0
s29-4.pddl
0.6487 0.6487 0.0 0.6019 0.6019 0.0
s30-0.pddl
0.6773 0.6773 0.0 0.5940 0.5940 0.0
s30-1.pddl
0.6652 0.6652 0.0 0.5910 0.5910 0.0
s30-2.pddl
0.6703 0.6703 0.0 0.5901 0.5901 0.0
s30-3.pddl
0.6494 0.6494 0.0 0.5967 0.5967 0.0
s30-4.pddl
0.6591 0.6591 0.0 0.5965 0.5965 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
movie
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
mprime
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 0.8967 0.8967 0.0
prob02.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 0.2230 0.2230 0.0
prob04.pddl
1.0000 1.0000 0.0 0.6967 0.6967 0.0
prob05.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
prob06.pddl
0.7664 0.7664 0.0 0 0 0.0
prob07.pddl
1.0000 1.0000 0.0 0.2676 0.2676 0.0
prob08.pddl
1.0000 1.0000 0.0 0 0 0.0
prob09.pddl
1.0000 1.0000 0.0 0.2181 0.2181 0.0
prob10.pddl
1.0000 1.0000 0.0 0 0 0.0
prob11.pddl
1.0000 1.0000 0.0 0.8878 0.8878 0.0
prob12.pddl
1.0000 1.0000 0.0 0.0037 0.0037 0.0
prob13.pddl
0.9545 0.9545 0.0 0 0 0.0
prob14.pddl
0.9784 0.9784 0.0 0 0 0.0
prob15.pddl
0.9820 0.9820 0.0 0 0 0.0
prob16.pddl
1.0000 1.0000 0.0 0.0056 0.0056 0.0
prob17.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
prob18.pddl
0.8452 0.8452 0.0 0 0 0.0
prob19.pddl
0.9280 0.9280 0.0 0 0 0.0
prob20.pddl
1.0000 1.0000 0.0 0 0 0.0
prob21.pddl
0.7912 0.7912 0.0 -0.0000 -0.0000 0.0
prob22.pddl
0.9411 0.9411 0.0 0 0 0.0
prob23.pddl
0.9437 0.9437 0.0 0 0 0.0
prob24.pddl
1.0000 1.0000 0.0 0 0 0.0
prob25.pddl
1.0000 1.0000 0.0 0.7578 0.7578 0.0
prob26.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
prob27.pddl
1.0000 1.0000 0.0 0.4005 0.4005 0.0
prob28.pddl
1.0000 1.0000 0.0 0.9040 0.9040 0.0
prob29.pddl
1.0000 1.0000 0.0 0.3056 0.3056 0.0
prob30.pddl
1.0000 1.0000 0.0 0 0 0.0
prob31.pddl
1.0000 1.0000 0.0 0.3534 0.3534 0.0
prob32.pddl
1.0000 1.0000 0.0 0.1095 0.1095 0.0
prob33.pddl
0.8800 0.8800 0.0 0 0 0.0
prob34.pddl
1.0000 1.0000 0.0 0.3128 0.3128 0.0
prob35.pddl
1.0000 1.0000 0.0 0.4145 0.4145 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
mystery
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
0.7448 0.7448 0.0 0.1760 0.1760 0.0
prob03.pddl
1.0000 1.0000 0.0 0.6552 0.6552 0.0
prob04.pddl
0 0 0.0 0 0 0.0
prob05.pddl
0 0 0.0 0 0 0.0
prob06.pddl
0.3127 0.3127 0.0 0 0 0.0
prob07.pddl
0 0 0.0 0 0 0.0
prob08.pddl
0 0 0.0 0 0 0.0
prob09.pddl
-0.0000 -0.0000 0.0 0.4762 0.4762 0.0
prob10.pddl
1.0000 1.0000 0.0 0 0 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
0 0 0.0 0 0 0.0
prob13.pddl
0.9210 0.9210 0.0 0 0 0.0
prob14.pddl
0.9784 0.9784 0.0 0 0 0.0
prob15.pddl
0.9749 0.9749 0.0 -0.0000 -0.0000 0.0
prob16.pddl
0 0 0.0 0 0 0.0
prob17.pddl
1.0000 1.0000 0.0 0.3083 0.3083 0.0
prob18.pddl
0 0 0.0 0 0 0.0
prob19.pddl
0.7089 0.7089 0.0 0.0382 0.0382 0.0
prob20.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
prob21.pddl
0 0 0.0 0 0 0.0
prob22.pddl
0 0 0.0 0 0 0.0
prob23.pddl
0 0 0.0 0 0 0.0
prob24.pddl
0 0 0.0 0 0 0.0
prob25.pddl
1.0000 1.0000 0.0 0.9164 0.9164 0.0
prob26.pddl
1.0000 1.0000 0.0 0.3251 0.3251 0.0
prob27.pddl
1.0000 1.0000 0.0 0.7382 0.7382 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 0.7351 0.7351 0.0
prob30.pddl
1.0000 1.0000 0.0 0.1912 0.1912 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
nomystery-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.7476 0.7476 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.9897 0.9897 0.0
p04.pddl
0.9740 0.9740 0.0 0.1566 0.1566 0.0
p05.pddl
0.9226 0.9226 0.0 -0.0000 -0.0000 0.0
p06.pddl
0.9045 0.9045 0.0 0 0 0.0
p07.pddl
0.9338 0.9338 0.0 0 0 0.0
p08.pddl
0.8946 0.8946 0.0 0 0 0.0
p09.pddl
0.8988 0.8988 0.0 0.7953 0.7953 0.0
p10.pddl
0.8539 0.8539 0.0 0 0 0.0
p11.pddl
0.8737 0.8737 0.0 0.8659 0.8659 0.0
p12.pddl
0.5785 0.5785 0.0 0.4676 0.4676 0.0
p13.pddl
0.8963 0.8963 0.0 0.3682 0.3682 0.0
p14.pddl
0.4550 0.4550 0.0 0.1013 0.1013 0.0
p15.pddl
0.8060 0.8060 0.0 0.1213 0.1213 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0.5981 0.5981 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0.7534 0.7534 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt08-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.9650 0.9650 0.0
p06.pddl
1.0000 1.0000 0.0 0.9612 0.9612 0.0
p07.pddl
1.0000 1.0000 0.0 0.9405 0.9405 0.0
p08.pddl
1.0000 1.0000 0.0 0.9215 0.9215 0.0
p09.pddl
1.0000 1.0000 0.0 0.9049 0.9049 0.0
p10.pddl
0.9937 0.9937 0.0 0.9023 0.9023 0.0
p11.pddl
0.9916 0.9916 0.0 0.8829 0.8829 0.0
p12.pddl
0.9897 0.9897 0.0 0.8758 0.8758 0.0
p13.pddl
0.9784 0.9784 0.0 0.8681 0.8681 0.0
p14.pddl
0.9732 0.9732 0.0 0.8539 0.8539 0.0
p15.pddl
0.9666 0.9666 0.0 0.8404 0.8404 0.0
p16.pddl
0.9604 0.9604 0.0 0.8424 0.8424 0.0
p17.pddl
0.9545 0.9545 0.0 0.8275 0.8275 0.0
p18.pddl
0.9531 0.9531 0.0 0.8090 0.8090 0.0
p19.pddl
0.9463 0.9463 0.0 0.8038 0.8038 0.0
p20.pddl
0.9490 0.9490 0.0 0.8103 0.8103 0.0
p21.pddl
0.9411 0.9411 0.0 0.7912 0.7912 0.0
p22.pddl
0.9303 0.9303 0.0 0.7867 0.7867 0.0
p23.pddl
0.9338 0.9338 0.0 0.7770 0.7770 0.0
p24.pddl
0.9280 0.9280 0.0 0.7763 0.7763 0.0
p25.pddl
0.9247 0.9247 0.0 0.7616 0.7616 0.0
p26.pddl
0.9174 0.9174 0.0 0.7569 0.7569 0.0
p27.pddl
0.9105 0.9105 0.0 0.7514 0.7514 0.0
p28.pddl
0.9124 0.9124 0.0 0.7490 0.7490 0.0
p29.pddl
0.9077 0.9077 0.0 0.7363 0.7363 0.0
p30.pddl
0.9040 0.9040 0.0 0.7331 0.7331 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9612 0.9612 0.0
p02.pddl
1.0000 1.0000 0.0 0.9405 0.9405 0.0
p03.pddl
1.0000 1.0000 0.0 0.9215 0.9215 0.0
p04.pddl
1.0000 1.0000 0.0 0.9049 0.9049 0.0
p05.pddl
0.9937 0.9937 0.0 0.9023 0.9023 0.0
p06.pddl
0.9916 0.9916 0.0 0.8829 0.8829 0.0
p07.pddl
0.9897 0.9897 0.0 0.8758 0.8758 0.0
p08.pddl
0.9784 0.9784 0.0 0.8681 0.8681 0.0
p09.pddl
0.9732 0.9732 0.0 0.8539 0.8539 0.0
p10.pddl
0.9303 0.9303 0.0 0.7867 0.7867 0.0
p11.pddl
0.9666 0.9666 0.0 0.8404 0.8404 0.0
p12.pddl
0.9604 0.9604 0.0 0.8424 0.8424 0.0
p13.pddl
0.9545 0.9545 0.0 0.8275 0.8275 0.0
p14.pddl
0.9531 0.9531 0.0 0.8090 0.8090 0.0
p15.pddl
0.9463 0.9463 0.0 0.8038 0.8038 0.0
p16.pddl
0.9411 0.9411 0.0 0.7912 0.7912 0.0
p17.pddl
0.9490 0.9490 0.0 0.8103 0.8103 0.0
p18.pddl
0.9338 0.9338 0.0 0.7770 0.7770 0.0
p19.pddl
0.9280 0.9280 0.0 0.7763 0.7763 0.0
p20.pddl
0.9247 0.9247 0.0 0.7616 0.7616 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
0.9666 0.9666 0.0 0.8426 0.8426 0.0
p20_2.pddl
0.9604 0.9604 0.0 0.8306 0.8306 0.0
p20_3.pddl
0.9531 0.9531 0.0 0.8343 0.8343 0.0
p25_1.pddl
0.9399 0.9399 0.0 0.7930 0.7930 0.0
p25_3.pddl
0.9280 0.9280 0.0 0.7839 0.7839 0.0
p30_1.pddl
0.9247 0.9247 0.0 0.7618 0.7618 0.0
p30_2.pddl
0.9215 0.9215 0.0 0.7543 0.7543 0.0
p30_3.pddl
0.9105 0.9105 0.0 0.7422 0.7422 0.0
p35_1.pddl
0.9068 0.9068 0.0 0.7315 0.7315 0.0
p35_2.pddl
0.9040 0.9040 0.0 0.7204 0.7204 0.0
p35_3.pddl
0.8914 0.8914 0.0 0.7128 0.7128 0.0
p40_1.pddl
0.8930 0.8930 0.0 0.7051 0.7051 0.0
p40_2.pddl
0.8890 0.8890 0.0 0.7067 0.7067 0.0
p40_3.pddl
0.8779 0.8779 0.0 0.6901 0.6901 0.0
p45_1.pddl
0.8786 0.8786 0.0 0.6861 0.6861 0.0
p45_2.pddl
0.8710 0.8710 0.0 0.6756 0.6756 0.0
p45_3.pddl
0.8634 0.8634 0.0 0.6616 0.6616 0.0
p50_1.pddl
0.8697 0.8697 0.0 0.6609 0.6609 0.0
p50_2.pddl
0.8627 0.8627 0.0 0.6542 0.6542 0.0
p50_3.pddl
0.8517 0.8517 0.0 0.6419 0.6419 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 0.8930 0.8930 0.0
p07.pddl
0.9978 0.9978 0.0 0.8958 0.8958 0.0
p08.pddl
0.9280 0.9280 0.0 0.7666 0.7666 0.0
p09.pddl
0.9280 0.9280 0.0 0.7698 0.7698 0.0
p10.pddl
0.9237 0.9237 0.0 0.7524 0.7524 0.0
p11.pddl
0.9237 0.9237 0.0 0.7559 0.7559 0.0
p12.pddl
0.9237 0.9237 0.0 0.7604 0.7604 0.0
p13.pddl
0.9237 0.9237 0.0 0.7575 0.7575 0.0
p14.pddl
0.9237 0.9237 0.0 0.7601 0.7601 0.0
p15.pddl
0.9226 0.9226 0.0 0.7656 0.7656 0.0
p16.pddl
0.9215 0.9215 0.0 0.7644 0.7644 0.0
p17.pddl
0.8996 0.8996 0.0 0.7264 0.7264 0.0
p18.pddl
0.8500 0.8500 0.0 0.6098 0.6098 0.0
p19.pddl
0.8988 0.8988 0.0 0.7133 0.7133 0.0
p20.pddl
0.8800 0.8800 0.0 0.6829 0.6829 0.0
p21.pddl
0.8800 0.8800 0.0 0.6808 0.6808 0.0
p22.pddl
0.8800 0.8800 0.0 0.6767 0.6767 0.0
p23.pddl
0.8800 0.8800 0.0 0.6794 0.6794 0.0
p24.pddl
0.8248 0.8248 0.0 0.5773 0.5773 0.0
p25.pddl
0.8248 0.8248 0.0 0.5801 0.5801 0.0
p26.pddl
0.8235 0.8235 0.0 0.5789 0.5789 0.0
p27.pddl
0.7807 0.7807 0.0 0.4952 0.4952 0.0
p28.pddl
0.7498 0.7498 0.0 0.4325 0.4325 0.0
p29.pddl
0.7498 0.7498 0.0 0.4366 0.4366 0.0
p30.pddl
0.7489 0.7489 0.0 0.4350 0.4350 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
organic-synthesis-opt18-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
0 0 0.0 0 0 0.0
p05.pddl
0 0 0.0 0 0 0.0
p06.pddl
0 0 0.0 0 0 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0 0 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0 0 0.0 0 0 0.0
p12.pddl
0 0 0.0 0 0 0.0
p13.pddl
0 0 0.0 0 0 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0 0 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
organic-synthesis-split-opt18-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 0.7927 0.7927 0.0
p03.pddl
0.8067 0.8067 0.0 0.2038 0.2038 0.0
p04.pddl
0.9332 0.9332 0.0 0.1508 0.1508 0.0
p05.pddl
0.8360 0.8360 0.0 0.2789 0.2789 0.0
p06.pddl
0.9049 0.9049 0.0 -0.0000 -0.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0.7689 0.7689 0.0 -0.0000 -0.0000 0.0
p09.pddl
0.9368 0.9368 0.0 0.3418 0.3418 0.0
p10.pddl
0.9392 0.9392 0.0 0.2885 0.2885 0.0
p11.pddl
0.6141 0.6141 0.0 0 0 0.0
p12.pddl
0.5604 0.5604 0.0 0 0 0.0
p13.pddl
0.5230 0.5230 0.0 0 0 0.0
p14.pddl
0.9231 0.9231 0.0 0.6433 0.6433 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
0.5471 0.5471 0.0 0 0 0.0
p17.pddl
0.4461 0.4461 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0.5545 0.5545 0.0 0 0 0.0
p20.pddl
0.0650 0.0650 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parcprinter-08-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 0.9405 0.9405 0.0
p05.pddl
1.0000 1.0000 0.0 0.8954 0.8954 0.0
p06.pddl
1.0000 1.0000 0.0 0.8863 0.8863 0.0
p07.pddl
0.9968 0.9968 0.0 0.8037 0.8037 0.0
p08.pddl
0.9802 0.9802 0.0 0.7778 0.7778 0.0
p09.pddl
0.9674 0.9674 0.0 0.7504 0.7504 0.0
p10.pddl
0.9553 0.9553 0.0 0.7742 0.7742 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 0.8963 0.8963 0.0
p13.pddl
1.0000 1.0000 0.0 0.3779 0.3779 0.0
p14.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
p15.pddl
0.9269 0.9269 0.0 0 0 0.0
p16.pddl
0.9802 0.9802 0.0 0 0 0.0
p17.pddl
0.9658 0.9658 0.0 0 0 0.0
p18.pddl
0.9476 0.9476 0.0 0 0 0.0
p19.pddl
0.7922 0.7922 0.0 0 0 0.0
p20.pddl
0.8724 0.8724 0.0 0 0 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 0.9589 0.9589 0.0
p25.pddl
0.9612 0.9612 0.0 0.0420 0.0420 0.0
p26.pddl
1.0000 1.0000 0.0 0.8714 0.8714 0.0
p27.pddl
0.9957 0.9957 0.0 0.8465 0.8465 0.0
p28.pddl
0.9793 0.9793 0.0 0.8069 0.8069 0.0
p29.pddl
0.8484 0.8484 0.0 0 0 0.0
p30.pddl
0.9221 0.9221 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parcprinter-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.8963 0.8963 0.0
p04.pddl
1.0000 1.0000 0.0 0.9405 0.9405 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 0.8863 0.8863 0.0
p07.pddl
1.0000 1.0000 0.0 0.8954 0.8954 0.0
p08.pddl
1.0000 1.0000 0.0 0.9589 0.9589 0.0
p09.pddl
1.0000 1.0000 0.0 0.3779 0.3779 0.0
p10.pddl
0.9612 0.9612 0.0 0.0420 0.0420 0.0
p11.pddl
1.0000 1.0000 0.0 0.8714 0.8714 0.0
p12.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.9968 0.9968 0.0 0.8037 0.8037 0.0
p14.pddl
0.9802 0.9802 0.0 0.7778 0.7778 0.0
p15.pddl
0.9674 0.9674 0.0 0.7504 0.7504 0.0
p16.pddl
0.9553 0.9553 0.0 0.7742 0.7742 0.0
p17.pddl
0.9269 0.9269 0.0 0 0 0.0
p18.pddl
0.9802 0.9802 0.0 0 0 0.0
p19.pddl
0.9658 0.9658 0.0 0 0 0.0
p20.pddl
0.9957 0.9957 0.0 0.8465 0.8465 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parking-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
0.9443 0.9443 0.0 0 0 0.0
pfile03-012.pddl
0.7817 0.7817 0.0 0 0 0.0
pfile04-013.pddl
0.7685 0.7685 0.0 0 0 0.0
pfile04-014.pddl
0.7278 0.7278 0.0 0 0 0.0
pfile04-015.pddl
0.8157 0.8157 0.0 0 0 0.0
pfile04-016.pddl
0.7696 0.7696 0.0 0 0 0.0
pfile05-017.pddl
0.8124 0.8124 0.0 0 0 0.0
pfile05-018.pddl
0.8259 0.8259 0.0 0 0 0.0
pfile05-019.pddl
0.7038 0.7038 0.0 0 0 0.0
pfile05-020.pddl
0.7273 0.7273 0.0 0 0 0.0
pfile06-021.pddl
0.7297 0.7297 0.0 0 0 0.0
pfile06-022.pddl
0.7311 0.7311 0.0 0 0 0.0
pfile06-023.pddl
0.7529 0.7529 0.0 0 0 0.0
pfile06-024.pddl
0.6280 0.6280 0.0 0 0 0.0
pfile07-025.pddl
0.6282 0.6282 0.0 0 0 0.0
pfile07-026.pddl
0.7303 0.7303 0.0 0 0 0.0
pfile07-027.pddl
0.7654 0.7654 0.0 0 0 0.0
pfile07-028.pddl
0.6318 0.6318 0.0 0 0 0.0
pfile08-029.pddl
0.6559 0.6559 0.0 0 0 0.0
pfile08-030.pddl
0.6915 0.6915 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parking-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
0.8574 0.8574 0.0 0 0 0.0
p_12_7-02.pddl
0.8411 0.8411 0.0 0.0202 0.0202 0.0
p_12_7-03.pddl
0.7709 0.7709 0.0 0 0 0.0
p_12_7-04.pddl
0.7946 0.7946 0.0 0 0 0.0
p_14_8-01.pddl
0.8214 0.8214 0.0 0 0 0.0
p_14_8-02.pddl
0.7760 0.7760 0.0 0 0 0.0
p_14_8-03.pddl
0.7048 0.7048 0.0 0 0 0.0
p_14_8-04.pddl
0.7828 0.7828 0.0 0 0 0.0
p_16_9-01.pddl
0.7538 0.7538 0.0 0 0 0.0
p_16_9-02.pddl
0.7890 0.7890 0.0 0 0 0.0
p_16_9-03.pddl
0.8377 0.8377 0.0 0 0 0.0
p_16_9-04.pddl
0.8255 0.8255 0.0 0 0 0.0
p_18_10-01.pddl
0.6894 0.6894 0.0 0 0 0.0
p_18_10-02.pddl
0.7582 0.7582 0.0 0 0 0.0
p_18_10-03.pddl
0.8406 0.8406 0.0 0 0 0.0
p_18_10-04.pddl
0.8659 0.8659 0.0 0 0 0.0
p_20_11-01.pddl
0.6599 0.6599 0.0 0 0 0.0
p_20_11-02.pddl
0.7125 0.7125 0.0 0 0 0.0
p_20_11-03.pddl
0.6745 0.6745 0.0 0 0 0.0
p_20_11-04.pddl
0.5994 0.5994 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pathways-noneg
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.6912 0.6912 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
0.9848 0.9848 0.0 0.6481 0.6481 0.0
p04.pddl
1.0000 1.0000 0.0 0.5191 0.5191 0.0
p05.pddl
1.0000 1.0000 0.0 0.1112 0.1112 0.0
p06.pddl
0.8585 0.8585 0.0 -0.0000 -0.0000 0.0
p07.pddl
0.8210 0.8210 0.0 -0.0000 -0.0000 0.0
p08.pddl
0.7522 0.7522 0.0 0 0 0.0
p09.pddl
0.8002 0.8002 0.0 -0.0000 -0.0000 0.0
p10.pddl
0 0 0.0 0 0 0.0
p11.pddl
0.7631 0.7631 0.0 -0.0000 -0.0000 0.0
p12.pddl
0.7243 0.7243 0.0 0 0 0.0
p13.pddl
0.7481 0.7481 0.0 0 0 0.0
p14.pddl
0.7048 0.7048 0.0 0 0 0.0
p15.pddl
0.7702 0.7702 0.0 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0.6857 0.6857 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0.5980 0.5980 0.0 0 0 0.0
p24.pddl
0.6037 0.6037 0.0 0 0 0.0
p25.pddl
0.6235 0.6235 0.0 0 0 0.0
p26.pddl
0.5786 0.5786 0.0 0 0 0.0
p27.pddl
0.5612 0.5612 0.0 0 0 0.0
p28.pddl
0.6364 0.6364 0.0 0 0 0.0
p29.pddl
0.5366 0.5366 0.0 0 0 0.0
p30.pddl
0.5014 0.5014 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pegsol-08-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
0.9619 0.9619 0.0 0.9690 0.9690 0.0
p05.pddl
0.9989 0.9989 0.0 1.0000 1.0000 0.0
p06.pddl
0.9139 0.9139 0.0 0.9968 0.9968 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0.8938 0.8938 0.0 0.8950 0.8950 0.0
p09.pddl
0.9682 0.9682 0.0 0.8553 0.8553 0.0
p10.pddl
0.6057 0.6057 0.0 0.7530 0.7530 0.0
p11.pddl
0.7407 0.7407 0.0 0.6801 0.6801 0.0
p12.pddl
0.7256 0.7256 0.0 0.8514 0.8514 0.0
p13.pddl
0.8793 0.8793 0.0 0.4497 0.4497 0.0
p14.pddl
0.8444 0.8444 0.0 0.4745 0.4745 0.0
p15.pddl
0.8500 0.8500 0.0 0.6745 0.6745 0.0
p16.pddl
0.7959 0.7959 0.0 0.5482 0.5482 0.0
p17.pddl
0.3930 0.3930 0.0 0.3726 0.3726 0.0
p18.pddl
0.5836 0.5836 0.0 0.8681 0.8681 0.0
p19.pddl
0.7791 0.7791 0.0 0.4837 0.4837 0.0
p20.pddl
0.7063 0.7063 0.0 0.8084 0.8084 0.0
p21.pddl
0.8030 0.8030 0.0 0.4155 0.4155 0.0
p22.pddl
0.6883 0.6883 0.0 0.5394 0.5394 0.0
p23.pddl
0.7271 0.7271 0.0 0.3470 0.3470 0.0
p24.pddl
0.6549 0.6549 0.0 0.4412 0.4412 0.0
p25.pddl
0.6842 0.6842 0.0 0.4750 0.4750 0.0
p26.pddl
0.7384 0.7384 0.0 0.3490 0.3490 0.0
p27.pddl
0.2598 0.2598 0.0 0.7264 0.7264 0.0
p28.pddl
0.1507 0.1507 0.0 0.0052 0.0052 0.0
p29.pddl
-0.0000 -0.0000 0.0 0.1871 0.1871 0.0
p30.pddl
0.1467 0.1467 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pegsol-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9392 0.9392 0.0 1.0000 1.0000 0.0
p02.pddl
0.3930 0.3930 0.0 0.3726 0.3726 0.0
p03.pddl
0.5836 0.5836 0.0 0.8681 0.8681 0.0
p04.pddl
0.7791 0.7791 0.0 0.4837 0.4837 0.0
p05.pddl
0.7701 0.7701 0.0 0.3193 0.3193 0.0
p06.pddl
0.9054 0.9054 0.0 0.7050 0.7050 0.0
p07.pddl
0.6872 0.6872 0.0 0.8099 0.8099 0.0
p08.pddl
0.7063 0.7063 0.0 0.8084 0.8084 0.0
p09.pddl
0.5748 0.5748 0.0 0.5145 0.5145 0.0
p10.pddl
0.8030 0.8030 0.0 0.4155 0.4155 0.0
p11.pddl
0.6883 0.6883 0.0 0.5394 0.5394 0.0
p12.pddl
0.6954 0.6954 0.0 0.4776 0.4776 0.0
p13.pddl
0.7271 0.7271 0.0 0.3470 0.3470 0.0
p14.pddl
0.6549 0.6549 0.0 0.4412 0.4412 0.0
p15.pddl
0.6842 0.6842 0.0 0.4750 0.4750 0.0
p16.pddl
0.7384 0.7384 0.0 0.3490 0.3490 0.0
p17.pddl
0.2598 0.2598 0.0 0.7264 0.7264 0.0
p18.pddl
0.1507 0.1507 0.0 0.0052 0.0052 0.0
p19.pddl
-0.0000 -0.0000 0.0 0.1871 0.1871 0.0
p20.pddl
0.1467 0.1467 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
petri-net-alignment-opt18-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8240 0.8240 0.0 0.7396 0.7396 0.0
p02.pddl
0.7958 0.7958 0.0 0.7100 0.7100 0.0
p03.pddl
0.7801 0.7801 0.0 0.6923 0.6923 0.0
p04.pddl
0.7792 0.7792 0.0 0.6884 0.6884 0.0
p05.pddl
0.7998 0.7998 0.0 0.7143 0.7143 0.0
p06.pddl
0.7795 0.7795 0.0 0.6899 0.6899 0.0
p07.pddl
0.7842 0.7842 0.0 0.6988 0.6988 0.0
p08.pddl
0.7792 0.7792 0.0 0.6894 0.6894 0.0
p09.pddl
0.7789 0.7789 0.0 0.6928 0.6928 0.0
p10.pddl
0.7563 0.7563 0.0 0.6649 0.6649 0.0
p11.pddl
0.7689 0.7689 0.0 0.6805 0.6805 0.0
p12.pddl
0.7435 0.7435 0.0 0.6501 0.6501 0.0
p13.pddl
0.7581 0.7581 0.0 0.6673 0.6673 0.0
p14.pddl
0.7540 0.7540 0.0 0.6645 0.6645 0.0
p15.pddl
0.7569 0.7569 0.0 0.6672 0.6672 0.0
p16.pddl
0.7474 0.7474 0.0 0.6569 0.6569 0.0
p17.pddl
0.7439 0.7439 0.0 0.6539 0.6539 0.0
p18.pddl
0.7474 0.7474 0.0 0.6575 0.6575 0.0
p19.pddl
0.7462 0.7462 0.0 0.6531 0.6531 0.0
p20.pddl
0.7414 0.7414 0.0 0.6499 0.6499 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pipesworld-notankage
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-net1-b6-g4.pddl
0.7279 0.7279 0.0 1.0000 1.0000 0.0
p03-net1-b8-g3.pddl
0.9205 0.9205 0.0 0.9758 0.9758 0.0
p04-net1-b8-g5.pddl
0.7277 0.7277 0.0 0.9887 0.9887 0.0
p05-net1-b10-g4.pddl
0.8218 0.8218 0.0 0.9497 0.9497 0.0
p06-net1-b10-g6.pddl
0.5608 0.5608 0.0 0.9490 0.9490 0.0
p07-net1-b12-g5.pddl
1.0000 1.0000 0.0 0.9463 0.9463 0.0
p08-net1-b12-g7.pddl
1.0000 1.0000 0.0 0.9380 0.9380 0.0
p09-net1-b14-g6.pddl
1.0000 1.0000 0.0 0.9450 0.9450 0.0
p10-net1-b14-g8.pddl
1.0000 1.0000 0.0 0.9018 0.9018 0.0
p11-net2-b10-g2.pddl
0.4203 0.4203 0.0 0.5538 0.5538 0.0
p12-net2-b10-g4.pddl
0.4296 0.4296 0.0 0.4841 0.4841 0.0
p13-net2-b12-g3.pddl
0.9749 0.9749 0.0 0.3649 0.3649 0.0
p14-net2-b12-g5.pddl
0.5175 0.5175 0.0 0.4815 0.4815 0.0
p15-net2-b14-g4.pddl
0.6740 0.6740 0.0 0.3765 0.3765 0.0
p16-net2-b14-g6.pddl
0.3235 0.3235 0.0 0.0617 0.0617 0.0
p17-net2-b16-g5.pddl
0.3749 0.3749 0.0 0.4854 0.4854 0.0
p18-net2-b16-g7.pddl
0.3173 0.3173 0.0 0.4371 0.4371 0.0
p19-net2-b18-g6.pddl
0.8882 0.8882 0.0 0.6565 0.6565 0.0
p20-net2-b18-g8.pddl
0.2631 0.2631 0.0 0.3292 0.3292 0.0
p21-net3-b12-g2.pddl
1.0000 1.0000 0.0 0.7624 0.7624 0.0
p22-net3-b12-g4.pddl
0.2424 0.2424 0.0 0.2285 0.2285 0.0
p23-net3-b14-g3.pddl
0.7925 0.7925 0.0 0.3676 0.3676 0.0
p24-net3-b14-g5.pddl
0.3413 0.3413 0.0 0.0976 0.0976 0.0
p25-net3-b16-g5.pddl
0.8141 0.8141 0.0 0.1119 0.1119 0.0
p26-net3-b16-g7.pddl
0.2878 0.2878 0.0 0.3353 0.3353 0.0
p27-net3-b18-g6.pddl
0.2808 0.2808 0.0 -0.0000 -0.0000 0.0
p28-net3-b18-g7.pddl
0.2880 0.2880 0.0 -0.0000 -0.0000 0.0
p29-net3-b20-g6.pddl
0.4544 0.4544 0.0 -0.0000 -0.0000 0.0
p30-net3-b20-g8.pddl
0.2889 0.2889 0.0 0.1790 0.1790 0.0
p31-net4-b14-g3.pddl
0.9134 0.9134 0.0 0.3071 0.3071 0.0
p32-net4-b14-g5.pddl
0.3878 0.3878 0.0 0.3744 0.3744 0.0
p33-net4-b16-g5.pddl
0.4884 0.4884 0.0 0.2582 0.2582 0.0
p34-net4-b16-g6.pddl
0.3042 0.3042 0.0 0.1751 0.1751 0.0
p35-net4-b18-g4.pddl
0.4041 0.4041 0.0 -0.0000 -0.0000 0.0
p36-net4-b18-g6.pddl
0.7974 0.7974 0.0 -0.0000 -0.0000 0.0
p37-net4-b20-g5.pddl
0.5942 0.5942 0.0 0 0 0.0
p38-net4-b20-g7.pddl
0.3175 0.3175 0.0 -0.0000 -0.0000 0.0
p39-net4-b22-g7.pddl
0.8320 0.8320 0.0 0 0 0.0
p40-net4-b22-g8.pddl
0.5102 0.5102 0.0 -0.0000 -0.0000 0.0
p41-net5-b22-g2.pddl
0.7526 0.7526 0.0 -0.0000 -0.0000 0.0
p42-net5-b22-g4.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6.pddl
0.7710 0.7710 0.0 0 0 0.0
p50-net5-b30-g8.pddl
0.2914 0.2914 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pipesworld-tankage
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-net1-b6-g4-t50.pddl
0.6910 0.6910 0.0 0.9437 0.9437 0.0
p03-net1-b8-g3-t80.pddl
1.0000 1.0000 0.0 0.8157 0.8157 0.0
p04-net1-b8-g5-t80.pddl
0.8235 0.8235 0.0 0.8179 0.8179 0.0
p05-net1-b10-g4-t50.pddl
0.9258 0.9258 0.0 0.8796 0.8796 0.0
p06-net1-b10-g6-t50.pddl
0.9604 0.9604 0.0 0.8720 0.8720 0.0
p07-net1-b12-g5-t80.pddl
1.0000 1.0000 0.0 0.9077 0.9077 0.0
p08-net1-b12-g7-t80.pddl
1.0000 1.0000 0.0 0.8322 0.8322 0.0
p09-net1-b14-g6-t50.pddl
0.3880 0.3880 0.0 0.2221 0.2221 0.0
p10-net1-b14-g8-t50.pddl
0.9560 0.9560 0.0 0.5009 0.5009 0.0
p11-net2-b10-g2-t30.pddl
0.7630 0.7630 0.0 0.3147 0.3147 0.0
p12-net2-b10-g4-t60.pddl
0.8343 0.8343 0.0 0.2382 0.2382 0.0
p13-net2-b12-g3-t70.pddl
0.9269 0.9269 0.0 -0.0000 -0.0000 0.0
p14-net2-b12-g5-t30.pddl
0.7125 0.7125 0.0 0.1441 0.1441 0.0
p15-net2-b14-g4-t30.pddl
0.6301 0.6301 0.0 0.0304 0.0304 0.0
p16-net2-b14-g6-t80.pddl
0.5774 0.5774 0.0 0 0 0.0
p17-net2-b16-g5-t20.pddl
0.4692 0.4692 0.0 -0.0000 -0.0000 0.0
p18-net2-b16-g7-t60.pddl
0.4613 0.4613 0.0 -0.0000 -0.0000 0.0
p19-net2-b18-g6-t60.pddl
0.8724 0.8724 0.0 -0.0000 -0.0000 0.0
p20-net2-b18-g8-t90.pddl
0.5464 0.5464 0.0 0 0 0.0
p21-net3-b12-g2-t60.pddl
0.9957 0.9957 0.0 0.1981 0.1981 0.0
p22-net3-b12-g4-t60.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p23-net3-b14-g3-t60.pddl
0.4531 0.4531 0.0 0 0 0.0
p24-net3-b14-g5-t60.pddl
0.5932 0.5932 0.0 0 0 0.0
p25-net3-b16-g5-t60.pddl
0.8073 0.8073 0.0 0 0 0.0
p26-net3-b16-g7-t70.pddl
0.3157 0.3157 0.0 0 0 0.0
p27-net3-b18-g6-t70.pddl
0.7656 0.7656 0.0 0 0 0.0
p28-net3-b18-g7-t70.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p29-net3-b20-g6-t70.pddl
0.6683 0.6683 0.0 0 0 0.0
p30-net3-b20-g8-t70.pddl
0.4632 0.4632 0.0 0 0 0.0
p31-net4-b14-g3-t20.pddl
0.0628 0.0628 0.0 0.2119 0.2119 0.0
p32-net4-b14-g5-t30.pddl
0.4197 0.4197 0.0 -0.0000 -0.0000 0.0
p33-net4-b16-g5-t60.pddl
0.7038 0.7038 0.0 0 0 0.0
p34-net4-b16-g6-t60.pddl
0.6417 0.6417 0.0 0 0 0.0
p35-net4-b18-g4-t90.pddl
0.7649 0.7649 0.0 0 0 0.0
p36-net4-b18-g6-t90.pddl
0.3525 0.3525 0.0 0 0 0.0
p37-net4-b20-g5-t60.pddl
0.7863 0.7863 0.0 0 0 0.0
p38-net4-b20-g7-t60.pddl
0.5444 0.5444 0.0 0 0 0.0
p39-net4-b22-g7-t50.pddl
0.7335 0.7335 0.0 0 0 0.0
p40-net4-b22-g8-t50.pddl
0.7679 0.7679 0.0 0 0 0.0
p41-net5-b22-g2-t20.pddl
0.9411 0.9411 0.0 0 0 0.0
p42-net5-b22-g4-t50.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3-t80.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5-t80.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4-t50.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6-t50.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5-t50.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7-t50.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6-t50.pddl
0.6144 0.6144 0.0 0 0 0.0
p50-net5-b30-g8-t50.pddl
0.3459 0.3459 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
psr-small
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-s5-n1-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-s7-n1-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-s8-n1-l4-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-s9-n1-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-s10-n1-l4-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-s11-n1-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-s12-n1-l5-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-s13-n1-l5-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10-s17-n2-l2-f30.pddl
0.8971 0.8971 0.0 1.0000 1.0000 0.0
p11-s18-n2-l2-f50.pddl
0.9134 0.9134 0.0 0.9897 0.9897 0.0
p12-s21-n2-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-s22-n2-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14-s23-n2-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-s24-n2-l4-f10.pddl
0.9374 0.9374 0.0 0.4031 0.4031 0.0
p16-s29-n2-l5-f30.pddl
0.7293 0.7293 0.0 0.6374 0.6374 0.0
p17-s30-n2-l5-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18-s31-n2-l5-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19-s33-n3-l2-f30.pddl
0.6766 0.6766 0.0 0.5556 0.5556 0.0
p20-s34-n3-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21-s35-n3-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22-s37-n3-l3-f30.pddl
0.5846 0.5846 0.0 0.7341 0.7341 0.0
p23-s38-n3-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24-s39-n3-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25-s40-n3-l4-f10.pddl
1.0000 1.0000 0.0 0.2025 0.2025 0.0
p26-s41-n3-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27-s42-n3-l4-f50.pddl
0.9184 0.9184 0.0 0.9867 0.9867 0.0
p28-s43-n3-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29-s45-n3-l5-f30.pddl
0.6909 0.6909 0.0 0.8343 0.8343 0.0
p30-s46-n3-l5-f50.pddl
0.8678 0.8678 0.0 0.9275 0.9275 0.0
p31-s49-n4-l2-f30.pddl
0.8704 0.8704 0.0 0.2883 0.2883 0.0
p32-s50-n4-l2-f50.pddl
0.8468 0.8468 0.0 0.8807 0.8807 0.0
p33-s51-n4-l2-f70.pddl
0.8517 0.8517 0.0 0.6493 0.6493 0.0
p34-s55-n4-l3-f70.pddl
0.9096 0.9096 0.0 0.9567 0.9567 0.0
p35-s57-n5-l2-f30.pddl
0.7190 0.7190 0.0 0.1306 0.1306 0.0
p36-s65-n6-l2-f30.pddl
0.7037 0.7037 0.0 -0.0000 -0.0000 0.0
p37-s67-n6-l2-f70.pddl
0.8437 0.8437 0.0 0.9154 0.9154 0.0
p38-s78-n3-l3-f50.pddl
0.9715 0.9715 0.0 1.0000 1.0000 0.0
p39-s79-n3-l3-f70.pddl
0.8793 0.8793 0.0 0.9463 0.9463 0.0
p40-s80-n3-l4-f10.pddl
0.7607 0.7607 0.0 -0.0000 -0.0000 0.0
p41-s81-n3-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p42-s82-n3-l4-f50.pddl
0.6797 0.6797 0.0 0.6810 0.6810 0.0
p43-s83-n3-l4-f70.pddl
0.8579 0.8579 0.0 0.9242 0.9242 0.0
p44-s89-n4-l2-f30.pddl
0.7890 0.7890 0.0 0.8954 0.8954 0.0
p45-s94-n4-l3-f50.pddl
0.9184 0.9184 0.0 0.9978 0.9978 0.0
p46-s97-n5-l2-f30.pddl
0.7487 0.7487 0.0 0.2660 0.2660 0.0
p47-s98-n5-l2-f50.pddl
0.8758 0.8758 0.0 0.8958 0.8958 0.0
p48-s101-n5-l3-f30.pddl
0.7239 0.7239 0.0 0.6945 0.6945 0.0
p49-s105-n6-l2-f30.pddl
0.6197 0.6197 0.0 0.5508 0.5508 0.0
p50-s107-n6-l2-f70.pddl
0.7971 0.7971 0.0 0.9242 0.9242 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
rovers
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.9470 0.9470 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.9957 0.9957 0.0 0.8268 0.8268 0.0
p06.pddl
0.8556 0.8556 0.0 0.7901 0.7901 0.0
p07.pddl
1.0000 1.0000 0.0 0.5734 0.5734 0.0
p08.pddl
0.9877 0.9877 0.0 0.5207 0.5207 0.0
p09.pddl
0.9619 0.9619 0.0 0.2915 0.2915 0.0
p10.pddl
0.8890 0.8890 0.0 0.2065 0.2065 0.0
p11.pddl
0.9247 0.9247 0.0 0.3955 0.3955 0.0
p12.pddl
1.0000 1.0000 0.0 0.4970 0.4970 0.0
p13.pddl
0.8297 0.8297 0.0 0.3518 0.3518 0.0
p14.pddl
0.9134 0.9134 0.0 0.2723 0.2723 0.0
p15.pddl
0.7718 0.7718 0.0 0.2242 0.2242 0.0
p16.pddl
0.8248 0.8248 0.0 0.2278 0.2278 0.0
p17.pddl
0.8979 0.8979 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.8786 0.8786 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.7500 0.7500 0.0 0 0 0.0
p20.pddl
0.7064 0.7064 0.0 0 0 0.0
p21.pddl
0.7352 0.7352 0.0 0 0 0.0
p22.pddl
0.7184 0.7184 0.0 -0.0000 -0.0000 0.0
p23.pddl
0.7071 0.7071 0.0 0 0 0.0
p24.pddl
0.6305 0.6305 0.0 0 0 0.0
p25.pddl
0.9258 0.9258 0.0 0.0335 0.0335 0.0
p26.pddl
0.7654 0.7654 0.0 0 0 0.0
p27.pddl
0.6820 0.6820 0.0 0 0 0.0
p28.pddl
0.6815 0.6815 0.0 0 0 0.0
p29.pddl
0.7789 0.7789 0.0 0 0 0.0
p30.pddl
0.6684 0.6684 0.0 0 0 0.0
p31.pddl
0.6155 0.6155 0.0 0 0 0.0
p32.pddl
0.5487 0.5487 0.0 0 0 0.0
p33.pddl
0.4675 0.4675 0.0 0 0 0.0
p34.pddl
0.5778 0.5778 0.0 0 0 0.0
p35.pddl
0.4216 0.4216 0.0 0 0 0.0
p36.pddl
0.4836 0.4836 0.0 0 0 0.0
p37.pddl
0.3631 0.3631 0.0 0 0 0.0
p38.pddl
0.4337 0.4337 0.0 0 0 0.0
p39.pddl
0.4441 0.4441 0.0 0 0 0.0
p40.pddl
0.3850 0.3850 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
satellite
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-pfile2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-pfile3.pddl
1.0000 1.0000 0.0 0.7752 0.7752 0.0
p04-pfile4.pddl
1.0000 1.0000 0.0 0.6818 0.6818 0.0
p05-pfile5.pddl
1.0000 1.0000 0.0 0.3192 0.3192 0.0
p06-pfile6.pddl
1.0000 1.0000 0.0 0.4283 0.4283 0.0
p07-pfile7.pddl
1.0000 1.0000 0.0 0.1833 0.1833 0.0
p08-pfile8.pddl
0.9802 0.9802 0.0 -0.0000 -0.0000 0.0
p09-pfile9.pddl
0.9503 0.9503 0.0 -0.0000 -0.0000 0.0
p10-pfile10.pddl
0.9374 0.9374 0.0 -0.0000 -0.0000 0.0
p11-pfile11.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
p12-pfile12.pddl
0.9839 0.9839 0.0 -0.0000 -0.0000 0.0
p13-pfile13.pddl
0.7547 0.7547 0.0 0 0 0.0
p14-pfile14.pddl
0.9105 0.9105 0.0 -0.0000 -0.0000 0.0
p15-pfile15.pddl
0.8137 0.8137 0.0 0 0 0.0
p16-pfile16.pddl
0.9560 0.9560 0.0 0 0 0.0
p17-pfile17.pddl
0.8066 0.8066 0.0 0 0 0.0
p18-pfile18.pddl
0.9032 0.9032 0.0 0 0 0.0
p19-pfile19.pddl
0.8110 0.8110 0.0 0 0 0.0
p20-pfile20.pddl
0.6458 0.6458 0.0 0 0 0.0
p21-HC-pfile1.pddl
0.8426 0.8426 0.0 -0.0000 -0.0000 0.0
p22-HC-pfile2.pddl
0.8157 0.8157 0.0 0 0 0.0
p23-HC-pfile3.pddl
0.6990 0.6990 0.0 -0.0000 -0.0000 0.0
p24-HC-pfile4.pddl
0.6298 0.6298 0.0 0 0 0.0
p25-HC-pfile5.pddl
0.6012 0.6012 0.0 0 0 0.0
p26-HC-pfile6.pddl
0.6775 0.6775 0.0 0 0 0.0
p27-HC-pfile7.pddl
0.7142 0.7142 0.0 0 0 0.0
p28-HC-pfile8.pddl
0.5067 0.5067 0.0 0 0 0.0
p29-HC-pfile9.pddl
0.6377 0.6377 0.0 0 0 0.0
p30-HC-pfile10.pddl
0.4866 0.4866 0.0 0 0 0.0
p31-HC-pfile11.pddl
0.5542 0.5542 0.0 0 0 0.0
p32-HC-pfile12.pddl
0.4285 0.4285 0.0 0 0 0.0
p33-HC-pfile13.pddl
0.3619 0.3619 0.0 0 0 0.0
p34-HC-pfile14.pddl
0.8084 0.8084 0.0 0 0 0.0
p35-HC-pfile15.pddl
0.4803 0.4803 0.0 0 0 0.0
p36-HC-pfile16.pddl
0.6756 0.6756 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
scanalyzer-08-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9589 0.9589 0.0
p02.pddl
1.0000 1.0000 0.0 0.9091 0.9091 0.0
p03.pddl
0.9503 0.9503 0.0 0.8954 0.8954 0.0
p04.pddl
1.0000 1.0000 0.0 0.8536 0.8536 0.0
p05.pddl
0.9215 0.9215 0.0 0.7737 0.7737 0.0
p06.pddl
0.8603 0.8603 0.0 0.7587 0.7587 0.0
p07.pddl
1.0000 1.0000 0.0 0.7710 0.7710 0.0
p08.pddl
0.8615 0.8615 0.0 0.6644 0.6644 0.0
p09.pddl
0.7985 0.7985 0.0 0.6502 0.6502 0.0
p10.pddl
0.9682 0.9682 0.0 0.7028 0.7028 0.0
p11.pddl
0.8130 0.8130 0.0 0.5730 0.5730 0.0
p12.pddl
0.7476 0.7476 0.0 0.5600 0.5600 0.0
p13.pddl
0.9338 0.9338 0.0 0.6447 0.6447 0.0
p14.pddl
0.7721 0.7721 0.0 0.4945 0.4945 0.0
p15.pddl
0.7045 0.7045 0.0 0.4827 0.4827 0.0
p16.pddl
0.9040 0.9040 0.0 0.5939 0.5939 0.0
p17.pddl
0.7367 0.7367 0.0 0.4257 0.4257 0.0
p18.pddl
0.6670 0.6670 0.0 0.4150 0.4150 0.0
p19.pddl
0.8779 0.8779 0.0 0.5488 0.5488 0.0
p20.pddl
0.7055 0.7055 0.0 0.3646 0.3646 0.0
p21.pddl
0.6337 0.6337 0.0 0.3547 0.3547 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 0.9947 0.9947 0.0
p26.pddl
0.8874 0.8874 0.0 0.9105 0.9105 0.0
p27.pddl
0.8800 0.8800 0.0 0.5336 0.5336 0.0
p28.pddl
1.0000 1.0000 0.0 0.8379 0.8379 0.0
p29.pddl
0.6365 0.6365 0.0 0.7181 0.7181 0.0
p30.pddl
0.7948 0.7948 0.0 0.5722 0.5722 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
scanalyzer-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 0.9091 0.9091 0.0
p03.pddl
0.9503 0.9503 0.0 0.8954 0.8954 0.0
p04.pddl
1.0000 1.0000 0.0 0.8536 0.8536 0.0
p05.pddl
1.0000 1.0000 0.0 0.7710 0.7710 0.0
p06.pddl
0.9215 0.9215 0.0 0.7737 0.7737 0.0
p07.pddl
0.8779 0.8779 0.0 0.5488 0.5488 0.0
p08.pddl
0.9682 0.9682 0.0 0.7028 0.7028 0.0
p09.pddl
0.9338 0.9338 0.0 0.6447 0.6447 0.0
p10.pddl
0.9040 0.9040 0.0 0.5939 0.5939 0.0
p11.pddl
1.0000 1.0000 0.0 0.9947 0.9947 0.0
p12.pddl
0.8603 0.8603 0.0 0.7587 0.7587 0.0
p13.pddl
0.8800 0.8800 0.0 0.5336 0.5336 0.0
p14.pddl
0.8874 0.8874 0.0 0.9105 0.9105 0.0
p15.pddl
0.8615 0.8615 0.0 0.6644 0.6644 0.0
p16.pddl
0.8130 0.8130 0.0 0.5730 0.5730 0.0
p17.pddl
0.7721 0.7721 0.0 0.4945 0.4945 0.0
p18.pddl
0.7367 0.7367 0.0 0.4257 0.4257 0.0
p19.pddl
0.7055 0.7055 0.0 0.3646 0.3646 0.0
p20.pddl
1.0000 1.0000 0.0 0.8379 0.8379 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
snake-opt18-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.6768 0.6768 0.0 0.4564 0.4564 0.0
p02.pddl
0.5047 0.5047 0.0 0.1588 0.1588 0.0
p03.pddl
0.2435 0.2435 0.0 0.0217 0.0217 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.8498 0.8498 0.0
p06.pddl
0.6130 0.6130 0.0 0.1202 0.1202 0.0
p07.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p08.pddl
0 0 0.0 -0.0000 -0.0000 0.0
p09.pddl
0.9619 0.9619 0.0 0.6812 0.6812 0.0
p10.pddl
0.7608 0.7608 0.0 0.4394 0.4394 0.0
p11.pddl
0.6134 0.6134 0.0 0.0362 0.0362 0.0
p12.pddl
0.0314 0.0314 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.2477 0.2477 0.0 0 0 0.0
p14.pddl
0 0 0.0 0 0 0.0
p15.pddl
0.8231 0.8231 0.0 0.3446 0.3446 0.0
p16.pddl
0.2562 0.2562 0.0 -0.0000 -0.0000 0.0
p17.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0.5185 0.5185 0.0 0.2032 0.2032 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
sokoban-opt08-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8737 0.8737 0.0 0.6675 0.6675 0.0
p02.pddl
0.8452 0.8452 0.0 0.8439 0.8439 0.0
p03.pddl
0.9315 0.9315 0.0 0.8495 0.8495 0.0
p04.pddl
0.6976 0.6976 0.0 0.5278 0.5278 0.0
p05.pddl
0.8421 0.8421 0.0 0 0 0.0
p06.pddl
0.8033 0.8033 0.0 0.4537 0.4537 0.0
p07.pddl
0.6579 0.6579 0.0 0.2942 0.2942 0.0
p08.pddl
0.2907 0.2907 0.0 -0.0000 -0.0000 0.0
p09.pddl
0.5108 0.5108 0.0 -0.0000 -0.0000 0.0
p10.pddl
0.4045 0.4045 0.0 0.0717 0.0717 0.0
p11.pddl
0.2040 0.2040 0.0 0.1440 0.1440 0.0
p12.pddl
0.3913 0.3913 0.0 -0.0000 -0.0000 0.0
p13.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p14.pddl
0.6024 0.6024 0.0 0.3109 0.3109 0.0
p15.pddl
0.1915 0.1915 0.0 -0.0000 -0.0000 0.0
p16.pddl
0.3072 0.3072 0.0 0.1912 0.1912 0.0
p17.pddl
0.4836 0.4836 0.0 0.2426 0.2426 0.0
p18.pddl
0.2460 0.2460 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.1728 0.1728 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.6189 0.6189 0.0 0.6392 0.6392 0.0
p21.pddl
0.6031 0.6031 0.0 0.5899 0.5899 0.0
p22.pddl
0.2329 0.2329 0.0 -0.0000 -0.0000 0.0
p23.pddl
0.5171 0.5171 0.0 0.0347 0.0347 0.0
p24.pddl
0.1191 0.1191 0.0 0 0 0.0
p25.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p26.pddl
0.2506 0.2506 0.0 0 0 0.0
p27.pddl
0.3925 0.3925 0.0 0.3637 0.3637 0.0
p28.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p29.pddl
0.9100 0.9100 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
sokoban-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8033 0.8033 0.0 0.4537 0.4537 0.0
p02.pddl
0.4836 0.4836 0.0 0.2426 0.2426 0.0
p03.pddl
0.6024 0.6024 0.0 0.3109 0.3109 0.0
p04.pddl
0.6976 0.6976 0.0 0.5278 0.5278 0.0
p05.pddl
0.3072 0.3072 0.0 0.1912 0.1912 0.0
p06.pddl
0.2040 0.2040 0.0 0.1440 0.1440 0.0
p07.pddl
0.4045 0.4045 0.0 0.0717 0.0717 0.0
p08.pddl
0.5108 0.5108 0.0 -0.0000 -0.0000 0.0
p09.pddl
0.6579 0.6579 0.0 0.2942 0.2942 0.0
p10.pddl
0.8421 0.8421 0.0 0 0 0.0
p11.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p12.pddl
0.6189 0.6189 0.0 0.6392 0.6392 0.0
p13.pddl
0.2907 0.2907 0.0 -0.0000 -0.0000 0.0
p14.pddl
0.3913 0.3913 0.0 -0.0000 -0.0000 0.0
p15.pddl
0.2460 0.2460 0.0 -0.0000 -0.0000 0.0
p16.pddl
0.1915 0.1915 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.1728 0.1728 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.6031 0.6031 0.0 0.5899 0.5899 0.0
p19.pddl
0.2329 0.2329 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.5171 0.5171 0.0 0.0347 0.0347 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
spider-opt18-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9338 0.9338 0.0 0.9463 0.9463 0.0
p02.pddl
0.6067 0.6067 0.0 0.5901 0.5901 0.0
p03.pddl
0.7875 0.7875 0.0 0.6451 0.6451 0.0
p04.pddl
0.8009 0.8009 0.0 0.5144 0.5144 0.0
p05.pddl
0.5358 0.5358 0.0 0.3822 0.3822 0.0
p06.pddl
0.4253 0.4253 0.0 -0.0000 -0.0000 0.0
p07.pddl
0.8594 0.8594 0.0 0.8579 0.8579 0.0
p08.pddl
0.8768 0.8768 0.0 0.8687 0.8687 0.0
p09.pddl
0.4252 0.4252 0.0 0.3904 0.3904 0.0
p10.pddl
0.2680 0.2680 0.0 0.0709 0.0709 0.0
p11.pddl
0.6583 0.6583 0.0 0.3724 0.3724 0.0
p12.pddl
0.5434 0.5434 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.3391 0.3391 0.0 0.2694 0.2694 0.0
p14.pddl
0.9635 0.9635 0.0 0.9574 0.9574 0.0
p15.pddl
0.9231 0.9231 0.0 0.9399 0.9399 0.0
p16.pddl
0.8782 0.8782 0.0 0.7536 0.7536 0.0
p17.pddl
0.7914 0.7914 0.0 0.8120 0.8120 0.0
p18.pddl
0.7344 0.7344 0.0 0.0339 0.0339 0.0
p19.pddl
0.7614 0.7614 0.0 0.4724 0.4724 0.0
p20.pddl
0.6796 0.6796 0.0 0.4744 0.4744 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
storage
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.9635 0.9635 0.0
p06.pddl
1.0000 1.0000 0.0 0.8890 0.8890 0.0
p07.pddl
0.9490 0.9490 0.0 0.9418 0.9418 0.0
p08.pddl
0.8730 0.8730 0.0 0.6870 0.6870 0.0
p09.pddl
0.8837 0.8837 0.0 0.6269 0.6269 0.0
p10.pddl
0.8545 0.8545 0.0 0.7297 0.7297 0.0
p11.pddl
0.5602 0.5602 0.0 0.4759 0.4759 0.0
p12.pddl
0.6059 0.6059 0.0 0.2701 0.2701 0.0
p13.pddl
0.4237 0.4237 0.0 0.6831 0.6831 0.0
p14.pddl
0.3576 0.3576 0.0 0.5159 0.5159 0.0
p15.pddl
0.5055 0.5055 0.0 0.3066 0.3066 0.0
p16.pddl
0.4904 0.4904 0.0 0.0448 0.0448 0.0
p17.pddl
0.4589 0.4589 0.0 -0.0000 -0.0000 0.0
p18.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0.1226 0.1226 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
termes-opt18-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.6943 0.6943 0.0 0.4392 0.4392 0.0
p02.pddl
0.4154 0.4154 0.0 0.4130 0.4130 0.0
p03.pddl
0.4042 0.4042 0.0 0.1978 0.1978 0.0
p04.pddl
0.4299 0.4299 0.0 0.2111 0.2111 0.0
p05.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p06.pddl
0.0991 0.0991 0.0 -0.0000 -0.0000 0.0
p07.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p08.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p09.pddl
0 0 0.0 0 0 0.0
p10.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p11.pddl
0.6371 0.6371 0.0 0.2666 0.2666 0.0
p12.pddl
0.5452 0.5452 0.0 0.5557 0.5557 0.0
p13.pddl
0.4676 0.4676 0.0 0.2247 0.2247 0.0
p14.pddl
0.5080 0.5080 0.0 0.3424 0.3424 0.0
p15.pddl
0.1707 0.1707 0.0 0.1440 0.1440 0.0
p16.pddl
0.2362 0.2362 0.0 0.0837 0.0837 0.0
p17.pddl
0.3062 0.3062 0.0 0.2736 0.2736 0.0
p18.pddl
0.6391 0.6391 0.0 0.5266 0.5266 0.0
p19.pddl
0.3362 0.3362 0.0 0.4017 0.4017 0.0
p20.pddl
0.3014 0.3014 0.0 0.2113 0.2113 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tetris-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
0.4427 0.4427 0.0 0.8279 0.8279 0.0
p01-8.pddl
0.4908 0.4908 0.0 0.7903 0.7903 0.0
p01-10.pddl
-0.0000 -0.0000 0.0 0.2206 0.2206 0.0
p02-4.pddl
0.7909 0.7909 0.0 1.0000 1.0000 0.0
p02-6.pddl
0.5100 0.5100 0.0 0.8811 0.8811 0.0
p02-8.pddl
0.5291 0.5291 0.0 0.5753 0.5753 0.0
p02-10.pddl
0.1504 0.1504 0.0 0.4115 0.4115 0.0
p03-4.pddl
0.5926 0.5926 0.0 0.9740 0.9740 0.0
p03-6.pddl
0.4784 0.4784 0.0 0.7220 0.7220 0.0
p03-8.pddl
0.5192 0.5192 0.0 0.7476 0.7476 0.0
p03-10.pddl
0.4577 0.4577 0.0 0.6055 0.6055 0.0
p04-6.pddl
0.4437 0.4437 0.0 0.7079 0.7079 0.0
p04-8.pddl
0.3623 0.3623 0.0 0.6818 0.6818 0.0
p04-10.pddl
0.3847 0.3847 0.0 0.6453 0.6453 0.0
p05-6.pddl
0.5719 0.5719 0.0 0.8551 0.8551 0.0
p05-8.pddl
0.0401 0.0401 0.0 0.7021 0.7021 0.0
p05-10.pddl
0.5027 0.5027 0.0 0.6043 0.6043 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tidybot-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.6769 0.6769 0.0 0.8844 0.8844 0.0
p03.pddl
0.9463 0.9463 0.0 0.9775 0.9775 0.0
p04.pddl
0.8051 0.8051 0.0 0.8082 0.8082 0.0
p05.pddl
0.6756 0.6756 0.0 0.5868 0.5868 0.0
p06.pddl
0.8495 0.8495 0.0 0.7552 0.7552 0.0
p07.pddl
0.7251 0.7251 0.0 0.9732 0.9732 0.0
p08.pddl
-0.0000 -0.0000 0.0 0.5396 0.5396 0.0
p09.pddl
0.4706 0.4706 0.0 0.8514 0.8514 0.0
p10.pddl
0.9258 0.9258 0.0 0.5874 0.5874 0.0
p11.pddl
0.7500 0.7500 0.0 0.7190 0.7190 0.0
p12.pddl
0.8353 0.8353 0.0 0.6017 0.6017 0.0
p13.pddl
0.5284 0.5284 0.0 0.6075 0.6075 0.0
p14.pddl
0.8489 0.8489 0.0 0.8077 0.8077 0.0
p15.pddl
0 0 0.0 0.5823 0.5823 0.0
p16.pddl
0.8646 0.8646 0.0 0.7079 0.7079 0.0
p17.pddl
0.5669 0.5669 0.0 0.2844 0.2844 0.0
p18.pddl
0.4518 0.4518 0.0 0.4699 0.4699 0.0
p19.pddl
0.7721 0.7721 0.0 0.6277 0.6277 0.0
p20.pddl
0.7184 0.7184 0.0 0.3742 0.3742 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tidybot-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.7147 0.7147 0.0 -0.0000 -0.0000 0.0
p02.pddl
0.7073 0.7073 0.0 0.4792 0.4792 0.0
p03.pddl
0.8539 0.8539 0.0 0.7302 0.7302 0.0
p04.pddl
0.9292 0.9292 0.0 0.5806 0.5806 0.0
p05.pddl
0.6109 0.6109 0.0 0.2394 0.2394 0.0
p06.pddl
0.5238 0.5238 0.0 0.2084 0.2084 0.0
p07.pddl
0.7988 0.7988 0.0 0.7214 0.7214 0.0
p08.pddl
0.9350 0.9350 0.0 0.8536 0.8536 0.0
p09.pddl
0.8545 0.8545 0.0 0.5640 0.5640 0.0
p10.pddl
0.7504 0.7504 0.0 0.3513 0.3513 0.0
p11.pddl
0.7500 0.7500 0.0 0.7190 0.7190 0.0
p12.pddl
0.8353 0.8353 0.0 0.6017 0.6017 0.0
p13.pddl
0.5284 0.5284 0.0 0.6075 0.6075 0.0
p14.pddl
0.8489 0.8489 0.0 0.8077 0.8077 0.0
p15.pddl
0 0 0.0 0.5823 0.5823 0.0
p16.pddl
0.8646 0.8646 0.0 0.7079 0.7079 0.0
p17.pddl
0.5669 0.5669 0.0 0.2844 0.2844 0.0
p18.pddl
0.4518 0.4518 0.0 0.4699 0.4699 0.0
p19.pddl
0.7721 0.7721 0.0 0.6277 0.6277 0.0
p20.pddl
0.7184 0.7184 0.0 0.3742 0.3742 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tpp
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.8609 0.8609 0.0
p06.pddl
0.9604 0.9604 0.0 0.5930 0.5930 0.0
p07.pddl
0.8882 0.8882 0.0 0.5222 0.5222 0.0
p08.pddl
0.8457 0.8457 0.0 0.4574 0.4574 0.0
p09.pddl
0.8044 0.8044 0.0 0.4187 0.4187 0.0
p10.pddl
0.7404 0.7404 0.0 0.3488 0.3488 0.0
p11.pddl
0.7258 0.7258 0.0 0.2900 0.2900 0.0
p12.pddl
0.7341 0.7341 0.0 0.2324 0.2324 0.0
p13.pddl
0.7998 0.7998 0.0 0.2786 0.2786 0.0
p14.pddl
0.7431 0.7431 0.0 0.2025 0.2025 0.0
p15.pddl
0.7002 0.7002 0.0 0.2236 0.2236 0.0
p16.pddl
0.6671 0.6671 0.0 0.0294 0.0294 0.0
p17.pddl
0.6473 0.6473 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.7224 0.7224 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.6015 0.6015 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.5824 0.5824 0.0 -0.0000 -0.0000 0.0
p21.pddl
0.6261 0.6261 0.0 -0.0000 -0.0000 0.0
p22.pddl
0.6962 0.6962 0.0 -0.0000 -0.0000 0.0
p23.pddl
0.6269 0.6269 0.0 -0.0000 -0.0000 0.0
p24.pddl
0.5109 0.5109 0.0 -0.0000 -0.0000 0.0
p25.pddl
0.5923 0.5923 0.0 -0.0000 -0.0000 0.0
p26.pddl
0.5982 0.5982 0.0 -0.0000 -0.0000 0.0
p27.pddl
0.5684 0.5684 0.0 -0.0000 -0.0000 0.0
p28.pddl
0.5666 0.5666 0.0 0 0 0.0
p29.pddl
0.4854 0.4854 0.0 0 0 0.0
p30.pddl
0.5134 0.5134 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt08-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 0.8618 0.8618 0.0
p03.pddl
1.0000 1.0000 0.0 0.7680 0.7680 0.0
p04.pddl
0.9503 0.9503 0.0 0.7364 0.7364 0.0
p05.pddl
0.9362 0.9362 0.0 0.6353 0.6353 0.0
p06.pddl
0.8765 0.8765 0.0 0.4157 0.4157 0.0
p07.pddl
0.8315 0.8315 0.0 0.2704 0.2704 0.0
p08.pddl
0.8609 0.8609 0.0 0.2510 0.2510 0.0
p09.pddl
0.7909 0.7909 0.0 0.1785 0.1785 0.0
p10.pddl
0.7897 0.7897 0.0 0.0920 0.0920 0.0
p11.pddl
1.0000 1.0000 0.0 0.9597 0.9597 0.0
p12.pddl
1.0000 1.0000 0.0 0.8116 0.8116 0.0
p13.pddl
1.0000 1.0000 0.0 0.6170 0.6170 0.0
p14.pddl
0.9490 0.9490 0.0 0.5422 0.5422 0.0
p15.pddl
0.7547 0.7547 0.0 0.4990 0.4990 0.0
p16.pddl
0.7968 0.7968 0.0 0.1478 0.1478 0.0
p17.pddl
0.6975 0.6975 0.0 0.0082 0.0082 0.0
p18.pddl
0.6626 0.6626 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.6691 0.6691 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.6276 0.6276 0.0 -0.0000 -0.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 0.8825 0.8825 0.0
p23.pddl
0.9897 0.9897 0.0 0.7571 0.7571 0.0
p24.pddl
1.0000 1.0000 0.0 0.7145 0.7145 0.0
p25.pddl
0.9005 0.9005 0.0 0.5791 0.5791 0.0
p26.pddl
0.9059 0.9059 0.0 0.4017 0.4017 0.0
p27.pddl
0.8822 0.8822 0.0 0.4412 0.4412 0.0
p28.pddl
0.7398 0.7398 0.0 0.1447 0.1447 0.0
p29.pddl
0.8058 0.8058 0.0 0.1716 0.1716 0.0
p30.pddl
0.8026 0.8026 0.0 0.1648 0.1648 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9897 0.9897 0.0 0.7571 0.7571 0.0
p02.pddl
1.0000 1.0000 0.0 0.7680 0.7680 0.0
p03.pddl
1.0000 1.0000 0.0 0.8116 0.8116 0.0
p04.pddl
1.0000 1.0000 0.0 0.6170 0.6170 0.0
p05.pddl
1.0000 1.0000 0.0 0.7145 0.7145 0.0
p06.pddl
0.9503 0.9503 0.0 0.7364 0.7364 0.0
p07.pddl
0.9338 0.9338 0.0 0.6535 0.6535 0.0
p08.pddl
0.9226 0.9226 0.0 0.4267 0.4267 0.0
p09.pddl
0.8579 0.8579 0.0 0.5314 0.5314 0.0
p10.pddl
0.8315 0.8315 0.0 0.3939 0.3939 0.0
p11.pddl
0.7919 0.7919 0.0 0.4791 0.4791 0.0
p12.pddl
0.8206 0.8206 0.0 0.2995 0.2995 0.0
p13.pddl
0.8506 0.8506 0.0 0.5428 0.5428 0.0
p14.pddl
0.8634 0.8634 0.0 0.3818 0.3818 0.0
p15.pddl
0.8442 0.8442 0.0 0.5661 0.5661 0.0
p16.pddl
0.7748 0.7748 0.0 0.3320 0.3320 0.0
p17.pddl
0.9362 0.9362 0.0 0.6353 0.6353 0.0
p18.pddl
0.9490 0.9490 0.0 0.5422 0.5422 0.0
p19.pddl
0.9005 0.9005 0.0 0.5791 0.5791 0.0
p20.pddl
0.8765 0.8765 0.0 0.4157 0.4157 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.8509 0.8509 0.0
p02.pddl
1.0000 1.0000 0.0 0.6717 0.6717 0.0
p03.pddl
1.0000 1.0000 0.0 0.6548 0.6548 0.0
p04.pddl
0.9858 0.9858 0.0 0.4827 0.4827 0.0
p05.pddl
0.9226 0.9226 0.0 0.2742 0.2742 0.0
p06.pddl
0.8684 0.8684 0.0 0.3861 0.3861 0.0
p07.pddl
0.9490 0.9490 0.0 0.5920 0.5920 0.0
p08.pddl
0.9014 0.9014 0.0 0.4753 0.4753 0.0
p09.pddl
0.8971 0.8971 0.0 0.4030 0.4030 0.0
p10.pddl
0.8765 0.8765 0.0 0.1160 0.1160 0.0
p11.pddl
0.7839 0.7839 0.0 0.0143 0.0143 0.0
p12.pddl
0.7624 0.7624 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.9897 0.9897 0.0 0.6278 0.6278 0.0
p14.pddl
0.9560 0.9560 0.0 0.6288 0.6288 0.0
p15.pddl
0.9463 0.9463 0.0 0.4866 0.4866 0.0
p16.pddl
0.9237 0.9237 0.0 0.0984 0.0984 0.0
p17.pddl
0.8012 0.8012 0.0 0.0454 0.0454 0.0
p18.pddl
0.8320 0.8320 0.0 0.0029 0.0029 0.0
p19.pddl
0.7756 0.7756 0.0 0.1200 0.1200 0.0
p20.pddl
0.7756 0.7756 0.0 0.1200 0.1200 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
trucks-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9666 0.9666 0.0 0.8914 0.8914 0.0
p02.pddl
0.9437 0.9437 0.0 0.4674 0.4674 0.0
p03.pddl
0.9200 0.9200 0.0 0.1462 0.1462 0.0
p04.pddl
0.4698 0.4698 0.0 0.7673 0.7673 0.0
p05.pddl
0.8946 0.8946 0.0 0.7470 0.7470 0.0
p06.pddl
0.8329 0.8329 0.0 0.7159 0.7159 0.0
p07.pddl
0.5529 0.5529 0.0 -0.0000 -0.0000 0.0
p08.pddl
0.7533 0.7533 0.0 0 0 0.0
p09.pddl
0.5907 0.5907 0.0 0 0 0.0
p10.pddl
0.0949 0.0949 0.0 0 0 0.0
p11.pddl
0.3358 0.3358 0.0 0 0 0.0
p12.pddl
0.0484 0.0484 0.0 0 0 0.0
p13.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p14.pddl
0.1788 0.1788 0.0 0 0 0.0
p15.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p16.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p17.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0 0 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
visitall-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem02-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem03-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem03-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem04-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem04-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem05-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem05-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem06-full.pddl
0.9226 0.9226 0.0 0.9820 0.9820 0.0
problem06-half.pddl
0.9877 0.9877 0.0 1.0000 1.0000 0.0
problem07-full.pddl
0.9269 0.9269 0.0 0.9332 0.9332 0.0
problem07-half.pddl
0.9326 0.9326 0.0 0.9386 0.9386 0.0
problem08-full.pddl
0.8710 0.8710 0.0 0.9134 0.9134 0.0
problem08-half.pddl
0.8954 0.8954 0.0 0.9326 0.9326 0.0
problem09-full.pddl
0.8495 0.8495 0.0 0.8855 0.8855 0.0
problem09-half.pddl
0.8157 0.8157 0.0 0.8588 0.8588 0.0
problem10-full.pddl
0.8223 0.8223 0.0 0.8615 0.8615 0.0
problem10-half.pddl
0.8324 0.8324 0.0 0.8700 0.8700 0.0
problem11-full.pddl
0.7549 0.7549 0.0 0.8290 0.8290 0.0
problem11-half.pddl
0.8353 0.8353 0.0 0.8279 0.8279 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
visitall-opt14-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-6.pddl
0.9226 0.9226 0.0 0.9820 0.9820 0.0
p-1-7.pddl
0.9269 0.9269 0.0 0.9332 0.9332 0.0
p-1-8.pddl
0.8710 0.8710 0.0 0.9134 0.9134 0.0
p-1-9.pddl
0.8495 0.8495 0.0 0.8855 0.8855 0.0
p-1-10.pddl
0.8223 0.8223 0.0 0.8615 0.8615 0.0
p-1-11.pddl
0.7549 0.7549 0.0 0.8290 0.8290 0.0
p-1-12.pddl
0.7742 0.7742 0.0 0.8189 0.8189 0.0
p-1-13.pddl
0.7073 0.7073 0.0 0.7981 0.7981 0.0
p-1-14.pddl
0.6852 0.6852 0.0 0.7828 0.7828 0.0
p-1-15.pddl
0.6697 0.6697 0.0 0.7592 0.7592 0.0
p-1-16.pddl
0.6449 0.6449 0.0 0.7518 0.7518 0.0
p-1-17.pddl
0.6504 0.6504 0.0 0.7317 0.7317 0.0
p-1-18.pddl
0.6204 0.6204 0.0 0.7201 0.7201 0.0
p-05-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-6.pddl
0.9858 0.9858 0.0 0.9811 0.9811 0.0
p-05-7.pddl
0.9077 0.9077 0.0 0.9574 0.9574 0.0
p-05-8.pddl
0.8852 0.8852 0.0 0.9258 0.9258 0.0
p-05-9.pddl
0.8609 0.8609 0.0 0.8871 0.8871 0.0
p-05-10.pddl
0.8437 0.8437 0.0 0.8844 0.8844 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
woodworking-opt08-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9690 0.9690 0.0
p02.pddl
0.8088 0.8088 0.0 0.9682 0.9682 0.0
p03.pddl
1.0000 1.0000 0.0 0.8618 0.8618 0.0
p04.pddl
1.0000 1.0000 0.0 0 0 0.0
p05.pddl
0.5582 0.5582 0.0 0.7224 0.7224 0.0
p06.pddl
1.0000 1.0000 0.0 0.3239 0.3239 0.0
p07.pddl
1.0000 1.0000 0.0 0.6804 0.6804 0.0
p08.pddl
1.0000 1.0000 0.0 0 0 0.0
p09.pddl
0.4593 0.4593 0.0 0 0 0.0
p10.pddl
0.9858 0.9858 0.0 0.0983 0.0983 0.0
p11.pddl
1.0000 1.0000 0.0 0.9650 0.9650 0.0
p12.pddl
1.0000 1.0000 0.0 0.9077 0.9077 0.0
p13.pddl
1.0000 1.0000 0.0 0.7935 0.7935 0.0
p14.pddl
0.5588 0.5588 0.0 0.8717 0.8717 0.0
p15.pddl
0.5235 0.5235 0.0 0.8108 0.8108 0.0
p16.pddl
0.5474 0.5474 0.0 0 0 0.0
p17.pddl
0.5358 0.5358 0.0 0.3718 0.3718 0.0
p18.pddl
1.0000 1.0000 0.0 0.2688 0.2688 0.0
p19.pddl
1.0000 1.0000 0.0 0.7136 0.7136 0.0
p20.pddl
0.4996 0.4996 0.0 0.1591 0.1591 0.0
p21.pddl
0.9350 0.9350 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 0.9968 0.9968 0.0
p23.pddl
1.0000 1.0000 0.0 0.9560 0.9560 0.0
p24.pddl
0.5461 0.5461 0.0 -0.0000 -0.0000 0.0
p25.pddl
0.5105 0.5105 0.0 0.7993 0.7993 0.0
p26.pddl
1.0000 1.0000 0.0 0 0 0.0
p27.pddl
0.5263 0.5263 0.0 0 0 0.0
p28.pddl
0.4617 0.4617 0.0 0 0 0.0
p29.pddl
1.0000 1.0000 0.0 0.6871 0.6871 0.0
p30.pddl
0.4620 0.4620 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
woodworking-opt11-strips
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9560 0.9560 0.0
p02.pddl
1.0000 1.0000 0.0 0.9077 0.9077 0.0
p03.pddl
1.0000 1.0000 0.0 0.7935 0.7935 0.0
p04.pddl
1.0000 1.0000 0.0 0.8618 0.8618 0.0
p05.pddl
0.5461 0.5461 0.0 -0.0000 -0.0000 0.0
p06.pddl
1.0000 1.0000 0.0 0 0 0.0
p07.pddl
0.5588 0.5588 0.0 0.8717 0.8717 0.0
p08.pddl
0.5105 0.5105 0.0 0.7993 0.7993 0.0
p09.pddl
0.5582 0.5582 0.0 0.7224 0.7224 0.0
p10.pddl
0.5235 0.5235 0.0 0.8108 0.8108 0.0
p11.pddl
1.0000 1.0000 0.0 0 0 0.0
p12.pddl
0.5474 0.5474 0.0 0 0 0.0
p13.pddl
1.0000 1.0000 0.0 0.3239 0.3239 0.0
p14.pddl
0.5263 0.5263 0.0 0 0 0.0
p15.pddl
0.5358 0.5358 0.0 0.3718 0.3718 0.0
p16.pddl
1.0000 1.0000 0.0 0.6804 0.6804 0.0
p17.pddl
0.4617 0.4617 0.0 0 0 0.0
p18.pddl
1.0000 1.0000 0.0 0.2688 0.2688 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 0.6871 0.6871 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
zenotravel
Show table
score_evaluations
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.7978 0.7978 0.0
p04.pddl
1.0000 1.0000 0.0 0.7666 0.7666 0.0
p05.pddl
1.0000 1.0000 0.0 0.7394 0.7394 0.0
p06.pddl
1.0000 1.0000 0.0 0.6493 0.6493 0.0
p07.pddl
0.9978 0.9978 0.0 0.6749 0.6749 0.0
p08.pddl
0.9877 0.9877 0.0 0.5197 0.5197 0.0
p09.pddl
0.9326 0.9326 0.0 0.5133 0.5133 0.0
p10.pddl
0.9154 0.9154 0.0 0.4554 0.4554 0.0
p11.pddl
1.0000 1.0000 0.0 0.4074 0.4074 0.0
p12.pddl
0.9437 0.9437 0.0 0.4360 0.4360 0.0
p13.pddl
0.8867 0.8867 0.0 0.3295 0.3295 0.0
p14.pddl
0.8231 0.8231 0.0 -0.0000 -0.0000 0.0
p15.pddl
0.7107 0.7107 0.0 0.0771 0.0771 0.0
p16.pddl
0.7998 0.7998 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.6976 0.6976 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.6642 0.6642 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.6496 0.6496 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.5667 0.5667 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
score_expansions
Show table
The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9877 0.9877 0.0 0.2240 0.2240 0.0
p02.pddl
0.8231 0.8231 0.0 0.2141 0.2141 0.0
p03.pddl
0.9490 0.9490 0.0 0.2087 0.2087 0.0
p04.pddl
0.9286 0.9286 0.0 0.1943 0.1943 0.0
p05.pddl
0.9604 0.9604 0.0 0.2294 0.2294 0.0
p06.pddl
0.9732 0.9732 0.0 0.1594 0.1594 0.0
p07.pddl
0.7852 0.7852 0.0 0.2088 0.2088 0.0
p08.pddl
0.9463 0.9463 0.0 0.1833 0.1833 0.0
p09.pddl
0.9476 0.9476 0.0 0.1794 0.1794 0.0
p10.pddl
0.7809 0.7809 0.0 0.2374 0.2374 0.0
p11.pddl
0.9194 0.9194 0.0 0.1977 0.1977 0.0
p12.pddl
0.8720 0.8720 0.0 0.1982 0.1982 0.0
p13.pddl
0.9032 0.9032 0.0 0.2318 0.2318 0.0
p14.pddl
0.9303 0.9303 0.0 0.2168 0.2168 0.0
p15.pddl
0.7971 0.7971 0.0 0.1706 0.1706 0.0
p16.pddl
0.9215 0.9215 0.0 0.1909 0.1909 0.0
p17.pddl
0.9005 0.9005 0.0 0.1978 0.1978 0.0
p18.pddl
0.7080 0.7080 0.0 0.1829 0.1829 0.0
p19.pddl
0.9159 0.9159 0.0 0.2223 0.2223 0.0
p20.pddl
0.8700 0.8700 0.0 0.1921 0.1921 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
airport
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-airport1-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-airport1-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-airport2-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-airport2-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-airport2-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-airport2-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-airport2-p3.pddl
0.8697 0.8697 0.0 0.8517 0.8517 0.0
p09-airport2-p4.pddl
0.8409 0.8409 0.0 0.4984 0.4984 0.0
p10-airport3-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-airport3-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-airport3-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-airport3-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14-airport3-p3.pddl
0.6592 0.6592 0.0 1.0000 1.0000 0.0
p15-airport3-p3.pddl
0.8971 0.8971 0.0 0.8859 0.8859 0.0
p16-airport3-p4.pddl
0.4581 0.4581 0.0 0.4652 0.4652 0.0
p17-airport3-p5.pddl
0.6105 0.6105 0.0 0.1459 0.1459 0.0
p18-airport3-p6.pddl
0.4921 0.4921 0.0 -0.0000 -0.0000 0.0
p19-airport3-p6.pddl
0.5796 0.5796 0.0 -0.0000 -0.0000 0.0
p20-airport3-p7.pddl
0.3996 0.3996 0.0 -0.0000 -0.0000 0.0
p21-airport4halfMUC-p2.pddl
0.8707 0.8707 0.0 0.9978 0.9978 0.0
p22-airport4halfMUC-p3.pddl
0.3617 0.3617 0.0 0.9567 0.9567 0.0
p23-airport4halfMUC-p4.pddl
0.3248 0.3248 0.0 0.9430 0.9430 0.0
p24-airport4halfMUC-p4.pddl
0.3786 0.3786 0.0 0.9470 0.9470 0.0
p25-airport4halfMUC-p5.pddl
0.3550 0.3550 0.0 0 0 0.0
p26-airport4halfMUC-p6.pddl
0 0 0.0 0 0 0.0
p27-airport4halfMUC-p6.pddl
0.3809 0.3809 0.0 0 0 0.0
p28-airport4halfMUC-p7.pddl
0 0 0.0 0 0 0.0
p29-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p30-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p31-airport4halfMUC-p9.pddl
0 0 0.0 0 0 0.0
p32-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p33-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p34-airport4halfMUC-p11.pddl
0 0 0.0 0 0 0.0
p35-airport4halfMUC-p12.pddl
0 0 0.0 0 0 0.0
p36-airport5MUC-p2.pddl
0.9820 0.9820 0.0 0.8014 0.8014 0.0
p37-airport5MUC-p3.pddl
0.3845 0.3845 0.0 0.0171 0.0171 0.0
p38-airport5MUC-p3.pddl
0.3498 0.3498 0.0 0.2483 0.2483 0.0
p39-airport5MUC-p4.pddl
0.3556 0.3556 0.0 0 0 0.0
p40-airport5MUC-p4.pddl
0.5716 0.5716 0.0 0.0196 0.0196 0.0
p41-airport5MUC-p4.pddl
0.3672 0.3672 0.0 0 0 0.0
p42-airport5MUC-p5.pddl
0 0 0.0 0 0 0.0
p43-airport5MUC-p5.pddl
0.3480 0.3480 0.0 0.2123 0.2123 0.0
p44-airport5MUC-p5.pddl
0.3313 0.3313 0.0 0 0 0.0
p45-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p46-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p47-airport5MUC-p8.pddl
0 0 0.0 0 0 0.0
p48-airport5MUC-p9.pddl
0 0 0.0 0 0 0.0
p49-airport5MUC-p10.pddl
0 0 0.0 0 0 0.0
p50-airport5MUC-p15.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
barman-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
0.7571 0.7571 0.0 0.4759 0.4759 0.0
pfile01-002.pddl
0.8382 0.8382 0.0 0.5056 0.5056 0.0
pfile01-003.pddl
0.8374 0.8374 0.0 0.5058 0.5058 0.0
pfile01-004.pddl
0.8362 0.8362 0.0 0.5056 0.5056 0.0
pfile02-005.pddl
0.7497 0.7497 0.0 0.3488 0.3488 0.0
pfile02-006.pddl
0.7854 0.7854 0.0 0.0294 0.0294 0.0
pfile02-007.pddl
0.7594 0.7594 0.0 0.3492 0.3492 0.0
pfile02-008.pddl
0.7641 0.7641 0.0 0.3220 0.3220 0.0
pfile03-009.pddl
0.7200 0.7200 0.0 0.2083 0.2083 0.0
pfile03-010.pddl
0.6584 0.6584 0.0 0.2076 0.2076 0.0
pfile03-011.pddl
0.7101 0.7101 0.0 0.1983 0.1983 0.0
pfile03-012.pddl
0.6664 0.6664 0.0 0.1982 0.1982 0.0
pfile04-013.pddl
0.6472 0.6472 0.0 0.0662 0.0662 0.0
pfile04-014.pddl
0.6451 0.6451 0.0 -0.0000 -0.0000 0.0
pfile04-015.pddl
0.6067 0.6067 0.0 0.0520 0.0520 0.0
pfile04-016.pddl
0.6050 0.6050 0.0 0.0662 0.0662 0.0
pfile05-017.pddl
0.6294 0.6294 0.0 0.0090 0.0090 0.0
pfile05-018.pddl
0.6287 0.6287 0.0 -0.0000 -0.0000 0.0
pfile05-019.pddl
0.6243 0.6243 0.0 -0.0000 -0.0000 0.0
pfile05-020.pddl
0.6440 0.6440 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
barman-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
0.7515 0.7515 0.0 0.0294 0.0294 0.0
p435-2.pddl
0.7042 0.7042 0.0 0.3474 0.3474 0.0
p435-3.pddl
0.7524 0.7524 0.0 0.0293 0.0293 0.0
p536-1.pddl
0.7146 0.7146 0.0 -0.0000 -0.0000 0.0
p536-2.pddl
0.6567 0.6567 0.0 0.2075 0.2075 0.0
p536-3.pddl
0.7201 0.7201 0.0 0.2083 0.2083 0.0
p638-1.pddl
0.6699 0.6699 0.0 0.0662 0.0662 0.0
p638-2.pddl
0.7023 0.7023 0.0 -0.0000 -0.0000 0.0
p638-3.pddl
0.6380 0.6380 0.0 0.0520 0.0520 0.0
p739-1.pddl
0.6456 0.6456 0.0 -0.0000 -0.0000 0.0
p739-2.pddl
0.5809 0.5809 0.0 -0.0000 -0.0000 0.0
p739-3.pddl
0.6198 0.6198 0.0 -0.0000 -0.0000 0.0
p839-1.pddl
0.5859 0.5859 0.0 -0.0000 -0.0000 0.0
p839-2.pddl
0.5963 0.5963 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
blocks
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-2.pddl
1.0000 1.0000 0.0 0.9715 0.9715 0.0
probBLOCKS-6-0.pddl
1.0000 1.0000 0.0 0.9483 0.9483 0.0
probBLOCKS-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-7-0.pddl
1.0000 1.0000 0.0 0.7976 0.7976 0.0
probBLOCKS-7-1.pddl
1.0000 1.0000 0.0 0.7916 0.7916 0.0
probBLOCKS-7-2.pddl
1.0000 1.0000 0.0 0.8545 0.8545 0.0
probBLOCKS-8-0.pddl
1.0000 1.0000 0.0 0.8914 0.8914 0.0
probBLOCKS-8-1.pddl
1.0000 1.0000 0.0 0.7413 0.7413 0.0
probBLOCKS-8-2.pddl
1.0000 1.0000 0.0 0.9740 0.9740 0.0
probBLOCKS-9-0.pddl
0.9320 0.9320 0.0 0.6994 0.6994 0.0
probBLOCKS-9-1.pddl
0.9169 0.9169 0.0 0.6943 0.6943 0.0
probBLOCKS-9-2.pddl
1.0000 1.0000 0.0 0.7206 0.7206 0.0
probBLOCKS-10-0.pddl
0.9411 0.9411 0.0 0.9205 0.9205 0.0
probBLOCKS-10-1.pddl
0.9386 0.9386 0.0 0.5833 0.5833 0.0
probBLOCKS-10-2.pddl
0.9179 0.9179 0.0 0.6410 0.6410 0.0
probBLOCKS-11-0.pddl
1.0000 1.0000 0.0 0.6611 0.6611 0.0
probBLOCKS-11-1.pddl
0.9226 0.9226 0.0 0.5483 0.5483 0.0
probBLOCKS-11-2.pddl
0.9682 0.9682 0.0 0.7321 0.7321 0.0
probBLOCKS-12-0.pddl
0.9100 0.9100 0.0 0.6354 0.6354 0.0
probBLOCKS-12-1.pddl
0.9082 0.9082 0.0 0.5470 0.5470 0.0
probBLOCKS-13-0.pddl
0.8003 0.8003 0.0 0.6102 0.6102 0.0
probBLOCKS-13-1.pddl
0.8270 0.8270 0.0 0.6036 0.6036 0.0
probBLOCKS-14-0.pddl
0.9264 0.9264 0.0 0.6592 0.6592 0.0
probBLOCKS-14-1.pddl
0.8829 0.8829 0.0 0.5759 0.5759 0.0
probBLOCKS-15-0.pddl
0.7383 0.7383 0.0 0.5064 0.5064 0.0
probBLOCKS-15-1.pddl
0.8631 0.8631 0.0 0.2780 0.2780 0.0
probBLOCKS-16-1.pddl
0.8308 0.8308 0.0 0.4654 0.4654 0.0
probBLOCKS-16-2.pddl
0.6331 0.6331 0.0 0.4732 0.4732 0.0
probBLOCKS-17-0.pddl
0.6221 0.6221 0.0 0.0702 0.0702 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
childsnack-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
0.9524 0.9524 0.0 0.2091 0.2091 0.0
child-snack_pfile01.pddl
0.9916 0.9916 0.0 0.1960 0.1960 0.0
child-snack_pfile02-2.pddl
0.9392 0.9392 0.0 0.0793 0.0793 0.0
child-snack_pfile02.pddl
0.9666 0.9666 0.0 0.0479 0.0479 0.0
child-snack_pfile03-2.pddl
0.8434 0.8434 0.0 -0.0000 -0.0000 0.0
child-snack_pfile03.pddl
0.8724 0.8724 0.0 -0.0000 -0.0000 0.0
child-snack_pfile04-2.pddl
0.8837 0.8837 0.0 0 0 0.0
child-snack_pfile04.pddl
0.8631 0.8631 0.0 0 0 0.0
child-snack_pfile05-2.pddl
0.8455 0.8455 0.0 0 0 0.0
child-snack_pfile05.pddl
0.8531 0.8531 0.0 0 0 0.0
child-snack_pfile06-2.pddl
0.8579 0.8579 0.0 0 0 0.0
child-snack_pfile06.pddl
0.8447 0.8447 0.0 0 0 0.0
child-snack_pfile07-2.pddl
0.8362 0.8362 0.0 0 0 0.0
child-snack_pfile07.pddl
0.8046 0.8046 0.0 0 0 0.0
child-snack_pfile08-2.pddl
0.8155 0.8155 0.0 0 0 0.0
child-snack_pfile08.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
data-network-opt18-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.8863 0.8863 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.8334 0.8334 0.0
p06.pddl
1.0000 1.0000 0.0 0.8411 0.8411 0.0
p07.pddl
0.9574 0.9574 0.0 -0.0000 -0.0000 0.0
p08.pddl
0.5911 0.5911 0.0 0.7333 0.7333 0.0
p09.pddl
1.0000 1.0000 0.0 0.8634 0.8634 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 0.8503 0.8503 0.0
p12.pddl
1.0000 1.0000 0.0 0.8565 0.8565 0.0
p13.pddl
1.0000 1.0000 0.0 0.9848 0.9848 0.0
p14.pddl
0.7126 0.7126 0.0 0.8946 0.8946 0.0
p15.pddl
1.0000 1.0000 0.0 0.7749 0.7749 0.0
p16.pddl
0.9356 0.9356 0.0 0.5722 0.5722 0.0
p17.pddl
1.0000 1.0000 0.0 0.7340 0.7340 0.0
p18.pddl
0.5595 0.5595 0.0 0.1139 0.1139 0.0
p19.pddl
1.0000 1.0000 0.0 0.4615 0.4615 0.0
p20.pddl
0.7039 0.7039 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
depot
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
0.6129 0.6129 0.0 0.5474 0.5474 0.0
p04.pddl
0.6870 0.6870 0.0 0.9315 0.9315 0.0
p05.pddl
0.2890 0.2890 0.0 0.8837 0.8837 0.0
p06.pddl
-0.0000 -0.0000 0.0 0.8399 0.8399 0.0
p07.pddl
0.8187 0.8187 0.0 0.2446 0.2446 0.0
p08.pddl
0.5453 0.5453 0.0 0.6774 0.6774 0.0
p09.pddl
0.3839 0.3839 0.0 0.1031 0.1031 0.0
p10.pddl
0.5238 0.5238 0.0 0.7177 0.7177 0.0
p11.pddl
0.4500 0.4500 0.0 0.7256 0.7256 0.0
p12.pddl
0.3845 0.3845 0.0 0 0 0.0
p13.pddl
1.0000 1.0000 0.0 0.9658 0.9658 0.0
p14.pddl
0.8206 0.8206 0.0 -0.0000 -0.0000 0.0
p15.pddl
0.1406 0.1406 0.0 -0.0000 -0.0000 0.0
p16.pddl
0.9658 0.9658 0.0 0.0265 0.0265 0.0
p17.pddl
1.0000 1.0000 0.0 0.5426 0.5426 0.0
p18.pddl
0.7985 0.7985 0.0 0 0 0.0
p19.pddl
0.4700 0.4700 0.0 -0.0000 -0.0000 0.0
p20.pddl
0 0 0.0 0.4008 0.4008 0.0
p21.pddl
0.9269 0.9269 0.0 0.0025 0.0025 0.0
p22.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
driverlog
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.5812 0.5812 0.0 0.8906 0.8906 0.0
p03.pddl
1.0000 1.0000 0.0 0.9443 0.9443 0.0
p04.pddl
0.5908 0.5908 0.0 0.8246 0.8246 0.0
p05.pddl
0.5821 0.5821 0.0 0.6084 0.6084 0.0
p06.pddl
0.8124 0.8124 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 0.9707 0.9707 0.0
p08.pddl
0.5577 0.5577 0.0 0.8606 0.8606 0.0
p09.pddl
0.8055 0.8055 0.0 0.8618 0.8618 0.0
p10.pddl
1.0000 1.0000 0.0 0.8177 0.8177 0.0
p11.pddl
0.9740 0.9740 0.0 0.8634 0.8634 0.0
p12.pddl
0.5418 0.5418 0.0 0.7954 0.7954 0.0
p13.pddl
0.6181 0.6181 0.0 0.8012 0.8012 0.0
p14.pddl
0.9362 0.9362 0.0 0.6818 0.6818 0.0
p15.pddl
0.9014 0.9014 0.0 0.5027 0.5027 0.0
p16.pddl
0.3545 0.3545 0.0 0.3071 0.3071 0.0
p17.pddl
0.7076 0.7076 0.0 0 0 0.0
p18.pddl
0.3461 0.3461 0.0 0.1748 0.1748 0.0
p19.pddl
0.3369 0.3369 0.0 0.0497 0.0497 0.0
p20.pddl
0.4267 0.4267 0.0 0.2686 0.2686 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
elevators-opt08-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.8040 0.8040 0.0
p02.pddl
1.0000 1.0000 0.0 0.9210 0.9210 0.0
p03.pddl
1.0000 1.0000 0.0 0.8894 0.8894 0.0
p04.pddl
1.0000 1.0000 0.0 0.6227 0.6227 0.0
p05.pddl
1.0000 1.0000 0.0 0.7373 0.7373 0.0
p06.pddl
0.9766 0.9766 0.0 0.6444 0.6444 0.0
p07.pddl
0.9749 0.9749 0.0 0.7607 0.7607 0.0
p08.pddl
1.0000 1.0000 0.0 0.7007 0.7007 0.0
p09.pddl
0.9144 0.9144 0.0 0.6062 0.6062 0.0
p10.pddl
0.9490 0.9490 0.0 0.6682 0.6682 0.0
p11.pddl
1.0000 1.0000 0.0 0.7705 0.7705 0.0
p12.pddl
1.0000 1.0000 0.0 0.7595 0.7595 0.0
p13.pddl
1.0000 1.0000 0.0 0.8539 0.8539 0.0
p14.pddl
1.0000 1.0000 0.0 0.7115 0.7115 0.0
p15.pddl
1.0000 1.0000 0.0 0.8163 0.8163 0.0
p16.pddl
0.9374 0.9374 0.0 0.5696 0.5696 0.0
p17.pddl
0.9303 0.9303 0.0 0.8021 0.8021 0.0
p18.pddl
0.9937 0.9937 0.0 0.6571 0.6571 0.0
p19.pddl
0.9275 0.9275 0.0 0.6886 0.6886 0.0
p20.pddl
0.9758 0.9758 0.0 0.7200 0.7200 0.0
p21.pddl
1.0000 1.0000 0.0 0.5900 0.5900 0.0
p22.pddl
1.0000 1.0000 0.0 0.5284 0.5284 0.0
p23.pddl
1.0000 1.0000 0.0 0.5465 0.5465 0.0
p24.pddl
0.9839 0.9839 0.0 0.4329 0.4329 0.0
p25.pddl
1.0000 1.0000 0.0 0.6179 0.6179 0.0
p26.pddl
1.0000 1.0000 0.0 0.8193 0.8193 0.0
p27.pddl
0.9174 0.9174 0.0 0.6159 0.6159 0.0
p28.pddl
0.9858 0.9858 0.0 0.6022 0.6022 0.0
p29.pddl
0.9210 0.9210 0.0 0.5775 0.5775 0.0
p30.pddl
0.9091 0.9091 0.0 0.3871 0.3871 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
elevators-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.7705 0.7705 0.0
p02.pddl
1.0000 1.0000 0.0 0.5900 0.5900 0.0
p03.pddl
1.0000 1.0000 0.0 0.7595 0.7595 0.0
p04.pddl
1.0000 1.0000 0.0 0.8894 0.8894 0.0
p05.pddl
1.0000 1.0000 0.0 0.8539 0.8539 0.0
p06.pddl
1.0000 1.0000 0.0 0.6227 0.6227 0.0
p07.pddl
1.0000 1.0000 0.0 0.8193 0.8193 0.0
p08.pddl
1.0000 1.0000 0.0 0.7373 0.7373 0.0
p09.pddl
1.0000 1.0000 0.0 0.5284 0.5284 0.0
p10.pddl
1.0000 1.0000 0.0 0.7115 0.7115 0.0
p11.pddl
0.9858 0.9858 0.0 0.6022 0.6022 0.0
p12.pddl
0.9766 0.9766 0.0 0.6444 0.6444 0.0
p13.pddl
0.9749 0.9749 0.0 0.7607 0.7607 0.0
p14.pddl
1.0000 1.0000 0.0 0.7007 0.7007 0.0
p15.pddl
0.9144 0.9144 0.0 0.6062 0.6062 0.0
p16.pddl
1.0000 1.0000 0.0 0.8163 0.8163 0.0
p17.pddl
0.9303 0.9303 0.0 0.8021 0.8021 0.0
p18.pddl
0.9937 0.9937 0.0 0.6571 0.6571 0.0
p19.pddl
1.0000 1.0000 0.0 0.5465 0.5465 0.0
p20.pddl
0.9839 0.9839 0.0 0.4329 0.4329 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
floortile-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
0.6975 0.6975 0.0 0.0402 0.0402 0.0
opt-p01-002.pddl
1.0000 1.0000 0.0 0.0937 0.0937 0.0
opt-p02-003.pddl
0.0602 0.0602 0.0 0 0 0.0
opt-p02-004.pddl
0.1253 0.1253 0.0 0 0 0.0
opt-p03-005.pddl
0.0894 0.0894 0.0 0 0 0.0
opt-p03-006.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p04-007.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p04-008.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p05-009.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p05-010.pddl
0 0 0.0 0 0 0.0
opt-p06-011.pddl
0 0 0.0 0 0 0.0
opt-p06-012.pddl
0 0 0.0 0 0 0.0
opt-p07-013.pddl
0 0 0.0 0 0 0.0
opt-p07-014.pddl
0 0 0.0 0 0 0.0
opt-p08-015.pddl
0 0 0.0 0 0 0.0
opt-p08-016.pddl
0 0 0.0 0 0 0.0
opt-p09-017.pddl
0 0 0.0 0 0 0.0
opt-p09-018.pddl
0 0 0.0 0 0 0.0
opt-p10-019.pddl
0 0 0.0 0 0 0.0
opt-p10-020.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
floortile-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
0.0994 0.0994 0.0 0 0 0.0
p01-4-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p01-5-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p01-5-4-2.pddl
0 0 0.0 0 0 0.0
p01-5-5-2.pddl
0 0 0.0 0 0 0.0
p01-6-4-2.pddl
0 0 0.0 0 0 0.0
p01-6-5-2.pddl
0 0 0.0 0 0 0.0
p02-4-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p02-5-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p02-5-4-2.pddl
0 0 0.0 0 0 0.0
p02-5-5-2.pddl
0 0 0.0 0 0 0.0
p02-6-4-2.pddl
0 0 0.0 0 0 0.0
p02-6-5-2.pddl
0 0 0.0 0 0 0.0
p03-4-3-2.pddl
0.0809 0.0809 0.0 0 0 0.0
p03-4-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-5-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-5-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-5-5-2.pddl
0 0 0.0 0 0 0.0
p03-6-4-2.pddl
0 0 0.0 0 0 0.0
p03-6-5-2.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
freecell
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
0.7442 0.7442 0.0 0.6633 0.6633 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
0.8229 0.8229 0.0 1.0000 1.0000 0.0
p11.pddl
0.6348 0.6348 0.0 0.6357 0.6357 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
0.6248 0.6248 0.0 0.9392 0.9392 0.0
p14.pddl
0.9589 0.9589 0.0 0.8684 0.8684 0.0
p15.pddl
0.8775 0.8775 0.0 1.0000 1.0000 0.0
p16.pddl
0.8882 0.8882 0.0 0.8615 0.8615 0.0
p17.pddl
0.9184 0.9184 0.0 0.9989 0.9989 0.0
p18.pddl
0.7410 0.7410 0.0 0.3649 0.3649 0.0
p19.pddl
0.4671 0.4671 0.0 0.3830 0.3830 0.0
p20.pddl
0.8137 0.8137 0.0 0.4498 0.4498 0.0
probfreecell-2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-1.pddl
0.9524 0.9524 0.0 1.0000 1.0000 0.0
probfreecell-8-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-5.pddl
0.9604 0.9604 0.0 1.0000 1.0000 0.0
probfreecell-9-1.pddl
0.9470 0.9470 0.0 1.0000 1.0000 0.0
probfreecell-9-2.pddl
0.9867 0.9867 0.0 1.0000 1.0000 0.0
probfreecell-9-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-9-4.pddl
0.9604 0.9604 0.0 1.0000 1.0000 0.0
probfreecell-9-5.pddl
0.9443 0.9443 0.0 0.9802 0.9802 0.0
probfreecell-10-1.pddl
0.6878 0.6878 0.0 0.6823 0.6823 0.0
probfreecell-10-2.pddl
0.9589 0.9589 0.0 0.9059 0.9059 0.0
probfreecell-10-3.pddl
0.9292 0.9292 0.0 0.5773 0.5773 0.0
probfreecell-10-4.pddl
0.9105 0.9105 0.0 0.5924 0.5924 0.0
probfreecell-10-5.pddl
0.8093 0.8093 0.0 0.9430 0.9430 0.0
probfreecell-11-1.pddl
0.8926 0.8926 0.0 0.4475 0.4475 0.0
probfreecell-11-2.pddl
0.8559 0.8559 0.0 0.4279 0.4279 0.0
probfreecell-11-3.pddl
0.8926 0.8926 0.0 0.6181 0.6181 0.0
probfreecell-11-4.pddl
0.8863 0.8863 0.0 0.9286 0.9286 0.0
probfreecell-11-5.pddl
0 0 0.0 0.8585 0.8585 0.0
probfreecell-12-1.pddl
0.4443 0.4443 0.0 0.3985 0.3985 0.0
probfreecell-12-2.pddl
0.7849 0.7849 0.0 0.6227 0.6227 0.0
probfreecell-12-3.pddl
0.9374 0.9374 0.0 0.6861 0.6861 0.0
probfreecell-12-4.pddl
0.8317 0.8317 0.0 0.5182 0.5182 0.0
probfreecell-12-5.pddl
0.0479 0.0479 0.0 0.4909 0.4909 0.0
probfreecell-13-1.pddl
0.3774 0.3774 0.0 0.4138 0.4138 0.0
probfreecell-13-2.pddl
0.4453 0.4453 0.0 0.4380 0.4380 0.0
probfreecell-13-3.pddl
0.8382 0.8382 0.0 0.6576 0.6576 0.0
probfreecell-13-4.pddl
0.5879 0.5879 0.0 0.6909 0.6909 0.0
probfreecell-13-5.pddl
0.0678 0.0678 0.0 0.0902 0.0902 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
ged-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-7-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-7-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-9.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
grid
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 0.7445 0.7445 0.0
prob03.pddl
0.9115 0.9115 0.0 0 0 0.0
prob04.pddl
0.9758 0.9758 0.0 0.7544 0.7544 0.0
prob05.pddl
0.8073 0.8073 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
gripper
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
1.0000 1.0000 0.0 0.9784 0.9784 0.0
prob05.pddl
1.0000 1.0000 0.0 0.9424 0.9424 0.0
prob06.pddl
1.0000 1.0000 0.0 0.9115 0.9115 0.0
prob07.pddl
1.0000 1.0000 0.0 0.8844 0.8844 0.0
prob08.pddl
1.0000 1.0000 0.0 0.8603 0.8603 0.0
prob09.pddl
1.0000 1.0000 0.0 0.8386 0.8386 0.0
prob10.pddl
1.0000 1.0000 0.0 0.8189 0.8189 0.0
prob11.pddl
0.9937 0.9937 0.0 0.8009 0.8009 0.0
prob12.pddl
0.9848 0.9848 0.0 0.7842 0.7842 0.0
prob13.pddl
0.9766 0.9766 0.0 0.7687 0.7687 0.0
prob14.pddl
0.9690 0.9690 0.0 0.7542 0.7542 0.0
prob15.pddl
0.9619 0.9619 0.0 0.7406 0.7406 0.0
prob16.pddl
0.9553 0.9553 0.0 0.7279 0.7279 0.0
prob17.pddl
0.9490 0.9490 0.0 0.7158 0.7158 0.0
prob18.pddl
0.9430 0.9430 0.0 0.7044 0.7044 0.0
prob19.pddl
0.9374 0.9374 0.0 0.6935 0.6935 0.0
prob20.pddl
0.9320 0.9320 0.0 0.6832 0.6832 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
hiking-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
0.9658 0.9658 0.0 0.8534 0.8534 0.0
ptesting-1-2-4.pddl
0.7691 0.7691 0.0 0.7010 0.7010 0.0
ptesting-1-2-5.pddl
0.6371 0.6371 0.0 0.5911 0.5911 0.0
ptesting-1-2-7.pddl
0.4865 0.4865 0.0 0.4047 0.4047 0.0
ptesting-1-2-8.pddl
0.4281 0.4281 0.0 0.3348 0.3348 0.0
ptesting-2-2-3.pddl
1.0000 1.0000 0.0 0.6290 0.6290 0.0
ptesting-2-2-4.pddl
0.6374 0.6374 0.0 0.3831 0.3831 0.0
ptesting-2-2-5.pddl
0.5411 0.5411 0.0 0.2987 0.2987 0.0
ptesting-2-2-6.pddl
0.4860 0.4860 0.0 0.2622 0.2622 0.0
ptesting-2-2-7.pddl
0.4049 0.4049 0.0 0.1851 0.1851 0.0
ptesting-2-2-8.pddl
0.3977 0.3977 0.0 0.1642 0.1642 0.0
ptesting-2-3-4.pddl
0.6012 0.6012 0.0 0.3832 0.3832 0.0
ptesting-2-3-5.pddl
0.5299 0.5299 0.0 0.2703 0.2703 0.0
ptesting-2-3-6.pddl
0.4657 0.4657 0.0 0.1869 0.1869 0.0
ptesting-2-3-7.pddl
0.3964 0.3964 0.0 0.1712 0.1712 0.0
ptesting-2-4-3.pddl
1.0000 1.0000 0.0 0.5441 0.5441 0.0
ptesting-2-4-4.pddl
0.5961 0.5961 0.0 0.3424 0.3424 0.0
ptesting-2-4-5.pddl
0.4871 0.4871 0.0 0.2448 0.2448 0.0
ptesting-2-4-6.pddl
0.4712 0.4712 0.0 0.1579 0.1579 0.0
ptesting-2-4-7.pddl
0.4064 0.4064 0.0 0.0927 0.0927 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
logistics00
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-9.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-7-0.pddl
0.9989 0.9989 0.0 1.0000 1.0000 0.0
probLOGISTICS-7-1.pddl
0.9399 0.9399 0.0 1.0000 1.0000 0.0
probLOGISTICS-8-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-8-1.pddl
0.9724 0.9724 0.0 1.0000 1.0000 0.0
probLOGISTICS-9-0.pddl
0.9978 0.9978 0.0 1.0000 1.0000 0.0
probLOGISTICS-9-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-10-0.pddl
0.9326 0.9326 0.0 0.9867 0.9867 0.0
probLOGISTICS-10-1.pddl
0.9732 0.9732 0.0 0.9937 0.9937 0.0
probLOGISTICS-11-0.pddl
0.9476 0.9476 0.0 0.9650 0.9650 0.0
probLOGISTICS-11-1.pddl
0.8837 0.8837 0.0 0.9604 0.9604 0.0
probLOGISTICS-12-0.pddl
0.9560 0.9560 0.0 0.9887 0.9887 0.0
probLOGISTICS-12-1.pddl
0.8747 0.8747 0.0 0.9374 0.9374 0.0
probLOGISTICS-13-0.pddl
0.8167 0.8167 0.0 0.6680 0.6680 0.0
probLOGISTICS-13-1.pddl
0.8386 0.8386 0.0 0.6751 0.6751 0.0
probLOGISTICS-14-0.pddl
0.8804 0.8804 0.0 0.6616 0.6616 0.0
probLOGISTICS-14-1.pddl
0.8444 0.8444 0.0 0.6317 0.6317 0.0
probLOGISTICS-15-0.pddl
0.8009 0.8009 0.0 0.6318 0.6318 0.0
probLOGISTICS-15-1.pddl
0.8588 0.8588 0.0 0.5948 0.5948 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
logistics98
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 0.6611 0.6611 0.0
prob02.pddl
0.9560 0.9560 0.0 0.4265 0.4265 0.0
prob03.pddl
0.9237 0.9237 0.0 0.1191 0.1191 0.0
prob04.pddl
0.8320 0.8320 0.0 0 0 0.0
prob05.pddl
1.0000 1.0000 0.0 0.8229 0.8229 0.0
prob06.pddl
0.7545 0.7545 0.0 0 0 0.0
prob07.pddl
0.9303 0.9303 0.0 0.2931 0.2931 0.0
prob08.pddl
0.9303 0.9303 0.0 0 0 0.0
prob09.pddl
0.7235 0.7235 0.0 0 0 0.0
prob10.pddl
0.6930 0.6930 0.0 -0.0000 -0.0000 0.0
prob11.pddl
1.0000 1.0000 0.0 0.3472 0.3472 0.0
prob12.pddl
0.9184 0.9184 0.0 0 0 0.0
prob13.pddl
0.8017 0.8017 0.0 0 0 0.0
prob14.pddl
0.7096 0.7096 0.0 0 0 0.0
prob15.pddl
0.7390 0.7390 0.0 0.2853 0.2853 0.0
prob16.pddl
0.8779 0.8779 0.0 0 0 0.0
prob17.pddl
0.9470 0.9470 0.0 0 0 0.0
prob18.pddl
0.5702 0.5702 0.0 0 0 0.0
prob19.pddl
0.6321 0.6321 0.0 0 0 0.0
prob20.pddl
0.5734 0.5734 0.0 0 0 0.0
prob21.pddl
0.7008 0.7008 0.0 0 0 0.0
prob22.pddl
0.3542 0.3542 0.0 0 0 0.0
prob23.pddl
0.6919 0.6919 0.0 0.0391 0.0391 0.0
prob24.pddl
0.9023 0.9023 0.0 0 0 0.0
prob25.pddl
0.5350 0.5350 0.0 0 0 0.0
prob26.pddl
0.5018 0.5018 0.0 0 0 0.0
prob27.pddl
0.5552 0.5552 0.0 0 0 0.0
prob28.pddl
0.3310 0.3310 0.0 0 0 0.0
prob29.pddl
0.4497 0.4497 0.0 0 0 0.0
prob30.pddl
0.5897 0.5897 0.0 0 0 0.0
prob31.pddl
1.0000 1.0000 0.0 0.8574 0.8574 0.0
prob32.pddl
1.0000 1.0000 0.0 0.9405 0.9405 0.0
prob33.pddl
1.0000 1.0000 0.0 0.8634 0.8634 0.0
prob34.pddl
0.8489 0.8489 0.0 0.3752 0.3752 0.0
prob35.pddl
1.0000 1.0000 0.0 0.6544 0.6544 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
miconic
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-2.pddl
0.9897 0.9897 0.0 1.0000 1.0000 0.0
s8-3.pddl
0.9927 0.9927 0.0 1.0000 1.0000 0.0
s8-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-0.pddl
0.9749 0.9749 0.0 1.0000 1.0000 0.0
s9-1.pddl
0.9715 0.9715 0.0 1.0000 1.0000 0.0
s9-2.pddl
0.9775 0.9775 0.0 1.0000 1.0000 0.0
s9-3.pddl
0.9916 0.9916 0.0 1.0000 1.0000 0.0
s9-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-0.pddl
0.9612 0.9612 0.0 1.0000 1.0000 0.0
s10-1.pddl
0.9758 0.9758 0.0 1.0000 1.0000 0.0
s10-2.pddl
0.9612 0.9612 0.0 1.0000 1.0000 0.0
s10-3.pddl
0.9968 0.9968 0.0 1.0000 1.0000 0.0
s10-4.pddl
0.9732 0.9732 0.0 1.0000 1.0000 0.0
s11-0.pddl
0.9399 0.9399 0.0 0.9989 0.9989 0.0
s11-1.pddl
0.9707 0.9707 0.0 1.0000 1.0000 0.0
s11-2.pddl
0.9226 0.9226 0.0 1.0000 1.0000 0.0
s11-3.pddl
0.9437 0.9437 0.0 0.9968 0.9968 0.0
s11-4.pddl
0.9503 0.9503 0.0 1.0000 1.0000 0.0
s12-0.pddl
0.9887 0.9887 0.0 1.0000 1.0000 0.0
s12-1.pddl
0.9247 0.9247 0.0 0.9674 0.9674 0.0
s12-2.pddl
0.9258 0.9258 0.0 0.9848 0.9848 0.0
s12-3.pddl
0.9362 0.9362 0.0 0.9927 0.9927 0.0
s12-4.pddl
0.9091 0.9091 0.0 1.0000 1.0000 0.0
s13-0.pddl
0.8971 0.8971 0.0 0.9989 0.9989 0.0
s13-1.pddl
0.9189 0.9189 0.0 0.9658 0.9658 0.0
s13-2.pddl
0.8988 0.8988 0.0 0.9582 0.9582 0.0
s13-3.pddl
0.9303 0.9303 0.0 0.9766 0.9766 0.0
s13-4.pddl
0.9326 0.9326 0.0 0.9450 0.9450 0.0
s14-0.pddl
0.9292 0.9292 0.0 0.9724 0.9724 0.0
s14-1.pddl
0.8950 0.8950 0.0 0.9666 0.9666 0.0
s14-2.pddl
0.8950 0.8950 0.0 0.9650 0.9650 0.0
s14-3.pddl
0.9200 0.9200 0.0 0.9320 0.9320 0.0
s14-4.pddl
0.9045 0.9045 0.0 0.9517 0.9517 0.0
s15-0.pddl
0.9059 0.9059 0.0 0.9503 0.9503 0.0
s15-1.pddl
0.8542 0.8542 0.0 0.9858 0.9858 0.0
s15-2.pddl
0.8710 0.8710 0.0 0.9666 0.9666 0.0
s15-3.pddl
0.8811 0.8811 0.0 0.9483 0.9483 0.0
s15-4.pddl
0.8825 0.8825 0.0 0.9524 0.9524 0.0
s16-0.pddl
0.8741 0.8741 0.0 0.9303 0.9303 0.0
s16-1.pddl
0.8779 0.8779 0.0 0.9269 0.9269 0.0
s16-2.pddl
0.8476 0.8476 0.0 0.9292 0.9292 0.0
s16-3.pddl
0.8675 0.8675 0.0 0.9538 0.9538 0.0
s16-4.pddl
0.8662 0.8662 0.0 0.9362 0.9362 0.0
s17-0.pddl
0.8498 0.8498 0.0 0.9315 0.9315 0.0
s17-1.pddl
0.8730 0.8730 0.0 0.9332 0.9332 0.0
s17-2.pddl
0.8522 0.8522 0.0 0.8988 0.8988 0.0
s17-3.pddl
0.8404 0.8404 0.0 0.9524 0.9524 0.0
s17-4.pddl
0.8737 0.8737 0.0 0.9210 0.9210 0.0
s18-0.pddl
0.8514 0.8514 0.0 0.9096 0.9096 0.0
s18-1.pddl
0.8594 0.8594 0.0 0.9456 0.9456 0.0
s18-2.pddl
0.8460 0.8460 0.0 0.9258 0.9258 0.0
s18-3.pddl
0.8331 0.8331 0.0 0.9100 0.9100 0.0
s18-4.pddl
0.8476 0.8476 0.0 0.9503 0.9503 0.0
s19-0.pddl
0.8246 0.8246 0.0 0.8741 0.8741 0.0
s19-1.pddl
0.8355 0.8355 0.0 0.8882 0.8882 0.0
s19-2.pddl
0.8250 0.8250 0.0 0.9242 0.9242 0.0
s19-3.pddl
0.8177 0.8177 0.0 0.9405 0.9405 0.0
s19-4.pddl
0.8286 0.8286 0.0 0.9275 0.9275 0.0
s20-0.pddl
0.8279 0.8279 0.0 0.9086 0.9086 0.0
s20-1.pddl
0.8200 0.8200 0.0 0.8890 0.8890 0.0
s20-2.pddl
0.8292 0.8292 0.0 0.9120 0.9120 0.0
s20-3.pddl
0.8343 0.8343 0.0 0.8793 0.8793 0.0
s20-4.pddl
0.8311 0.8311 0.0 0.8833 0.8833 0.0
s21-0.pddl
0.8033 0.8033 0.0 0.9005 0.9005 0.0
s21-1.pddl
0.8105 0.8105 0.0 0.8579 0.8579 0.0
s21-2.pddl
0.8450 0.8450 0.0 0.8618 0.8618 0.0
s21-3.pddl
0.8263 0.8263 0.0 0.8863 0.8863 0.0
s21-4.pddl
0.8419 0.8419 0.0 0.8717 0.8717 0.0
s22-0.pddl
0.7903 0.7903 0.0 0.9068 0.9068 0.0
s22-1.pddl
0.7971 0.7971 0.0 0.8775 0.8775 0.0
s22-2.pddl
0.7995 0.7995 0.0 0.8668 0.8668 0.0
s22-3.pddl
0.7981 0.7981 0.0 0.8874 0.8874 0.0
s22-4.pddl
0.8078 0.8078 0.0 0.8681 0.8681 0.0
s23-0.pddl
0.7830 0.7830 0.0 0.8704 0.8704 0.0
s23-1.pddl
0.7998 0.7998 0.0 0.8902 0.8902 0.0
s23-2.pddl
0.8093 0.8093 0.0 0.8520 0.8520 0.0
s23-3.pddl
0.8082 0.8082 0.0 0.8681 0.8681 0.0
s23-4.pddl
0.8019 0.8019 0.0 0.8926 0.8926 0.0
s24-0.pddl
0.7993 0.7993 0.0 0.8637 0.8637 0.0
s24-1.pddl
0.7892 0.7892 0.0 0.8511 0.8511 0.0
s24-2.pddl
0.7825 0.7825 0.0 0.8691 0.8691 0.0
s24-3.pddl
0.7873 0.7873 0.0 0.8652 0.8652 0.0
s24-4.pddl
0.7843 0.7843 0.0 0.8389 0.8389 0.0
s25-0.pddl
0.7818 0.7818 0.0 0.8357 0.8357 0.0
s25-1.pddl
0.7622 0.7622 0.0 0.8545 0.8545 0.0
s25-2.pddl
0.7938 0.7938 0.0 0.8306 0.8306 0.0
s25-3.pddl
0.7668 0.7668 0.0 0.8489 0.8489 0.0
s25-4.pddl
0.7650 0.7650 0.0 0.8668 0.8668 0.0
s26-0.pddl
0.7611 0.7611 0.0 0.8406 0.8406 0.0
s26-1.pddl
0.7741 0.7741 0.0 0.8447 0.8447 0.0
s26-2.pddl
0.7487 0.7487 0.0 0.8246 0.8246 0.0
s26-3.pddl
0.7610 0.7610 0.0 0.8401 0.8401 0.0
s26-4.pddl
0.7836 0.7836 0.0 0.8151 0.8151 0.0
s27-0.pddl
0.7473 0.7473 0.0 0.8329 0.8329 0.0
s27-1.pddl
0.7662 0.7662 0.0 0.8382 0.8382 0.0
s27-2.pddl
0.7471 0.7471 0.0 0.8707 0.8707 0.0
s27-3.pddl
0.7613 0.7613 0.0 0.8195 0.8195 0.0
s27-4.pddl
0.7568 0.7568 0.0 0.8382 0.8382 0.0
s28-0.pddl
0.7377 0.7377 0.0 0.8233 0.8233 0.0
s28-1.pddl
0.7516 0.7516 0.0 0.8091 0.8091 0.0
s28-2.pddl
0.7404 0.7404 0.0 0.8348 0.8348 0.0
s28-3.pddl
0.7745 0.7745 0.0 0.8353 0.8353 0.0
s28-4.pddl
0.7522 0.7522 0.0 0.8350 0.8350 0.0
s29-0.pddl
0.7515 0.7515 0.0 0.8069 0.8069 0.0
s29-1.pddl
0.7593 0.7593 0.0 0.8268 0.8268 0.0
s29-2.pddl
0.7424 0.7424 0.0 0.8143 0.8143 0.0
s29-3.pddl
0.7286 0.7286 0.0 0.8389 0.8389 0.0
s29-4.pddl
0.7240 0.7240 0.0 0.8457 0.8457 0.0
s30-0.pddl
0.7526 0.7526 0.0 0.8099 0.8099 0.0
s30-1.pddl
0.7405 0.7405 0.0 0.8193 0.8193 0.0
s30-2.pddl
0.7456 0.7456 0.0 0.8255 0.8255 0.0
s30-3.pddl
0.7247 0.7247 0.0 0.8220 0.8220 0.0
s30-4.pddl
0.7344 0.7344 0.0 0.8391 0.8391 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
movie
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
mprime
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 0.1939 0.1939 0.0
prob03.pddl
1.0000 1.0000 0.0 0.5063 0.5063 0.0
prob04.pddl
1.0000 1.0000 0.0 0.9642 0.9642 0.0
prob05.pddl
1.0000 1.0000 0.0 0.0908 0.0908 0.0
prob06.pddl
0.8419 0.8419 0.0 0 0 0.0
prob07.pddl
1.0000 1.0000 0.0 0.4207 0.4207 0.0
prob08.pddl
1.0000 1.0000 0.0 0 0 0.0
prob09.pddl
1.0000 1.0000 0.0 0.4233 0.4233 0.0
prob10.pddl
1.0000 1.0000 0.0 0 0 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
1.0000 1.0000 0.0 0.1750 0.1750 0.0
prob13.pddl
1.0000 1.0000 0.0 0 0 0.0
prob14.pddl
1.0000 1.0000 0.0 0 0 0.0
prob15.pddl
1.0000 1.0000 0.0 0 0 0.0
prob16.pddl
1.0000 1.0000 0.0 0.2836 0.2836 0.0
prob17.pddl
1.0000 1.0000 0.0 0.1069 0.1069 0.0
prob18.pddl
0.9210 0.9210 0.0 0 0 0.0
prob19.pddl
1.0000 1.0000 0.0 0 0 0.0
prob20.pddl
1.0000 1.0000 0.0 0 0 0.0
prob21.pddl
0.8668 0.8668 0.0 -0.0000 -0.0000 0.0
prob22.pddl
1.0000 1.0000 0.0 0 0 0.0
prob23.pddl
1.0000 1.0000 0.0 0 0 0.0
prob24.pddl
1.0000 1.0000 0.0 0 0 0.0
prob25.pddl
1.0000 1.0000 0.0 0.9159 0.9159 0.0
prob26.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
prob27.pddl
1.0000 1.0000 0.0 0.6734 0.6734 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 0.5419 0.5419 0.0
prob30.pddl
1.0000 1.0000 0.0 0 0 0.0
prob31.pddl
1.0000 1.0000 0.0 0.5894 0.5894 0.0
prob32.pddl
1.0000 1.0000 0.0 0.2361 0.2361 0.0
prob33.pddl
0.9560 0.9560 0.0 0 0 0.0
prob34.pddl
1.0000 1.0000 0.0 0.5581 0.5581 0.0
prob35.pddl
1.0000 1.0000 0.0 0.5748 0.5748 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
mystery
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
0.8452 0.8452 0.0 0.4086 0.4086 0.0
prob03.pddl
1.0000 1.0000 0.0 0.8463 0.8463 0.0
prob04.pddl
0 0 0.0 0 0 0.0
prob05.pddl
0 0 0.0 0 0 0.0
prob06.pddl
0.4047 0.4047 0.0 0 0 0.0
prob07.pddl
0 0 0.0 0 0 0.0
prob08.pddl
0 0 0.0 0 0 0.0
prob09.pddl
-0.0000 -0.0000 0.0 0.6479 0.6479 0.0
prob10.pddl
1.0000 1.0000 0.0 0 0 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
0 0 0.0 0 0 0.0
prob13.pddl
1.0000 1.0000 0.0 0 0 0.0
prob14.pddl
1.0000 1.0000 0.0 0 0 0.0
prob15.pddl
1.0000 1.0000 0.0 0.0384 0.0384 0.0
prob16.pddl
0 0 0.0 0 0 0.0
prob17.pddl
1.0000 1.0000 0.0 0.5749 0.5749 0.0
prob18.pddl
0 0 0.0 0 0 0.0
prob19.pddl
0.7861 0.7861 0.0 0.2155 0.2155 0.0
prob20.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
prob21.pddl
0 0 0.0 0 0 0.0
prob22.pddl
0 0 0.0 0 0 0.0
prob23.pddl
0 0 0.0 0 0 0.0
prob24.pddl
0 0 0.0 0 0 0.0
prob25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob26.pddl
1.0000 1.0000 0.0 0.4686 0.4686 0.0
prob27.pddl
1.0000 1.0000 0.0 0.9332 0.9332 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 0.8938 0.8938 0.0
prob30.pddl
1.0000 1.0000 0.0 0.3786 0.3786 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
nomystery-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.7500 0.7500 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 0.1566 0.1566 0.0
p05.pddl
0.9989 0.9989 0.0 -0.0000 -0.0000 0.0
p06.pddl
0.9830 0.9830 0.0 0 0 0.0
p07.pddl
1.0000 1.0000 0.0 0 0 0.0
p08.pddl
0.9724 0.9724 0.0 0 0 0.0
p09.pddl
0.9758 0.9758 0.0 0.9766 0.9766 0.0
p10.pddl
0.9297 0.9297 0.0 0 0 0.0
p11.pddl
0.9858 0.9858 0.0 0.8717 0.8717 0.0
p12.pddl
0.7045 0.7045 0.0 0.4680 0.4680 0.0
p13.pddl
1.0000 1.0000 0.0 0.3684 0.3684 0.0
p14.pddl
0.5758 0.5758 0.0 0.1013 0.1013 0.0
p15.pddl
0.9149 0.9149 0.0 0.1218 0.1218 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0.7215 0.7215 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0.8627 0.8627 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt08-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 0.9927 0.9927 0.0
p12.pddl
1.0000 1.0000 0.0 0.9968 0.9968 0.0
p13.pddl
1.0000 1.0000 0.0 0.9927 0.9927 0.0
p14.pddl
1.0000 1.0000 0.0 0.9848 0.9848 0.0
p15.pddl
1.0000 1.0000 0.0 0.9867 0.9867 0.0
p16.pddl
1.0000 1.0000 0.0 0.9666 0.9666 0.0
p17.pddl
1.0000 1.0000 0.0 0.9567 0.9567 0.0
p18.pddl
1.0000 1.0000 0.0 0.9470 0.9470 0.0
p19.pddl
1.0000 1.0000 0.0 0.9264 0.9264 0.0
p20.pddl
1.0000 1.0000 0.0 0.9497 0.9497 0.0
p21.pddl
1.0000 1.0000 0.0 0.9326 0.9326 0.0
p22.pddl
1.0000 1.0000 0.0 0.9144 0.9144 0.0
p23.pddl
1.0000 1.0000 0.0 0.9005 0.9005 0.0
p24.pddl
1.0000 1.0000 0.0 0.9054 0.9054 0.0
p25.pddl
1.0000 1.0000 0.0 0.9036 0.9036 0.0
p26.pddl
0.9937 0.9937 0.0 0.8958 0.8958 0.0
p27.pddl
0.9867 0.9867 0.0 0.8844 0.8844 0.0
p28.pddl
0.9887 0.9887 0.0 0.8914 0.8914 0.0
p29.pddl
0.9839 0.9839 0.0 0.8652 0.8652 0.0
p30.pddl
0.9802 0.9802 0.0 0.8565 0.8565 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 0.9927 0.9927 0.0
p07.pddl
1.0000 1.0000 0.0 0.9968 0.9968 0.0
p08.pddl
1.0000 1.0000 0.0 0.9927 0.9927 0.0
p09.pddl
1.0000 1.0000 0.0 0.9848 0.9848 0.0
p10.pddl
1.0000 1.0000 0.0 0.9144 0.9144 0.0
p11.pddl
1.0000 1.0000 0.0 0.9867 0.9867 0.0
p12.pddl
1.0000 1.0000 0.0 0.9666 0.9666 0.0
p13.pddl
1.0000 1.0000 0.0 0.9567 0.9567 0.0
p14.pddl
1.0000 1.0000 0.0 0.9470 0.9470 0.0
p15.pddl
1.0000 1.0000 0.0 0.9264 0.9264 0.0
p16.pddl
1.0000 1.0000 0.0 0.9326 0.9326 0.0
p17.pddl
1.0000 1.0000 0.0 0.9497 0.9497 0.0
p18.pddl
1.0000 1.0000 0.0 0.9005 0.9005 0.0
p19.pddl
1.0000 1.0000 0.0 0.9054 0.9054 0.0
p20.pddl
1.0000 1.0000 0.0 0.9036 0.9036 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
1.0000 1.0000 0.0 0.9839 0.9839 0.0
p20_2.pddl
1.0000 1.0000 0.0 0.9531 0.9531 0.0
p20_3.pddl
1.0000 1.0000 0.0 0.9418 0.9418 0.0
p25_1.pddl
1.0000 1.0000 0.0 0.9258 0.9258 0.0
p25_3.pddl
1.0000 1.0000 0.0 0.8863 0.8863 0.0
p30_1.pddl
1.0000 1.0000 0.0 0.8950 0.8950 0.0
p30_2.pddl
0.9978 0.9978 0.0 0.8848 0.8848 0.0
p30_3.pddl
0.9867 0.9867 0.0 0.8447 0.8447 0.0
p35_1.pddl
0.9830 0.9830 0.0 0.8675 0.8675 0.0
p35_2.pddl
0.9802 0.9802 0.0 0.8646 0.8646 0.0
p35_3.pddl
0.9674 0.9674 0.0 0.8151 0.8151 0.0
p40_1.pddl
0.9690 0.9690 0.0 0.8612 0.8612 0.0
p40_2.pddl
0.9650 0.9650 0.0 0.8481 0.8481 0.0
p40_3.pddl
0.9538 0.9538 0.0 0.8049 0.8049 0.0
p45_1.pddl
0.9545 0.9545 0.0 0.8270 0.8270 0.0
p45_2.pddl
0.9470 0.9470 0.0 0.8091 0.8091 0.0
p45_3.pddl
0.9392 0.9392 0.0 0.7588 0.7588 0.0
p50_1.pddl
0.9456 0.9456 0.0 0.8055 0.8055 0.0
p50_2.pddl
0.9386 0.9386 0.0 0.7889 0.7889 0.0
p50_3.pddl
0.9275 0.9275 0.0 0.7454 0.7454 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 0.9968 0.9968 0.0
p07.pddl
1.0000 1.0000 0.0 0.9957 0.9957 0.0
p08.pddl
1.0000 1.0000 0.0 0.8942 0.8942 0.0
p09.pddl
1.0000 1.0000 0.0 0.8852 0.8852 0.0
p10.pddl
1.0000 1.0000 0.0 0.8687 0.8687 0.0
p11.pddl
1.0000 1.0000 0.0 0.8681 0.8681 0.0
p12.pddl
1.0000 1.0000 0.0 0.8751 0.8751 0.0
p13.pddl
1.0000 1.0000 0.0 0.8615 0.8615 0.0
p14.pddl
1.0000 1.0000 0.0 0.8697 0.8697 0.0
p15.pddl
0.9989 0.9989 0.0 0.8758 0.8758 0.0
p16.pddl
0.9978 0.9978 0.0 0.8741 0.8741 0.0
p17.pddl
0.9758 0.9758 0.0 0.8401 0.8401 0.0
p18.pddl
0.9258 0.9258 0.0 0.7386 0.7386 0.0
p19.pddl
0.9749 0.9749 0.0 0.8297 0.8297 0.0
p20.pddl
0.9560 0.9560 0.0 0.8047 0.8047 0.0
p21.pddl
0.9560 0.9560 0.0 0.8021 0.8021 0.0
p22.pddl
0.9560 0.9560 0.0 0.7876 0.7876 0.0
p23.pddl
0.9560 0.9560 0.0 0.7898 0.7898 0.0
p24.pddl
0.9005 0.9005 0.0 0.7077 0.7077 0.0
p25.pddl
0.9005 0.9005 0.0 0.7077 0.7077 0.0
p26.pddl
0.8992 0.8992 0.0 0.6923 0.6923 0.0
p27.pddl
0.8562 0.8562 0.0 0.6035 0.6035 0.0
p28.pddl
0.8253 0.8253 0.0 0.5659 0.5659 0.0
p29.pddl
0.8253 0.8253 0.0 0.5659 0.5659 0.0
p30.pddl
0.8244 0.8244 0.0 0.5424 0.5424 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
organic-synthesis-opt18-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
0 0 0.0 0 0 0.0
p05.pddl
0 0 0.0 0 0 0.0
p06.pddl
0 0 0.0 0 0 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0 0 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0 0 0.0 0 0 0.0
p12.pddl
0 0 0.0 0 0 0.0
p13.pddl
0 0 0.0 0 0 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0 0 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
organic-synthesis-split-opt18-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 0.7981 0.7981 0.0
p03.pddl
1.0000 1.0000 0.0 0.2042 0.2042 0.0
p04.pddl
1.0000 1.0000 0.0 0.1511 0.1511 0.0
p05.pddl
1.0000 1.0000 0.0 0.2873 0.2873 0.0
p06.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0.9411 0.9411 0.0 -0.0000 -0.0000 0.0
p09.pddl
1.0000 1.0000 0.0 0.3418 0.3418 0.0
p10.pddl
1.0000 1.0000 0.0 0.2885 0.2885 0.0
p11.pddl
0.7827 0.7827 0.0 0 0 0.0
p12.pddl
0.8101 0.8101 0.0 0 0 0.0
p13.pddl
0.8077 0.8077 0.0 0 0 0.0
p14.pddl
1.0000 1.0000 0.0 0.6503 0.6503 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
0.7623 0.7623 0.0 0 0 0.0
p17.pddl
0.7047 0.7047 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0.8058 0.8058 0.0 0 0 0.0
p20.pddl
0.4832 0.4832 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parcprinter-08-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 0.9510 0.9510 0.0
p08.pddl
1.0000 1.0000 0.0 0.9560 0.9560 0.0
p09.pddl
1.0000 1.0000 0.0 0.9303 0.9303 0.0
p10.pddl
1.0000 1.0000 0.0 0.9877 0.9877 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 0.9830 0.9830 0.0
p13.pddl
1.0000 1.0000 0.0 0.4756 0.4756 0.0
p14.pddl
1.0000 1.0000 0.0 0.0880 0.0880 0.0
p15.pddl
1.0000 1.0000 0.0 0 0 0.0
p16.pddl
1.0000 1.0000 0.0 0 0 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
1.0000 1.0000 0.0 0 0 0.0
p19.pddl
0.8758 0.8758 0.0 0 0 0.0
p20.pddl
0.9582 0.9582 0.0 0 0 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 0.1337 0.1337 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
0.9424 0.9424 0.0 0 0 0.0
p30.pddl
1.0000 1.0000 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parcprinter-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.9830 0.9830 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 0.4756 0.4756 0.0
p10.pddl
1.0000 1.0000 0.0 0.1337 0.1337 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 0.0880 0.0880 0.0
p13.pddl
1.0000 1.0000 0.0 0.9510 0.9510 0.0
p14.pddl
1.0000 1.0000 0.0 0.9560 0.9560 0.0
p15.pddl
1.0000 1.0000 0.0 0.9303 0.9303 0.0
p16.pddl
1.0000 1.0000 0.0 0.9877 0.9877 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
1.0000 1.0000 0.0 0 0 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parking-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile03-012.pddl
0.8646 0.8646 0.0 0 0 0.0
pfile04-013.pddl
0.8517 0.8517 0.0 0 0 0.0
pfile04-014.pddl
0.8135 0.8135 0.0 0 0 0.0
pfile04-015.pddl
0.9014 0.9014 0.0 0 0 0.0
pfile04-016.pddl
0.8597 0.8597 0.0 0 0 0.0
pfile05-017.pddl
0.8984 0.8984 0.0 0 0 0.0
pfile05-018.pddl
0.9115 0.9115 0.0 0 0 0.0
pfile05-019.pddl
0.7866 0.7866 0.0 0 0 0.0
pfile05-020.pddl
0.8181 0.8181 0.0 0 0 0.0
pfile06-021.pddl
0.8118 0.8118 0.0 0 0 0.0
pfile06-022.pddl
0.8145 0.8145 0.0 0 0 0.0
pfile06-023.pddl
0.8372 0.8372 0.0 0 0 0.0
pfile06-024.pddl
0.7100 0.7100 0.0 0 0 0.0
pfile07-025.pddl
0.7111 0.7111 0.0 0 0 0.0
pfile07-026.pddl
0.8173 0.8173 0.0 0 0 0.0
pfile07-027.pddl
0.8509 0.8509 0.0 0 0 0.0
pfile07-028.pddl
0.7144 0.7144 0.0 0 0 0.0
pfile08-029.pddl
0.7369 0.7369 0.0 0 0 0.0
pfile08-030.pddl
0.7715 0.7715 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parking-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
0.9456 0.9456 0.0 0 0 0.0
p_12_7-02.pddl
0.9258 0.9258 0.0 0.2595 0.2595 0.0
p_12_7-03.pddl
0.8649 0.8649 0.0 0 0 0.0
p_12_7-04.pddl
0.8871 0.8871 0.0 0 0 0.0
p_14_8-01.pddl
0.9068 0.9068 0.0 0 0 0.0
p_14_8-02.pddl
0.8697 0.8697 0.0 0 0 0.0
p_14_8-03.pddl
0.7886 0.7886 0.0 0 0 0.0
p_14_8-04.pddl
0.8649 0.8649 0.0 0 0 0.0
p_16_9-01.pddl
0.8343 0.8343 0.0 0 0 0.0
p_16_9-02.pddl
0.8744 0.8744 0.0 0 0 0.0
p_16_9-03.pddl
0.9205 0.9205 0.0 0 0 0.0
p_16_9-04.pddl
0.9110 0.9110 0.0 0 0 0.0
p_18_10-01.pddl
0.7746 0.7746 0.0 0 0 0.0
p_18_10-02.pddl
0.8396 0.8396 0.0 0 0 0.0
p_18_10-03.pddl
0.9275 0.9275 0.0 0 0 0.0
p_18_10-04.pddl
0.9476 0.9476 0.0 0 0 0.0
p_20_11-01.pddl
0.7410 0.7410 0.0 0 0 0.0
p_20_11-02.pddl
0.7936 0.7936 0.0 0 0 0.0
p_20_11-03.pddl
0.7563 0.7563 0.0 0 0 0.0
p_20_11-04.pddl
0.6801 0.6801 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pathways-noneg
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.6960 0.6960 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.7354 0.7354 0.0
p04.pddl
1.0000 1.0000 0.0 0.5992 0.5992 0.0
p05.pddl
1.0000 1.0000 0.0 0.2837 0.2837 0.0
p06.pddl
0.9344 0.9344 0.0 -0.0000 -0.0000 0.0
p07.pddl
0.8967 0.8967 0.0 -0.0000 -0.0000 0.0
p08.pddl
0.8277 0.8277 0.0 0 0 0.0
p09.pddl
0.8758 0.8758 0.0 -0.0000 -0.0000 0.0
p10.pddl
0 0 0.0 0 0 0.0
p11.pddl
0.8386 0.8386 0.0 -0.0000 -0.0000 0.0
p12.pddl
0.8002 0.8002 0.0 0 0 0.0
p13.pddl
0.8235 0.8235 0.0 0 0 0.0
p14.pddl
0.7802 0.7802 0.0 0 0 0.0
p15.pddl
0.8457 0.8457 0.0 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0.7611 0.7611 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0.6733 0.6733 0.0 0 0 0.0
p24.pddl
0.6791 0.6791 0.0 0 0 0.0
p25.pddl
0.6988 0.6988 0.0 0 0 0.0
p26.pddl
0.6539 0.6539 0.0 0 0 0.0
p27.pddl
0.6365 0.6365 0.0 0 0 0.0
p28.pddl
0.7118 0.7118 0.0 0 0 0.0
p29.pddl
0.6119 0.6119 0.0 0 0 0.0
p30.pddl
0.5767 0.5767 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pegsol-08-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 0.9775 0.9775 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0.9927 0.9927 0.0 0.9320 0.9320 0.0
p09.pddl
1.0000 1.0000 0.0 0.8646 0.8646 0.0
p10.pddl
0.7037 0.7037 0.0 0.7592 0.7592 0.0
p11.pddl
0.8343 0.8343 0.0 0.6829 0.6829 0.0
p12.pddl
0.8181 0.8181 0.0 0.8591 0.8591 0.0
p13.pddl
0.9682 0.9682 0.0 0.4504 0.4504 0.0
p14.pddl
0.9374 0.9374 0.0 0.4752 0.4752 0.0
p15.pddl
0.9386 0.9386 0.0 0.6787 0.6787 0.0
p16.pddl
0.8825 0.8825 0.0 0.5486 0.5486 0.0
p17.pddl
0.4845 0.4845 0.0 0.3728 0.3728 0.0
p18.pddl
0.6782 0.6782 0.0 0.8775 0.8775 0.0
p19.pddl
0.8730 0.8730 0.0 0.4842 0.4842 0.0
p20.pddl
0.8009 0.8009 0.0 0.8208 0.8208 0.0
p21.pddl
0.8934 0.8934 0.0 0.4163 0.4163 0.0
p22.pddl
0.7823 0.7823 0.0 0.5400 0.5400 0.0
p23.pddl
0.8263 0.8263 0.0 0.3472 0.3472 0.0
p24.pddl
0.7476 0.7476 0.0 0.4418 0.4418 0.0
p25.pddl
0.7759 0.7759 0.0 0.4757 0.4757 0.0
p26.pddl
0.8324 0.8324 0.0 0.3494 0.3494 0.0
p27.pddl
0.3524 0.3524 0.0 0.7344 0.7344 0.0
p28.pddl
0.2436 0.2436 0.0 0.0052 0.0052 0.0
p29.pddl
-0.0000 -0.0000 0.0 0.1872 0.1872 0.0
p30.pddl
0.2400 0.2400 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pegsol-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.4845 0.4845 0.0 0.3728 0.3728 0.0
p03.pddl
0.6782 0.6782 0.0 0.8775 0.8775 0.0
p04.pddl
0.8730 0.8730 0.0 0.4842 0.4842 0.0
p05.pddl
0.8634 0.8634 0.0 0.3196 0.3196 0.0
p06.pddl
0.9916 0.9916 0.0 0.7078 0.7078 0.0
p07.pddl
0.7797 0.7797 0.0 0.8331 0.8331 0.0
p08.pddl
0.8009 0.8009 0.0 0.8208 0.8208 0.0
p09.pddl
0.6678 0.6678 0.0 0.5155 0.5155 0.0
p10.pddl
0.8934 0.8934 0.0 0.4163 0.4163 0.0
p11.pddl
0.7823 0.7823 0.0 0.5400 0.5400 0.0
p12.pddl
0.7889 0.7889 0.0 0.4780 0.4780 0.0
p13.pddl
0.8263 0.8263 0.0 0.3472 0.3472 0.0
p14.pddl
0.7476 0.7476 0.0 0.4418 0.4418 0.0
p15.pddl
0.7759 0.7759 0.0 0.4757 0.4757 0.0
p16.pddl
0.8324 0.8324 0.0 0.3494 0.3494 0.0
p17.pddl
0.3524 0.3524 0.0 0.7344 0.7344 0.0
p18.pddl
0.2436 0.2436 0.0 0.0052 0.0052 0.0
p19.pddl
-0.0000 -0.0000 0.0 0.1872 0.1872 0.0
p20.pddl
0.2400 0.2400 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
petri-net-alignment-opt18-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8996 0.8996 0.0 0.9001 0.9001 0.0
p02.pddl
0.8714 0.8714 0.0 0.8744 0.8744 0.0
p03.pddl
0.8556 0.8556 0.0 0.8577 0.8577 0.0
p04.pddl
0.8548 0.8548 0.0 0.8551 0.8551 0.0
p05.pddl
0.8754 0.8754 0.0 0.8768 0.8768 0.0
p06.pddl
0.8551 0.8551 0.0 0.8548 0.8548 0.0
p07.pddl
0.8597 0.8597 0.0 0.8600 0.8600 0.0
p08.pddl
0.8548 0.8548 0.0 0.8545 0.8545 0.0
p09.pddl
0.8545 0.8545 0.0 0.8574 0.8574 0.0
p10.pddl
0.8317 0.8317 0.0 0.8324 0.8324 0.0
p11.pddl
0.8444 0.8444 0.0 0.8468 0.8468 0.0
p12.pddl
0.8189 0.8189 0.0 0.8185 0.8185 0.0
p13.pddl
0.8336 0.8336 0.0 0.8327 0.8327 0.0
p14.pddl
0.8295 0.8295 0.0 0.8315 0.8315 0.0
p15.pddl
0.8324 0.8324 0.0 0.8343 0.8343 0.0
p16.pddl
0.8229 0.8229 0.0 0.8242 0.8242 0.0
p17.pddl
0.8193 0.8193 0.0 0.8212 0.8212 0.0
p18.pddl
0.8229 0.8229 0.0 0.8248 0.8248 0.0
p19.pddl
0.8216 0.8216 0.0 0.8208 0.8208 0.0
p20.pddl
0.8169 0.8169 0.0 0.8181 0.8181 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pipesworld-notankage
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-net1-b6-g4.pddl
0.8033 0.8033 0.0 1.0000 1.0000 0.0
p03-net1-b8-g3.pddl
0.9968 0.9968 0.0 1.0000 1.0000 0.0
p04-net1-b8-g5.pddl
0.8031 0.8031 0.0 1.0000 1.0000 0.0
p05-net1-b10-g4.pddl
0.8975 0.8975 0.0 1.0000 1.0000 0.0
p06-net1-b10-g6.pddl
0.6361 0.6361 0.0 1.0000 1.0000 0.0
p07-net1-b12-g5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-net1-b12-g7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-net1-b14-g6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10-net1-b14-g8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-net2-b10-g2.pddl
0.4955 0.4955 0.0 0.6374 0.6374 0.0
p12-net2-b10-g4.pddl
0.5049 0.5049 0.0 0.5740 0.5740 0.0
p13-net2-b12-g3.pddl
1.0000 1.0000 0.0 0.4512 0.4512 0.0
p14-net2-b12-g5.pddl
0.5928 0.5928 0.0 0.6201 0.6201 0.0
p15-net2-b14-g4.pddl
0.7494 0.7494 0.0 0.4691 0.4691 0.0
p16-net2-b14-g6.pddl
0.3988 0.3988 0.0 0.1534 0.1534 0.0
p17-net2-b16-g5.pddl
0.4502 0.4502 0.0 0.6385 0.6385 0.0
p18-net2-b16-g7.pddl
0.3925 0.3925 0.0 0.6016 0.6016 0.0
p19-net2-b18-g6.pddl
0.9642 0.9642 0.0 0.8225 0.8225 0.0
p20-net2-b18-g8.pddl
0.3383 0.3383 0.0 0.4872 0.4872 0.0
p21-net3-b12-g2.pddl
1.0000 1.0000 0.0 0.8754 0.8754 0.0
p22-net3-b12-g4.pddl
0.3177 0.3177 0.0 0.3787 0.3787 0.0
p23-net3-b14-g3.pddl
0.8681 0.8681 0.0 0.5109 0.5109 0.0
p24-net3-b14-g5.pddl
0.4165 0.4165 0.0 0.2267 0.2267 0.0
p25-net3-b16-g5.pddl
0.8898 0.8898 0.0 0.2690 0.2690 0.0
p26-net3-b16-g7.pddl
0.3631 0.3631 0.0 0.5317 0.5317 0.0
p27-net3-b18-g6.pddl
0.3561 0.3561 0.0 -0.0000 -0.0000 0.0
p28-net3-b18-g7.pddl
0.3633 0.3633 0.0 0.0320 0.0320 0.0
p29-net3-b20-g6.pddl
0.5297 0.5297 0.0 0.0721 0.0721 0.0
p30-net3-b20-g8.pddl
0.3642 0.3642 0.0 0.3797 0.3797 0.0
p31-net4-b14-g3.pddl
0.9897 0.9897 0.0 0.4463 0.4463 0.0
p32-net4-b14-g5.pddl
0.4630 0.4630 0.0 0.5456 0.5456 0.0
p33-net4-b16-g5.pddl
0.5637 0.5637 0.0 0.4026 0.4026 0.0
p34-net4-b16-g6.pddl
0.3795 0.3795 0.0 0.3349 0.3349 0.0
p35-net4-b18-g4.pddl
0.4793 0.4793 0.0 -0.0000 -0.0000 0.0
p36-net4-b18-g6.pddl
0.8730 0.8730 0.0 -0.0000 -0.0000 0.0
p37-net4-b20-g5.pddl
0.6695 0.6695 0.0 0 0 0.0
p38-net4-b20-g7.pddl
0.3927 0.3927 0.0 0.0348 0.0348 0.0
p39-net4-b22-g7.pddl
0.9077 0.9077 0.0 0 0 0.0
p40-net4-b22-g8.pddl
0.5855 0.5855 0.0 -0.0000 -0.0000 0.0
p41-net5-b22-g2.pddl
0.8281 0.8281 0.0 0.1627 0.1627 0.0
p42-net5-b22-g4.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6.pddl
0.8465 0.8465 0.0 0 0 0.0
p50-net5-b30-g8.pddl
0.3667 0.3667 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pipesworld-tankage
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-net1-b6-g4-t50.pddl
0.7664 0.7664 0.0 1.0000 1.0000 0.0
p03-net1-b8-g3-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-net1-b8-g5-t80.pddl
0.8992 0.8992 0.0 1.0000 1.0000 0.0
p05-net1-b10-g4-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-net1-b10-g6-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-net1-b12-g5-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-net1-b12-g7-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-net1-b14-g6-t50.pddl
0.4633 0.4633 0.0 0.4629 0.4629 0.0
p10-net1-b14-g8-t50.pddl
1.0000 1.0000 0.0 0.7959 0.7959 0.0
p11-net2-b10-g2-t30.pddl
0.8404 0.8404 0.0 0.4596 0.4596 0.0
p12-net2-b10-g4-t60.pddl
0.9100 0.9100 0.0 0.3740 0.3740 0.0
p13-net2-b12-g3-t70.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
p14-net2-b12-g5-t30.pddl
0.7908 0.7908 0.0 0.3205 0.3205 0.0
p15-net2-b14-g4-t30.pddl
0.7082 0.7082 0.0 0.1905 0.1905 0.0
p16-net2-b14-g6-t80.pddl
0.6527 0.6527 0.0 0 0 0.0
p17-net2-b16-g5-t20.pddl
0.5527 0.5527 0.0 0.1143 0.1143 0.0
p18-net2-b16-g7-t60.pddl
0.5366 0.5366 0.0 0.0733 0.0733 0.0
p19-net2-b18-g6-t60.pddl
0.9490 0.9490 0.0 0.1040 0.1040 0.0
p20-net2-b18-g8-t90.pddl
0.6217 0.6217 0.0 0 0 0.0
p21-net3-b12-g2-t60.pddl
1.0000 1.0000 0.0 0.3446 0.3446 0.0
p22-net3-b12-g4-t60.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p23-net3-b14-g3-t60.pddl
0.5298 0.5298 0.0 0 0 0.0
p24-net3-b14-g5-t60.pddl
0.6726 0.6726 0.0 0 0 0.0
p25-net3-b16-g5-t60.pddl
0.8829 0.8829 0.0 0 0 0.0
p26-net3-b16-g7-t70.pddl
0.3910 0.3910 0.0 0 0 0.0
p27-net3-b18-g6-t70.pddl
0.8411 0.8411 0.0 0 0 0.0
p28-net3-b18-g7-t70.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p29-net3-b20-g6-t70.pddl
0.7437 0.7437 0.0 0 0 0.0
p30-net3-b20-g8-t70.pddl
0.5385 0.5385 0.0 0 0 0.0
p31-net4-b14-g3-t20.pddl
0.1440 0.1440 0.0 0.3094 0.3094 0.0
p32-net4-b14-g5-t30.pddl
0.4950 0.4950 0.0 -0.0000 -0.0000 0.0
p33-net4-b16-g5-t60.pddl
0.7792 0.7792 0.0 0 0 0.0
p34-net4-b16-g6-t60.pddl
0.7170 0.7170 0.0 0 0 0.0
p35-net4-b18-g4-t90.pddl
0.8404 0.8404 0.0 0 0 0.0
p36-net4-b18-g6-t90.pddl
0.4278 0.4278 0.0 0 0 0.0
p37-net4-b20-g5-t60.pddl
0.8618 0.8618 0.0 0 0 0.0
p38-net4-b20-g7-t60.pddl
0.6197 0.6197 0.0 0 0 0.0
p39-net4-b22-g7-t50.pddl
0.8090 0.8090 0.0 0 0 0.0
p40-net4-b22-g8-t50.pddl
0.8434 0.8434 0.0 0 0 0.0
p41-net5-b22-g2-t20.pddl
1.0000 1.0000 0.0 0 0 0.0
p42-net5-b22-g4-t50.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3-t80.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5-t80.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4-t50.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6-t50.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5-t50.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7-t50.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6-t50.pddl
0.6897 0.6897 0.0 0 0 0.0
p50-net5-b30-g8-t50.pddl
0.4212 0.4212 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
psr-small
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-s5-n1-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-s7-n1-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-s8-n1-l4-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-s9-n1-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-s10-n1-l4-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-s11-n1-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-s12-n1-l5-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-s13-n1-l5-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10-s17-n2-l2-f30.pddl
0.9732 0.9732 0.0 1.0000 1.0000 0.0
p11-s18-n2-l2-f50.pddl
0.9897 0.9897 0.0 1.0000 1.0000 0.0
p12-s21-n2-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-s22-n2-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14-s23-n2-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-s24-n2-l4-f10.pddl
1.0000 1.0000 0.0 0.4562 0.4562 0.0
p16-s29-n2-l5-f30.pddl
0.8047 0.8047 0.0 0.6424 0.6424 0.0
p17-s30-n2-l5-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18-s31-n2-l5-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19-s33-n3-l2-f30.pddl
0.7520 0.7520 0.0 0.5884 0.5884 0.0
p20-s34-n3-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21-s35-n3-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22-s37-n3-l3-f30.pddl
0.6599 0.6599 0.0 0.8691 0.8691 0.0
p23-s38-n3-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24-s39-n3-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25-s40-n3-l4-f10.pddl
1.0000 1.0000 0.0 0.3113 0.3113 0.0
p26-s41-n3-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27-s42-n3-l4-f50.pddl
0.9947 0.9947 0.0 1.0000 1.0000 0.0
p28-s43-n3-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29-s45-n3-l5-f30.pddl
0.7662 0.7662 0.0 0.9957 0.9957 0.0
p30-s46-n3-l5-f50.pddl
0.9437 0.9437 0.0 1.0000 1.0000 0.0
p31-s49-n4-l2-f30.pddl
0.9463 0.9463 0.0 0.3224 0.3224 0.0
p32-s50-n4-l2-f50.pddl
0.9226 0.9226 0.0 0.9597 0.9597 0.0
p33-s51-n4-l2-f70.pddl
0.9275 0.9275 0.0 0.6734 0.6734 0.0
p34-s55-n4-l3-f70.pddl
0.9858 0.9858 0.0 1.0000 1.0000 0.0
p35-s57-n5-l2-f30.pddl
0.7945 0.7945 0.0 0.1500 0.1500 0.0
p36-s65-n6-l2-f30.pddl
0.7791 0.7791 0.0 0.0207 0.0207 0.0
p37-s67-n6-l2-f70.pddl
0.9194 0.9194 0.0 1.0000 1.0000 0.0
p38-s78-n3-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p39-s79-n3-l3-f70.pddl
0.9553 0.9553 0.0 1.0000 1.0000 0.0
p40-s80-n3-l4-f10.pddl
0.8362 0.8362 0.0 -0.0000 -0.0000 0.0
p41-s81-n3-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p42-s82-n3-l4-f50.pddl
0.7551 0.7551 0.0 0.6897 0.6897 0.0
p43-s83-n3-l4-f70.pddl
0.9338 0.9338 0.0 1.0000 1.0000 0.0
p44-s89-n4-l2-f30.pddl
0.8646 0.8646 0.0 1.0000 1.0000 0.0
p45-s94-n4-l3-f50.pddl
0.9947 0.9947 0.0 1.0000 1.0000 0.0
p46-s97-n5-l2-f30.pddl
0.8242 0.8242 0.0 0.2749 0.2749 0.0
p47-s98-n5-l2-f50.pddl
0.9517 0.9517 0.0 0.9802 0.9802 0.0
p48-s101-n5-l3-f30.pddl
0.7993 0.7993 0.0 0.8429 0.8429 0.0
p49-s105-n6-l2-f30.pddl
0.6950 0.6950 0.0 0.7204 0.7204 0.0
p50-s107-n6-l2-f70.pddl
0.8727 0.8727 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
rovers
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.9830 0.9830 0.0
p06.pddl
0.9315 0.9315 0.0 0.9724 0.9724 0.0
p07.pddl
1.0000 1.0000 0.0 0.6816 0.6816 0.0
p08.pddl
1.0000 1.0000 0.0 0.6959 0.6959 0.0
p09.pddl
1.0000 1.0000 0.0 0.4193 0.4193 0.0
p10.pddl
0.9650 0.9650 0.0 0.3637 0.3637 0.0
p11.pddl
1.0000 1.0000 0.0 0.5468 0.5468 0.0
p12.pddl
1.0000 1.0000 0.0 0.6529 0.6529 0.0
p13.pddl
0.9054 0.9054 0.0 0.5038 0.5038 0.0
p14.pddl
0.9897 0.9897 0.0 0.4122 0.4122 0.0
p15.pddl
0.8473 0.8473 0.0 0.3642 0.3642 0.0
p16.pddl
0.9005 0.9005 0.0 0.3863 0.3863 0.0
p17.pddl
0.9740 0.9740 0.0 0.0900 0.0900 0.0
p18.pddl
0.9545 0.9545 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.8255 0.8255 0.0 0 0 0.0
p20.pddl
0.7818 0.7818 0.0 0 0 0.0
p21.pddl
0.8107 0.8107 0.0 0 0 0.0
p22.pddl
0.7938 0.7938 0.0 -0.0000 -0.0000 0.0
p23.pddl
0.7825 0.7825 0.0 0 0 0.0
p24.pddl
0.7058 0.7058 0.0 0 0 0.0
p25.pddl
1.0000 1.0000 0.0 0.3444 0.3444 0.0
p26.pddl
0.8409 0.8409 0.0 0 0 0.0
p27.pddl
0.7574 0.7574 0.0 0 0 0.0
p28.pddl
0.7568 0.7568 0.0 0 0 0.0
p29.pddl
0.8545 0.8545 0.0 0 0 0.0
p30.pddl
0.7438 0.7438 0.0 0 0 0.0
p31.pddl
0.6908 0.6908 0.0 0 0 0.0
p32.pddl
0.6240 0.6240 0.0 0 0 0.0
p33.pddl
0.5428 0.5428 0.0 0 0 0.0
p34.pddl
0.6531 0.6531 0.0 0 0 0.0
p35.pddl
0.4969 0.4969 0.0 0 0 0.0
p36.pddl
0.5588 0.5588 0.0 0 0 0.0
p37.pddl
0.4384 0.4384 0.0 0 0 0.0
p38.pddl
0.5090 0.5090 0.0 0 0 0.0
p39.pddl
0.5194 0.5194 0.0 0 0 0.0
p40.pddl
0.4603 0.4603 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
satellite
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-pfile2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-pfile3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-pfile4.pddl
1.0000 1.0000 0.0 0.8811 0.8811 0.0
p05-pfile5.pddl
1.0000 1.0000 0.0 0.6431 0.6431 0.0
p06-pfile6.pddl
1.0000 1.0000 0.0 0.5277 0.5277 0.0
p07-pfile7.pddl
1.0000 1.0000 0.0 0.5302 0.5302 0.0
p08-pfile8.pddl
1.0000 1.0000 0.0 0.1707 0.1707 0.0
p09-pfile9.pddl
1.0000 1.0000 0.0 0.3025 0.3025 0.0
p10-pfile10.pddl
1.0000 1.0000 0.0 0.1070 0.1070 0.0
p11-pfile11.pddl
1.0000 1.0000 0.0 0.3081 0.3081 0.0
p12-pfile12.pddl
1.0000 1.0000 0.0 -0.0000 -0.0000 0.0
p13-pfile13.pddl
0.8301 0.8301 0.0 0 0 0.0
p14-pfile14.pddl
0.9867 0.9867 0.0 0.1250 0.1250 0.0
p15-pfile15.pddl
0.8894 0.8894 0.0 0 0 0.0
p16-pfile16.pddl
1.0000 1.0000 0.0 0 0 0.0
p17-pfile17.pddl
0.8822 0.8822 0.0 0 0 0.0
p18-pfile18.pddl
0.9793 0.9793 0.0 0 0 0.0
p19-pfile19.pddl
0.8867 0.8867 0.0 0 0 0.0
p20-pfile20.pddl
0.7212 0.7212 0.0 0 0 0.0
p21-HC-pfile1.pddl
0.9184 0.9184 0.0 0.3347 0.3347 0.0
p22-HC-pfile2.pddl
0.8914 0.8914 0.0 0 0 0.0
p23-HC-pfile3.pddl
0.7744 0.7744 0.0 0.4057 0.4057 0.0
p24-HC-pfile4.pddl
0.7051 0.7051 0.0 0 0 0.0
p25-HC-pfile5.pddl
0.6765 0.6765 0.0 0 0 0.0
p26-HC-pfile6.pddl
0.7529 0.7529 0.0 0 0 0.0
p27-HC-pfile7.pddl
0.7897 0.7897 0.0 0 0 0.0
p28-HC-pfile8.pddl
0.5820 0.5820 0.0 0 0 0.0
p29-HC-pfile9.pddl
0.7131 0.7131 0.0 0 0 0.0
p30-HC-pfile10.pddl
0.5619 0.5619 0.0 0 0 0.0
p31-HC-pfile11.pddl
0.6295 0.6295 0.0 0 0 0.0
p32-HC-pfile12.pddl
0.5037 0.5037 0.0 0 0 0.0
p33-HC-pfile13.pddl
0.4372 0.4372 0.0 0 0 0.0
p34-HC-pfile14.pddl
0.8840 0.8840 0.0 0 0 0.0
p35-HC-pfile15.pddl
0.5556 0.5556 0.0 0 0 0.0
p36-HC-pfile16.pddl
0.7510 0.7510 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
scanalyzer-08-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.9978 0.9978 0.0 1.0000 1.0000 0.0
p06.pddl
0.9362 0.9362 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0.9374 0.9374 0.0 0.9766 0.9766 0.0
p09.pddl
0.8741 0.8741 0.0 0.9650 0.9650 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0.8886 0.8886 0.0 0.9200 0.9200 0.0
p12.pddl
0.8231 0.8231 0.0 0.9100 0.9100 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
0.8476 0.8476 0.0 0.8710 0.8710 0.0
p15.pddl
0.7799 0.7799 0.0 0.8624 0.8624 0.0
p16.pddl
0.9802 0.9802 0.0 1.0000 1.0000 0.0
p17.pddl
0.8122 0.8122 0.0 0.8281 0.8281 0.0
p18.pddl
0.7424 0.7424 0.0 0.8206 0.8206 0.0
p19.pddl
0.9538 0.9538 0.0 1.0000 1.0000 0.0
p20.pddl
0.7809 0.7809 0.0 0.7900 0.7900 0.0
p21.pddl
0.7090 0.7090 0.0 0.7833 0.7833 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
0.9635 0.9635 0.0 1.0000 1.0000 0.0
p27.pddl
0.9567 0.9567 0.0 0.6567 0.6567 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
0.7119 0.7119 0.0 0.9538 0.9538 0.0
p30.pddl
0.8727 0.8727 0.0 0.8060 0.8060 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
scanalyzer-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
0.9978 0.9978 0.0 1.0000 1.0000 0.0
p07.pddl
0.9538 0.9538 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
0.9802 0.9802 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
0.9362 0.9362 0.0 1.0000 1.0000 0.0
p13.pddl
0.9567 0.9567 0.0 0.6567 0.6567 0.0
p14.pddl
0.9635 0.9635 0.0 1.0000 1.0000 0.0
p15.pddl
0.9374 0.9374 0.0 0.9766 0.9766 0.0
p16.pddl
0.8886 0.8886 0.0 0.9200 0.9200 0.0
p17.pddl
0.8476 0.8476 0.0 0.8710 0.8710 0.0
p18.pddl
0.8122 0.8122 0.0 0.8281 0.8281 0.0
p19.pddl
0.7809 0.7809 0.0 0.7900 0.7900 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
snake-opt18-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.7542 0.7542 0.0 0.5031 0.5031 0.0
p02.pddl
0.5814 0.5814 0.0 0.1911 0.1911 0.0
p03.pddl
0.3208 0.3208 0.0 0.0444 0.0444 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.9200 0.9200 0.0
p06.pddl
0.6892 0.6892 0.0 0.1605 0.1605 0.0
p07.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p08.pddl
0 0 0.0 -0.0000 -0.0000 0.0
p09.pddl
1.0000 1.0000 0.0 0.7400 0.7400 0.0
p10.pddl
0.8372 0.8372 0.0 0.4901 0.4901 0.0
p11.pddl
0.6891 0.6891 0.0 0.0731 0.0731 0.0
p12.pddl
0.1079 0.1079 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.3243 0.3243 0.0 0 0 0.0
p14.pddl
0 0 0.0 0 0 0.0
p15.pddl
0.8988 0.8988 0.0 0.3887 0.3887 0.0
p16.pddl
0.3322 0.3322 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.0330 0.0330 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0.5940 0.5940 0.0 0.2460 0.2460 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
sokoban-opt08-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9589 0.9589 0.0 0.6715 0.6715 0.0
p02.pddl
0.9297 0.9297 0.0 0.8649 0.8649 0.0
p03.pddl
1.0000 1.0000 0.0 0.8606 0.8606 0.0
p04.pddl
0.7814 0.7814 0.0 0.5364 0.5364 0.0
p05.pddl
0.9490 0.9490 0.0 0 0 0.0
p06.pddl
0.8902 0.8902 0.0 0.4625 0.4625 0.0
p07.pddl
0.7406 0.7406 0.0 0.2947 0.2947 0.0
p08.pddl
0.3737 0.3737 0.0 -0.0000 -0.0000 0.0
p09.pddl
0.5962 0.5962 0.0 -0.0000 -0.0000 0.0
p10.pddl
0.4873 0.4873 0.0 0.0718 0.0718 0.0
p11.pddl
0.2808 0.2808 0.0 0.1445 0.1445 0.0
p12.pddl
0.4745 0.4745 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.0493 0.0493 0.0 -0.0000 -0.0000 0.0
p14.pddl
0.6838 0.6838 0.0 0.3133 0.3133 0.0
p15.pddl
0.2696 0.2696 0.0 -0.0000 -0.0000 0.0
p16.pddl
0.3853 0.3853 0.0 0.1943 0.1943 0.0
p17.pddl
0.5622 0.5622 0.0 0.2441 0.2441 0.0
p18.pddl
0.3238 0.3238 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.2528 0.2528 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.6943 0.6943 0.0 0.6397 0.6397 0.0
p21.pddl
0.6937 0.6937 0.0 0.6517 0.6517 0.0
p22.pddl
0.3148 0.3148 0.0 -0.0000 -0.0000 0.0
p23.pddl
0.6006 0.6006 0.0 0.0347 0.0347 0.0
p24.pddl
0.2007 0.2007 0.0 0 0 0.0
p25.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p26.pddl
0.3336 0.3336 0.0 0 0 0.0
p27.pddl
0.4777 0.4777 0.0 0.3685 0.3685 0.0
p28.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p29.pddl
0.9916 0.9916 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
sokoban-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8902 0.8902 0.0 0.4625 0.4625 0.0
p02.pddl
0.5622 0.5622 0.0 0.2441 0.2441 0.0
p03.pddl
0.6838 0.6838 0.0 0.3133 0.3133 0.0
p04.pddl
0.7814 0.7814 0.0 0.5364 0.5364 0.0
p05.pddl
0.3853 0.3853 0.0 0.1943 0.1943 0.0
p06.pddl
0.2808 0.2808 0.0 0.1445 0.1445 0.0
p07.pddl
0.4873 0.4873 0.0 0.0718 0.0718 0.0
p08.pddl
0.5962 0.5962 0.0 -0.0000 -0.0000 0.0
p09.pddl
0.7406 0.7406 0.0 0.2947 0.2947 0.0
p10.pddl
0.9490 0.9490 0.0 0 0 0.0
p11.pddl
0.0493 0.0493 0.0 -0.0000 -0.0000 0.0
p12.pddl
0.6943 0.6943 0.0 0.6397 0.6397 0.0
p13.pddl
0.3737 0.3737 0.0 -0.0000 -0.0000 0.0
p14.pddl
0.4745 0.4745 0.0 -0.0000 -0.0000 0.0
p15.pddl
0.3238 0.3238 0.0 -0.0000 -0.0000 0.0
p16.pddl
0.2696 0.2696 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.2528 0.2528 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.6937 0.6937 0.0 0.6517 0.6517 0.0
p19.pddl
0.3148 0.3148 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.6006 0.6006 0.0 0.0347 0.0347 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
spider-opt18-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9749 0.9749 0.0
p02.pddl
0.6894 0.6894 0.0 0.5920 0.5920 0.0
p03.pddl
0.8765 0.8765 0.0 0.6530 0.6530 0.0
p04.pddl
0.8829 0.8829 0.0 0.5276 0.5276 0.0
p05.pddl
0.6193 0.6193 0.0 0.3894 0.3894 0.0
p06.pddl
0.5094 0.5094 0.0 -0.0000 -0.0000 0.0
p07.pddl
0.9470 0.9470 0.0 0.8704 0.8704 0.0
p08.pddl
0.9635 0.9635 0.0 0.8844 0.8844 0.0
p09.pddl
0.5116 0.5116 0.0 0.3929 0.3929 0.0
p10.pddl
0.3525 0.3525 0.0 0.0709 0.0709 0.0
p11.pddl
0.7445 0.7445 0.0 0.3925 0.3925 0.0
p12.pddl
0.6309 0.6309 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.4220 0.4220 0.0 0.3058 0.3058 0.0
p14.pddl
1.0000 1.0000 0.0 0.9858 0.9858 0.0
p15.pddl
1.0000 1.0000 0.0 0.9724 0.9724 0.0
p16.pddl
0.9642 0.9642 0.0 0.7863 0.7863 0.0
p17.pddl
0.8786 0.8786 0.0 0.8414 0.8414 0.0
p18.pddl
0.8177 0.8177 0.0 0.0429 0.0429 0.0
p19.pddl
0.8434 0.8434 0.0 0.5283 0.5283 0.0
p20.pddl
0.7641 0.7641 0.0 0.5119 0.5119 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
storage
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 0.9916 0.9916 0.0
p07.pddl
1.0000 1.0000 0.0 0.9811 0.9811 0.0
p08.pddl
0.9490 0.9490 0.0 0.7418 0.7418 0.0
p09.pddl
0.9597 0.9597 0.0 0.7271 0.7271 0.0
p10.pddl
0.9303 0.9303 0.0 0.7572 0.7572 0.0
p11.pddl
0.6355 0.6355 0.0 0.5220 0.5220 0.0
p12.pddl
0.6812 0.6812 0.0 0.3376 0.3376 0.0
p13.pddl
0.4990 0.4990 0.0 0.7645 0.7645 0.0
p14.pddl
0.4329 0.4329 0.0 0.5789 0.5789 0.0
p15.pddl
0.5808 0.5808 0.0 0.3986 0.3986 0.0
p16.pddl
0.5657 0.5657 0.0 0.1339 0.1339 0.0
p17.pddl
0.5342 0.5342 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.0404 0.0404 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0.1978 0.1978 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
termes-opt18-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.7697 0.7697 0.0 0.4777 0.4777 0.0
p02.pddl
0.4907 0.4907 0.0 0.4452 0.4452 0.0
p03.pddl
0.4795 0.4795 0.0 0.2213 0.2213 0.0
p04.pddl
0.5051 0.5051 0.0 0.2371 0.2371 0.0
p05.pddl
0.0401 0.0401 0.0 -0.0000 -0.0000 0.0
p06.pddl
0.1744 0.1744 0.0 -0.0000 -0.0000 0.0
p07.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p08.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p09.pddl
0 0 0.0 0 0 0.0
p10.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p11.pddl
0.7124 0.7124 0.0 0.2974 0.2974 0.0
p12.pddl
0.6205 0.6205 0.0 0.5890 0.5890 0.0
p13.pddl
0.5429 0.5429 0.0 0.2532 0.2532 0.0
p14.pddl
0.5833 0.5833 0.0 0.3716 0.3716 0.0
p15.pddl
0.2459 0.2459 0.0 0.1658 0.1658 0.0
p16.pddl
0.3114 0.3114 0.0 0.1033 0.1033 0.0
p17.pddl
0.3815 0.3815 0.0 0.3056 0.3056 0.0
p18.pddl
0.7145 0.7145 0.0 0.5705 0.5705 0.0
p19.pddl
0.4115 0.4115 0.0 0.4365 0.4365 0.0
p20.pddl
0.3767 0.3767 0.0 0.2452 0.2452 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tetris-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
0.5180 0.5180 0.0 1.0000 1.0000 0.0
p01-8.pddl
0.5661 0.5661 0.0 0.9405 0.9405 0.0
p01-10.pddl
-0.0000 -0.0000 0.0 0.3948 0.3948 0.0
p02-4.pddl
0.8665 0.8665 0.0 1.0000 1.0000 0.0
p02-6.pddl
0.5853 0.5853 0.0 1.0000 1.0000 0.0
p02-8.pddl
0.6044 0.6044 0.0 0.7524 0.7524 0.0
p02-10.pddl
0.2257 0.2257 0.0 0.6031 0.6031 0.0
p03-4.pddl
0.6679 0.6679 0.0 1.0000 1.0000 0.0
p03-6.pddl
0.5537 0.5537 0.0 0.9014 0.9014 0.0
p03-8.pddl
0.5944 0.5944 0.0 0.9091 0.9091 0.0
p03-10.pddl
0.5330 0.5330 0.0 0.7631 0.7631 0.0
p04-6.pddl
0.5190 0.5190 0.0 0.8793 0.8793 0.0
p04-8.pddl
0.4376 0.4376 0.0 0.8545 0.8545 0.0
p04-10.pddl
0.4600 0.4600 0.0 0.7866 0.7866 0.0
p05-6.pddl
0.6472 0.6472 0.0 1.0000 1.0000 0.0
p05-8.pddl
0.1154 0.1154 0.0 0.8652 0.8652 0.0
p05-10.pddl
0.5780 0.5780 0.0 0.7660 0.7660 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tidybot-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.7523 0.7523 0.0 0.9418 0.9418 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
0.8807 0.8807 0.0 0.8591 0.8591 0.0
p05.pddl
0.7510 0.7510 0.0 0.6317 0.6317 0.0
p06.pddl
0.9253 0.9253 0.0 0.8053 0.8053 0.0
p07.pddl
0.8047 0.8047 0.0 1.0000 1.0000 0.0
p08.pddl
-0.0000 -0.0000 0.0 0.5835 0.5835 0.0
p09.pddl
0.5458 0.5458 0.0 0.9100 0.9100 0.0
p10.pddl
1.0000 1.0000 0.0 0.6405 0.6405 0.0
p11.pddl
0.8255 0.8255 0.0 0.7755 0.7755 0.0
p12.pddl
0.9110 0.9110 0.0 0.6553 0.6553 0.0
p13.pddl
0.6037 0.6037 0.0 0.6610 0.6610 0.0
p14.pddl
0.9247 0.9247 0.0 0.8678 0.8678 0.0
p15.pddl
0 0 0.0 0.6382 0.6382 0.0
p16.pddl
0.9405 0.9405 0.0 0.7710 0.7710 0.0
p17.pddl
0.6422 0.6422 0.0 0.3324 0.3324 0.0
p18.pddl
0.5271 0.5271 0.0 0.5212 0.5212 0.0
p19.pddl
0.8476 0.8476 0.0 0.6835 0.6835 0.0
p20.pddl
0.7938 0.7938 0.0 0.4261 0.4261 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tidybot-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.7901 0.7901 0.0 -0.0000 -0.0000 0.0
p02.pddl
0.7827 0.7827 0.0 0.5335 0.5335 0.0
p03.pddl
0.9297 0.9297 0.0 0.7917 0.7917 0.0
p04.pddl
1.0000 1.0000 0.0 0.6316 0.6316 0.0
p05.pddl
0.6862 0.6862 0.0 0.2890 0.2890 0.0
p06.pddl
0.5991 0.5991 0.0 0.2575 0.2575 0.0
p07.pddl
0.8744 0.8744 0.0 0.7766 0.7766 0.0
p08.pddl
1.0000 1.0000 0.0 0.9194 0.9194 0.0
p09.pddl
0.9303 0.9303 0.0 0.6158 0.6158 0.0
p10.pddl
0.8259 0.8259 0.0 0.4039 0.4039 0.0
p11.pddl
0.8255 0.8255 0.0 0.7755 0.7755 0.0
p12.pddl
0.9110 0.9110 0.0 0.6553 0.6553 0.0
p13.pddl
0.6037 0.6037 0.0 0.6610 0.6610 0.0
p14.pddl
0.9247 0.9247 0.0 0.8678 0.8678 0.0
p15.pddl
0 0 0.0 0.6382 0.6382 0.0
p16.pddl
0.9405 0.9405 0.0 0.7710 0.7710 0.0
p17.pddl
0.6422 0.6422 0.0 0.3324 0.3324 0.0
p18.pddl
0.5271 0.5271 0.0 0.5212 0.5212 0.0
p19.pddl
0.8476 0.8476 0.0 0.6835 0.6835 0.0
p20.pddl
0.7938 0.7938 0.0 0.4261 0.4261 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tpp
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.9470 0.9470 0.0
p06.pddl
1.0000 1.0000 0.0 0.7161 0.7161 0.0
p07.pddl
0.9642 0.9642 0.0 0.6549 0.6549 0.0
p08.pddl
0.9215 0.9215 0.0 0.5964 0.5964 0.0
p09.pddl
0.8800 0.8800 0.0 0.5504 0.5504 0.0
p10.pddl
0.8159 0.8159 0.0 0.4729 0.4729 0.0
p11.pddl
0.8012 0.8012 0.0 0.4069 0.4069 0.0
p12.pddl
0.8095 0.8095 0.0 0.3598 0.3598 0.0
p13.pddl
0.8754 0.8754 0.0 0.4393 0.4393 0.0
p14.pddl
0.8185 0.8185 0.0 0.3575 0.3575 0.0
p15.pddl
0.7756 0.7756 0.0 0.3910 0.3910 0.0
p16.pddl
0.7425 0.7425 0.0 0.2112 0.2112 0.0
p17.pddl
0.7227 0.7227 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.7978 0.7978 0.0 0.0729 0.0729 0.0
p19.pddl
0.6768 0.6768 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.6577 0.6577 0.0 -0.0000 -0.0000 0.0
p21.pddl
0.7014 0.7014 0.0 0.1381 0.1381 0.0
p22.pddl
0.7715 0.7715 0.0 0.1359 0.1359 0.0
p23.pddl
0.7022 0.7022 0.0 0.0461 0.0461 0.0
p24.pddl
0.5862 0.5862 0.0 0.0827 0.0827 0.0
p25.pddl
0.6676 0.6676 0.0 -0.0000 -0.0000 0.0
p26.pddl
0.6735 0.6735 0.0 -0.0000 -0.0000 0.0
p27.pddl
0.6437 0.6437 0.0 -0.0000 -0.0000 0.0
p28.pddl
0.6419 0.6419 0.0 0 0 0.0
p29.pddl
0.5606 0.5606 0.0 0 0 0.0
p30.pddl
0.5887 0.5887 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt08-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 0.9463 0.9463 0.0
p03.pddl
1.0000 1.0000 0.0 0.8818 0.8818 0.0
p04.pddl
1.0000 1.0000 0.0 0.8414 0.8414 0.0
p05.pddl
1.0000 1.0000 0.0 0.7367 0.7367 0.0
p06.pddl
0.9524 0.9524 0.0 0.5473 0.5473 0.0
p07.pddl
0.9072 0.9072 0.0 0.3760 0.3760 0.0
p08.pddl
0.9368 0.9368 0.0 0.3667 0.3667 0.0
p09.pddl
0.8665 0.8665 0.0 0.3021 0.3021 0.0
p10.pddl
0.8652 0.8652 0.0 0.2194 0.2194 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 0.8837 0.8837 0.0
p13.pddl
1.0000 1.0000 0.0 0.6932 0.6932 0.0
p14.pddl
1.0000 1.0000 0.0 0.6265 0.6265 0.0
p15.pddl
0.8301 0.8301 0.0 0.5869 0.5869 0.0
p16.pddl
0.8724 0.8724 0.0 0.2510 0.2510 0.0
p17.pddl
0.7729 0.7729 0.0 0.1136 0.1136 0.0
p18.pddl
0.7380 0.7380 0.0 0.0704 0.0704 0.0
p19.pddl
0.7445 0.7445 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.7029 0.7029 0.0 -0.0000 -0.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 0.9811 0.9811 0.0
p23.pddl
1.0000 1.0000 0.0 0.8534 0.8534 0.0
p24.pddl
1.0000 1.0000 0.0 0.8231 0.8231 0.0
p25.pddl
0.9766 0.9766 0.0 0.6771 0.6771 0.0
p26.pddl
0.9820 0.9820 0.0 0.5349 0.5349 0.0
p27.pddl
0.9582 0.9582 0.0 0.5687 0.5687 0.0
p28.pddl
0.8153 0.8153 0.0 0.2632 0.2632 0.0
p29.pddl
0.8814 0.8814 0.0 0.2946 0.2946 0.0
p30.pddl
0.8782 0.8782 0.0 0.2839 0.2839 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.8534 0.8534 0.0
p02.pddl
1.0000 1.0000 0.0 0.8818 0.8818 0.0
p03.pddl
1.0000 1.0000 0.0 0.8837 0.8837 0.0
p04.pddl
1.0000 1.0000 0.0 0.6932 0.6932 0.0
p05.pddl
1.0000 1.0000 0.0 0.8231 0.8231 0.0
p06.pddl
1.0000 1.0000 0.0 0.8414 0.8414 0.0
p07.pddl
1.0000 1.0000 0.0 0.7588 0.7588 0.0
p08.pddl
0.9989 0.9989 0.0 0.5589 0.5589 0.0
p09.pddl
0.9338 0.9338 0.0 0.6507 0.6507 0.0
p10.pddl
0.9072 0.9072 0.0 0.5326 0.5326 0.0
p11.pddl
0.8675 0.8675 0.0 0.5995 0.5995 0.0
p12.pddl
0.8963 0.8963 0.0 0.4382 0.4382 0.0
p13.pddl
0.9264 0.9264 0.0 0.6399 0.6399 0.0
p14.pddl
0.9392 0.9392 0.0 0.5324 0.5324 0.0
p15.pddl
0.9200 0.9200 0.0 0.6895 0.6895 0.0
p16.pddl
0.8503 0.8503 0.0 0.4761 0.4761 0.0
p17.pddl
1.0000 1.0000 0.0 0.7367 0.7367 0.0
p18.pddl
1.0000 1.0000 0.0 0.6265 0.6265 0.0
p19.pddl
0.9766 0.9766 0.0 0.6771 0.6771 0.0
p20.pddl
0.9524 0.9524 0.0 0.5473 0.5473 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9682 0.9682 0.0
p02.pddl
1.0000 1.0000 0.0 0.7753 0.7753 0.0
p03.pddl
1.0000 1.0000 0.0 0.7645 0.7645 0.0
p04.pddl
1.0000 1.0000 0.0 0.6155 0.6155 0.0
p05.pddl
0.9989 0.9989 0.0 0.3827 0.3827 0.0
p06.pddl
0.9443 0.9443 0.0 0.4997 0.4997 0.0
p07.pddl
1.0000 1.0000 0.0 0.6722 0.6722 0.0
p08.pddl
0.9775 0.9775 0.0 0.5473 0.5473 0.0
p09.pddl
0.9732 0.9732 0.0 0.4810 0.4810 0.0
p10.pddl
0.9524 0.9524 0.0 0.1893 0.1893 0.0
p11.pddl
0.8594 0.8594 0.0 0.1063 0.1063 0.0
p12.pddl
0.8379 0.8379 0.0 0.0268 0.0268 0.0
p13.pddl
1.0000 1.0000 0.0 0.6990 0.6990 0.0
p14.pddl
1.0000 1.0000 0.0 0.7168 0.7168 0.0
p15.pddl
1.0000 1.0000 0.0 0.5670 0.5670 0.0
p16.pddl
1.0000 1.0000 0.0 0.1762 0.1762 0.0
p17.pddl
0.8768 0.8768 0.0 0.1174 0.1174 0.0
p18.pddl
0.9077 0.9077 0.0 0.0733 0.0733 0.0
p19.pddl
0.8511 0.8511 0.0 0.1991 0.1991 0.0
p20.pddl
0.8511 0.8511 0.0 0.1991 0.1991 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
trucks-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9476 0.9476 0.0
p02.pddl
1.0000 1.0000 0.0 0.4689 0.4689 0.0
p03.pddl
1.0000 1.0000 0.0 0.1463 0.1463 0.0
p04.pddl
0.5735 0.5735 0.0 0.9129 0.9129 0.0
p05.pddl
0.9707 0.9707 0.0 0.9179 0.9179 0.0
p06.pddl
0.9174 0.9174 0.0 0.8971 0.8971 0.0
p07.pddl
0.6695 0.6695 0.0 -0.0000 -0.0000 0.0
p08.pddl
0.8631 0.8631 0.0 0 0 0.0
p09.pddl
0.7163 0.7163 0.0 0 0 0.0
p10.pddl
0.2647 0.2647 0.0 0 0 0.0
p11.pddl
0.4880 0.4880 0.0 0 0 0.0
p12.pddl
0.2084 0.2084 0.0 0 0 0.0
p13.pddl
0.0618 0.0618 0.0 0 0 0.0
p14.pddl
0.3407 0.3407 0.0 0 0 0.0
p15.pddl
0.0355 0.0355 0.0 0 0 0.0
p16.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p17.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0 0 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
visitall-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem02-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem03-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem03-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem04-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem04-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem05-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem05-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem06-full.pddl
0.9989 0.9989 0.0 1.0000 1.0000 0.0
problem06-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem07-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem07-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem08-full.pddl
0.9470 0.9470 0.0 1.0000 1.0000 0.0
problem08-half.pddl
0.9715 0.9715 0.0 1.0000 1.0000 0.0
problem09-full.pddl
0.9253 0.9253 0.0 1.0000 1.0000 0.0
problem09-half.pddl
0.8914 0.8914 0.0 0.9476 0.9476 0.0
problem10-full.pddl
0.8979 0.8979 0.0 1.0000 1.0000 0.0
problem10-half.pddl
0.9082 0.9082 0.0 0.9604 0.9604 0.0
problem11-full.pddl
0.8304 0.8304 0.0 0.9483 0.9483 0.0
problem11-half.pddl
0.9110 0.9110 0.0 0.8984 0.8984 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
visitall-opt14-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-6.pddl
0.9989 0.9989 0.0 1.0000 1.0000 0.0
p-1-7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-8.pddl
0.9470 0.9470 0.0 1.0000 1.0000 0.0
p-1-9.pddl
0.9253 0.9253 0.0 1.0000 1.0000 0.0
p-1-10.pddl
0.8979 0.8979 0.0 1.0000 1.0000 0.0
p-1-11.pddl
0.8304 0.8304 0.0 0.9483 0.9483 0.0
p-1-12.pddl
0.8498 0.8498 0.0 0.9582 0.9582 0.0
p-1-13.pddl
0.7827 0.7827 0.0 0.9344 0.9344 0.0
p-1-14.pddl
0.7606 0.7606 0.0 0.9215 0.9215 0.0
p-1-15.pddl
0.7450 0.7450 0.0 0.8833 0.8833 0.0
p-1-16.pddl
0.7203 0.7203 0.0 0.8894 0.8894 0.0
p-1-17.pddl
0.7258 0.7258 0.0 0.8582 0.8582 0.0
p-1-18.pddl
0.6958 0.6958 0.0 0.8503 0.8503 0.0
p-05-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-7.pddl
0.9839 0.9839 0.0 1.0000 1.0000 0.0
p-05-8.pddl
0.9612 0.9612 0.0 1.0000 1.0000 0.0
p-05-9.pddl
0.9368 0.9368 0.0 0.9724 0.9724 0.0
p-05-10.pddl
0.9194 0.9194 0.0 0.9793 0.9793 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
woodworking-opt08-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.8844 0.8844 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 0 0 0.0
p05.pddl
0.6335 0.6335 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 0.5664 0.5664 0.0
p07.pddl
1.0000 1.0000 0.0 0.9906 0.9906 0.0
p08.pddl
1.0000 1.0000 0.0 0 0 0.0
p09.pddl
0.5645 0.5645 0.0 0 0 0.0
p10.pddl
1.0000 1.0000 0.0 0.4212 0.4212 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
0.6645 0.6645 0.0 1.0000 1.0000 0.0
p15.pddl
0.5988 0.5988 0.0 1.0000 1.0000 0.0
p16.pddl
0.6371 0.6371 0.0 0 0 0.0
p17.pddl
0.6111 0.6111 0.0 0.6586 0.6586 0.0
p18.pddl
1.0000 1.0000 0.0 0.5475 0.5475 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
0.5749 0.5749 0.0 0.4704 0.4704 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
0.6621 0.6621 0.0 -0.0000 -0.0000 0.0
p25.pddl
0.5858 0.5858 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 0 0 0.0
p27.pddl
0.6018 0.6018 0.0 0 0 0.0
p28.pddl
0.5370 0.5370 0.0 0 0 0.0
p29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30.pddl
0.5373 0.5373 0.0 0.1928 0.1928 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
woodworking-opt11-strips
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.6621 0.6621 0.0 -0.0000 -0.0000 0.0
p06.pddl
1.0000 1.0000 0.0 0 0 0.0
p07.pddl
0.6645 0.6645 0.0 1.0000 1.0000 0.0
p08.pddl
0.5858 0.5858 0.0 1.0000 1.0000 0.0
p09.pddl
0.6335 0.6335 0.0 1.0000 1.0000 0.0
p10.pddl
0.5988 0.5988 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 0 0 0.0
p12.pddl
0.6371 0.6371 0.0 0 0 0.0
p13.pddl
1.0000 1.0000 0.0 0.5664 0.5664 0.0
p14.pddl
0.6018 0.6018 0.0 0 0 0.0
p15.pddl
0.6111 0.6111 0.0 0.6586 0.6586 0.0
p16.pddl
1.0000 1.0000 0.0 0.9906 0.9906 0.0
p17.pddl
0.5370 0.5370 0.0 0 0 0.0
p18.pddl
1.0000 1.0000 0.0 0.5475 0.5475 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
zenotravel
Show table
score_expansions
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.9978 0.9978 0.0
p04.pddl
1.0000 1.0000 0.0 0.9567 0.9567 0.0
p05.pddl
1.0000 1.0000 0.0 0.8874 0.8874 0.0
p06.pddl
1.0000 1.0000 0.0 0.8235 0.8235 0.0
p07.pddl
1.0000 1.0000 0.0 0.8457 0.8457 0.0
p08.pddl
1.0000 1.0000 0.0 0.7798 0.7798 0.0
p09.pddl
1.0000 1.0000 0.0 0.7229 0.7229 0.0
p10.pddl
0.9916 0.9916 0.0 0.7060 0.7060 0.0
p11.pddl
1.0000 1.0000 0.0 0.6907 0.6907 0.0
p12.pddl
1.0000 1.0000 0.0 0.6803 0.6803 0.0
p13.pddl
0.9627 0.9627 0.0 0.6194 0.6194 0.0
p14.pddl
0.8988 0.8988 0.0 0.3821 0.3821 0.0
p15.pddl
0.7861 0.7861 0.0 0.3336 0.3336 0.0
p16.pddl
0.8754 0.8754 0.0 0.3379 0.3379 0.0
p17.pddl
0.7730 0.7730 0.0 0.1793 0.1793 0.0
p18.pddl
0.7396 0.7396 0.0 0.3236 0.3236 0.0
p19.pddl
0.7249 0.7249 0.0 0.2216 0.2216 0.0
p20.pddl
0.6420 0.6420 0.0 0.1693 0.1693 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
score_generated
Show table
The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8044 0.8044 0.0 0.0757 0.0757 0.0
p02.pddl
0.6371 0.6371 0.0 0.0574 0.0574 0.0
p03.pddl
0.7693 0.7693 0.0 0.0408 0.0408 0.0
p04.pddl
0.7534 0.7534 0.0 0.0511 0.0511 0.0
p05.pddl
0.7730 0.7730 0.0 0.0709 0.0709 0.0
p06.pddl
0.7860 0.7860 0.0 -0.0000 -0.0000 0.0
p07.pddl
0.6047 0.6047 0.0 0.0678 0.0678 0.0
p08.pddl
0.7592 0.7592 0.0 0.0260 0.0260 0.0
p09.pddl
0.7540 0.7540 0.0 0.0109 0.0109 0.0
p10.pddl
0.5952 0.5952 0.0 0.0926 0.0926 0.0
p11.pddl
0.7279 0.7279 0.0 0.0382 0.0382 0.0
p12.pddl
0.6826 0.6826 0.0 0.0357 0.0357 0.0
p13.pddl
0.7187 0.7187 0.0 0.0869 0.0869 0.0
p14.pddl
0.7422 0.7422 0.0 0.0574 0.0574 0.0
p15.pddl
0.6093 0.6093 0.0 0.0045 0.0045 0.0
p16.pddl
0.7323 0.7323 0.0 0.0411 0.0411 0.0
p17.pddl
0.7127 0.7127 0.0 0.0385 0.0385 0.0
p18.pddl
0.5303 0.5303 0.0 0.0200 0.0200 0.0
p19.pddl
0.7252 0.7252 0.0 0.0754 0.0754 0.0
p20.pddl
0.6772 0.6772 0.0 0.0364 0.0364 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
airport
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-airport1-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-airport1-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-airport2-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-airport2-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-airport2-p2.pddl
0.9658 0.9658 0.0 0.9916 0.9916 0.0
p07-airport2-p2.pddl
0.9715 0.9715 0.0 0.9784 0.9784 0.0
p08-airport2-p3.pddl
0.7092 0.7092 0.0 0.7550 0.7550 0.0
p09-airport2-p4.pddl
0.6660 0.6660 0.0 0.3756 0.3756 0.0
p10-airport3-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-airport3-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-airport3-p2.pddl
0.8992 0.8992 0.0 0.9978 0.9978 0.0
p13-airport3-p2.pddl
0.9490 0.9490 0.0 0.9968 0.9968 0.0
p14-airport3-p3.pddl
0.4858 0.4858 0.0 0.9023 0.9023 0.0
p15-airport3-p3.pddl
0.7133 0.7133 0.0 0.8173 0.8173 0.0
p16-airport3-p4.pddl
0.2629 0.2629 0.0 0.3455 0.3455 0.0
p17-airport3-p5.pddl
0.4026 0.4026 0.0 0.0010 0.0010 0.0
p18-airport3-p6.pddl
0.2706 0.2706 0.0 -0.0000 -0.0000 0.0
p19-airport3-p6.pddl
0.3834 0.3834 0.0 -0.0000 -0.0000 0.0
p20-airport3-p7.pddl
0.1793 0.1793 0.0 -0.0000 -0.0000 0.0
p21-airport4halfMUC-p2.pddl
0.7336 0.7336 0.0 0.8818 0.8818 0.0
p22-airport4halfMUC-p3.pddl
0.1817 0.1817 0.0 0.7909 0.7909 0.0
p23-airport4halfMUC-p4.pddl
0.1276 0.1276 0.0 0.7478 0.7478 0.0
p24-airport4halfMUC-p4.pddl
0.1503 0.1503 0.0 0.7405 0.7405 0.0
p25-airport4halfMUC-p5.pddl
0.1220 0.1220 0.0 0 0 0.0
p26-airport4halfMUC-p6.pddl
0 0 0.0 0 0 0.0
p27-airport4halfMUC-p6.pddl
0.1283 0.1283 0.0 0 0 0.0
p28-airport4halfMUC-p7.pddl
0 0 0.0 0 0 0.0
p29-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p30-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p31-airport4halfMUC-p9.pddl
0 0 0.0 0 0 0.0
p32-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p33-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p34-airport4halfMUC-p11.pddl
0 0 0.0 0 0 0.0
p35-airport4halfMUC-p12.pddl
0 0 0.0 0 0 0.0
p36-airport5MUC-p2.pddl
0.8747 0.8747 0.0 0.7148 0.7148 0.0
p37-airport5MUC-p3.pddl
0.1996 0.1996 0.0 -0.0000 -0.0000 0.0
p38-airport5MUC-p3.pddl
0.1668 0.1668 0.0 0.1649 0.1649 0.0
p39-airport5MUC-p4.pddl
0.1815 0.1815 0.0 0 0 0.0
p40-airport5MUC-p4.pddl
0.3899 0.3899 0.0 -0.0000 -0.0000 0.0
p41-airport5MUC-p4.pddl
0.1500 0.1500 0.0 0 0 0.0
p42-airport5MUC-p5.pddl
0 0 0.0 0 0 0.0
p43-airport5MUC-p5.pddl
0.1429 0.1429 0.0 0.0629 0.0629 0.0
p44-airport5MUC-p5.pddl
0.1212 0.1212 0.0 0 0 0.0
p45-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p46-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p47-airport5MUC-p8.pddl
0 0 0.0 0 0 0.0
p48-airport5MUC-p9.pddl
0 0 0.0 0 0 0.0
p49-airport5MUC-p10.pddl
0 0 0.0 0 0 0.0
p50-airport5MUC-p15.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
barman-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
0.5642 0.5642 0.0 0.3069 0.3069 0.0
pfile01-002.pddl
0.6443 0.6443 0.0 0.3361 0.3361 0.0
pfile01-003.pddl
0.6433 0.6433 0.0 0.3363 0.3363 0.0
pfile01-004.pddl
0.6422 0.6422 0.0 0.3361 0.3361 0.0
pfile02-005.pddl
0.5412 0.5412 0.0 0.1750 0.1750 0.0
pfile02-006.pddl
0.5749 0.5749 0.0 -0.0000 -0.0000 0.0
pfile02-007.pddl
0.5498 0.5498 0.0 0.1754 0.1754 0.0
pfile02-008.pddl
0.5529 0.5529 0.0 0.1483 0.1483 0.0
pfile03-009.pddl
0.4954 0.4954 0.0 0.0311 0.0311 0.0
pfile03-010.pddl
0.4372 0.4372 0.0 0.0304 0.0304 0.0
pfile03-011.pddl
0.4851 0.4851 0.0 0.0211 0.0211 0.0
pfile03-012.pddl
0.4436 0.4436 0.0 0.0210 0.0210 0.0
pfile04-013.pddl
0.4095 0.4095 0.0 -0.0000 -0.0000 0.0
pfile04-014.pddl
0.4006 0.4006 0.0 -0.0000 -0.0000 0.0
pfile04-015.pddl
0.3723 0.3723 0.0 -0.0000 -0.0000 0.0
pfile04-016.pddl
0.3707 0.3707 0.0 -0.0000 -0.0000 0.0
pfile05-017.pddl
0.3724 0.3724 0.0 -0.0000 -0.0000 0.0
pfile05-018.pddl
0.3751 0.3751 0.0 -0.0000 -0.0000 0.0
pfile05-019.pddl
0.3724 0.3724 0.0 -0.0000 -0.0000 0.0
pfile05-020.pddl
0.3887 0.3887 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
barman-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
0.5420 0.5420 0.0 -0.0000 -0.0000 0.0
p435-2.pddl
0.4945 0.4945 0.0 0.1737 0.1737 0.0
p435-3.pddl
0.5427 0.5427 0.0 -0.0000 -0.0000 0.0
p536-1.pddl
0.4893 0.4893 0.0 -0.0000 -0.0000 0.0
p536-2.pddl
0.4381 0.4381 0.0 0.0303 0.0303 0.0
p536-3.pddl
0.4955 0.4955 0.0 0.0311 0.0311 0.0
p638-1.pddl
0.4297 0.4297 0.0 -0.0000 -0.0000 0.0
p638-2.pddl
0.4581 0.4581 0.0 -0.0000 -0.0000 0.0
p638-3.pddl
0.3954 0.3954 0.0 -0.0000 -0.0000 0.0
p739-1.pddl
0.3925 0.3925 0.0 -0.0000 -0.0000 0.0
p739-2.pddl
0.3343 0.3343 0.0 -0.0000 -0.0000 0.0
p739-3.pddl
0.3712 0.3712 0.0 -0.0000 -0.0000 0.0
p839-1.pddl
0.3300 0.3300 0.0 -0.0000 -0.0000 0.0
p839-2.pddl
0.3433 0.3433 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
blocks
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-1.pddl
1.0000 1.0000 0.0 0.9200 0.9200 0.0
probBLOCKS-5-2.pddl
0.9820 0.9820 0.0 0.8700 0.8700 0.0
probBLOCKS-6-0.pddl
1.0000 1.0000 0.0 0.8411 0.8411 0.0
probBLOCKS-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-6-2.pddl
0.9247 0.9247 0.0 0.9169 0.9169 0.0
probBLOCKS-7-0.pddl
0.9430 0.9430 0.0 0.6787 0.6787 0.0
probBLOCKS-7-1.pddl
0.8634 0.8634 0.0 0.6751 0.6751 0.0
probBLOCKS-7-2.pddl
0.8730 0.8730 0.0 0.7401 0.7401 0.0
probBLOCKS-8-0.pddl
0.8867 0.8867 0.0 0.7764 0.7764 0.0
probBLOCKS-8-1.pddl
0.9036 0.9036 0.0 0.6206 0.6206 0.0
probBLOCKS-8-2.pddl
0.9350 0.9350 0.0 0.8455 0.8455 0.0
probBLOCKS-9-0.pddl
0.7701 0.7701 0.0 0.5794 0.5794 0.0
probBLOCKS-9-1.pddl
0.7499 0.7499 0.0 0.5731 0.5731 0.0
probBLOCKS-9-2.pddl
0.8357 0.8357 0.0 0.5974 0.5974 0.0
probBLOCKS-10-0.pddl
0.7508 0.7508 0.0 0.8062 0.8062 0.0
probBLOCKS-10-1.pddl
0.7487 0.7487 0.0 0.4480 0.4480 0.0
probBLOCKS-10-2.pddl
0.7180 0.7180 0.0 0.5115 0.5115 0.0
probBLOCKS-11-0.pddl
0.8442 0.8442 0.0 0.5382 0.5382 0.0
probBLOCKS-11-1.pddl
0.7118 0.7118 0.0 0.4125 0.4125 0.0
probBLOCKS-11-2.pddl
0.7986 0.7986 0.0 0.6045 0.6045 0.0
probBLOCKS-12-0.pddl
0.7207 0.7207 0.0 0.4954 0.4954 0.0
probBLOCKS-12-1.pddl
0.7126 0.7126 0.0 0.4131 0.4131 0.0
probBLOCKS-13-0.pddl
0.5899 0.5899 0.0 0.4724 0.4724 0.0
probBLOCKS-13-1.pddl
0.6210 0.6210 0.0 0.4647 0.4647 0.0
probBLOCKS-14-0.pddl
0.7432 0.7432 0.0 0.5220 0.5220 0.0
probBLOCKS-14-1.pddl
0.6759 0.6759 0.0 0.4400 0.4400 0.0
probBLOCKS-15-0.pddl
0.5456 0.5456 0.0 0.3751 0.3751 0.0
probBLOCKS-15-1.pddl
0.6793 0.6793 0.0 0.1365 0.1365 0.0
probBLOCKS-16-1.pddl
0.5939 0.5939 0.0 0.3210 0.3210 0.0
probBLOCKS-16-2.pddl
0.4385 0.4385 0.0 0.3341 0.3341 0.0
probBLOCKS-17-0.pddl
0.4104 0.4104 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
childsnack-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
0.4394 0.4394 0.0 -0.0000 -0.0000 0.0
child-snack_pfile01.pddl
0.5004 0.5004 0.0 -0.0000 -0.0000 0.0
child-snack_pfile02-2.pddl
0.3635 0.3635 0.0 -0.0000 -0.0000 0.0
child-snack_pfile02.pddl
0.4246 0.4246 0.0 -0.0000 -0.0000 0.0
child-snack_pfile03-2.pddl
0.2476 0.2476 0.0 -0.0000 -0.0000 0.0
child-snack_pfile03.pddl
0.2674 0.2674 0.0 -0.0000 -0.0000 0.0
child-snack_pfile04-2.pddl
0.2205 0.2205 0.0 0 0 0.0
child-snack_pfile04.pddl
0.2041 0.2041 0.0 0 0 0.0
child-snack_pfile05-2.pddl
0.1673 0.1673 0.0 0 0 0.0
child-snack_pfile05.pddl
0.1658 0.1658 0.0 0 0 0.0
child-snack_pfile06-2.pddl
0.1271 0.1271 0.0 0 0 0.0
child-snack_pfile06.pddl
0.1156 0.1156 0.0 0 0 0.0
child-snack_pfile07-2.pddl
0.0813 0.0813 0.0 0 0 0.0
child-snack_pfile07.pddl
0.0521 0.0521 0.0 0 0 0.0
child-snack_pfile08-2.pddl
0.0452 0.0452 0.0 0 0 0.0
child-snack_pfile08.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
data-network-opt18-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8409 0.8409 0.0 0.8357 0.8357 0.0
p02.pddl
1.0000 1.0000 0.0 0.8637 0.8637 0.0
p03.pddl
0.9386 0.9386 0.0 0.6038 0.6038 0.0
p04.pddl
0.9036 0.9036 0.0 0.7641 0.7641 0.0
p05.pddl
0.8684 0.8684 0.0 0.5308 0.5308 0.0
p06.pddl
0.9221 0.9221 0.0 0.5474 0.5474 0.0
p07.pddl
0.6455 0.6455 0.0 -0.0000 -0.0000 0.0
p08.pddl
0.2588 0.2588 0.0 0.4262 0.4262 0.0
p09.pddl
0.8571 0.8571 0.0 0.5982 0.5982 0.0
p10.pddl
0.9437 0.9437 0.0 0.7635 0.7635 0.0
p11.pddl
0.9724 0.9724 0.0 0.5784 0.5784 0.0
p12.pddl
0.9766 0.9766 0.0 0.5763 0.5763 0.0
p13.pddl
0.9399 0.9399 0.0 0.7124 0.7124 0.0
p14.pddl
0.3267 0.3267 0.0 0.5548 0.5548 0.0
p15.pddl
0.9110 0.9110 0.0 0.4587 0.4587 0.0
p16.pddl
0.5339 0.5339 0.0 0.1873 0.1873 0.0
p17.pddl
0.8772 0.8772 0.0 0.4279 0.4279 0.0
p18.pddl
0.1529 0.1529 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.7313 0.7313 0.0 0.0274 0.0274 0.0
p20.pddl
0.2800 0.2800 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
depot
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9811 0.9811 0.0 0.8822 0.8822 0.0
p02.pddl
0.8697 0.8697 0.0 0.8536 0.8536 0.0
p03.pddl
0.3953 0.3953 0.0 0.3252 0.3252 0.0
p04.pddl
0.4604 0.4604 0.0 0.6899 0.6899 0.0
p05.pddl
0.0645 0.0645 0.0 0.6467 0.6467 0.0
p06.pddl
-0.0000 -0.0000 0.0 0.5807 0.5807 0.0
p07.pddl
0.5759 0.5759 0.0 0.0079 0.0079 0.0
p08.pddl
0.2918 0.2918 0.0 0.4178 0.4178 0.0
p09.pddl
0.1281 0.1281 0.0 -0.0000 -0.0000 0.0
p10.pddl
0.2344 0.2344 0.0 0.4156 0.4156 0.0
p11.pddl
0.1533 0.1533 0.0 0.4127 0.4127 0.0
p12.pddl
0.0719 0.0719 0.0 0 0 0.0
p13.pddl
0.6999 0.6999 0.0 0.6688 0.6688 0.0
p14.pddl
0.5065 0.5065 0.0 -0.0000 -0.0000 0.0
p15.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p16.pddl
0.6295 0.6295 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.6451 0.6451 0.0 0.1820 0.1820 0.0
p18.pddl
0.4163 0.4163 0.0 0 0 0.0
p19.pddl
0.0864 0.0864 0.0 -0.0000 -0.0000 0.0
p20.pddl
0 0 0.0 0.0051 0.0051 0.0
p21.pddl
0.4491 0.4491 0.0 -0.0000 -0.0000 0.0
p22.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
driverlog
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.3524 0.3524 0.0 0.6808 0.6808 0.0
p03.pddl
0.9332 0.9332 0.0 0.7417 0.7417 0.0
p04.pddl
0.3326 0.3326 0.0 0.5803 0.5803 0.0
p05.pddl
0.3096 0.3096 0.0 0.3590 0.3590 0.0
p06.pddl
0.5317 0.5317 0.0 0.8343 0.8343 0.0
p07.pddl
0.8091 0.8091 0.0 0.6733 0.6733 0.0
p08.pddl
0.2597 0.2597 0.0 0.5635 0.5635 0.0
p09.pddl
0.5440 0.5440 0.0 0.6218 0.6218 0.0
p10.pddl
0.7662 0.7662 0.0 0.5682 0.5682 0.0
p11.pddl
0.6959 0.6959 0.0 0.6085 0.6085 0.0
p12.pddl
0.2429 0.2429 0.0 0.5547 0.5547 0.0
p13.pddl
0.3263 0.3263 0.0 0.5365 0.5365 0.0
p14.pddl
0.6408 0.6408 0.0 0.4216 0.4216 0.0
p15.pddl
0.5839 0.5839 0.0 0.1783 0.1783 0.0
p16.pddl
0.0174 0.0174 0.0 0.0098 0.0098 0.0
p17.pddl
0.3366 0.3366 0.0 0 0 0.0
p18.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p19.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p20.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
elevators-opt08-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.7616 0.7616 0.0 0.5217 0.5217 0.0
p02.pddl
0.8890 0.8890 0.0 0.6070 0.6070 0.0
p03.pddl
0.7752 0.7752 0.0 0.6049 0.6049 0.0
p04.pddl
0.7246 0.7246 0.0 0.3048 0.3048 0.0
p05.pddl
0.7199 0.7199 0.0 0.4478 0.4478 0.0
p06.pddl
0.6555 0.6555 0.0 0.3226 0.3226 0.0
p07.pddl
0.6760 0.6760 0.0 0.4700 0.4700 0.0
p08.pddl
0.7411 0.7411 0.0 0.3771 0.3771 0.0
p09.pddl
0.6088 0.6088 0.0 0.3063 0.3063 0.0
p10.pddl
0.6177 0.6177 0.0 0.3307 0.3307 0.0
p11.pddl
0.7543 0.7543 0.0 0.4603 0.4603 0.0
p12.pddl
0.7111 0.7111 0.0 0.4288 0.4288 0.0
p13.pddl
0.7466 0.7466 0.0 0.5425 0.5425 0.0
p14.pddl
0.6647 0.6647 0.0 0.3754 0.3754 0.0
p15.pddl
0.6828 0.6828 0.0 0.5038 0.5038 0.0
p16.pddl
0.5986 0.5986 0.0 0.2315 0.2315 0.0
p17.pddl
0.6081 0.6081 0.0 0.4871 0.4871 0.0
p18.pddl
0.6503 0.6503 0.0 0.3216 0.3216 0.0
p19.pddl
0.6053 0.6053 0.0 0.3714 0.3714 0.0
p20.pddl
0.6339 0.6339 0.0 0.3808 0.3808 0.0
p21.pddl
0.7553 0.7553 0.0 0.2649 0.2649 0.0
p22.pddl
0.7544 0.7544 0.0 0.1697 0.1697 0.0
p23.pddl
0.7211 0.7211 0.0 0.2206 0.2206 0.0
p24.pddl
0.6278 0.6278 0.0 0.0779 0.0779 0.0
p25.pddl
0.6764 0.6764 0.0 0.2900 0.2900 0.0
p26.pddl
0.7317 0.7317 0.0 0.4584 0.4584 0.0
p27.pddl
0.5878 0.5878 0.0 0.2874 0.2874 0.0
p28.pddl
0.6251 0.6251 0.0 0.2470 0.2470 0.0
p29.pddl
0.5887 0.5887 0.0 0.2435 0.2435 0.0
p30.pddl
0.5399 0.5399 0.0 0.0225 0.0225 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
elevators-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.7543 0.7543 0.0 0.4603 0.4603 0.0
p02.pddl
0.7553 0.7553 0.0 0.2649 0.2649 0.0
p03.pddl
0.7111 0.7111 0.0 0.4288 0.4288 0.0
p04.pddl
0.7752 0.7752 0.0 0.6049 0.6049 0.0
p05.pddl
0.7466 0.7466 0.0 0.5425 0.5425 0.0
p06.pddl
0.7246 0.7246 0.0 0.3048 0.3048 0.0
p07.pddl
0.7317 0.7317 0.0 0.4584 0.4584 0.0
p08.pddl
0.7199 0.7199 0.0 0.4478 0.4478 0.0
p09.pddl
0.7544 0.7544 0.0 0.1697 0.1697 0.0
p10.pddl
0.6647 0.6647 0.0 0.3754 0.3754 0.0
p11.pddl
0.6251 0.6251 0.0 0.2470 0.2470 0.0
p12.pddl
0.6555 0.6555 0.0 0.3226 0.3226 0.0
p13.pddl
0.6760 0.6760 0.0 0.4700 0.4700 0.0
p14.pddl
0.7411 0.7411 0.0 0.3771 0.3771 0.0
p15.pddl
0.6088 0.6088 0.0 0.3063 0.3063 0.0
p16.pddl
0.6828 0.6828 0.0 0.5038 0.5038 0.0
p17.pddl
0.6081 0.6081 0.0 0.4871 0.4871 0.0
p18.pddl
0.6503 0.6503 0.0 0.3216 0.3216 0.0
p19.pddl
0.7211 0.7211 0.0 0.2206 0.2206 0.0
p20.pddl
0.6278 0.6278 0.0 0.0779 0.0779 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
floortile-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
0.4796 0.4796 0.0 -0.0000 -0.0000 0.0
opt-p01-002.pddl
0.7792 0.7792 0.0 -0.0000 -0.0000 0.0
opt-p02-003.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p02-004.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p03-005.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p03-006.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p04-007.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p04-008.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p05-009.pddl
-0.0000 -0.0000 0.0 0 0 0.0
opt-p05-010.pddl
0 0 0.0 0 0 0.0
opt-p06-011.pddl
0 0 0.0 0 0 0.0
opt-p06-012.pddl
0 0 0.0 0 0 0.0
opt-p07-013.pddl
0 0 0.0 0 0 0.0
opt-p07-014.pddl
0 0 0.0 0 0 0.0
opt-p08-015.pddl
0 0 0.0 0 0 0.0
opt-p08-016.pddl
0 0 0.0 0 0 0.0
opt-p09-017.pddl
0 0 0.0 0 0 0.0
opt-p09-018.pddl
0 0 0.0 0 0 0.0
opt-p10-019.pddl
0 0 0.0 0 0 0.0
opt-p10-020.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
floortile-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p01-4-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p01-5-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p01-5-4-2.pddl
0 0 0.0 0 0 0.0
p01-5-5-2.pddl
0 0 0.0 0 0 0.0
p01-6-4-2.pddl
0 0 0.0 0 0 0.0
p01-6-5-2.pddl
0 0 0.0 0 0 0.0
p02-4-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p02-5-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p02-5-4-2.pddl
0 0 0.0 0 0 0.0
p02-5-5-2.pddl
0 0 0.0 0 0 0.0
p02-6-4-2.pddl
0 0 0.0 0 0 0.0
p02-6-5-2.pddl
0 0 0.0 0 0 0.0
p03-4-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-4-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-5-3-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-5-4-2.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p03-5-5-2.pddl
0 0 0.0 0 0 0.0
p03-6-4-2.pddl
0 0 0.0 0 0 0.0
p03-6-5-2.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
freecell
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
0.9666 0.9666 0.0 0.9503 0.9503 0.0
p04.pddl
0.8479 0.8479 0.0 0.9091 0.9091 0.0
p05.pddl
0.9040 0.9040 0.0 0.9063 0.9063 0.0
p06.pddl
0.8103 0.8103 0.0 0.8730 0.8730 0.0
p07.pddl
0.5800 0.5800 0.0 0.4959 0.4959 0.0
p08.pddl
0.8078 0.8078 0.0 0.8311 0.8311 0.0
p09.pddl
0.8000 0.8000 0.0 0.8455 0.8455 0.0
p10.pddl
0.6412 0.6412 0.0 0.7676 0.7676 0.0
p11.pddl
0.4897 0.4897 0.0 0.5018 0.5018 0.0
p12.pddl
0.7849 0.7849 0.0 0.8421 0.8421 0.0
p13.pddl
0.4570 0.4570 0.0 0.7275 0.7275 0.0
p14.pddl
0.7371 0.7371 0.0 0.6295 0.6295 0.0
p15.pddl
0.6720 0.6720 0.0 0.7756 0.7756 0.0
p16.pddl
0.6580 0.6580 0.0 0.6334 0.6334 0.0
p17.pddl
0.7077 0.7077 0.0 0.7775 0.7775 0.0
p18.pddl
0.5811 0.5811 0.0 0.2479 0.2479 0.0
p19.pddl
0.3128 0.3128 0.0 0.2445 0.2445 0.0
p20.pddl
0.6343 0.6343 0.0 0.2995 0.2995 0.0
probfreecell-2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-1.pddl
0.9887 0.9887 0.0 0.9937 0.9937 0.0
probfreecell-3-2.pddl
0.9690 0.9690 0.0 0.9658 0.9658 0.0
probfreecell-3-3.pddl
0.9699 0.9699 0.0 0.9749 0.9749 0.0
probfreecell-3-4.pddl
0.9650 0.9650 0.0 0.9574 0.9574 0.0
probfreecell-3-5.pddl
0.9682 0.9682 0.0 0.9682 0.9682 0.0
probfreecell-4-1.pddl
0.9174 0.9174 0.0 0.9275 0.9275 0.0
probfreecell-4-2.pddl
0.9326 0.9326 0.0 0.9303 0.9303 0.0
probfreecell-4-3.pddl
0.9326 0.9326 0.0 0.9326 0.9326 0.0
probfreecell-4-4.pddl
0.9129 0.9129 0.0 0.9134 0.9134 0.0
probfreecell-4-5.pddl
0.9247 0.9247 0.0 0.9247 0.9247 0.0
probfreecell-5-1.pddl
0.8151 0.8151 0.0 0.8655 0.8655 0.0
probfreecell-5-2.pddl
0.8772 0.8772 0.0 0.8837 0.8837 0.0
probfreecell-5-3.pddl
0.9082 0.9082 0.0 0.8975 0.8975 0.0
probfreecell-5-4.pddl
0.8634 0.8634 0.0 0.8765 0.8765 0.0
probfreecell-5-5.pddl
0.8694 0.8694 0.0 0.8890 0.8890 0.0
probfreecell-6-1.pddl
0.8450 0.8450 0.0 0.8568 0.8568 0.0
probfreecell-6-2.pddl
0.8720 0.8720 0.0 0.8606 0.8606 0.0
probfreecell-6-3.pddl
0.8414 0.8414 0.0 0.8577 0.8577 0.0
probfreecell-6-4.pddl
0.8434 0.8434 0.0 0.8548 0.8548 0.0
probfreecell-6-5.pddl
0.8244 0.8244 0.0 0.8457 0.8457 0.0
probfreecell-7-1.pddl
0.7805 0.7805 0.0 0.8253 0.8253 0.0
probfreecell-7-2.pddl
0.8579 0.8579 0.0 0.8539 0.8539 0.0
probfreecell-7-3.pddl
0.7511 0.7511 0.0 0.8206 0.8206 0.0
probfreecell-7-4.pddl
0.7766 0.7766 0.0 0.8139 0.8139 0.0
probfreecell-7-5.pddl
0.7849 0.7849 0.0 0.7935 0.7935 0.0
probfreecell-8-1.pddl
0.7214 0.7214 0.0 0.8331 0.8331 0.0
probfreecell-8-2.pddl
0.7664 0.7664 0.0 0.8126 0.8126 0.0
probfreecell-8-3.pddl
0.7447 0.7447 0.0 0.8255 0.8255 0.0
probfreecell-8-4.pddl
0.7831 0.7831 0.0 0.8084 0.8084 0.0
probfreecell-8-5.pddl
0.6988 0.6988 0.0 0.7792 0.7792 0.0
probfreecell-9-1.pddl
0.7018 0.7018 0.0 0.7706 0.7706 0.0
probfreecell-9-2.pddl
0.7227 0.7227 0.0 0.7689 0.7689 0.0
probfreecell-9-3.pddl
0.7542 0.7542 0.0 0.8040 0.8040 0.0
probfreecell-9-4.pddl
0.7240 0.7240 0.0 0.7864 0.7864 0.0
probfreecell-9-5.pddl
0.6988 0.6988 0.0 0.7224 0.7224 0.0
probfreecell-10-1.pddl
0.5276 0.5276 0.0 0.5605 0.5605 0.0
probfreecell-10-2.pddl
0.7143 0.7143 0.0 0.6630 0.6630 0.0
probfreecell-10-3.pddl
0.6863 0.6863 0.0 0.4495 0.4495 0.0
probfreecell-10-4.pddl
0.6790 0.6790 0.0 0.4873 0.4873 0.0
probfreecell-10-5.pddl
0.6341 0.6341 0.0 0.7088 0.7088 0.0
probfreecell-11-1.pddl
0.6789 0.6789 0.0 0.3229 0.3229 0.0
probfreecell-11-2.pddl
0.6320 0.6320 0.0 0.1936 0.1936 0.0
probfreecell-11-3.pddl
0.6831 0.6831 0.0 0.3751 0.3751 0.0
probfreecell-11-4.pddl
0.6667 0.6667 0.0 0.6888 0.6888 0.0
probfreecell-11-5.pddl
0 0 0.0 0.6778 0.6778 0.0
probfreecell-12-1.pddl
0.2666 0.2666 0.0 0.2739 0.2739 0.0
probfreecell-12-2.pddl
0.6183 0.6183 0.0 0.4296 0.4296 0.0
probfreecell-12-3.pddl
0.7253 0.7253 0.0 0.4539 0.4539 0.0
probfreecell-12-4.pddl
0.6322 0.6322 0.0 0.3906 0.3906 0.0
probfreecell-12-5.pddl
-0.0000 -0.0000 0.0 0.3273 0.3273 0.0
probfreecell-13-1.pddl
0.2316 0.2316 0.0 0.2950 0.2950 0.0
probfreecell-13-2.pddl
0.2684 0.2684 0.0 0.2604 0.2604 0.0
probfreecell-13-3.pddl
0.6451 0.6451 0.0 0.4272 0.4272 0.0
probfreecell-13-4.pddl
0.4115 0.4115 0.0 0.4713 0.4713 0.0
probfreecell-13-5.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
ged-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-8.pddl
0.9699 0.9699 0.0 0.9674 0.9674 0.0
d-3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-4.pddl
0.9612 0.9612 0.0 0.9740 0.9740 0.0
d-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-3.pddl
0.9619 0.9619 0.0 0.9732 0.9732 0.0
d-4-8.pddl
0.9699 0.9699 0.0 0.9674 0.9674 0.0
d-7-5.pddl
0.9968 0.9968 0.0 0.9989 0.9989 0.0
d-7-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-1.pddl
1.0000 1.0000 0.0 0.9968 0.9968 0.0
d-8-2.pddl
0.9699 0.9699 0.0 0.9627 0.9627 0.0
d-8-4.pddl
0.9674 0.9674 0.0 0.9642 0.9642 0.0
d-8-9.pddl
0.8761 0.8761 0.0 0.9154 0.9154 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
grid
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 0.9332 0.9332 0.0
prob02.pddl
0.8975 0.8975 0.0 0.5971 0.5971 0.0
prob03.pddl
0.7478 0.7478 0.0 0 0 0.0
prob04.pddl
0.8080 0.8080 0.0 0.5957 0.5957 0.0
prob05.pddl
0.6481 0.6481 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
gripper
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
0.9766 0.9766 0.0 0.8971 0.8971 0.0
prob03.pddl
0.9231 0.9231 0.0 0.8183 0.8183 0.0
prob04.pddl
0.8807 0.8807 0.0 0.7549 0.7549 0.0
prob05.pddl
0.8455 0.8455 0.0 0.7018 0.7018 0.0
prob06.pddl
0.8153 0.8153 0.0 0.6561 0.6561 0.0
prob07.pddl
0.7889 0.7889 0.0 0.6161 0.6161 0.0
prob08.pddl
0.7654 0.7654 0.0 0.5804 0.5804 0.0
prob09.pddl
0.7442 0.7442 0.0 0.5483 0.5483 0.0
prob10.pddl
0.7249 0.7249 0.0 0.5190 0.5190 0.0
prob11.pddl
0.7072 0.7072 0.0 0.4922 0.4922 0.0
prob12.pddl
0.6909 0.6909 0.0 0.4674 0.4674 0.0
prob13.pddl
0.6757 0.6757 0.0 0.4443 0.4443 0.0
prob14.pddl
0.6615 0.6615 0.0 0.4228 0.4228 0.0
prob15.pddl
0.6482 0.6482 0.0 0.4026 0.4026 0.0
prob16.pddl
0.6356 0.6356 0.0 0.3836 0.3836 0.0
prob17.pddl
0.6237 0.6237 0.0 0.3656 0.3656 0.0
prob18.pddl
0.6125 0.6125 0.0 0.3486 0.3486 0.0
prob19.pddl
0.6018 0.6018 0.0 0.3324 0.3324 0.0
prob20.pddl
0.5916 0.5916 0.0 0.3170 0.3170 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
hiking-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
0.7457 0.7457 0.0 0.6511 0.6511 0.0
ptesting-1-2-4.pddl
0.5395 0.5395 0.0 0.4774 0.4774 0.0
ptesting-1-2-5.pddl
0.3953 0.3953 0.0 0.3468 0.3468 0.0
ptesting-1-2-7.pddl
0.2116 0.2116 0.0 0.1349 0.1349 0.0
ptesting-1-2-8.pddl
0.1387 0.1387 0.0 0.0531 0.0531 0.0
ptesting-2-2-3.pddl
0.7629 0.7629 0.0 0.2925 0.2925 0.0
ptesting-2-2-4.pddl
0.2846 0.2846 0.0 0.0398 0.0398 0.0
ptesting-2-2-5.pddl
0.2007 0.2007 0.0 -0.0000 -0.0000 0.0
ptesting-2-2-6.pddl
0.1321 0.1321 0.0 -0.0000 -0.0000 0.0
ptesting-2-2-7.pddl
0.0469 0.0469 0.0 -0.0000 -0.0000 0.0
ptesting-2-2-8.pddl
0.0188 0.0188 0.0 -0.0000 -0.0000 0.0
ptesting-2-3-4.pddl
0.2364 0.2364 0.0 0.0368 0.0368 0.0
ptesting-2-3-5.pddl
0.1547 0.1547 0.0 -0.0000 -0.0000 0.0
ptesting-2-3-6.pddl
0.0895 0.0895 0.0 -0.0000 -0.0000 0.0
ptesting-2-3-7.pddl
0.0118 0.0118 0.0 -0.0000 -0.0000 0.0
ptesting-2-4-3.pddl
0.7386 0.7386 0.0 0.1749 0.1749 0.0
ptesting-2-4-4.pddl
0.2270 0.2270 0.0 -0.0000 -0.0000 0.0
ptesting-2-4-5.pddl
0.1002 0.1002 0.0 -0.0000 -0.0000 0.0
ptesting-2-4-6.pddl
0.0733 0.0733 0.0 -0.0000 -0.0000 0.0
ptesting-2-4-7.pddl
0.0138 0.0138 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
logistics00
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
0.8988 0.8988 0.0 0.8992 0.8992 0.0
probLOGISTICS-4-1.pddl
0.8852 0.8852 0.0 0.9362 0.9362 0.0
probLOGISTICS-4-2.pddl
0.9424 0.9424 0.0 0.9635 0.9635 0.0
probLOGISTICS-5-0.pddl
0.8308 0.8308 0.0 0.8761 0.8761 0.0
probLOGISTICS-5-1.pddl
0.9159 0.9159 0.0 0.9315 0.9315 0.0
probLOGISTICS-5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-0.pddl
0.8357 0.8357 0.0 0.8800 0.8800 0.0
probLOGISTICS-6-1.pddl
0.9159 0.9159 0.0 0.9386 0.9386 0.0
probLOGISTICS-6-2.pddl
0.8225 0.8225 0.0 0.8765 0.8765 0.0
probLOGISTICS-6-9.pddl
0.8268 0.8268 0.0 0.8837 0.8837 0.0
probLOGISTICS-7-0.pddl
0.7277 0.7277 0.0 0.7824 0.7824 0.0
probLOGISTICS-7-1.pddl
0.6726 0.6726 0.0 0.7524 0.7524 0.0
probLOGISTICS-8-0.pddl
0.7675 0.7675 0.0 0.8000 0.8000 0.0
probLOGISTICS-8-1.pddl
0.6917 0.6917 0.0 0.7424 0.7424 0.0
probLOGISTICS-9-0.pddl
0.7185 0.7185 0.0 0.7521 0.7521 0.0
probLOGISTICS-9-1.pddl
0.7702 0.7702 0.0 0.7924 0.7924 0.0
probLOGISTICS-10-0.pddl
0.6323 0.6323 0.0 0.7045 0.7045 0.0
probLOGISTICS-10-1.pddl
0.6729 0.6729 0.0 0.7074 0.7074 0.0
probLOGISTICS-11-0.pddl
0.6384 0.6384 0.0 0.6775 0.6775 0.0
probLOGISTICS-11-1.pddl
0.5743 0.5743 0.0 0.6650 0.6650 0.0
probLOGISTICS-12-0.pddl
0.6482 0.6482 0.0 0.7021 0.7021 0.0
probLOGISTICS-12-1.pddl
0.5591 0.5591 0.0 0.6299 0.6299 0.0
probLOGISTICS-13-0.pddl
0.4682 0.4682 0.0 0.3203 0.3203 0.0
probLOGISTICS-13-1.pddl
0.4893 0.4893 0.0 0.3317 0.3317 0.0
probLOGISTICS-14-0.pddl
0.5259 0.5259 0.0 0.3109 0.3109 0.0
probLOGISTICS-14-1.pddl
0.4884 0.4884 0.0 0.2760 0.2760 0.0
probLOGISTICS-15-0.pddl
0.4373 0.4373 0.0 0.2739 0.2739 0.0
probLOGISTICS-15-1.pddl
0.4957 0.4957 0.0 0.2367 0.2367 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
logistics98
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.6782 0.6782 0.0 0.3242 0.3242 0.0
prob02.pddl
0.5298 0.5298 0.0 0.0017 0.0017 0.0
prob03.pddl
0.4380 0.4380 0.0 -0.0000 -0.0000 0.0
prob04.pddl
0.2993 0.2993 0.0 0 0 0.0
prob05.pddl
0.7170 0.7170 0.0 0.4811 0.4811 0.0
prob06.pddl
0.2333 0.2333 0.0 0 0 0.0
prob07.pddl
0.4592 0.4592 0.0 -0.0000 -0.0000 0.0
prob08.pddl
0.3892 0.3892 0.0 0 0 0.0
prob09.pddl
0.1546 0.1546 0.0 0 0 0.0
prob10.pddl
0.1694 0.1694 0.0 -0.0000 -0.0000 0.0
prob11.pddl
0.5296 0.5296 0.0 -0.0000 -0.0000 0.0
prob12.pddl
0.2662 0.2662 0.0 0 0 0.0
prob13.pddl
0.1665 0.1665 0.0 0 0 0.0
prob14.pddl
0.1480 0.1480 0.0 0 0 0.0
prob15.pddl
0.3023 0.3023 0.0 -0.0000 -0.0000 0.0
prob16.pddl
0.2787 0.2787 0.0 0 0 0.0
prob17.pddl
0.4101 0.4101 0.0 0 0 0.0
prob18.pddl
-0.0000 -0.0000 0.0 0 0 0.0
prob19.pddl
0.0094 0.0094 0.0 0 0 0.0
prob20.pddl
-0.0000 -0.0000 0.0 0 0 0.0
prob21.pddl
0.0260 0.0260 0.0 0 0 0.0
prob22.pddl
-0.0000 -0.0000 0.0 0 0 0.0
prob23.pddl
0.1994 0.1994 0.0 -0.0000 -0.0000 0.0
prob24.pddl
0.1968 0.1968 0.0 0 0 0.0
prob25.pddl
-0.0000 -0.0000 0.0 0 0 0.0
prob26.pddl
-0.0000 -0.0000 0.0 0 0 0.0
prob27.pddl
-0.0000 -0.0000 0.0 0 0 0.0
prob28.pddl
-0.0000 -0.0000 0.0 0 0 0.0
prob29.pddl
-0.0000 -0.0000 0.0 0 0 0.0
prob30.pddl
-0.0000 -0.0000 0.0 0 0 0.0
prob31.pddl
0.8717 0.8717 0.0 0.5597 0.5597 0.0
prob32.pddl
0.8159 0.8159 0.0 0.6723 0.6723 0.0
prob33.pddl
0.7219 0.7219 0.0 0.5285 0.5285 0.0
prob34.pddl
0.4408 0.4408 0.0 -0.0000 -0.0000 0.0
prob35.pddl
0.6453 0.6453 0.0 0.2516 0.2516 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
miconic
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-0.pddl
0.9916 0.9916 0.0 1.0000 1.0000 0.0
s3-1.pddl
0.9784 0.9784 0.0 1.0000 1.0000 0.0
s3-2.pddl
0.9897 0.9897 0.0 1.0000 1.0000 0.0
s3-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-4.pddl
0.9957 0.9957 0.0 1.0000 1.0000 0.0
s4-0.pddl
0.9430 0.9430 0.0 0.9399 0.9399 0.0
s4-1.pddl
0.9476 0.9476 0.0 0.9356 0.9356 0.0
s4-2.pddl
0.8882 0.8882 0.0 0.9368 0.9368 0.0
s4-3.pddl
0.8741 0.8741 0.0 0.9635 0.9635 0.0
s4-4.pddl
0.8724 0.8724 0.0 0.9356 0.9356 0.0
s5-0.pddl
0.8327 0.8327 0.0 0.8618 0.8618 0.0
s5-1.pddl
0.8320 0.8320 0.0 0.9100 0.9100 0.0
s5-2.pddl
0.8675 0.8675 0.0 0.9149 0.9149 0.0
s5-3.pddl
0.8878 0.8878 0.0 0.8754 0.8754 0.0
s5-4.pddl
0.8240 0.8240 0.0 0.8878 0.8878 0.0
s6-0.pddl
0.7867 0.7867 0.0 0.8442 0.8442 0.0
s6-1.pddl
0.8460 0.8460 0.0 0.8177 0.8177 0.0
s6-2.pddl
0.7778 0.7778 0.0 0.8283 0.8283 0.0
s6-3.pddl
0.8035 0.8035 0.0 0.8357 0.8357 0.0
s6-4.pddl
0.7818 0.7818 0.0 0.8122 0.8122 0.0
s7-0.pddl
0.7846 0.7846 0.0 0.7956 0.7956 0.0
s7-1.pddl
0.7273 0.7273 0.0 0.7718 0.7718 0.0
s7-2.pddl
0.8028 0.8028 0.0 0.8112 0.8112 0.0
s7-3.pddl
0.7574 0.7574 0.0 0.7805 0.7805 0.0
s7-4.pddl
0.7370 0.7370 0.0 0.8038 0.8038 0.0
s8-0.pddl
0.7442 0.7442 0.0 0.7710 0.7710 0.0
s8-1.pddl
0.7078 0.7078 0.0 0.7266 0.7266 0.0
s8-2.pddl
0.6890 0.6890 0.0 0.7731 0.7731 0.0
s8-3.pddl
0.6924 0.6924 0.0 0.7912 0.7912 0.0
s8-4.pddl
0.7202 0.7202 0.0 0.7866 0.7866 0.0
s9-0.pddl
0.6620 0.6620 0.0 0.7622 0.7622 0.0
s9-1.pddl
0.6580 0.6580 0.0 0.7757 0.7757 0.0
s9-2.pddl
0.6640 0.6640 0.0 0.7409 0.7409 0.0
s9-3.pddl
0.6785 0.6785 0.0 0.7484 0.7484 0.0
s9-4.pddl
0.6994 0.6994 0.0 0.7444 0.7444 0.0
s10-0.pddl
0.6357 0.6357 0.0 0.7125 0.7125 0.0
s10-1.pddl
0.6510 0.6510 0.0 0.7446 0.7446 0.0
s10-2.pddl
0.6349 0.6349 0.0 0.7090 0.7090 0.0
s10-3.pddl
0.6706 0.6706 0.0 0.7027 0.7027 0.0
s10-4.pddl
0.6478 0.6478 0.0 0.7012 0.7012 0.0
s11-0.pddl
0.6044 0.6044 0.0 0.6658 0.6658 0.0
s11-1.pddl
0.6343 0.6343 0.0 0.6705 0.6705 0.0
s11-2.pddl
0.5882 0.5882 0.0 0.6974 0.6974 0.0
s11-3.pddl
0.6085 0.6085 0.0 0.6637 0.6637 0.0
s11-4.pddl
0.6137 0.6137 0.0 0.6751 0.6751 0.0
s12-0.pddl
0.6424 0.6424 0.0 0.6822 0.6822 0.0
s12-1.pddl
0.5795 0.5795 0.0 0.6244 0.6244 0.0
s12-2.pddl
0.5811 0.5811 0.0 0.6418 0.6418 0.0
s12-3.pddl
0.5909 0.5909 0.0 0.6495 0.6495 0.0
s12-4.pddl
0.5651 0.5651 0.0 0.6687 0.6687 0.0
s13-0.pddl
0.5437 0.5437 0.0 0.6467 0.6467 0.0
s13-1.pddl
0.5649 0.5649 0.0 0.6141 0.6141 0.0
s13-2.pddl
0.5459 0.5459 0.0 0.6072 0.6072 0.0
s13-3.pddl
0.5770 0.5770 0.0 0.6251 0.6251 0.0
s13-4.pddl
0.5784 0.5784 0.0 0.5932 0.5932 0.0
s14-0.pddl
0.5673 0.5673 0.0 0.6121 0.6121 0.0
s14-1.pddl
0.5332 0.5332 0.0 0.6067 0.6067 0.0
s14-2.pddl
0.5339 0.5339 0.0 0.6053 0.6053 0.0
s14-3.pddl
0.5570 0.5570 0.0 0.5722 0.5722 0.0
s14-4.pddl
0.5426 0.5426 0.0 0.5919 0.5919 0.0
s15-0.pddl
0.5362 0.5362 0.0 0.5825 0.5825 0.0
s15-1.pddl
0.4855 0.4855 0.0 0.6182 0.6182 0.0
s15-2.pddl
0.5021 0.5021 0.0 0.5991 0.5991 0.0
s15-3.pddl
0.5116 0.5116 0.0 0.5811 0.5811 0.0
s15-4.pddl
0.5129 0.5129 0.0 0.5848 0.5848 0.0
s16-0.pddl
0.4980 0.4980 0.0 0.5560 0.5560 0.0
s16-1.pddl
0.5018 0.5018 0.0 0.5523 0.5523 0.0
s16-2.pddl
0.4718 0.4718 0.0 0.5547 0.5547 0.0
s16-3.pddl
0.4909 0.4909 0.0 0.5789 0.5789 0.0
s16-4.pddl
0.4901 0.4901 0.0 0.5618 0.5618 0.0
s17-0.pddl
0.4669 0.4669 0.0 0.5500 0.5500 0.0
s17-1.pddl
0.4899 0.4899 0.0 0.5517 0.5517 0.0
s17-2.pddl
0.4689 0.4689 0.0 0.5173 0.5173 0.0
s17-3.pddl
0.4583 0.4583 0.0 0.5715 0.5715 0.0
s17-4.pddl
0.4902 0.4902 0.0 0.5397 0.5397 0.0
s18-0.pddl
0.4619 0.4619 0.0 0.5218 0.5218 0.0
s18-1.pddl
0.4700 0.4700 0.0 0.5577 0.5577 0.0
s18-2.pddl
0.4566 0.4566 0.0 0.5379 0.5379 0.0
s18-3.pddl
0.4442 0.4442 0.0 0.5223 0.5223 0.0
s18-4.pddl
0.4585 0.4585 0.0 0.5620 0.5620 0.0
s19-0.pddl
0.4296 0.4296 0.0 0.4806 0.4806 0.0
s19-1.pddl
0.4406 0.4406 0.0 0.4948 0.4948 0.0
s19-2.pddl
0.4303 0.4303 0.0 0.5307 0.5307 0.0
s19-3.pddl
0.4231 0.4231 0.0 0.5469 0.5469 0.0
s19-4.pddl
0.4337 0.4337 0.0 0.5337 0.5337 0.0
s20-0.pddl
0.4272 0.4272 0.0 0.5093 0.5093 0.0
s20-1.pddl
0.4196 0.4196 0.0 0.4898 0.4898 0.0
s20-2.pddl
0.4285 0.4285 0.0 0.5125 0.5125 0.0
s20-3.pddl
0.4333 0.4333 0.0 0.4799 0.4799 0.0
s20-4.pddl
0.4304 0.4304 0.0 0.4840 0.4840 0.0
s21-0.pddl
0.3977 0.3977 0.0 0.4957 0.4957 0.0
s21-1.pddl
0.4049 0.4049 0.0 0.4536 0.4536 0.0
s21-2.pddl
0.4392 0.4392 0.0 0.4573 0.4573 0.0
s21-3.pddl
0.4207 0.4207 0.0 0.4819 0.4819 0.0
s21-4.pddl
0.4358 0.4358 0.0 0.4670 0.4670 0.0
s22-0.pddl
0.3795 0.3795 0.0 0.4972 0.4972 0.0
s22-1.pddl
0.3862 0.3862 0.0 0.4679 0.4679 0.0
s22-2.pddl
0.3884 0.3884 0.0 0.4572 0.4572 0.0
s22-3.pddl
0.3875 0.3875 0.0 0.4780 0.4780 0.0
s22-4.pddl
0.3969 0.3969 0.0 0.4585 0.4585 0.0
s23-0.pddl
0.3677 0.3677 0.0 0.4561 0.4561 0.0
s23-1.pddl
0.3842 0.3842 0.0 0.4755 0.4755 0.0
s23-2.pddl
0.3931 0.3931 0.0 0.4372 0.4372 0.0
s23-3.pddl
0.3920 0.3920 0.0 0.4534 0.4534 0.0
s23-4.pddl
0.3863 0.3863 0.0 0.4779 0.4779 0.0
s24-0.pddl
0.3789 0.3789 0.0 0.4441 0.4441 0.0
s24-1.pddl
0.3688 0.3688 0.0 0.4319 0.4319 0.0
s24-2.pddl
0.3623 0.3623 0.0 0.4499 0.4499 0.0
s24-3.pddl
0.3670 0.3670 0.0 0.4462 0.4462 0.0
s24-4.pddl
0.3639 0.3639 0.0 0.4198 0.4198 0.0
s25-0.pddl
0.3572 0.3572 0.0 0.4122 0.4122 0.0
s25-1.pddl
0.3376 0.3376 0.0 0.4310 0.4310 0.0
s25-2.pddl
0.3685 0.3685 0.0 0.4068 0.4068 0.0
s25-3.pddl
0.3422 0.3422 0.0 0.4253 0.4253 0.0
s25-4.pddl
0.3404 0.3404 0.0 0.4431 0.4431 0.0
s26-0.pddl
0.3320 0.3320 0.0 0.4125 0.4125 0.0
s26-1.pddl
0.3449 0.3449 0.0 0.4166 0.4166 0.0
s26-2.pddl
0.3200 0.3200 0.0 0.3968 0.3968 0.0
s26-3.pddl
0.3321 0.3321 0.0 0.4125 0.4125 0.0
s26-4.pddl
0.3545 0.3545 0.0 0.3872 0.3872 0.0
s27-0.pddl
0.3141 0.3141 0.0 0.4009 0.4009 0.0
s27-1.pddl
0.3334 0.3334 0.0 0.4061 0.4061 0.0
s27-2.pddl
0.3140 0.3140 0.0 0.4384 0.4384 0.0
s27-3.pddl
0.3283 0.3283 0.0 0.3875 0.3875 0.0
s27-4.pddl
0.3237 0.3237 0.0 0.4061 0.4061 0.0
s28-0.pddl
0.3009 0.3009 0.0 0.3874 0.3874 0.0
s28-1.pddl
0.3146 0.3146 0.0 0.3731 0.3731 0.0
s28-2.pddl
0.3035 0.3035 0.0 0.3989 0.3989 0.0
s28-3.pddl
0.3372 0.3372 0.0 0.3990 0.3990 0.0
s28-4.pddl
0.3151 0.3151 0.0 0.3991 0.3991 0.0
s29-0.pddl
0.3107 0.3107 0.0 0.3670 0.3670 0.0
s29-1.pddl
0.3181 0.3181 0.0 0.3867 0.3867 0.0
s29-2.pddl
0.3014 0.3014 0.0 0.3744 0.3744 0.0
s29-3.pddl
0.2879 0.2879 0.0 0.3988 0.3988 0.0
s29-4.pddl
0.2835 0.2835 0.0 0.4058 0.4058 0.0
s30-0.pddl
0.3080 0.3080 0.0 0.3662 0.3662 0.0
s30-1.pddl
0.2960 0.2960 0.0 0.3757 0.3757 0.0
s30-2.pddl
0.3010 0.3010 0.0 0.3818 0.3818 0.0
s30-3.pddl
0.2803 0.2803 0.0 0.3785 0.3785 0.0
s30-4.pddl
0.2901 0.2901 0.0 0.3955 0.3955 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
movie
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.9164 0.9164 0.0 0.9164 0.9164 0.0
prob02.pddl
0.8979 0.8979 0.0 0.8979 0.8979 0.0
prob03.pddl
0.8822 0.8822 0.0 0.8822 0.8822 0.0
prob04.pddl
0.8684 0.8684 0.0 0.8684 0.8684 0.0
prob05.pddl
0.8562 0.8562 0.0 0.8562 0.8562 0.0
prob06.pddl
0.8452 0.8452 0.0 0.8452 0.8452 0.0
prob07.pddl
0.8353 0.8353 0.0 0.8353 0.8353 0.0
prob08.pddl
0.8261 0.8261 0.0 0.8261 0.8261 0.0
prob09.pddl
0.8177 0.8177 0.0 0.8177 0.8177 0.0
prob10.pddl
0.8099 0.8099 0.0 0.8099 0.8099 0.0
prob11.pddl
0.8026 0.8026 0.0 0.8026 0.8026 0.0
prob12.pddl
0.7958 0.7958 0.0 0.7958 0.7958 0.0
prob13.pddl
0.7893 0.7893 0.0 0.7893 0.7893 0.0
prob14.pddl
0.7833 0.7833 0.0 0.7833 0.7833 0.0
prob15.pddl
0.7775 0.7775 0.0 0.7775 0.7775 0.0
prob16.pddl
0.7721 0.7721 0.0 0.7721 0.7721 0.0
prob17.pddl
0.7669 0.7669 0.0 0.7669 0.7669 0.0
prob18.pddl
0.7619 0.7619 0.0 0.7619 0.7619 0.0
prob19.pddl
0.7572 0.7572 0.0 0.7572 0.7572 0.0
prob20.pddl
0.7526 0.7526 0.0 0.7526 0.7526 0.0
prob21.pddl
0.7483 0.7483 0.0 0.7483 0.7483 0.0
prob22.pddl
0.7441 0.7441 0.0 0.7441 0.7441 0.0
prob23.pddl
0.7400 0.7400 0.0 0.7400 0.7400 0.0
prob24.pddl
0.7362 0.7362 0.0 0.7362 0.7362 0.0
prob25.pddl
0.7324 0.7324 0.0 0.7324 0.7324 0.0
prob26.pddl
0.7288 0.7288 0.0 0.7288 0.7288 0.0
prob27.pddl
0.7253 0.7253 0.0 0.7253 0.7253 0.0
prob28.pddl
0.7218 0.7218 0.0 0.7218 0.7218 0.0
prob29.pddl
0.7185 0.7185 0.0 0.7185 0.7185 0.0
prob30.pddl
0.7153 0.7153 0.0 0.7153 0.7153 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
mprime
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.9430 0.9430 0.0 0.7949 0.7949 0.0
prob02.pddl
0.6853 0.6853 0.0 -0.0000 -0.0000 0.0
prob03.pddl
0.8047 0.8047 0.0 0.0369 0.0369 0.0
prob04.pddl
0.8173 0.8173 0.0 0.5617 0.5617 0.0
prob05.pddl
0.8151 0.8151 0.0 -0.0000 -0.0000 0.0
prob06.pddl
0.2483 0.2483 0.0 0 0 0.0
prob07.pddl
0.8768 0.8768 0.0 0.0702 0.0702 0.0
prob08.pddl
0.5967 0.5967 0.0 0 0 0.0
prob09.pddl
0.7266 0.7266 0.0 0.0623 0.0623 0.0
prob10.pddl
0.5775 0.5775 0.0 0 0 0.0
prob11.pddl
0.8206 0.8206 0.0 0.8871 0.8871 0.0
prob12.pddl
0.7438 0.7438 0.0 -0.0000 -0.0000 0.0
prob13.pddl
0.4571 0.4571 0.0 0 0 0.0
prob14.pddl
0.4415 0.4415 0.0 0 0 0.0
prob15.pddl
0.4568 0.4568 0.0 0 0 0.0
prob16.pddl
0.7595 0.7595 0.0 -0.0000 -0.0000 0.0
prob17.pddl
0.7048 0.7048 0.0 -0.0000 -0.0000 0.0
prob18.pddl
0.3113 0.3113 0.0 0 0 0.0
prob19.pddl
0.5182 0.5182 0.0 0 0 0.0
prob20.pddl
0.4749 0.4749 0.0 0 0 0.0
prob21.pddl
0.4476 0.4476 0.0 -0.0000 -0.0000 0.0
prob22.pddl
0.4154 0.4154 0.0 0 0 0.0
prob23.pddl
0.4340 0.4340 0.0 0 0 0.0
prob24.pddl
0.6441 0.6441 0.0 0 0 0.0
prob25.pddl
1.0000 1.0000 0.0 0.6301 0.6301 0.0
prob26.pddl
0.7579 0.7579 0.0 -0.0000 -0.0000 0.0
prob27.pddl
0.8126 0.8126 0.0 0.2532 0.2532 0.0
prob28.pddl
0.9018 0.9018 0.0 0.8327 0.8327 0.0
prob29.pddl
0.8615 0.8615 0.0 0.1153 0.1153 0.0
prob30.pddl
0.6195 0.6195 0.0 0 0 0.0
prob31.pddl
0.8179 0.8179 0.0 0.2233 0.2233 0.0
prob32.pddl
0.8665 0.8665 0.0 -0.0000 -0.0000 0.0
prob33.pddl
0.4662 0.4662 0.0 0 0 0.0
prob34.pddl
0.8859 0.8859 0.0 0.1885 0.1885 0.0
prob35.pddl
0.9297 0.9297 0.0 0.2396 0.2396 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
mystery
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
0.5178 0.5178 0.0 0.0696 0.0696 0.0
prob03.pddl
1.0000 1.0000 0.0 0.5689 0.5689 0.0
prob04.pddl
0 0 0.0 0 0 0.0
prob05.pddl
0 0 0.0 0 0 0.0
prob06.pddl
0.0663 0.0663 0.0 0 0 0.0
prob07.pddl
0 0 0.0 0 0 0.0
prob08.pddl
0 0 0.0 0 0 0.0
prob09.pddl
-0.0000 -0.0000 0.0 0.3872 0.3872 0.0
prob10.pddl
0.8003 0.8003 0.0 0 0 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
0 0 0.0 0 0 0.0
prob13.pddl
0.6474 0.6474 0.0 0 0 0.0
prob14.pddl
0.6536 0.6536 0.0 0 0 0.0
prob15.pddl
0.6724 0.6724 0.0 -0.0000 -0.0000 0.0
prob16.pddl
0 0 0.0 0 0 0.0
prob17.pddl
0.9129 0.9129 0.0 0.1985 0.1985 0.0
prob18.pddl
0 0 0.0 0 0 0.0
prob19.pddl
0.4476 0.4476 0.0 -0.0000 -0.0000 0.0
prob20.pddl
0.7610 0.7610 0.0 -0.0000 -0.0000 0.0
prob21.pddl
0 0 0.0 0 0 0.0
prob22.pddl
0 0 0.0 0 0 0.0
prob23.pddl
0 0 0.0 0 0 0.0
prob24.pddl
0 0 0.0 0 0 0.0
prob25.pddl
1.0000 1.0000 0.0 0.8525 0.8525 0.0
prob26.pddl
0.9867 0.9867 0.0 0.1982 0.1982 0.0
prob27.pddl
0.9839 0.9839 0.0 0.6764 0.6764 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 0.6633 0.6633 0.0
prob30.pddl
0.8206 0.8206 0.0 0.0765 0.0765 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
nomystery-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9699 0.9699 0.0 0.6598 0.6598 0.0
p02.pddl
0.9811 0.9811 0.0 1.0000 1.0000 0.0
p03.pddl
0.9386 0.9386 0.0 0.9699 0.9699 0.0
p04.pddl
0.8574 0.8574 0.0 0.0378 0.0378 0.0
p05.pddl
0.8060 0.8060 0.0 -0.0000 -0.0000 0.0
p06.pddl
0.7889 0.7889 0.0 0 0 0.0
p07.pddl
0.7922 0.7922 0.0 0 0 0.0
p08.pddl
0.7651 0.7651 0.0 0 0 0.0
p09.pddl
0.7556 0.7556 0.0 0.7815 0.7815 0.0
p10.pddl
0.7108 0.7108 0.0 0 0 0.0
p11.pddl
0.8582 0.8582 0.0 0.7903 0.7903 0.0
p12.pddl
0.5488 0.5488 0.0 0.3665 0.3665 0.0
p13.pddl
0.8204 0.8204 0.0 0.2482 0.2482 0.0
p14.pddl
0.3937 0.3937 0.0 -0.0000 -0.0000 0.0
p15.pddl
0.7260 0.7260 0.0 -0.0000 -0.0000 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0.4967 0.4967 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0.6480 0.6480 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt08-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.9775 0.9775 0.0 0.9658 0.9658 0.0
p06.pddl
0.9619 0.9619 0.0 0.9619 0.9619 0.0
p07.pddl
0.9497 0.9497 0.0 0.9411 0.9411 0.0
p08.pddl
0.9380 0.9380 0.0 0.9221 0.9221 0.0
p09.pddl
0.9082 0.9082 0.0 0.9054 0.9054 0.0
p10.pddl
0.9164 0.9164 0.0 0.9027 0.9027 0.0
p11.pddl
0.8922 0.8922 0.0 0.8833 0.8833 0.0
p12.pddl
0.8930 0.8930 0.0 0.8761 0.8761 0.0
p13.pddl
0.8786 0.8786 0.0 0.8684 0.8684 0.0
p14.pddl
0.8649 0.8649 0.0 0.8542 0.8542 0.0
p15.pddl
0.8460 0.8460 0.0 0.8406 0.8406 0.0
p16.pddl
0.8545 0.8545 0.0 0.8426 0.8426 0.0
p17.pddl
0.8450 0.8450 0.0 0.8277 0.8277 0.0
p18.pddl
0.8317 0.8317 0.0 0.8091 0.8091 0.0
p19.pddl
0.8331 0.8331 0.0 0.8040 0.8040 0.0
p20.pddl
0.8149 0.8149 0.0 0.8105 0.8105 0.0
p21.pddl
0.8038 0.8038 0.0 0.7914 0.7914 0.0
p22.pddl
0.8031 0.8031 0.0 0.7869 0.7869 0.0
p23.pddl
0.7836 0.7836 0.0 0.7771 0.7771 0.0
p24.pddl
0.7811 0.7811 0.0 0.7764 0.7764 0.0
p25.pddl
0.7757 0.7757 0.0 0.7617 0.7617 0.0
p26.pddl
0.7706 0.7706 0.0 0.7571 0.7571 0.0
p27.pddl
0.7721 0.7721 0.0 0.7515 0.7515 0.0
p28.pddl
0.7555 0.7555 0.0 0.7491 0.7491 0.0
p29.pddl
0.7578 0.7578 0.0 0.7363 0.7363 0.0
p30.pddl
0.7430 0.7430 0.0 0.7332 0.7332 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9619 0.9619 0.0 0.9619 0.9619 0.0
p02.pddl
0.9497 0.9497 0.0 0.9411 0.9411 0.0
p03.pddl
0.9380 0.9380 0.0 0.9221 0.9221 0.0
p04.pddl
0.9082 0.9082 0.0 0.9054 0.9054 0.0
p05.pddl
0.9164 0.9164 0.0 0.9027 0.9027 0.0
p06.pddl
0.8922 0.8922 0.0 0.8833 0.8833 0.0
p07.pddl
0.8930 0.8930 0.0 0.8761 0.8761 0.0
p08.pddl
0.8786 0.8786 0.0 0.8684 0.8684 0.0
p09.pddl
0.8649 0.8649 0.0 0.8542 0.8542 0.0
p10.pddl
0.8031 0.8031 0.0 0.7869 0.7869 0.0
p11.pddl
0.8460 0.8460 0.0 0.8406 0.8406 0.0
p12.pddl
0.8545 0.8545 0.0 0.8426 0.8426 0.0
p13.pddl
0.8450 0.8450 0.0 0.8277 0.8277 0.0
p14.pddl
0.8317 0.8317 0.0 0.8091 0.8091 0.0
p15.pddl
0.8331 0.8331 0.0 0.8040 0.8040 0.0
p16.pddl
0.8038 0.8038 0.0 0.7914 0.7914 0.0
p17.pddl
0.8149 0.8149 0.0 0.8105 0.8105 0.0
p18.pddl
0.7836 0.7836 0.0 0.7771 0.7771 0.0
p19.pddl
0.7811 0.7811 0.0 0.7764 0.7764 0.0
p20.pddl
0.7757 0.7757 0.0 0.7617 0.7617 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
0.8362 0.8362 0.0 0.8429 0.8429 0.0
p20_2.pddl
0.8489 0.8489 0.0 0.8308 0.8308 0.0
p20_3.pddl
0.8473 0.8473 0.0 0.8345 0.8345 0.0
p25_1.pddl
0.8091 0.8091 0.0 0.7932 0.7932 0.0
p25_3.pddl
0.8073 0.8073 0.0 0.7840 0.7840 0.0
p30_1.pddl
0.7520 0.7520 0.0 0.7619 0.7619 0.0
p30_2.pddl
0.7635 0.7635 0.0 0.7544 0.7544 0.0
p30_3.pddl
0.7733 0.7733 0.0 0.7424 0.7424 0.0
p35_1.pddl
0.7362 0.7362 0.0 0.7316 0.7316 0.0
p35_2.pddl
0.7266 0.7266 0.0 0.7204 0.7204 0.0
p35_3.pddl
0.7444 0.7444 0.0 0.7128 0.7128 0.0
p40_1.pddl
0.6985 0.6985 0.0 0.7052 0.7052 0.0
p40_2.pddl
0.7126 0.7126 0.0 0.7068 0.7068 0.0
p40_3.pddl
0.7175 0.7175 0.0 0.6901 0.6901 0.0
p45_1.pddl
0.6837 0.6837 0.0 0.6861 0.6861 0.0
p45_2.pddl
0.6904 0.6904 0.0 0.6756 0.6756 0.0
p45_3.pddl
0.6971 0.6971 0.0 0.6616 0.6616 0.0
p50_1.pddl
0.6543 0.6543 0.0 0.6609 0.6609 0.0
p50_2.pddl
0.6737 0.6737 0.0 0.6543 0.6543 0.0
p50_3.pddl
0.6813 0.6813 0.0 0.6420 0.6420 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
0.9040 0.9040 0.0 0.8934 0.8934 0.0
p07.pddl
0.9149 0.9149 0.0 0.8963 0.8963 0.0
p08.pddl
0.7908 0.7908 0.0 0.7668 0.7668 0.0
p09.pddl
0.7986 0.7986 0.0 0.7700 0.7700 0.0
p10.pddl
0.7834 0.7834 0.0 0.7525 0.7525 0.0
p11.pddl
0.7906 0.7906 0.0 0.7560 0.7560 0.0
p12.pddl
0.7900 0.7900 0.0 0.7605 0.7605 0.0
p13.pddl
0.7904 0.7904 0.0 0.7576 0.7576 0.0
p14.pddl
0.7890 0.7890 0.0 0.7602 0.7602 0.0
p15.pddl
0.7974 0.7974 0.0 0.7657 0.7657 0.0
p16.pddl
0.7953 0.7953 0.0 0.7645 0.7645 0.0
p17.pddl
0.7550 0.7550 0.0 0.7265 0.7265 0.0
p18.pddl
0.6444 0.6444 0.0 0.6098 0.6098 0.0
p19.pddl
0.7538 0.7538 0.0 0.7134 0.7134 0.0
p20.pddl
0.7117 0.7117 0.0 0.6829 0.6829 0.0
p21.pddl
0.7097 0.7097 0.0 0.6808 0.6808 0.0
p22.pddl
0.7110 0.7110 0.0 0.6767 0.6767 0.0
p23.pddl
0.7153 0.7153 0.0 0.6795 0.6795 0.0
p24.pddl
0.6086 0.6086 0.0 0.5774 0.5774 0.0
p25.pddl
0.6122 0.6122 0.0 0.5801 0.5801 0.0
p26.pddl
0.6181 0.6181 0.0 0.5790 0.5790 0.0
p27.pddl
0.5372 0.5372 0.0 0.4952 0.4952 0.0
p28.pddl
0.4661 0.4661 0.0 0.4325 0.4325 0.0
p29.pddl
0.4717 0.4717 0.0 0.4367 0.4367 0.0
p30.pddl
0.4796 0.4796 0.0 0.4350 0.4350 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
organic-synthesis-opt18-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
0 0 0.0 0 0 0.0
p05.pddl
0 0 0.0 0 0 0.0
p06.pddl
0 0 0.0 0 0 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0 0 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0 0 0.0 0 0 0.0
p12.pddl
0 0 0.0 0 0 0.0
p13.pddl
0 0 0.0 0 0 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0 0 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
organic-synthesis-split-opt18-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9839 0.9839 0.0
p02.pddl
1.0000 1.0000 0.0 0.7784 0.7784 0.0
p03.pddl
0.7583 0.7583 0.0 0.1994 0.1994 0.0
p04.pddl
0.7689 0.7689 0.0 0.1499 0.1499 0.0
p05.pddl
0.7618 0.7618 0.0 0.2769 0.2769 0.0
p06.pddl
0.7146 0.7146 0.0 -0.0000 -0.0000 0.0
p07.pddl
0.8299 0.8299 0.0 0.8304 0.8304 0.0
p08.pddl
0.5551 0.5551 0.0 -0.0000 -0.0000 0.0
p09.pddl
0.8958 0.8958 0.0 0.3278 0.3278 0.0
p10.pddl
0.8804 0.8804 0.0 0.2773 0.2773 0.0
p11.pddl
0.3685 0.3685 0.0 0 0 0.0
p12.pddl
0.4135 0.4135 0.0 0 0 0.0
p13.pddl
0.2750 0.2750 0.0 0 0 0.0
p14.pddl
0.7636 0.7636 0.0 0.6279 0.6279 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
0.2958 0.2958 0.0 0 0 0.0
p17.pddl
0.1989 0.1989 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0.4495 0.4495 0.0 0 0 0.0
p20.pddl
0.0646 0.0646 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parcprinter-08-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
0.9848 0.9848 0.0 0.9105 0.9105 0.0
p05.pddl
0.9386 0.9386 0.0 0.8640 0.8640 0.0
p06.pddl
0.9005 0.9005 0.0 0.8724 0.8724 0.0
p07.pddl
0.8681 0.8681 0.0 0.7564 0.7564 0.0
p08.pddl
0.8399 0.8399 0.0 0.7345 0.7345 0.0
p09.pddl
0.8149 0.8149 0.0 0.7064 0.7064 0.0
p10.pddl
0.7925 0.7925 0.0 0.7545 0.7545 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 0.8800 0.8800 0.0
p13.pddl
0.9968 0.9968 0.0 0.2937 0.2937 0.0
p14.pddl
0.9392 0.9392 0.0 -0.0000 -0.0000 0.0
p15.pddl
0.7884 0.7884 0.0 0 0 0.0
p16.pddl
0.8509 0.8509 0.0 0 0 0.0
p17.pddl
0.8204 0.8204 0.0 0 0 0.0
p18.pddl
0.7886 0.7886 0.0 0 0 0.0
p19.pddl
0.5979 0.5979 0.0 0 0 0.0
p20.pddl
0.6966 0.6966 0.0 0 0 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
0.9567 0.9567 0.0 0.9497 0.9497 0.0
p25.pddl
0.8382 0.8382 0.0 -0.0000 -0.0000 0.0
p26.pddl
0.8741 0.8741 0.0 0.8594 0.8594 0.0
p27.pddl
0.8421 0.8421 0.0 0.8329 0.8329 0.0
p28.pddl
0.8143 0.8143 0.0 0.7940 0.7940 0.0
p29.pddl
0.6627 0.6627 0.0 0 0 0.0
p30.pddl
0.7445 0.7445 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parcprinter-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.8800 0.8800 0.0
p04.pddl
0.9848 0.9848 0.0 0.9105 0.9105 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
0.9005 0.9005 0.0 0.8724 0.8724 0.0
p07.pddl
0.9386 0.9386 0.0 0.8640 0.8640 0.0
p08.pddl
0.9567 0.9567 0.0 0.9497 0.9497 0.0
p09.pddl
0.9968 0.9968 0.0 0.2937 0.2937 0.0
p10.pddl
0.8382 0.8382 0.0 -0.0000 -0.0000 0.0
p11.pddl
0.8741 0.8741 0.0 0.8594 0.8594 0.0
p12.pddl
0.9392 0.9392 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.8681 0.8681 0.0 0.7564 0.7564 0.0
p14.pddl
0.8399 0.8399 0.0 0.7345 0.7345 0.0
p15.pddl
0.8149 0.8149 0.0 0.7064 0.7064 0.0
p16.pddl
0.7925 0.7925 0.0 0.7545 0.7545 0.0
p17.pddl
0.7884 0.7884 0.0 0 0 0.0
p18.pddl
0.8509 0.8509 0.0 0 0 0.0
p19.pddl
0.8204 0.8204 0.0 0 0 0.0
p20.pddl
0.8421 0.8421 0.0 0.8329 0.8329 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parking-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
0.7574 0.7574 0.0 0 0 0.0
pfile03-012.pddl
0.5884 0.5884 0.0 0 0 0.0
pfile04-013.pddl
0.5608 0.5608 0.0 0 0 0.0
pfile04-014.pddl
0.5241 0.5241 0.0 0 0 0.0
pfile04-015.pddl
0.6134 0.6134 0.0 0 0 0.0
pfile04-016.pddl
0.5719 0.5719 0.0 0 0 0.0
pfile05-017.pddl
0.5904 0.5904 0.0 0 0 0.0
pfile05-018.pddl
0.6095 0.6095 0.0 0 0 0.0
pfile05-019.pddl
0.4813 0.4813 0.0 0 0 0.0
pfile05-020.pddl
0.5171 0.5171 0.0 0 0 0.0
pfile06-021.pddl
0.4948 0.4948 0.0 0 0 0.0
pfile06-022.pddl
0.4971 0.4971 0.0 0 0 0.0
pfile06-023.pddl
0.5210 0.5210 0.0 0 0 0.0
pfile06-024.pddl
0.3923 0.3923 0.0 0 0 0.0
pfile07-025.pddl
0.3831 0.3831 0.0 0 0 0.0
pfile07-026.pddl
0.4933 0.4933 0.0 0 0 0.0
pfile07-027.pddl
0.5240 0.5240 0.0 0 0 0.0
pfile07-028.pddl
0.3855 0.3855 0.0 0 0 0.0
pfile08-029.pddl
0.3974 0.3974 0.0 0 0 0.0
pfile08-030.pddl
0.4325 0.4325 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
parking-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
0.6740 0.6740 0.0 0 0 0.0
p_12_7-02.pddl
0.6519 0.6519 0.0 -0.0000 -0.0000 0.0
p_12_7-03.pddl
0.5960 0.5960 0.0 0 0 0.0
p_12_7-04.pddl
0.6133 0.6133 0.0 0 0 0.0
p_14_8-01.pddl
0.6178 0.6178 0.0 0 0 0.0
p_14_8-02.pddl
0.5822 0.5822 0.0 0 0 0.0
p_14_8-03.pddl
0.4977 0.4977 0.0 0 0 0.0
p_14_8-04.pddl
0.5740 0.5740 0.0 0 0 0.0
p_16_9-01.pddl
0.5294 0.5294 0.0 0 0 0.0
p_16_9-02.pddl
0.5713 0.5713 0.0 0 0 0.0
p_16_9-03.pddl
0.6176 0.6176 0.0 0 0 0.0
p_16_9-04.pddl
0.6104 0.6104 0.0 0 0 0.0
p_18_10-01.pddl
0.4575 0.4575 0.0 0 0 0.0
p_18_10-02.pddl
0.5221 0.5221 0.0 0 0 0.0
p_18_10-03.pddl
0.6098 0.6098 0.0 0 0 0.0
p_18_10-04.pddl
0.6265 0.6265 0.0 0 0 0.0
p_20_11-01.pddl
0.4125 0.4125 0.0 0 0 0.0
p_20_11-02.pddl
0.4641 0.4641 0.0 0 0 0.0
p_20_11-03.pddl
0.4269 0.4269 0.0 0 0 0.0
p_20_11-04.pddl
0.3509 0.3509 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pathways-noneg
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9476 0.9476 0.0 0.5555 0.5555 0.0
p02.pddl
0.9848 0.9848 0.0 0.9707 0.9707 0.0
p03.pddl
0.7752 0.7752 0.0 0.4725 0.4725 0.0
p04.pddl
0.8017 0.8017 0.0 0.3033 0.3033 0.0
p05.pddl
0.7227 0.7227 0.0 -0.0000 -0.0000 0.0
p06.pddl
0.5183 0.5183 0.0 -0.0000 -0.0000 0.0
p07.pddl
0.4625 0.4625 0.0 -0.0000 -0.0000 0.0
p08.pddl
0.4267 0.4267 0.0 0 0 0.0
p09.pddl
0.4298 0.4298 0.0 -0.0000 -0.0000 0.0
p10.pddl
0 0 0.0 0 0 0.0
p11.pddl
0.3807 0.3807 0.0 -0.0000 -0.0000 0.0
p12.pddl
0.3923 0.3923 0.0 0 0 0.0
p13.pddl
0.3617 0.3617 0.0 0 0 0.0
p14.pddl
0.3415 0.3415 0.0 0 0 0.0
p15.pddl
0.3888 0.3888 0.0 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0.3322 0.3322 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0.1842 0.1842 0.0 0 0 0.0
p24.pddl
0.1888 0.1888 0.0 0 0 0.0
p25.pddl
0.1968 0.1968 0.0 0 0 0.0
p26.pddl
0.2033 0.2033 0.0 0 0 0.0
p27.pddl
0.1627 0.1627 0.0 0 0 0.0
p28.pddl
0.2133 0.2133 0.0 0 0 0.0
p29.pddl
0.1165 0.1165 0.0 0 0 0.0
p30.pddl
0.1145 0.1145 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pegsol-08-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
0.9802 0.9802 0.0 0.9399 0.9399 0.0
p05.pddl
0.9947 0.9947 0.0 1.0000 1.0000 0.0
p06.pddl
0.9054 0.9054 0.0 0.9766 0.9766 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0.8775 0.8775 0.0 0.8796 0.8796 0.0
p09.pddl
0.9619 0.9619 0.0 0.8214 0.8214 0.0
p10.pddl
0.6146 0.6146 0.0 0.7139 0.7139 0.0
p11.pddl
0.7369 0.7369 0.0 0.6332 0.6332 0.0
p12.pddl
0.7291 0.7291 0.0 0.8159 0.8159 0.0
p13.pddl
0.8606 0.8606 0.0 0.3964 0.3964 0.0
p14.pddl
0.8272 0.8272 0.0 0.4186 0.4186 0.0
p15.pddl
0.8463 0.8463 0.0 0.6340 0.6340 0.0
p16.pddl
0.8040 0.8040 0.0 0.4960 0.4960 0.0
p17.pddl
0.3993 0.3993 0.0 0.3098 0.3098 0.0
p18.pddl
0.5891 0.5891 0.0 0.8394 0.8394 0.0
p19.pddl
0.7808 0.7808 0.0 0.4284 0.4284 0.0
p20.pddl
0.7090 0.7090 0.0 0.7763 0.7763 0.0
p21.pddl
0.7875 0.7875 0.0 0.3578 0.3578 0.0
p22.pddl
0.6889 0.6889 0.0 0.4812 0.4812 0.0
p23.pddl
0.7226 0.7226 0.0 0.2842 0.2842 0.0
p24.pddl
0.6535 0.6535 0.0 0.3840 0.3840 0.0
p25.pddl
0.6927 0.6927 0.0 0.4158 0.4158 0.0
p26.pddl
0.7328 0.7328 0.0 0.2892 0.2892 0.0
p27.pddl
0.2670 0.2670 0.0 0.6890 0.6890 0.0
p28.pddl
0.1601 0.1601 0.0 -0.0000 -0.0000 0.0
p29.pddl
-0.0000 -0.0000 0.0 0.1196 0.1196 0.0
p30.pddl
0.1534 0.1534 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pegsol-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9470 0.9470 0.0 1.0000 1.0000 0.0
p02.pddl
0.3993 0.3993 0.0 0.3098 0.3098 0.0
p03.pddl
0.5891 0.5891 0.0 0.8394 0.8394 0.0
p04.pddl
0.7808 0.7808 0.0 0.4284 0.4284 0.0
p05.pddl
0.7733 0.7733 0.0 0.2602 0.2602 0.0
p06.pddl
0.8833 0.8833 0.0 0.6637 0.6637 0.0
p07.pddl
0.6876 0.6876 0.0 0.7890 0.7890 0.0
p08.pddl
0.7090 0.7090 0.0 0.7763 0.7763 0.0
p09.pddl
0.5720 0.5720 0.0 0.4590 0.4590 0.0
p10.pddl
0.7875 0.7875 0.0 0.3578 0.3578 0.0
p11.pddl
0.6889 0.6889 0.0 0.4812 0.4812 0.0
p12.pddl
0.7050 0.7050 0.0 0.4192 0.4192 0.0
p13.pddl
0.7226 0.7226 0.0 0.2842 0.2842 0.0
p14.pddl
0.6535 0.6535 0.0 0.3840 0.3840 0.0
p15.pddl
0.6927 0.6927 0.0 0.4158 0.4158 0.0
p16.pddl
0.7328 0.7328 0.0 0.2892 0.2892 0.0
p17.pddl
0.2670 0.2670 0.0 0.6890 0.6890 0.0
p18.pddl
0.1601 0.1601 0.0 -0.0000 -0.0000 0.0
p19.pddl
-0.0000 -0.0000 0.0 0.1196 0.1196 0.0
p20.pddl
0.1534 0.1534 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
petri-net-alignment-opt18-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.7895 0.7895 0.0 0.7379 0.7379 0.0
p02.pddl
0.7694 0.7694 0.0 0.7084 0.7084 0.0
p03.pddl
0.7566 0.7566 0.0 0.6909 0.6909 0.0
p04.pddl
0.7525 0.7525 0.0 0.6871 0.6871 0.0
p05.pddl
0.7727 0.7727 0.0 0.7122 0.7122 0.0
p06.pddl
0.7553 0.7553 0.0 0.6886 0.6886 0.0
p07.pddl
0.7578 0.7578 0.0 0.6974 0.6974 0.0
p08.pddl
0.7536 0.7536 0.0 0.6880 0.6880 0.0
p09.pddl
0.7583 0.7583 0.0 0.6914 0.6914 0.0
p10.pddl
0.7353 0.7353 0.0 0.6636 0.6636 0.0
p11.pddl
0.7476 0.7476 0.0 0.6792 0.6792 0.0
p12.pddl
0.7236 0.7236 0.0 0.6489 0.6489 0.0
p13.pddl
0.7369 0.7369 0.0 0.6659 0.6659 0.0
p14.pddl
0.7352 0.7352 0.0 0.6634 0.6634 0.0
p15.pddl
0.7373 0.7373 0.0 0.6661 0.6661 0.0
p16.pddl
0.7283 0.7283 0.0 0.6556 0.6556 0.0
p17.pddl
0.7267 0.7267 0.0 0.6529 0.6529 0.0
p18.pddl
0.7297 0.7297 0.0 0.6565 0.6565 0.0
p19.pddl
0.7271 0.7271 0.0 0.6519 0.6519 0.0
p20.pddl
0.7235 0.7235 0.0 0.6487 0.6487 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pipesworld-notankage
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-net1-b6-g4.pddl
0.6294 0.6294 0.0 0.9887 0.9887 0.0
p03-net1-b8-g3.pddl
0.7729 0.7729 0.0 0.9411 0.9411 0.0
p04-net1-b8-g5.pddl
0.5854 0.5854 0.0 0.9517 0.9517 0.0
p05-net1-b10-g4.pddl
0.6457 0.6457 0.0 0.9115 0.9115 0.0
p06-net1-b10-g6.pddl
0.3827 0.3827 0.0 0.9242 0.9242 0.0
p07-net1-b12-g5.pddl
0.9553 0.9553 0.0 0.9292 0.9292 0.0
p08-net1-b12-g7.pddl
0.9286 0.9286 0.0 0.9286 0.9286 0.0
p09-net1-b14-g6.pddl
0.8414 0.8414 0.0 0.9350 0.9350 0.0
p10-net1-b14-g8.pddl
0.8263 0.8263 0.0 0.8910 0.8910 0.0
p11-net2-b10-g2.pddl
0.3489 0.3489 0.0 0.4891 0.4891 0.0
p12-net2-b10-g4.pddl
0.3615 0.3615 0.0 0.4290 0.4290 0.0
p13-net2-b12-g3.pddl
0.8697 0.8697 0.0 0.2999 0.2999 0.0
p14-net2-b12-g5.pddl
0.4291 0.4291 0.0 0.4442 0.4442 0.0
p15-net2-b14-g4.pddl
0.5888 0.5888 0.0 0.3135 0.3135 0.0
p16-net2-b14-g6.pddl
0.2529 0.2529 0.0 -0.0000 -0.0000 0.0
p17-net2-b16-g5.pddl
0.2519 0.2519 0.0 0.4488 0.4488 0.0
p18-net2-b16-g7.pddl
0.2021 0.2021 0.0 0.4026 0.4026 0.0
p19-net2-b18-g6.pddl
0.7245 0.7245 0.0 0.6241 0.6241 0.0
p20-net2-b18-g8.pddl
0.1474 0.1474 0.0 0.2934 0.2934 0.0
p21-net3-b12-g2.pddl
0.9430 0.9430 0.0 0.6903 0.6903 0.0
p22-net3-b12-g4.pddl
0.1135 0.1135 0.0 0.1719 0.1719 0.0
p23-net3-b14-g3.pddl
0.6525 0.6525 0.0 0.2883 0.2883 0.0
p24-net3-b14-g5.pddl
0.2020 0.2020 0.0 0.0288 0.0288 0.0
p25-net3-b16-g5.pddl
0.6353 0.6353 0.0 0.0342 0.0342 0.0
p26-net3-b16-g7.pddl
0.1191 0.1191 0.0 0.2925 0.2925 0.0
p27-net3-b18-g6.pddl
0.1354 0.1354 0.0 -0.0000 -0.0000 0.0
p28-net3-b18-g7.pddl
0.1097 0.1097 0.0 -0.0000 -0.0000 0.0
p29-net3-b20-g6.pddl
0.2506 0.2506 0.0 -0.0000 -0.0000 0.0
p30-net3-b20-g8.pddl
0.1007 0.1007 0.0 0.1228 0.1228 0.0
p31-net4-b14-g3.pddl
0.7620 0.7620 0.0 0.2339 0.2339 0.0
p32-net4-b14-g5.pddl
0.2575 0.2575 0.0 0.3280 0.3280 0.0
p33-net4-b16-g5.pddl
0.2965 0.2965 0.0 0.1679 0.1679 0.0
p34-net4-b16-g6.pddl
0.1352 0.1352 0.0 0.0930 0.0930 0.0
p35-net4-b18-g4.pddl
0.2025 0.2025 0.0 -0.0000 -0.0000 0.0
p36-net4-b18-g6.pddl
0.6015 0.6015 0.0 -0.0000 -0.0000 0.0
p37-net4-b20-g5.pddl
0.3934 0.3934 0.0 0 0 0.0
p38-net4-b20-g7.pddl
0.1285 0.1285 0.0 -0.0000 -0.0000 0.0
p39-net4-b22-g7.pddl
0.6013 0.6013 0.0 0 0 0.0
p40-net4-b22-g8.pddl
0.2866 0.2866 0.0 -0.0000 -0.0000 0.0
p41-net5-b22-g2.pddl
0.5401 0.5401 0.0 -0.0000 -0.0000 0.0
p42-net5-b22-g4.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6.pddl
0.5046 0.5046 0.0 0 0 0.0
p50-net5-b30-g8.pddl
0.0317 0.0317 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
pipesworld-tankage
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-net1-b6-g4-t50.pddl
0.6058 0.6058 0.0 0.8681 0.8681 0.0
p03-net1-b8-g3-t80.pddl
0.8266 0.8266 0.0 0.7656 0.7656 0.0
p04-net1-b8-g5-t80.pddl
0.6015 0.6015 0.0 0.7585 0.7585 0.0
p05-net1-b10-g4-t50.pddl
0.6972 0.6972 0.0 0.8283 0.8283 0.0
p06-net1-b10-g6-t50.pddl
0.7258 0.7258 0.0 0.8382 0.8382 0.0
p07-net1-b12-g5-t80.pddl
0.7741 0.7741 0.0 0.9027 0.9027 0.0
p08-net1-b12-g7-t80.pddl
0.7059 0.7059 0.0 0.8214 0.8214 0.0
p09-net1-b14-g6-t50.pddl
0.0851 0.0851 0.0 0.0953 0.0953 0.0
p10-net1-b14-g8-t50.pddl
0.6308 0.6308 0.0 0.4320 0.4320 0.0
p11-net2-b10-g2-t30.pddl
0.6496 0.6496 0.0 0.2608 0.2608 0.0
p12-net2-b10-g4-t60.pddl
0.6778 0.6778 0.0 0.1450 0.1450 0.0
p13-net2-b12-g3-t70.pddl
0.7460 0.7460 0.0 -0.0000 -0.0000 0.0
p14-net2-b12-g5-t30.pddl
0.5825 0.5825 0.0 0.0992 0.0992 0.0
p15-net2-b14-g4-t30.pddl
0.5114 0.5114 0.0 -0.0000 -0.0000 0.0
p16-net2-b14-g6-t80.pddl
0.4031 0.4031 0.0 0 0 0.0
p17-net2-b16-g5-t20.pddl
0.3709 0.3709 0.0 -0.0000 -0.0000 0.0
p18-net2-b16-g7-t60.pddl
0.2771 0.2771 0.0 -0.0000 -0.0000 0.0
p19-net2-b18-g6-t60.pddl
0.6471 0.6471 0.0 -0.0000 -0.0000 0.0
p20-net2-b18-g8-t90.pddl
0.3172 0.3172 0.0 0 0 0.0
p21-net3-b12-g2-t60.pddl
0.8637 0.8637 0.0 0.1187 0.1187 0.0
p22-net3-b12-g4-t60.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p23-net3-b14-g3-t60.pddl
0.2401 0.2401 0.0 0 0 0.0
p24-net3-b14-g5-t60.pddl
0.3784 0.3784 0.0 0 0 0.0
p25-net3-b16-g5-t60.pddl
0.5003 0.5003 0.0 0 0 0.0
p26-net3-b16-g7-t70.pddl
0.0107 0.0107 0.0 0 0 0.0
p27-net3-b18-g6-t70.pddl
0.4714 0.4714 0.0 0 0 0.0
p28-net3-b18-g7-t70.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p29-net3-b20-g6-t70.pddl
0.3164 0.3164 0.0 0 0 0.0
p30-net3-b20-g8-t70.pddl
0.1521 0.1521 0.0 0 0 0.0
p31-net4-b14-g3-t20.pddl
0.0097 0.0097 0.0 0.1414 0.1414 0.0
p32-net4-b14-g5-t30.pddl
0.2532 0.2532 0.0 -0.0000 -0.0000 0.0
p33-net4-b16-g5-t60.pddl
0.4278 0.4278 0.0 0 0 0.0
p34-net4-b16-g6-t60.pddl
0.3974 0.3974 0.0 0 0 0.0
p35-net4-b18-g4-t90.pddl
0.3928 0.3928 0.0 0 0 0.0
p36-net4-b18-g6-t90.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p37-net4-b20-g5-t60.pddl
0.4712 0.4712 0.0 0 0 0.0
p38-net4-b20-g7-t60.pddl
0.2502 0.2502 0.0 0 0 0.0
p39-net4-b22-g7-t50.pddl
0.3746 0.3746 0.0 0 0 0.0
p40-net4-b22-g8-t50.pddl
0.4159 0.4159 0.0 0 0 0.0
p41-net5-b22-g2-t20.pddl
0.6939 0.6939 0.0 0 0 0.0
p42-net5-b22-g4-t50.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3-t80.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5-t80.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4-t50.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6-t50.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5-t50.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7-t50.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6-t50.pddl
0.2415 0.2415 0.0 0 0 0.0
p50-net5-b30-g8-t50.pddl
-0.0000 -0.0000 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
psr-small
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-s5-n1-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-s7-n1-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-s8-n1-l4-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-s9-n1-l4-f30.pddl
0.9978 0.9978 0.0 1.0000 1.0000 0.0
p06-s10-n1-l4-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-s11-n1-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-s12-n1-l5-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-s13-n1-l5-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10-s17-n2-l2-f30.pddl
0.8416 0.8416 0.0 1.0000 1.0000 0.0
p11-s18-n2-l2-f50.pddl
0.9082 0.9082 0.0 0.9635 0.9635 0.0
p12-s21-n2-l3-f30.pddl
0.9978 0.9978 0.0 1.0000 1.0000 0.0
p13-s22-n2-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14-s23-n2-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-s24-n2-l4-f10.pddl
0.8553 0.8553 0.0 0.2607 0.2607 0.0
p16-s29-n2-l5-f30.pddl
0.6530 0.6530 0.0 0.4804 0.4804 0.0
p17-s30-n2-l5-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18-s31-n2-l5-f70.pddl
0.9858 0.9858 0.0 1.0000 1.0000 0.0
p19-s33-n3-l2-f30.pddl
0.5908 0.5908 0.0 0.4111 0.4111 0.0
p20-s34-n3-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21-s35-n3-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22-s37-n3-l3-f30.pddl
0.5337 0.5337 0.0 0.7112 0.7112 0.0
p23-s38-n3-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24-s39-n3-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25-s40-n3-l4-f10.pddl
0.9392 0.9392 0.0 0.1161 0.1161 0.0
p26-s41-n3-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27-s42-n3-l4-f50.pddl
0.8775 0.8775 0.0 0.9374 0.9374 0.0
p28-s43-n3-l4-f70.pddl
0.9604 0.9604 0.0 1.0000 1.0000 0.0
p29-s45-n3-l5-f30.pddl
0.6204 0.6204 0.0 0.8250 0.8250 0.0
p30-s46-n3-l5-f50.pddl
0.8171 0.8171 0.0 0.8918 0.8918 0.0
p31-s49-n4-l2-f30.pddl
0.8017 0.8017 0.0 0.1608 0.1608 0.0
p32-s50-n4-l2-f50.pddl
0.8259 0.8259 0.0 0.8548 0.8548 0.0
p33-s51-n4-l2-f70.pddl
0.7638 0.7638 0.0 0.5165 0.5165 0.0
p34-s55-n4-l3-f70.pddl
0.8979 0.8979 0.0 0.9362 0.9362 0.0
p35-s57-n5-l2-f30.pddl
0.6567 0.6567 0.0 0.0301 0.0301 0.0
p36-s65-n6-l2-f30.pddl
0.6347 0.6347 0.0 -0.0000 -0.0000 0.0
p37-s67-n6-l2-f70.pddl
0.8242 0.8242 0.0 0.9059 0.9059 0.0
p38-s78-n3-l3-f50.pddl
0.9456 0.9456 0.0 1.0000 1.0000 0.0
p39-s79-n3-l3-f70.pddl
0.8099 0.8099 0.0 0.8671 0.8671 0.0
p40-s80-n3-l4-f10.pddl
0.6781 0.6781 0.0 -0.0000 -0.0000 0.0
p41-s81-n3-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p42-s82-n3-l4-f50.pddl
0.5896 0.5896 0.0 0.5268 0.5268 0.0
p43-s83-n3-l4-f70.pddl
0.8114 0.8114 0.0 0.8814 0.8814 0.0
p44-s89-n4-l2-f30.pddl
0.7383 0.7383 0.0 0.8786 0.8786 0.0
p45-s94-n4-l3-f50.pddl
0.9072 0.9072 0.0 0.9715 0.9715 0.0
p46-s97-n5-l2-f30.pddl
0.7068 0.7068 0.0 0.1731 0.1731 0.0
p47-s98-n5-l2-f50.pddl
0.8579 0.8579 0.0 0.8758 0.8758 0.0
p48-s101-n5-l3-f30.pddl
0.6598 0.6598 0.0 0.6767 0.6767 0.0
p49-s105-n6-l2-f30.pddl
0.5647 0.5647 0.0 0.5350 0.5350 0.0
p50-s107-n6-l2-f70.pddl
0.7782 0.7782 0.0 0.9082 0.9082 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
rovers
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9545 0.9545 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
0.9699 0.9699 0.0 0.8479 0.8479 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.7828 0.7828 0.0 0.6856 0.6856 0.0
p06.pddl
0.6508 0.6508 0.0 0.6774 0.6774 0.0
p07.pddl
0.8003 0.8003 0.0 0.3976 0.3976 0.0
p08.pddl
0.7378 0.7378 0.0 0.3737 0.3737 0.0
p09.pddl
0.7113 0.7113 0.0 0.0770 0.0770 0.0
p10.pddl
0.6263 0.6263 0.0 -0.0000 -0.0000 0.0
p11.pddl
0.6687 0.6687 0.0 0.2026 0.2026 0.0
p12.pddl
0.7945 0.7945 0.0 0.3283 0.3283 0.0
p13.pddl
0.5760 0.5760 0.0 0.1627 0.1627 0.0
p14.pddl
0.6385 0.6385 0.0 0.0609 0.0609 0.0
p15.pddl
0.4707 0.4707 0.0 0.0136 0.0136 0.0
p16.pddl
0.5631 0.5631 0.0 0.0557 0.0557 0.0
p17.pddl
0.5805 0.5805 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.5436 0.5436 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.4154 0.4154 0.0 0 0 0.0
p20.pddl
0.3562 0.3562 0.0 0 0 0.0
p21.pddl
0.4116 0.4116 0.0 0 0 0.0
p22.pddl
0.3491 0.3491 0.0 -0.0000 -0.0000 0.0
p23.pddl
0.3359 0.3359 0.0 0 0 0.0
p24.pddl
0.2638 0.2638 0.0 0 0 0.0
p25.pddl
0.5337 0.5337 0.0 -0.0000 -0.0000 0.0
p26.pddl
0.3932 0.3932 0.0 0 0 0.0
p27.pddl
0.3223 0.3223 0.0 0 0 0.0
p28.pddl
0.2891 0.2891 0.0 0 0 0.0
p29.pddl
0.3726 0.3726 0.0 0 0 0.0
p30.pddl
0.2772 0.2772 0.0 0 0 0.0
p31.pddl
0.2072 0.2072 0.0 0 0 0.0
p32.pddl
0.1306 0.1306 0.0 0 0 0.0
p33.pddl
0.0649 0.0649 0.0 0 0 0.0
p34.pddl
0.1461 0.1461 0.0 0 0 0.0
p35.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p36.pddl
0.0753 0.0753 0.0 0 0 0.0
p37.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p38.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p39.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p40.pddl
-0.0000 -0.0000 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
satellite
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
1.0000 1.0000 0.0 0.9927 0.9927 0.0
p02-pfile2.pddl
0.9517 0.9517 0.0 0.9430 0.9430 0.0
p03-pfile3.pddl
0.9205 0.9205 0.0 0.7142 0.7142 0.0
p04-pfile4.pddl
0.8131 0.8131 0.0 0.5523 0.5523 0.0
p05-pfile5.pddl
0.7166 0.7166 0.0 0.2655 0.2655 0.0
p06-pfile6.pddl
0.7285 0.7285 0.0 0.1451 0.1451 0.0
p07-pfile7.pddl
0.7392 0.7392 0.0 0.1052 0.1052 0.0
p08-pfile8.pddl
0.6076 0.6076 0.0 -0.0000 -0.0000 0.0
p09-pfile9.pddl
0.5564 0.5564 0.0 -0.0000 -0.0000 0.0
p10-pfile10.pddl
0.5267 0.5267 0.0 -0.0000 -0.0000 0.0
p11-pfile11.pddl
0.5762 0.5762 0.0 -0.0000 -0.0000 0.0
p12-pfile12.pddl
0.5339 0.5339 0.0 -0.0000 -0.0000 0.0
p13-pfile13.pddl
0.2844 0.2844 0.0 0 0 0.0
p14-pfile14.pddl
0.4393 0.4393 0.0 -0.0000 -0.0000 0.0
p15-pfile15.pddl
0.3102 0.3102 0.0 0 0 0.0
p16-pfile16.pddl
0.4280 0.4280 0.0 0 0 0.0
p17-pfile17.pddl
0.2592 0.2592 0.0 0 0 0.0
p18-pfile18.pddl
0.4516 0.4516 0.0 0 0 0.0
p19-pfile19.pddl
0.3579 0.3579 0.0 0 0 0.0
p20-pfile20.pddl
0.1921 0.1921 0.0 0 0 0.0
p21-HC-pfile1.pddl
0.3325 0.3325 0.0 -0.0000 -0.0000 0.0
p22-HC-pfile2.pddl
0.2836 0.2836 0.0 0 0 0.0
p23-HC-pfile3.pddl
0.1291 0.1291 0.0 -0.0000 -0.0000 0.0
p24-HC-pfile4.pddl
0.0266 0.0266 0.0 0 0 0.0
p25-HC-pfile5.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p26-HC-pfile6.pddl
0.0580 0.0580 0.0 0 0 0.0
p27-HC-pfile7.pddl
0.0700 0.0700 0.0 0 0 0.0
p28-HC-pfile8.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p29-HC-pfile9.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p30-HC-pfile10.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p31-HC-pfile11.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p32-HC-pfile12.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p33-HC-pfile13.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p34-HC-pfile14.pddl
0.1312 0.1312 0.0 0 0 0.0
p35-HC-pfile15.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p36-HC-pfile16.pddl
-0.0000 -0.0000 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
scanalyzer-08-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8922 0.8922 0.0 0.9077 0.9077 0.0
p02.pddl
0.8077 0.8077 0.0 0.8574 0.8574 0.0
p03.pddl
0.7770 0.7770 0.0 0.8609 0.8609 0.0
p04.pddl
0.7619 0.7619 0.0 0.7985 0.7985 0.0
p05.pddl
0.6726 0.6726 0.0 0.7199 0.7199 0.0
p06.pddl
0.6286 0.6286 0.0 0.7236 0.7236 0.0
p07.pddl
0.6620 0.6620 0.0 0.7135 0.7135 0.0
p08.pddl
0.5681 0.5681 0.0 0.6082 0.6082 0.0
p09.pddl
0.5203 0.5203 0.0 0.6121 0.6121 0.0
p10.pddl
0.5808 0.5808 0.0 0.6436 0.6436 0.0
p11.pddl
0.4828 0.4828 0.0 0.5147 0.5147 0.0
p12.pddl
0.4311 0.4311 0.0 0.5185 0.5185 0.0
p13.pddl
0.5124 0.5124 0.0 0.5842 0.5842 0.0
p14.pddl
0.4106 0.4106 0.0 0.4343 0.4343 0.0
p15.pddl
0.3552 0.3552 0.0 0.4380 0.4380 0.0
p16.pddl
0.4534 0.4534 0.0 0.5323 0.5323 0.0
p17.pddl
0.3478 0.3478 0.0 0.3640 0.3640 0.0
p18.pddl
0.2891 0.2891 0.0 0.3676 0.3676 0.0
p19.pddl
0.4014 0.4014 0.0 0.4863 0.4863 0.0
p20.pddl
0.2924 0.2924 0.0 0.3016 0.3016 0.0
p21.pddl
0.2305 0.2305 0.0 0.3050 0.3050 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
0.9877 0.9877 0.0 0.9545 0.9545 0.0
p26.pddl
0.7689 0.7689 0.0 0.8684 0.8684 0.0
p27.pddl
0.7820 0.7820 0.0 0.4820 0.4820 0.0
p28.pddl
0.8244 0.8244 0.0 0.7778 0.7778 0.0
p29.pddl
0.4421 0.4421 0.0 0.6847 0.6847 0.0
p30.pddl
0.6227 0.6227 0.0 0.5562 0.5562 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
scanalyzer-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.8077 0.8077 0.0 0.8574 0.8574 0.0
p03.pddl
0.7770 0.7770 0.0 0.8609 0.8609 0.0
p04.pddl
0.7619 0.7619 0.0 0.7985 0.7985 0.0
p05.pddl
0.6620 0.6620 0.0 0.7135 0.7135 0.0
p06.pddl
0.6726 0.6726 0.0 0.7199 0.7199 0.0
p07.pddl
0.4014 0.4014 0.0 0.4863 0.4863 0.0
p08.pddl
0.5808 0.5808 0.0 0.6436 0.6436 0.0
p09.pddl
0.5124 0.5124 0.0 0.5842 0.5842 0.0
p10.pddl
0.4534 0.4534 0.0 0.5323 0.5323 0.0
p11.pddl
0.9877 0.9877 0.0 0.9545 0.9545 0.0
p12.pddl
0.6286 0.6286 0.0 0.7236 0.7236 0.0
p13.pddl
0.7820 0.7820 0.0 0.4820 0.4820 0.0
p14.pddl
0.7689 0.7689 0.0 0.8684 0.8684 0.0
p15.pddl
0.5681 0.5681 0.0 0.6082 0.6082 0.0
p16.pddl
0.4828 0.4828 0.0 0.5147 0.5147 0.0
p17.pddl
0.4106 0.4106 0.0 0.4343 0.4343 0.0
p18.pddl
0.3478 0.3478 0.0 0.3640 0.3640 0.0
p19.pddl
0.2924 0.2924 0.0 0.3016 0.3016 0.0
p20.pddl
0.8244 0.8244 0.0 0.7778 0.7778 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
snake-opt18-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.6846 0.6846 0.0 0.4306 0.4306 0.0
p02.pddl
0.5107 0.5107 0.0 0.1263 0.1263 0.0
p03.pddl
0.2550 0.2550 0.0 -0.0000 -0.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.9839 0.9839 0.0 0.8313 0.8313 0.0
p06.pddl
0.6081 0.6081 0.0 0.0880 0.0880 0.0
p07.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p08.pddl
0 0 0.0 -0.0000 -0.0000 0.0
p09.pddl
0.9538 0.9538 0.0 0.6494 0.6494 0.0
p10.pddl
0.7533 0.7533 0.0 0.4092 0.4092 0.0
p11.pddl
0.6036 0.6036 0.0 -0.0000 -0.0000 0.0
p12.pddl
0.0330 0.0330 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.2475 0.2475 0.0 0 0 0.0
p14.pddl
0 0 0.0 0 0 0.0
p15.pddl
0.8024 0.8024 0.0 0.3020 0.3020 0.0
p16.pddl
0.2451 0.2451 0.0 -0.0000 -0.0000 0.0
p17.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0.4985 0.4985 0.0 0.1586 0.1586 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
sokoban-opt08-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8534 0.8534 0.0 0.5713 0.5713 0.0
p02.pddl
0.8179 0.8179 0.0 0.7602 0.7602 0.0
p03.pddl
0.9231 0.9231 0.0 0.7729 0.7729 0.0
p04.pddl
0.6731 0.6731 0.0 0.4303 0.4303 0.0
p05.pddl
0.8097 0.8097 0.0 0 0 0.0
p06.pddl
0.7827 0.7827 0.0 0.3564 0.3564 0.0
p07.pddl
0.6271 0.6271 0.0 0.1988 0.1988 0.0
p08.pddl
0.2571 0.2571 0.0 -0.0000 -0.0000 0.0
p09.pddl
0.4840 0.4840 0.0 -0.0000 -0.0000 0.0
p10.pddl
0.3820 0.3820 0.0 -0.0000 -0.0000 0.0
p11.pddl
0.1902 0.1902 0.0 0.0582 0.0582 0.0
p12.pddl
0.3662 0.3662 0.0 -0.0000 -0.0000 0.0
p13.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p14.pddl
0.5805 0.5805 0.0 0.2144 0.2144 0.0
p15.pddl
0.1623 0.1623 0.0 -0.0000 -0.0000 0.0
p16.pddl
0.2816 0.2816 0.0 0.0929 0.0929 0.0
p17.pddl
0.4621 0.4621 0.0 0.1466 0.1466 0.0
p18.pddl
0.2246 0.2246 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.1434 0.1434 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.6190 0.6190 0.0 0.5646 0.5646 0.0
p21.pddl
0.5863 0.5863 0.0 0.5398 0.5398 0.0
p22.pddl
0.2015 0.2015 0.0 -0.0000 -0.0000 0.0
p23.pddl
0.4827 0.4827 0.0 -0.0000 -0.0000 0.0
p24.pddl
0.0912 0.0912 0.0 0 0 0.0
p25.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p26.pddl
0.2178 0.2178 0.0 0 0 0.0
p27.pddl
0.3685 0.3685 0.0 0.2758 0.2758 0.0
p28.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p29.pddl
0.8707 0.8707 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
sokoban-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.7827 0.7827 0.0 0.3564 0.3564 0.0
p02.pddl
0.4621 0.4621 0.0 0.1466 0.1466 0.0
p03.pddl
0.5805 0.5805 0.0 0.2144 0.2144 0.0
p04.pddl
0.6731 0.6731 0.0 0.4303 0.4303 0.0
p05.pddl
0.2816 0.2816 0.0 0.0929 0.0929 0.0
p06.pddl
0.1902 0.1902 0.0 0.0582 0.0582 0.0
p07.pddl
0.3820 0.3820 0.0 -0.0000 -0.0000 0.0
p08.pddl
0.4840 0.4840 0.0 -0.0000 -0.0000 0.0
p09.pddl
0.6271 0.6271 0.0 0.1988 0.1988 0.0
p10.pddl
0.8097 0.8097 0.0 0 0 0.0
p11.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p12.pddl
0.6190 0.6190 0.0 0.5646 0.5646 0.0
p13.pddl
0.2571 0.2571 0.0 -0.0000 -0.0000 0.0
p14.pddl
0.3662 0.3662 0.0 -0.0000 -0.0000 0.0
p15.pddl
0.2246 0.2246 0.0 -0.0000 -0.0000 0.0
p16.pddl
0.1623 0.1623 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.1434 0.1434 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.5863 0.5863 0.0 0.5398 0.5398 0.0
p19.pddl
0.2015 0.2015 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.4827 0.4827 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
spider-opt18-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9582 0.9582 0.0 0.9463 0.9463 0.0
p02.pddl
0.6511 0.6511 0.0 0.5803 0.5803 0.0
p03.pddl
0.8093 0.8093 0.0 0.6382 0.6382 0.0
p04.pddl
0.8183 0.8183 0.0 0.5034 0.5034 0.0
p05.pddl
0.5862 0.5862 0.0 0.3744 0.3744 0.0
p06.pddl
0.4498 0.4498 0.0 -0.0000 -0.0000 0.0
p07.pddl
0.8906 0.8906 0.0 0.8476 0.8476 0.0
p08.pddl
0.9077 0.9077 0.0 0.8652 0.8652 0.0
p09.pddl
0.4603 0.4603 0.0 0.3735 0.3735 0.0
p10.pddl
0.2925 0.2925 0.0 0.0484 0.0484 0.0
p11.pddl
0.6772 0.6772 0.0 0.3578 0.3578 0.0
p12.pddl
0.5703 0.5703 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.3554 0.3554 0.0 0.2563 0.2563 0.0
p14.pddl
0.9877 0.9877 0.0 0.9531 0.9531 0.0
p15.pddl
0.9567 0.9567 0.0 0.9405 0.9405 0.0
p16.pddl
0.8855 0.8855 0.0 0.7447 0.7447 0.0
p17.pddl
0.8157 0.8157 0.0 0.8090 0.8090 0.0
p18.pddl
0.7272 0.7272 0.0 0.0006 0.0006 0.0
p19.pddl
0.7197 0.7197 0.0 0.4598 0.4598 0.0
p20.pddl
0.6908 0.6908 0.0 0.4635 0.4635 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
storage
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.9947 0.9947 0.0 0.8867 0.8867 0.0
p06.pddl
0.9682 0.9682 0.0 0.8253 0.8253 0.0
p07.pddl
0.8796 0.8796 0.0 0.8825 0.8825 0.0
p08.pddl
0.7370 0.7370 0.0 0.5760 0.5760 0.0
p09.pddl
0.7229 0.7229 0.0 0.5358 0.5358 0.0
p10.pddl
0.7649 0.7649 0.0 0.6611 0.6611 0.0
p11.pddl
0.4138 0.4138 0.0 0.3488 0.3488 0.0
p12.pddl
0.4144 0.4144 0.0 0.1311 0.1311 0.0
p13.pddl
0.3259 0.3259 0.0 0.6352 0.6352 0.0
p14.pddl
0.2072 0.2072 0.0 0.4150 0.4150 0.0
p15.pddl
0.3075 0.3075 0.0 0.1968 0.1968 0.0
p16.pddl
0.2722 0.2722 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.2346 0.2346 0.0 -0.0000 -0.0000 0.0
p18.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
termes-opt18-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.6175 0.6175 0.0 0.3379 0.3379 0.0
p02.pddl
0.3567 0.3567 0.0 0.3128 0.3128 0.0
p03.pddl
0.3329 0.3329 0.0 0.0965 0.0965 0.0
p04.pddl
0.3664 0.3664 0.0 0.1112 0.1112 0.0
p05.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p06.pddl
0.0452 0.0452 0.0 -0.0000 -0.0000 0.0
p07.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p08.pddl
-0.0000 -0.0000 0.0 -0.0000 -0.0000 0.0
p09.pddl
0 0 0.0 0 0 0.0
p10.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p11.pddl
0.5708 0.5708 0.0 0.1655 0.1655 0.0
p12.pddl
0.4890 0.4890 0.0 0.4673 0.4673 0.0
p13.pddl
0.4109 0.4109 0.0 0.1304 0.1304 0.0
p14.pddl
0.4426 0.4426 0.0 0.2396 0.2396 0.0
p15.pddl
0.1146 0.1146 0.0 0.0414 0.0414 0.0
p16.pddl
0.1880 0.1880 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.2602 0.2602 0.0 0.1788 0.1788 0.0
p18.pddl
0.5723 0.5723 0.0 0.4422 0.4422 0.0
p19.pddl
0.2891 0.2891 0.0 0.3248 0.3248 0.0
p20.pddl
0.2464 0.2464 0.0 0.1305 0.1305 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tetris-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
0.2622 0.2622 0.0 0.7802 0.7802 0.0
p01-8.pddl
0.3255 0.3255 0.0 0.7109 0.7109 0.0
p01-10.pddl
-0.0000 -0.0000 0.0 0.1118 0.1118 0.0
p02-4.pddl
0.6759 0.6759 0.0 1.0000 1.0000 0.0
p02-6.pddl
0.3502 0.3502 0.0 0.8147 0.8147 0.0
p02-8.pddl
0.3412 0.3412 0.0 0.4853 0.4853 0.0
p02-10.pddl
-0.0000 -0.0000 0.0 0.3170 0.3170 0.0
p03-4.pddl
0.4230 0.4230 0.0 0.9231 0.9231 0.0
p03-6.pddl
0.2867 0.2867 0.0 0.6464 0.6464 0.0
p03-8.pddl
0.3464 0.3464 0.0 0.6666 0.6666 0.0
p03-10.pddl
0.2659 0.2659 0.0 0.5125 0.5125 0.0
p04-6.pddl
0.2629 0.2629 0.0 0.6346 0.6346 0.0
p04-8.pddl
0.1716 0.1716 0.0 0.6036 0.6036 0.0
p04-10.pddl
0.2216 0.2216 0.0 0.5588 0.5588 0.0
p05-6.pddl
0.4149 0.4149 0.0 0.7863 0.7863 0.0
p05-8.pddl
-0.0000 -0.0000 0.0 0.6205 0.6205 0.0
p05-10.pddl
0.3177 0.3177 0.0 0.5067 0.5067 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tidybot-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.6539 0.6539 0.0 0.8306 0.8306 0.0
p03.pddl
0.9001 0.9001 0.0 0.9332 0.9332 0.0
p04.pddl
0.7801 0.7801 0.0 0.7462 0.7462 0.0
p05.pddl
0.6226 0.6226 0.0 0.5132 0.5132 0.0
p06.pddl
0.8046 0.8046 0.0 0.6864 0.6864 0.0
p07.pddl
0.6941 0.6941 0.0 0.9215 0.9215 0.0
p08.pddl
-0.0000 -0.0000 0.0 0.4660 0.4660 0.0
p09.pddl
0.4109 0.4109 0.0 0.7855 0.7855 0.0
p10.pddl
0.8694 0.8694 0.0 0.5178 0.5178 0.0
p11.pddl
0.7085 0.7085 0.0 0.6575 0.6575 0.0
p12.pddl
0.7869 0.7869 0.0 0.5329 0.5329 0.0
p13.pddl
0.4727 0.4727 0.0 0.5382 0.5382 0.0
p14.pddl
0.7866 0.7866 0.0 0.7430 0.7430 0.0
p15.pddl
0 0 0.0 0.5096 0.5096 0.0
p16.pddl
0.8107 0.8107 0.0 0.6452 0.6452 0.0
p17.pddl
0.4977 0.4977 0.0 0.2093 0.2093 0.0
p18.pddl
0.4017 0.4017 0.0 0.3962 0.3962 0.0
p19.pddl
0.7159 0.7159 0.0 0.5639 0.5639 0.0
p20.pddl
0.6721 0.6721 0.0 0.2968 0.2968 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tidybot-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.6638 0.6638 0.0 -0.0000 -0.0000 0.0
p02.pddl
0.6509 0.6509 0.0 0.4079 0.4079 0.0
p03.pddl
0.7971 0.7971 0.0 0.6668 0.6668 0.0
p04.pddl
0.8659 0.8659 0.0 0.5097 0.5097 0.0
p05.pddl
0.5491 0.5491 0.0 0.1668 0.1668 0.0
p06.pddl
0.4781 0.4781 0.0 0.1353 0.1353 0.0
p07.pddl
0.7434 0.7434 0.0 0.6526 0.6526 0.0
p08.pddl
0.8747 0.8747 0.0 0.7958 0.7958 0.0
p09.pddl
0.8042 0.8042 0.0 0.4924 0.4924 0.0
p10.pddl
0.6940 0.6940 0.0 0.2763 0.2763 0.0
p11.pddl
0.7085 0.7085 0.0 0.6575 0.6575 0.0
p12.pddl
0.7869 0.7869 0.0 0.5329 0.5329 0.0
p13.pddl
0.4727 0.4727 0.0 0.5382 0.5382 0.0
p14.pddl
0.7866 0.7866 0.0 0.7430 0.7430 0.0
p15.pddl
0 0 0.0 0.5096 0.5096 0.0
p16.pddl
0.8107 0.8107 0.0 0.6452 0.6452 0.0
p17.pddl
0.4977 0.4977 0.0 0.2093 0.2093 0.0
p18.pddl
0.4017 0.4017 0.0 0.3962 0.3962 0.0
p19.pddl
0.7159 0.7159 0.0 0.5639 0.5639 0.0
p20.pddl
0.6721 0.6721 0.0 0.2968 0.2968 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tpp
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.9877 0.9877 0.0 0.7886 0.7886 0.0
p06.pddl
0.8565 0.8565 0.0 0.4978 0.4978 0.0
p07.pddl
0.7794 0.7794 0.0 0.4248 0.4248 0.0
p08.pddl
0.7292 0.7292 0.0 0.3560 0.3560 0.0
p09.pddl
0.6639 0.6639 0.0 0.3121 0.3121 0.0
p10.pddl
0.5930 0.5930 0.0 0.2395 0.2395 0.0
p11.pddl
0.5940 0.5940 0.0 0.1702 0.1702 0.0
p12.pddl
0.5946 0.5946 0.0 0.1121 0.1121 0.0
p13.pddl
0.6153 0.6153 0.0 0.1707 0.1707 0.0
p14.pddl
0.5649 0.5649 0.0 0.0871 0.0871 0.0
p15.pddl
0.5198 0.5198 0.0 0.1189 0.1189 0.0
p16.pddl
0.4709 0.4709 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.4412 0.4412 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.5266 0.5266 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.3874 0.3874 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.3633 0.3633 0.0 -0.0000 -0.0000 0.0
p21.pddl
0.4107 0.4107 0.0 -0.0000 -0.0000 0.0
p22.pddl
0.4926 0.4926 0.0 -0.0000 -0.0000 0.0
p23.pddl
0.4073 0.4073 0.0 -0.0000 -0.0000 0.0
p24.pddl
0.2772 0.2772 0.0 -0.0000 -0.0000 0.0
p25.pddl
0.3659 0.3659 0.0 -0.0000 -0.0000 0.0
p26.pddl
0.3689 0.3689 0.0 -0.0000 -0.0000 0.0
p27.pddl
0.3387 0.3387 0.0 -0.0000 -0.0000 0.0
p28.pddl
0.3265 0.3265 0.0 0 0 0.0
p29.pddl
0.2306 0.2306 0.0 0 0 0.0
p30.pddl
0.2621 0.2621 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt08-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9775 0.9775 0.0
p02.pddl
0.9906 0.9906 0.0 0.7702 0.7702 0.0
p03.pddl
0.8691 0.8691 0.0 0.6687 0.6687 0.0
p04.pddl
0.7930 0.7930 0.0 0.6280 0.6280 0.0
p05.pddl
0.7357 0.7357 0.0 0.4838 0.4838 0.0
p06.pddl
0.6767 0.6767 0.0 0.2709 0.2709 0.0
p07.pddl
0.6175 0.6175 0.0 0.1004 0.1004 0.0
p08.pddl
0.6554 0.6554 0.0 0.0891 0.0891 0.0
p09.pddl
0.5632 0.5632 0.0 0.0093 0.0093 0.0
p10.pddl
0.5562 0.5562 0.0 -0.0000 -0.0000 0.0
p11.pddl
1.0000 1.0000 0.0 0.8643 0.8643 0.0
p12.pddl
0.9538 0.9538 0.0 0.6898 0.6898 0.0
p13.pddl
0.8514 0.8514 0.0 0.4785 0.4785 0.0
p14.pddl
0.7920 0.7920 0.0 0.4109 0.4109 0.0
p15.pddl
0.5715 0.5715 0.0 0.3633 0.3633 0.0
p16.pddl
0.5439 0.5439 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.4924 0.4924 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.4371 0.4371 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.4199 0.4199 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.4465 0.4465 0.0 -0.0000 -0.0000 0.0
p21.pddl
0.9867 0.9867 0.0 0.9463 0.9463 0.0
p22.pddl
0.9280 0.9280 0.0 0.7966 0.7966 0.0
p23.pddl
0.8637 0.8637 0.0 0.6604 0.6604 0.0
p24.pddl
0.8844 0.8844 0.0 0.6151 0.6151 0.0
p25.pddl
0.7437 0.7437 0.0 0.4593 0.4593 0.0
p26.pddl
0.6843 0.6843 0.0 0.2512 0.2512 0.0
p27.pddl
0.6872 0.6872 0.0 0.2932 0.2932 0.0
p28.pddl
0.5173 0.5173 0.0 -0.0000 -0.0000 0.0
p29.pddl
0.5972 0.5972 0.0 0.0042 0.0042 0.0
p30.pddl
0.5556 0.5556 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8637 0.8637 0.0 0.6604 0.6604 0.0
p02.pddl
0.8691 0.8691 0.0 0.6687 0.6687 0.0
p03.pddl
0.9538 0.9538 0.0 0.6898 0.6898 0.0
p04.pddl
0.8514 0.8514 0.0 0.4785 0.4785 0.0
p05.pddl
0.8844 0.8844 0.0 0.6151 0.6151 0.0
p06.pddl
0.7930 0.7930 0.0 0.6280 0.6280 0.0
p07.pddl
0.7828 0.7828 0.0 0.5274 0.5274 0.0
p08.pddl
0.7310 0.7310 0.0 0.3008 0.3008 0.0
p09.pddl
0.6867 0.6867 0.0 0.4041 0.4041 0.0
p10.pddl
0.6434 0.6434 0.0 0.2706 0.2706 0.0
p11.pddl
0.6095 0.6095 0.0 0.3496 0.3496 0.0
p12.pddl
0.6072 0.6072 0.0 0.1515 0.1515 0.0
p13.pddl
0.6891 0.6891 0.0 0.4356 0.4356 0.0
p14.pddl
0.6395 0.6395 0.0 0.2505 0.2505 0.0
p15.pddl
0.6545 0.6545 0.0 0.4479 0.4479 0.0
p16.pddl
0.5553 0.5553 0.0 0.1931 0.1931 0.0
p17.pddl
0.7357 0.7357 0.0 0.4838 0.4838 0.0
p18.pddl
0.7920 0.7920 0.0 0.4109 0.4109 0.0
p19.pddl
0.7437 0.7437 0.0 0.4593 0.4593 0.0
p20.pddl
0.6767 0.6767 0.0 0.2709 0.2709 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8822 0.8822 0.0 0.7592 0.7592 0.0
p02.pddl
0.8355 0.8355 0.0 0.5325 0.5325 0.0
p03.pddl
0.8542 0.8542 0.0 0.5293 0.5293 0.0
p04.pddl
0.7986 0.7986 0.0 0.3505 0.3505 0.0
p05.pddl
0.6994 0.6994 0.0 0.1029 0.1029 0.0
p06.pddl
0.6704 0.6704 0.0 0.2384 0.2384 0.0
p07.pddl
0.8204 0.8204 0.0 0.4757 0.4757 0.0
p08.pddl
0.7641 0.7641 0.0 0.3353 0.3353 0.0
p09.pddl
0.7182 0.7182 0.0 0.2481 0.2481 0.0
p10.pddl
0.6796 0.6796 0.0 -0.0000 -0.0000 0.0
p11.pddl
0.5863 0.5863 0.0 -0.0000 -0.0000 0.0
p12.pddl
0.5517 0.5517 0.0 -0.0000 -0.0000 0.0
p13.pddl
0.8528 0.8528 0.0 0.4983 0.4983 0.0
p14.pddl
0.7725 0.7725 0.0 0.4973 0.4973 0.0
p15.pddl
0.7689 0.7689 0.0 0.3395 0.3395 0.0
p16.pddl
0.7213 0.7213 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.5797 0.5797 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.6174 0.6174 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.5589 0.5589 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.5589 0.5589 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
trucks-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8014 0.8014 0.0 0.7750 0.7750 0.0
p02.pddl
0.7567 0.7567 0.0 0.2961 0.2961 0.0
p03.pddl
0.6737 0.6737 0.0 -0.0000 -0.0000 0.0
p04.pddl
0.2948 0.2948 0.0 0.5885 0.5885 0.0
p05.pddl
0.5711 0.5711 0.0 0.5252 0.5252 0.0
p06.pddl
0.5355 0.5355 0.0 0.4903 0.4903 0.0
p07.pddl
0.3043 0.3043 0.0 -0.0000 -0.0000 0.0
p08.pddl
0.4529 0.4529 0.0 0 0 0.0
p09.pddl
0.2718 0.2718 0.0 0 0 0.0
p10.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p11.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p12.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p13.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p14.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p15.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p16.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p17.pddl
-0.0000 -0.0000 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0 0 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
visitall-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem02-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem03-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem03-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem04-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem04-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem05-full.pddl
0.9524 0.9524 0.0 1.0000 1.0000 0.0
problem05-half.pddl
0.9811 0.9811 0.0 0.9848 0.9848 0.0
problem06-full.pddl
0.8609 0.8609 0.0 0.9830 0.9830 0.0
problem06-half.pddl
0.9264 0.9264 0.0 0.9560 0.9560 0.0
problem07-full.pddl
0.8640 0.8640 0.0 0.9174 0.9174 0.0
problem07-half.pddl
0.8678 0.8678 0.0 0.9129 0.9129 0.0
problem08-full.pddl
0.8040 0.8040 0.0 0.9139 0.9139 0.0
problem08-half.pddl
0.8270 0.8270 0.0 0.8996 0.8996 0.0
problem09-full.pddl
0.7815 0.7815 0.0 0.8859 0.8859 0.0
problem09-half.pddl
0.7467 0.7467 0.0 0.8090 0.8090 0.0
problem10-full.pddl
0.7539 0.7539 0.0 0.8618 0.8618 0.0
problem10-half.pddl
0.7646 0.7646 0.0 0.8212 0.8212 0.0
problem11-full.pddl
0.6863 0.6863 0.0 0.8088 0.8088 0.0
problem11-half.pddl
0.7659 0.7659 0.0 0.7576 0.7576 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
visitall-opt14-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
0.9524 0.9524 0.0 1.0000 1.0000 0.0
p-1-6.pddl
0.8609 0.8609 0.0 0.9830 0.9830 0.0
p-1-7.pddl
0.8640 0.8640 0.0 0.9174 0.9174 0.0
p-1-8.pddl
0.8040 0.8040 0.0 0.9139 0.9139 0.0
p-1-9.pddl
0.7815 0.7815 0.0 0.8859 0.8859 0.0
p-1-10.pddl
0.7539 0.7539 0.0 0.8618 0.8618 0.0
p-1-11.pddl
0.6863 0.6863 0.0 0.8088 0.8088 0.0
p-1-12.pddl
0.7054 0.7054 0.0 0.8181 0.8181 0.0
p-1-13.pddl
0.6366 0.6366 0.0 0.7935 0.7935 0.0
p-1-14.pddl
0.6139 0.6139 0.0 0.7801 0.7801 0.0
p-1-15.pddl
0.5973 0.5973 0.0 0.7409 0.7409 0.0
p-1-16.pddl
0.5730 0.5730 0.0 0.7468 0.7468 0.0
p-1-17.pddl
0.5783 0.5783 0.0 0.7149 0.7149 0.0
p-1-18.pddl
0.5480 0.5480 0.0 0.7061 0.7061 0.0
p-05-5.pddl
0.9483 0.9483 0.0 1.0000 1.0000 0.0
p-05-6.pddl
0.9231 0.9231 0.0 0.9450 0.9450 0.0
p-05-7.pddl
0.8401 0.8401 0.0 0.9194 0.9194 0.0
p-05-8.pddl
0.8187 0.8187 0.0 0.8786 0.8786 0.0
p-05-9.pddl
0.7935 0.7935 0.0 0.8343 0.8343 0.0
p-05-10.pddl
0.7744 0.7744 0.0 0.8421 0.8421 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
woodworking-opt08-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.9332 0.9332 0.0
p02.pddl
0.5872 0.5872 0.0 0.9362 0.9362 0.0
p03.pddl
0.7922 0.7922 0.0 0.8409 0.8409 0.0
p04.pddl
0.7757 0.7757 0.0 0 0 0.0
p05.pddl
0.2521 0.2521 0.0 0.6982 0.6982 0.0
p06.pddl
0.7792 0.7792 0.0 0.2454 0.2454 0.0
p07.pddl
0.6960 0.6960 0.0 0.6577 0.6577 0.0
p08.pddl
0.7084 0.7084 0.0 0 0 0.0
p09.pddl
0.1566 0.1566 0.0 0 0 0.0
p10.pddl
0.5619 0.5619 0.0 0.0366 0.0366 0.0
p11.pddl
1.0000 1.0000 0.0 0.9120 0.9120 0.0
p12.pddl
0.9205 0.9205 0.0 0.8811 0.8811 0.0
p13.pddl
0.8694 0.8694 0.0 0.7474 0.7474 0.0
p14.pddl
0.2971 0.2971 0.0 0.8471 0.8471 0.0
p15.pddl
0.2322 0.2322 0.0 0.7938 0.7938 0.0
p16.pddl
0.2413 0.2413 0.0 0 0 0.0
p17.pddl
0.1941 0.1941 0.0 0.3177 0.3177 0.0
p18.pddl
0.6973 0.6973 0.0 0.2138 0.2138 0.0
p19.pddl
0.6256 0.6256 0.0 0.6904 0.6904 0.0
p20.pddl
0.1352 0.1352 0.0 0.1101 0.1101 0.0
p21.pddl
0.7499 0.7499 0.0 1.0000 1.0000 0.0
p22.pddl
0.9811 0.9811 0.0 0.9927 0.9927 0.0
p23.pddl
0.9437 0.9437 0.0 0.9437 0.9437 0.0
p24.pddl
0.2933 0.2933 0.0 -0.0000 -0.0000 0.0
p25.pddl
0.1939 0.1939 0.0 0.7854 0.7854 0.0
p26.pddl
0.7701 0.7701 0.0 0 0 0.0
p27.pddl
0.1902 0.1902 0.0 0 0 0.0
p28.pddl
0.1049 0.1049 0.0 0 0 0.0
p29.pddl
0.6527 0.6527 0.0 0.6747 0.6747 0.0
p30.pddl
0.0617 0.0617 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
woodworking-opt11-strips
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9437 0.9437 0.0 0.9437 0.9437 0.0
p02.pddl
0.9205 0.9205 0.0 0.8811 0.8811 0.0
p03.pddl
0.8694 0.8694 0.0 0.7474 0.7474 0.0
p04.pddl
0.7922 0.7922 0.0 0.8409 0.8409 0.0
p05.pddl
0.2933 0.2933 0.0 -0.0000 -0.0000 0.0
p06.pddl
0.7757 0.7757 0.0 0 0 0.0
p07.pddl
0.2971 0.2971 0.0 0.8471 0.8471 0.0
p08.pddl
0.1939 0.1939 0.0 0.7854 0.7854 0.0
p09.pddl
0.2521 0.2521 0.0 0.6982 0.6982 0.0
p10.pddl
0.2322 0.2322 0.0 0.7938 0.7938 0.0
p11.pddl
0.7701 0.7701 0.0 0 0 0.0
p12.pddl
0.2413 0.2413 0.0 0 0 0.0
p13.pddl
0.7792 0.7792 0.0 0.2454 0.2454 0.0
p14.pddl
0.1902 0.1902 0.0 0 0 0.0
p15.pddl
0.1941 0.1941 0.0 0.3177 0.3177 0.0
p16.pddl
0.6960 0.6960 0.0 0.6577 0.6577 0.0
p17.pddl
0.1049 0.1049 0.0 0 0 0.0
p18.pddl
0.6973 0.6973 0.0 0.2138 0.2138 0.0
p19.pddl
0.7084 0.7084 0.0 0 0 0.0
p20.pddl
0.6527 0.6527 0.0 0.6747 0.6747 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
zenotravel
Show table
score_generated
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
0.9169 0.9169 0.0 0.7072 0.7072 0.0
p04.pddl
0.9139 0.9139 0.0 0.6824 0.6824 0.0
p05.pddl
0.8571 0.8571 0.0 0.6189 0.6189 0.0
p06.pddl
0.8476 0.8476 0.0 0.5189 0.5189 0.0
p07.pddl
0.8465 0.8465 0.0 0.5744 0.5744 0.0
p08.pddl
0.7236 0.7236 0.0 0.4462 0.4462 0.0
p09.pddl
0.7095 0.7095 0.0 0.3987 0.3987 0.0
p10.pddl
0.6379 0.6379 0.0 0.3680 0.3680 0.0
p11.pddl
0.6932 0.6932 0.0 0.3059 0.3059 0.0
p12.pddl
0.6468 0.6468 0.0 0.3191 0.3191 0.0
p13.pddl
0.5714 0.5714 0.0 0.2401 0.2401 0.0
p14.pddl
0.4158 0.4158 0.0 -0.0000 -0.0000 0.0
p15.pddl
0.4215 0.4215 0.0 -0.0000 -0.0000 0.0
p16.pddl
0.3538 0.3538 0.0 -0.0000 -0.0000 0.0
p17.pddl
0.3644 0.3644 0.0 -0.0000 -0.0000 0.0
p18.pddl
0.3231 0.3231 0.0 -0.0000 -0.0000 0.0
p19.pddl
0.3480 0.3480 0.0 -0.0000 -0.0000 0.0
p20.pddl
0.2151 0.2151 0.0 -0.0000 -0.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
score_memory
Show table
The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5021 0.5013 -0.0007 0.4998 0.4997 -0.0001
p02.pddl
0.4845 0.4835 -0.001 0.4804 0.4804 0.0
p03.pddl
0.4515 0.4504 -0.0011 0.4470 0.4470 0.0
p04.pddl
0.4959 0.4952 -0.0007 0.4936 0.4936 0.0
p05.pddl
0.4619 0.4608 -0.0011 0.4571 0.4571 0.0
p06.pddl
0.4399 0.4386 -0.0013 0.4343 0.4343 -0.0
p07.pddl
0.4860 0.4852 -0.0008 0.4833 0.4833 -0.0
p08.pddl
0.4534 0.4522 -0.0011 0.4498 0.4498 0.0
p09.pddl
0.4146 0.4132 -0.0013 0.4097 0.4097 -0.0
p10.pddl
0.4708 0.4698 -0.001 0.4672 0.4672 0.0
p11.pddl
0.4468 0.4457 -0.0011 0.4417 0.4417 -0.0
p12.pddl
0.4091 0.4078 -0.0013 0.4041 0.4041 0.0
p13.pddl
0.4658 0.4647 -0.0011 0.4621 0.4626 0.0004
p14.pddl
0.4420 0.4408 -0.0012 0.4376 0.4376 -0.0
p15.pddl
0.4014 0.4001 -0.0013 0.3949 0.3949 0.0
p16.pddl
0.4614 0.4602 -0.0012 0.4570 0.4570 0.0
p17.pddl
0.4358 0.4345 -0.0013 0.4310 0.4310 0.0
p18.pddl
0.3950 0.3938 -0.0013 0.3896 0.3896 0.0
p19.pddl
0.4568 0.4556 -0.0012 0.4534 0.4534 0.0
p20.pddl
0.4154 0.4140 -0.0014 0.4104 0.4104 0.0
Sum of diffs
-0.0226
0.0003
Arithmetic mean of diffs
-0.0011
0.0000
airport
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p02-airport1-p1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p03-airport1-p2.pddl
0.5595 0.5598 0.0003 0.5595 0.5594 -0.0
p04-airport2-p1.pddl
0.5595 0.5595 0.0 0.5585 0.5585 0.0
p05-airport2-p1.pddl
0.5592 0.5592 -0.0 0.5582 0.5582 -0.0
p06-airport2-p2.pddl
0.5585 0.5585 -0.0 0.5570 0.5569 -0.0
p07-airport2-p2.pddl
0.5585 0.5585 -0.0 0.5570 0.5569 -0.0
p08-airport2-p3.pddl
0.5579 0.5576 -0.0003 0.5547 0.5548 0.0
p09-airport2-p4.pddl
0.5572 0.5571 -0.0001 0.5522 0.5522 -0.0
p10-airport3-p1.pddl
0.5592 0.5592 0.0 0.5582 0.5582 0.0
p11-airport3-p1.pddl
0.5592 0.5592 -0.0 0.5582 0.5582 -0.0
p12-airport3-p2.pddl
0.5585 0.5585 -0.0 0.5566 0.5566 -0.0
p13-airport3-p2.pddl
0.5585 0.5585 -0.0 0.5566 0.5566 -0.0
p14-airport3-p3.pddl
0.5573 0.5572 -0.0001 0.5538 0.5541 0.0003
p15-airport3-p3.pddl
0.5576 0.5575 -0.0001 0.5541 0.5541 -0.0
p16-airport3-p4.pddl
0.5461 0.5460 -0.0001 0.5514 0.5514 -0.0
p17-airport3-p5.pddl
0.5533 0.5533 -0.0 0.4999 0.4999 -0.0
p18-airport3-p6.pddl
0.5425 0.5425 -0.0 0.3242 0.3242 -0.0
p19-airport3-p6.pddl
0.5523 0.5523 -0.0 0.2881 0.2881 0.0
p20-airport3-p7.pddl
0.5248 0.5248 -0.0 0.0466 0.0466 -0.0
p21-airport4halfMUC-p2.pddl
0.5499 0.5496 -0.0004 0.5235 0.5234 -0.0001
p22-airport4halfMUC-p3.pddl
0.5105 0.5105 0.0 0.5002 0.5002 0.0
p23-airport4halfMUC-p4.pddl
0.4822 0.4822 -0.0 0.4738 0.4739 0.0001
p24-airport4halfMUC-p4.pddl
0.4935 0.4935 -0.0 0.4803 0.4803 -0.0
p25-airport4halfMUC-p5.pddl
0.4736 0.4735 -0.0 0 0 0.0
p26-airport4halfMUC-p6.pddl
0 0 0.0 0 0 0.0
p27-airport4halfMUC-p6.pddl
0.4663 0.4663 -0.0 0 0 0.0
p28-airport4halfMUC-p7.pddl
0 0 0.0 0 0 0.0
p29-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p30-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p31-airport4halfMUC-p9.pddl
0 0 0.0 0 0 0.0
p32-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p33-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p34-airport4halfMUC-p11.pddl
0 0 0.0 0 0 0.0
p35-airport4halfMUC-p12.pddl
0 0 0.0 0 0 0.0
p36-airport5MUC-p2.pddl
0.5488 0.5486 -0.0002 0.5233 0.5233 -0.0
p37-airport5MUC-p3.pddl
0.5162 0.5164 0.0002 0.3581 0.3581 -0.0
p38-airport5MUC-p3.pddl
0.5038 0.5038 -0.0 0.4964 0.4965 0.0
p39-airport5MUC-p4.pddl
0.4940 0.4940 -0.0 0 0 0.0
p40-airport5MUC-p4.pddl
0.5386 0.5382 -0.0004 0.3332 0.3332 -0.0
p41-airport5MUC-p4.pddl
0.4936 0.4936 0.0 0 0 0.0
p42-airport5MUC-p5.pddl
0 0 0.0 0 0 0.0
p43-airport5MUC-p5.pddl
0.4788 0.4788 -0.0 0.4446 0.4449 0.0003
p44-airport5MUC-p5.pddl
0.4635 0.4635 -0.0 0 0 0.0
p45-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p46-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p47-airport5MUC-p8.pddl
0 0 0.0 0 0 0.0
p48-airport5MUC-p9.pddl
0 0 0.0 0 0 0.0
p49-airport5MUC-p10.pddl
0 0 0.0 0 0 0.0
p50-airport5MUC-p15.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0014
0.0001
Arithmetic mean of diffs
-0.0000
0.0000
barman-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
0.5588 0.5588 -0.0 0.5571 0.5571 0.0
pfile01-002.pddl
0.5588 0.5588 -0.0 0.5577 0.5577 0.0
pfile01-003.pddl
0.5588 0.5588 -0.0 0.5577 0.5577 0.0
pfile01-004.pddl
0.5588 0.5588 -0.0 0.5577 0.5577 0.0
pfile02-005.pddl
0.5584 0.5584 -0.0 0.5501 0.5501 -0.0
pfile02-006.pddl
0.5584 0.5584 -0.0 0.4910 0.4910 0.0
pfile02-007.pddl
0.5584 0.5584 -0.0 0.5501 0.5501 0.0
pfile02-008.pddl
0.5584 0.5584 -0.0 0.5485 0.5486 0.0
pfile03-009.pddl
0.5579 0.5578 -0.0 0.5238 0.5238 -0.0
pfile03-010.pddl
0.5578 0.5578 -0.0 0.5236 0.5235 -0.0001
pfile03-011.pddl
0.5579 0.5578 -0.0 0.5214 0.5213 -0.0001
pfile03-012.pddl
0.5578 0.5578 -0.0 0.5213 0.5213 -0.0
pfile04-013.pddl
0.5571 0.5568 -0.0003 0.4405 0.4404 -0.0001
pfile04-014.pddl
0.5568 0.5568 0.0 0.3659 0.3659 -0.0
pfile04-015.pddl
0.5565 0.5565 0.0 0.4321 0.4320 -0.0001
pfile04-016.pddl
0.5565 0.5562 -0.0003 0.4405 0.4405 -0.0
pfile05-017.pddl
0.5561 0.5561 -0.0 0.3842 0.3842 -0.0001
pfile05-018.pddl
0.5561 0.5561 0.0 0.3684 0.3684 -0.0
pfile05-019.pddl
0.5561 0.5561 -0.0 0.3168 0.3169 0.0
pfile05-020.pddl
0.5564 0.5564 0.0 0.2856 0.2856 0.0
Sum of diffs
-0.0009
-0.0005
Arithmetic mean of diffs
-0.0000
-0.0000
barman-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
0.5584 0.5584 -0.0 0.4911 0.4910 -0.0
p435-2.pddl
0.5584 0.5584 -0.0 0.5501 0.5501 0.0
p435-3.pddl
0.5584 0.5584 -0.0 0.4910 0.4910 -0.0
p536-1.pddl
0.5579 0.5578 -0.0 0.2651 0.2651 -0.0
p536-2.pddl
0.5578 0.5578 -0.0 0.5236 0.5236 0.0
p536-3.pddl
0.5579 0.5578 -0.0 0.5237 0.5237 -0.0
p638-1.pddl
0.5571 0.5572 0.0 0.4404 0.4404 0.0
p638-2.pddl
0.5571 0.5572 0.0 0.3801 0.3801 -0.0
p638-3.pddl
0.5568 0.5568 0.0 0.4330 0.4329 -0.0001
p739-1.pddl
0.5564 0.5564 0.0 0.3187 0.3187 -0.0
p739-2.pddl
0.5552 0.5548 -0.0003 0.3135 0.3135 -0.0
p739-3.pddl
0.5561 0.5560 -0.0 0.3136 0.3136 -0.0
p839-1.pddl
0.5547 0.5547 -0.0 0.2383 0.2383 0.0
p839-2.pddl
0.5551 0.5551 -0.0 0.2408 0.2408 0.0
Sum of diffs
-0.0004
-0.0002
Arithmetic mean of diffs
-0.0000
-0.0000
blocks
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
probBLOCKS-4-1.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
probBLOCKS-4-2.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
probBLOCKS-5-0.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
probBLOCKS-5-1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
probBLOCKS-5-2.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
probBLOCKS-6-0.pddl
0.5598 0.5597 -0.0001 0.5598 0.5597 -0.0001
probBLOCKS-6-1.pddl
0.5598 0.5597 -0.0001 0.5598 0.5597 -0.0001
probBLOCKS-6-2.pddl
0.5598 0.5597 -0.0001 0.5598 0.5597 -0.0001
probBLOCKS-7-0.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
probBLOCKS-7-1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
probBLOCKS-7-2.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
probBLOCKS-8-0.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
probBLOCKS-8-1.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
probBLOCKS-8-2.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
probBLOCKS-9-0.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
probBLOCKS-9-1.pddl
0.5594 0.5594 -0.0 0.5594 0.5591 -0.0003
probBLOCKS-9-2.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
probBLOCKS-10-0.pddl
0.5593 0.5591 -0.0002 0.5590 0.5590 0.0
probBLOCKS-10-1.pddl
0.5593 0.5591 -0.0002 0.5590 0.5587 -0.0003
probBLOCKS-10-2.pddl
0.5593 0.5591 -0.0002 0.5590 0.5590 0.0
probBLOCKS-11-0.pddl
0.5591 0.5591 0.0 0.5591 0.5591 -0.0
probBLOCKS-11-1.pddl
0.5591 0.5591 0.0 0.5585 0.5584 -0.0
probBLOCKS-11-2.pddl
0.5591 0.5591 0.0 0.5591 0.5591 -0.0
probBLOCKS-12-0.pddl
0.5588 0.5588 -0.0 0.5585 0.5585 -0.0
probBLOCKS-12-1.pddl
0.5588 0.5588 -0.0 0.5582 0.5584 0.0001
probBLOCKS-13-0.pddl
0.5587 0.5584 -0.0004 0.5584 0.5584 -0.0
probBLOCKS-13-1.pddl
0.5584 0.5584 -0.0 0.5581 0.5581 -0.0
probBLOCKS-14-0.pddl
0.5585 0.5585 -0.0001 0.5582 0.5582 -0.0
probBLOCKS-14-1.pddl
0.5585 0.5585 -0.0001 0.5581 0.5581 0.0
probBLOCKS-15-0.pddl
0.5581 0.5581 -0.0 0.5570 0.5569 -0.0
probBLOCKS-15-1.pddl
0.5581 0.5581 -0.0 0.5410 0.5412 0.0002
probBLOCKS-16-1.pddl
0.5579 0.5579 -0.0001 0.5541 0.5541 0.0
probBLOCKS-16-2.pddl
0.5576 0.5575 -0.0001 0.5557 0.5554 -0.0003
probBLOCKS-17-0.pddl
0.5570 0.5569 -0.0002 0.4528 0.4528 -0.0
Sum of diffs
-0.0020
-0.0011
Arithmetic mean of diffs
-0.0001
-0.0000
childsnack-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
0.5592 0.5591 -0.0 0.4640 0.4639 -0.0
child-snack_pfile01.pddl
0.5592 0.5591 -0.0 0.4602 0.4602 -0.0
child-snack_pfile02-2.pddl
0.5581 0.5579 -0.0001 0.3150 0.3150 -0.0
child-snack_pfile02.pddl
0.5587 0.5586 -0.0001 0.3001 0.3001 -0.0
child-snack_pfile03-2.pddl
0.5545 0.5548 0.0002 0.1320 0.1320 0.0
child-snack_pfile03.pddl
0.5555 0.5554 -0.0 0.0885 0.0885 0.0
child-snack_pfile04-2.pddl
0.5529 0.5529 0.0 0 0 0.0
child-snack_pfile04.pddl
0.5520 0.5520 0.0 0 0 0.0
child-snack_pfile05-2.pddl
0.5490 0.5489 -0.0001 0 0 0.0
child-snack_pfile05.pddl
0.5489 0.5489 -0.0001 0 0 0.0
child-snack_pfile06-2.pddl
0.5446 0.5447 0.0001 0 0 0.0
child-snack_pfile06.pddl
0.5435 0.5436 0.0001 0 0 0.0
child-snack_pfile07-2.pddl
0.5382 0.5382 0.0 0 0 0.0
child-snack_pfile07.pddl
0.5328 0.5329 0.0001 0 0 0.0
child-snack_pfile08-2.pddl
0.5307 0.5309 0.0001 0 0 0.0
child-snack_pfile08.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0001
-0.0001
Arithmetic mean of diffs
0.0000
-0.0000
data-network-opt18-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5587 0.5590 0.0003 0.5587 0.5587 0.0
p02.pddl
0.5585 0.5585 -0.0 0.5585 0.5584 -0.0
p03.pddl
0.5584 0.5584 -0.0 0.5581 0.5581 0.0
p04.pddl
0.5576 0.5575 -0.0001 0.5570 0.5570 0.0
p05.pddl
0.5578 0.5577 -0.0 0.5574 0.5574 0.0
p06.pddl
0.5576 0.5575 -0.0 0.5572 0.5572 0.0
p07.pddl
0.5572 0.5572 -0.0001 0.3395 0.3395 -0.0
p08.pddl
0.5544 0.5544 -0.0001 0.5572 0.5572 -0.0
p09.pddl
0.5585 0.5584 -0.0 0.5581 0.5581 -0.0
p10.pddl
0.5578 0.5578 -0.0 0.5575 0.5575 -0.0
p11.pddl
0.5576 0.5576 -0.0001 0.5570 0.5572 0.0002
p12.pddl
0.5575 0.5572 -0.0003 0.5572 0.5572 -0.0
p13.pddl
0.5573 0.5572 -0.0001 0.5566 0.5566 0.0
p14.pddl
0.5555 0.5554 -0.0001 0.5552 0.5552 0.0
p15.pddl
0.5569 0.5568 -0.0001 0.5565 0.5565 0.0
p16.pddl
0.5558 0.5555 -0.0003 0.5531 0.5531 0.0
p17.pddl
0.5550 0.5548 -0.0002 0.5541 0.5541 0.0
p18.pddl
0.5463 0.5462 -0.0001 0.3960 0.3960 -0.0
p19.pddl
0.5540 0.5539 -0.0001 0.5350 0.5351 0.0001
p20.pddl
0.5521 0.5520 -0.0 0.2330 0.2330 0.0
Sum of diffs
-0.0016
0.0002
Arithmetic mean of diffs
-0.0001
0.0000
depot
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p02.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p03.pddl
0.5582 0.5582 -0.0 0.5581 0.5582 0.0
p04.pddl
0.5579 0.5577 -0.0002 0.5576 0.5579 0.0003
p05.pddl
0.5242 0.5241 -0.0 0.5567 0.5567 0.0
p06.pddl
0.0733 0.0733 0.0 0.5529 0.5529 -0.0
p07.pddl
0.5588 0.5587 -0.0 0.5377 0.5377 -0.0
p08.pddl
0.5543 0.5543 -0.0 0.5560 0.5559 -0.0001
p09.pddl
0.5362 0.5362 -0.0 0.4271 0.4271 0.0
p10.pddl
0.5527 0.5527 -0.0 0.5572 0.5572 0.0
p11.pddl
0.5425 0.5425 -0.0 0.5541 0.5540 -0.0
p12.pddl
0.5239 0.5239 -0.0 0 0 0.0
p13.pddl
0.5563 0.5560 -0.0003 0.5563 0.5563 0.0
p14.pddl
0.5525 0.5523 -0.0002 0.3702 0.3702 0.0
p15.pddl
0.4065 0.4065 -0.0 0.0649 0.0649 -0.0
p16.pddl
0.5554 0.5554 -0.0 0.3670 0.3669 -0.0
p17.pddl
0.5509 0.5506 -0.0003 0.5460 0.5460 -0.0
p18.pddl
0.5420 0.5416 -0.0003 0 0 0.0
p19.pddl
0.5369 0.5369 0.0 0.0444 0.0444 -0.0
p20.pddl
0 0 0.0 0.5083 0.5084 0.0
p21.pddl
0.5343 0.5338 -0.0005 0.1534 0.1534 -0.0
p22.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0021
0.0001
Arithmetic mean of diffs
-0.0001
0.0000
driverlog
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p02.pddl
0.5585 0.5585 -0.0 0.5598 0.5601 0.0003
p03.pddl
0.5598 0.5598 0.0 0.5598 0.5598 -0.0
p04.pddl
0.5582 0.5581 -0.0 0.5598 0.5598 -0.0
p05.pddl
0.5575 0.5575 -0.0 0.5585 0.5585 -0.0
p06.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p07.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p08.pddl
0.5560 0.5559 -0.0 0.5595 0.5598 0.0003
p09.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p10.pddl
0.5595 0.5594 -0.0 0.5592 0.5591 -0.0
p11.pddl
0.5594 0.5594 -0.0 0.5591 0.5591 -0.0
p12.pddl
0.5543 0.5543 -0.0 0.5587 0.5587 0.0
p13.pddl
0.5570 0.5569 -0.0001 0.5583 0.5583 -0.0
p14.pddl
0.5585 0.5584 -0.0 0.5583 0.5583 0.0
p15.pddl
0.5568 0.5568 -0.0001 0.5464 0.5464 -0.0
p16.pddl
0.5190 0.5190 -0.0 0.4937 0.4937 -0.0001
p17.pddl
0.5521 0.5522 0.0001 0 0 0.0
p18.pddl
0.5052 0.5051 -0.0 0.3872 0.3872 -0.0
p19.pddl
0.5001 0.5002 0.0001 0.2206 0.2206 -0.0
p20.pddl
0.5088 0.5088 -0.0 0.3431 0.3431 -0.0
Sum of diffs
-0.0003
0.0003
Arithmetic mean of diffs
-0.0000
0.0000
elevators-opt08-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p02.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p03.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 -0.0
p04.pddl
0.5593 0.5595 0.0001 0.5589 0.5587 -0.0002
p05.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p06.pddl
0.5591 0.5591 0.0 0.5585 0.5585 -0.0
p07.pddl
0.5595 0.5595 -0.0 0.5592 0.5592 -0.0
p08.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
p09.pddl
0.5589 0.5588 -0.0 0.5579 0.5578 -0.0001
p10.pddl
0.5588 0.5587 -0.0 0.5575 0.5575 0.0
p11.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 -0.0
p12.pddl
0.5593 0.5593 -0.0 0.5593 0.5593 -0.0
p13.pddl
0.5594 0.5593 -0.0 0.5594 0.5593 -0.0
p14.pddl
0.5591 0.5591 0.0 0.5589 0.5588 -0.0
p15.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 -0.0
p16.pddl
0.5589 0.5588 -0.0 0.5572 0.5571 -0.0002
p17.pddl
0.5588 0.5588 0.0 0.5588 0.5588 -0.0
p18.pddl
0.5588 0.5587 -0.0 0.5588 0.5588 -0.0
p19.pddl
0.5588 0.5588 -0.0 0.5588 0.5585 -0.0003
p20.pddl
0.5587 0.5586 -0.0 0.5587 0.5587 0.0
p21.pddl
0.5594 0.5594 -0.0 0.5587 0.5587 -0.0
p22.pddl
0.5594 0.5594 -0.0 0.5556 0.5557 0.0
p23.pddl
0.5591 0.5591 -0.0 0.5576 0.5576 0.0
p24.pddl
0.5588 0.5588 -0.0 0.5514 0.5514 -0.0
p25.pddl
0.5591 0.5588 -0.0003 0.5584 0.5584 -0.0
p26.pddl
0.5587 0.5587 -0.0 0.5587 0.5587 -0.0
p27.pddl
0.5588 0.5588 -0.0 0.5576 0.5576 -0.0
p28.pddl
0.5586 0.5585 -0.0001 0.5574 0.5574 0.0
p29.pddl
0.5588 0.5587 -0.0 0.5568 0.5568 0.0
p30.pddl
0.5581 0.5581 -0.0001 0.5403 0.5403 -0.0
Sum of diffs
-0.0010
-0.0009
Arithmetic mean of diffs
-0.0000
-0.0000
elevators-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 -0.0
p02.pddl
0.5594 0.5594 -0.0 0.5587 0.5587 -0.0
p03.pddl
0.5593 0.5593 -0.0 0.5593 0.5593 -0.0
p04.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 -0.0
p05.pddl
0.5594 0.5593 -0.0 0.5594 0.5593 -0.0
p06.pddl
0.5593 0.5595 0.0001 0.5589 0.5587 -0.0002
p07.pddl
0.5587 0.5587 -0.0 0.5587 0.5587 -0.0
p08.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p09.pddl
0.5594 0.5594 -0.0 0.5556 0.5557 0.0
p10.pddl
0.5591 0.5591 0.0 0.5589 0.5588 -0.0
p11.pddl
0.5586 0.5585 -0.0001 0.5574 0.5574 0.0
p12.pddl
0.5591 0.5591 0.0 0.5585 0.5585 -0.0
p13.pddl
0.5595 0.5595 -0.0 0.5592 0.5592 -0.0
p14.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
p15.pddl
0.5589 0.5588 -0.0 0.5579 0.5578 -0.0001
p16.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 -0.0
p17.pddl
0.5588 0.5588 0.0 0.5588 0.5588 -0.0
p18.pddl
0.5588 0.5587 -0.0 0.5588 0.5588 -0.0
p19.pddl
0.5591 0.5591 -0.0 0.5576 0.5576 0.0
p20.pddl
0.5588 0.5588 -0.0 0.5514 0.5514 -0.0
Sum of diffs
-0.0003
-0.0004
Arithmetic mean of diffs
-0.0000
-0.0000
floortile-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
0.5595 0.5595 -0.0 0.5022 0.5021 -0.0001
opt-p01-002.pddl
0.5598 0.5598 -0.0 0.5235 0.5235 -0.0001
opt-p02-003.pddl
0.4391 0.4391 -0.0 0 0 0.0
opt-p02-004.pddl
0.4815 0.4815 -0.0 0 0 0.0
opt-p03-005.pddl
0.4478 0.4477 -0.0001 0 0 0.0
opt-p03-006.pddl
0.2419 0.2419 0.0 0 0 0.0
opt-p04-007.pddl
0.2040 0.2040 -0.0 0 0 0.0
opt-p04-008.pddl
0.0757 0.0757 -0.0 0 0 0.0
opt-p05-009.pddl
0.2789 0.2790 0.0 0 0 0.0
opt-p05-010.pddl
0 0 0.0 0 0 0.0
opt-p06-011.pddl
0 0 0.0 0 0 0.0
opt-p06-012.pddl
0 0 0.0 0 0 0.0
opt-p07-013.pddl
0 0 0.0 0 0 0.0
opt-p07-014.pddl
0 0 0.0 0 0 0.0
opt-p08-015.pddl
0 0 0.0 0 0 0.0
opt-p08-016.pddl
0 0 0.0 0 0 0.0
opt-p09-017.pddl
0 0 0.0 0 0 0.0
opt-p09-018.pddl
0 0 0.0 0 0 0.0
opt-p10-019.pddl
0 0 0.0 0 0 0.0
opt-p10-020.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0001
-0.0001
Arithmetic mean of diffs
-0.0000
-0.0000
floortile-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
0.4515 0.4515 0.0 0 0 0.0
p01-4-4-2.pddl
0.1542 0.1542 -0.0 0 0 0.0
p01-5-3-2.pddl
0.1966 0.1966 0.0 0 0 0.0
p01-5-4-2.pddl
0 0 0.0 0 0 0.0
p01-5-5-2.pddl
0 0 0.0 0 0 0.0
p01-6-4-2.pddl
0 0 0.0 0 0 0.0
p01-6-5-2.pddl
0 0 0.0 0 0 0.0
p02-4-4-2.pddl
0.1375 0.1375 -0.0 0 0 0.0
p02-5-3-2.pddl
0.2811 0.2811 -0.0 0 0 0.0
p02-5-4-2.pddl
0 0 0.0 0 0 0.0
p02-5-5-2.pddl
0 0 0.0 0 0 0.0
p02-6-4-2.pddl
0 0 0.0 0 0 0.0
p02-6-5-2.pddl
0 0 0.0 0 0 0.0
p03-4-3-2.pddl
0.4451 0.4450 -0.0 0 0 0.0
p03-4-4-2.pddl
0.1580 0.1580 0.0 0 0 0.0
p03-5-3-2.pddl
0.2705 0.2705 0.0 0 0 0.0
p03-5-4-2.pddl
0.1565 0.1565 0.0 0 0 0.0
p03-5-5-2.pddl
0 0 0.0 0 0 0.0
p03-6-4-2.pddl
0 0 0.0 0 0 0.0
p03-6-5-2.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0000
0.0000
Arithmetic mean of diffs
-0.0000
0.0000
freecell
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5588 0.5588 -0.0 0.5589 0.5588 -0.0
p02.pddl
0.5566 0.5566 -0.0001 0.5566 0.5566 -0.0001
p03.pddl
0.5561 0.5560 -0.0001 0.5558 0.5560 0.0002
p04.pddl
0.5551 0.5550 -0.0 0.5551 0.5550 -0.0
p05.pddl
0.5520 0.5518 -0.0002 0.5516 0.5516 -0.0
p06.pddl
0.5471 0.5468 -0.0003 0.5467 0.5467 0.0
p07.pddl
0.5471 0.5468 -0.0003 0.5467 0.5467 0.0
p08.pddl
0.5436 0.5433 -0.0004 0.5433 0.5433 -0.0
p09.pddl
0.5436 0.5432 -0.0004 0.5432 0.5432 0.0
p10.pddl
0.5357 0.5354 -0.0003 0.5357 0.5357 0.0
p11.pddl
0.5357 0.5352 -0.0005 0.5357 0.5357 0.0
p12.pddl
0.5357 0.5354 -0.0003 0.5355 0.5357 0.0002
p13.pddl
0.5324 0.5319 -0.0005 0.5314 0.5314 0.0
p14.pddl
0.5323 0.5319 -0.0005 0.5315 0.5315 0.0
p15.pddl
0.5260 0.5252 -0.0008 0.5249 0.5249 -0.0
p16.pddl
0.5260 0.5252 -0.0007 0.5249 0.5249 0.0
p17.pddl
0.5134 0.5126 -0.0008 0.5120 0.5120 -0.0
p18.pddl
0.5133 0.5126 -0.0007 0.5124 0.5124 -0.0
p19.pddl
0.5082 0.5074 -0.0008 0.5071 0.5071 -0.0
p20.pddl
0.5082 0.5074 -0.0008 0.5069 0.5069 0.0
probfreecell-2-1.pddl
0.5520 0.5519 -0.0001 0.5516 0.5516 0.0
probfreecell-2-2.pddl
0.5520 0.5519 -0.0001 0.5516 0.5517 0.0
probfreecell-2-3.pddl
0.5520 0.5519 -0.0001 0.5517 0.5517 -0.0
probfreecell-2-4.pddl
0.5520 0.5519 -0.0001 0.5516 0.5516 -0.0
probfreecell-2-5.pddl
0.5520 0.5519 -0.0001 0.5517 0.5516 -0.0
probfreecell-3-1.pddl
0.5465 0.5463 -0.0003 0.5459 0.5459 0.0
probfreecell-3-2.pddl
0.5465 0.5463 -0.0003 0.5460 0.5460 -0.0
probfreecell-3-3.pddl
0.5465 0.5463 -0.0003 0.5461 0.5461 -0.0
probfreecell-3-4.pddl
0.5465 0.5463 -0.0003 0.5459 0.5459 -0.0
probfreecell-3-5.pddl
0.5465 0.5463 -0.0002 0.5462 0.5459 -0.0003
probfreecell-4-1.pddl
0.5438 0.5435 -0.0003 0.5433 0.5433 0.0
probfreecell-4-2.pddl
0.5439 0.5436 -0.0003 0.5433 0.5433 -0.0
probfreecell-4-3.pddl
0.5439 0.5436 -0.0003 0.5433 0.5433 0.0
probfreecell-4-4.pddl
0.5438 0.5436 -0.0003 0.5433 0.5433 -0.0
probfreecell-4-5.pddl
0.5439 0.5436 -0.0003 0.5431 0.5431 0.0
probfreecell-5-1.pddl
0.5359 0.5355 -0.0004 0.5353 0.5353 0.0
probfreecell-5-2.pddl
0.5360 0.5355 -0.0004 0.5354 0.5354 -0.0
probfreecell-5-3.pddl
0.5360 0.5356 -0.0004 0.5352 0.5352 0.0
probfreecell-5-4.pddl
0.5359 0.5357 -0.0002 0.5352 0.5352 -0.0
probfreecell-5-5.pddl
0.5360 0.5356 -0.0004 0.5352 0.5352 0.0
probfreecell-6-1.pddl
0.5336 0.5332 -0.0005 0.5330 0.5330 -0.0
probfreecell-6-2.pddl
0.5337 0.5332 -0.0005 0.5329 0.5329 0.0
probfreecell-6-3.pddl
0.5337 0.5331 -0.0006 0.5324 0.5324 0.0
probfreecell-6-4.pddl
0.5337 0.5332 -0.0004 0.5327 0.5327 -0.0
probfreecell-6-5.pddl
0.5337 0.5330 -0.0006 0.5327 0.5327 0.0
probfreecell-7-1.pddl
0.5313 0.5308 -0.0005 0.5302 0.5300 -0.0002
probfreecell-7-2.pddl
0.5312 0.5308 -0.0004 0.5303 0.5303 0.0
probfreecell-7-3.pddl
0.5313 0.5308 -0.0005 0.5298 0.5298 0.0
probfreecell-7-4.pddl
0.5313 0.5307 -0.0005 0.5301 0.5301 0.0
probfreecell-7-5.pddl
0.5313 0.5308 -0.0005 0.5303 0.5303 -0.0
probfreecell-8-1.pddl
0.5283 0.5282 -0.0 0.5273 0.5273 0.0
probfreecell-8-2.pddl
0.5283 0.5283 -0.0 0.5280 0.5280 -0.0
probfreecell-8-3.pddl
0.5283 0.5282 -0.0 0.5280 0.5280 0.0
probfreecell-8-4.pddl
0.5283 0.5283 -0.0 0.5277 0.5277 -0.0
probfreecell-8-5.pddl
0.5283 0.5282 -0.0 0.5278 0.5278 0.0
probfreecell-9-1.pddl
0.5248 0.5241 -0.0008 0.5226 0.5226 0.0
probfreecell-9-2.pddl
0.5249 0.5241 -0.0008 0.5231 0.5231 -0.0
probfreecell-9-3.pddl
0.5246 0.5239 -0.0008 0.5231 0.5231 -0.0
probfreecell-9-4.pddl
0.5248 0.5240 -0.0008 0.5230 0.5230 0.0
probfreecell-9-5.pddl
0.5248 0.5241 -0.0008 0.5233 0.5233 -0.0
probfreecell-10-1.pddl
0.5152 0.5144 -0.0007 0.5136 0.5136 0.0
probfreecell-10-2.pddl
0.5152 0.5145 -0.0008 0.5140 0.5142 0.0002
probfreecell-10-3.pddl
0.5150 0.5142 -0.0007 0.5138 0.5138 0.0
probfreecell-10-4.pddl
0.5152 0.5144 -0.0007 0.5141 0.5141 0.0
probfreecell-10-5.pddl
0.5151 0.5144 -0.0008 0.5142 0.5142 -0.0
probfreecell-11-1.pddl
0.5130 0.5123 -0.0007 0.5116 0.5116 0.0
probfreecell-11-2.pddl
0.5129 0.5121 -0.0008 0.5113 0.5113 0.0
probfreecell-11-3.pddl
0.5130 0.5123 -0.0007 0.5117 0.5117 0.0
probfreecell-11-4.pddl
0.5131 0.5123 -0.0008 0.5116 0.5116 0.0
probfreecell-11-5.pddl
0 0 0.0 0.5114 0.5114 -0.0
probfreecell-12-1.pddl
0.5109 0.5102 -0.0007 0.5095 0.5095 -0.0
probfreecell-12-2.pddl
0.5110 0.5102 -0.0008 0.5095 0.5095 0.0
probfreecell-12-3.pddl
0.5109 0.5101 -0.0008 0.5090 0.5090 0.0
probfreecell-12-4.pddl
0.5109 0.5100 -0.0009 0.5097 0.5097 -0.0
probfreecell-12-5.pddl
0.4274 0.4274 -0.0 0.5096 0.5096 -0.0
probfreecell-13-1.pddl
0.5088 0.5080 -0.0009 0.5076 0.5076 -0.0
probfreecell-13-2.pddl
0.5088 0.5081 -0.0008 0.5074 0.5074 -0.0
probfreecell-13-3.pddl
0.5089 0.5081 -0.0008 0.5077 0.5077 -0.0
probfreecell-13-4.pddl
0.5089 0.5080 -0.0008 0.5078 0.5078 0.0
probfreecell-13-5.pddl
0.4402 0.4402 -0.0 0.4600 0.4600 -0.0
Sum of diffs
-0.0359
-0.0003
Arithmetic mean of diffs
-0.0004
-0.0000
ged-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
d-1-3.pddl
0.5585 0.5585 -0.0 0.5582 0.5582 -0.0
d-1-4.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
d-1-8.pddl
0.5576 0.5576 -0.0001 0.5576 0.5576 0.0
d-2-1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
d-2-3.pddl
0.5591 0.5588 -0.0003 0.5588 0.5588 -0.0
d-2-4.pddl
0.5594 0.5593 -0.0 0.5594 0.5594 -0.0
d-2-8.pddl
0.5560 0.5560 -0.0 0.5557 0.5557 0.0
d-3-1.pddl
0.5585 0.5585 -0.0 0.5582 0.5582 -0.0
d-3-2.pddl
0.5591 0.5588 -0.0003 0.5588 0.5588 -0.0
d-3-4.pddl
0.5576 0.5576 -0.0 0.5576 0.5576 0.0
d-4-2.pddl
0.5594 0.5593 -0.0 0.5594 0.5594 -0.0
d-4-3.pddl
0.5576 0.5576 -0.0 0.5576 0.5576 0.0
d-4-8.pddl
0.5560 0.5560 -0.0 0.5557 0.5557 0.0
d-7-5.pddl
0.5576 0.5576 -0.0001 0.5576 0.5576 0.0
d-7-6.pddl
0.5585 0.5585 -0.0 0.5582 0.5582 -0.0
d-8-1.pddl
0.5576 0.5576 -0.0001 0.5576 0.5576 0.0
d-8-2.pddl
0.5560 0.5560 -0.0 0.5557 0.5557 0.0
d-8-4.pddl
0.5560 0.5560 -0.0 0.5557 0.5557 0.0
d-8-9.pddl
0.5560 0.5560 -0.0 0.5557 0.5557 -0.0
Sum of diffs
-0.0012
-0.0002
Arithmetic mean of diffs
-0.0001
-0.0000
grid
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.5562 0.5561 -0.0001 0.5552 0.5552 -0.0
prob02.pddl
0.5539 0.5537 -0.0002 0.5526 0.5526 -0.0
prob03.pddl
0.5498 0.5494 -0.0004 0 0 0.0
prob04.pddl
0.5439 0.5439 -0.0 0.5415 0.5415 0.0
prob05.pddl
0.5383 0.5378 -0.0006 0.3964 0.3964 -0.0
Sum of diffs
-0.0014
-0.0000
Arithmetic mean of diffs
-0.0003
-0.0000
gripper
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob02.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob03.pddl
0.5598 0.5598 -0.0 0.5598 0.5601 0.0003
prob04.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
prob05.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
prob06.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
prob07.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
prob08.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
prob09.pddl
0.5595 0.5595 -0.0 0.5598 0.5598 -0.0
prob10.pddl
0.5595 0.5595 -0.0 0.5595 0.5598 0.0003
prob11.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
prob12.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
prob13.pddl
0.5595 0.5595 0.0 0.5592 0.5592 -0.0
prob14.pddl
0.5595 0.5595 -0.0 0.5588 0.5588 -0.0
prob15.pddl
0.5594 0.5594 -0.0 0.5584 0.5584 0.0
prob16.pddl
0.5594 0.5593 -0.0 0.5578 0.5578 -0.0
prob17.pddl
0.5593 0.5591 -0.0002 0.5574 0.5574 0.0
prob18.pddl
0.5592 0.5591 -0.0 0.5570 0.5571 0.0001
prob19.pddl
0.5591 0.5591 -0.0 0.5566 0.5566 -0.0
prob20.pddl
0.5591 0.5591 -0.0 0.5560 0.5559 -0.0
Sum of diffs
-0.0007
0.0005
Arithmetic mean of diffs
-0.0000
0.0000
hiking-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
0.5598 0.5597 -0.0 0.5598 0.5597 -0.0
ptesting-1-2-4.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0001
ptesting-1-2-5.pddl
0.5584 0.5584 -0.0 0.5591 0.5591 0.0
ptesting-1-2-7.pddl
0.5515 0.5515 -0.0 0.5551 0.5551 0.0
ptesting-1-2-8.pddl
0.5445 0.5445 0.0 0.5503 0.5502 -0.0001
ptesting-2-2-3.pddl
0.5585 0.5584 -0.0 0.5585 0.5585 0.0
ptesting-2-2-4.pddl
0.5550 0.5550 -0.0001 0.5502 0.5502 0.0
ptesting-2-2-5.pddl
0.5494 0.5494 0.0 0.5299 0.5298 -0.0
ptesting-2-2-6.pddl
0.5412 0.5412 -0.0 0.5265 0.5265 -0.0
ptesting-2-2-7.pddl
0.5245 0.5245 -0.0 0.4657 0.4657 -0.0
ptesting-2-2-8.pddl
0.5141 0.5141 -0.0 0.4643 0.4643 0.0
ptesting-2-3-4.pddl
0.5522 0.5521 -0.0001 0.5495 0.5495 -0.0
ptesting-2-3-5.pddl
0.5436 0.5436 -0.0 0.5257 0.5257 0.0
ptesting-2-3-6.pddl
0.5328 0.5327 -0.0 0.4638 0.4638 0.0
ptesting-2-3-7.pddl
0.5119 0.5119 -0.0 0.4587 0.4588 0.0001
ptesting-2-4-3.pddl
0.5569 0.5569 -0.0001 0.5570 0.5570 -0.0
ptesting-2-4-4.pddl
0.5504 0.5505 0.0001 0.5426 0.5427 0.0001
ptesting-2-4-5.pddl
0.5358 0.5358 -0.0 0.5163 0.5163 0.0
ptesting-2-4-6.pddl
0.5274 0.5274 -0.0 0.4649 0.4649 -0.0
ptesting-2-4-7.pddl
0.5099 0.5099 -0.0 0.3905 0.3905 -0.0
Sum of diffs
-0.0004
0.0001
Arithmetic mean of diffs
-0.0000
0.0000
logistics00
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
probLOGISTICS-4-1.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
probLOGISTICS-4-2.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
probLOGISTICS-5-0.pddl
0.5598 0.5601 0.0003 0.5601 0.5601 -0.0
probLOGISTICS-5-1.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
probLOGISTICS-5-2.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
probLOGISTICS-6-0.pddl
0.5598 0.5601 0.0003 0.5598 0.5601 0.0003
probLOGISTICS-6-1.pddl
0.5598 0.5601 0.0003 0.5598 0.5601 0.0003
probLOGISTICS-6-2.pddl
0.5598 0.5601 0.0003 0.5598 0.5601 0.0003
probLOGISTICS-6-9.pddl
0.5598 0.5601 0.0003 0.5598 0.5601 0.0003
probLOGISTICS-7-0.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
probLOGISTICS-7-1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
probLOGISTICS-8-0.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
probLOGISTICS-8-1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
probLOGISTICS-9-0.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
probLOGISTICS-9-1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
probLOGISTICS-10-0.pddl
0.5595 0.5595 0.0 0.5595 0.5595 0.0
probLOGISTICS-10-1.pddl
0.5595 0.5595 0.0 0.5595 0.5595 0.0
probLOGISTICS-11-0.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
probLOGISTICS-11-1.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
probLOGISTICS-12-0.pddl
0.5595 0.5595 0.0 0.5595 0.5595 -0.0
probLOGISTICS-12-1.pddl
0.5595 0.5595 0.0 0.5595 0.5595 -0.0
probLOGISTICS-13-0.pddl
0.5588 0.5588 0.0 0.5563 0.5563 -0.0
probLOGISTICS-13-1.pddl
0.5588 0.5588 0.0 0.5570 0.5570 0.0
probLOGISTICS-14-0.pddl
0.5592 0.5591 -0.0 0.5563 0.5563 -0.0
probLOGISTICS-14-1.pddl
0.5588 0.5588 -0.0 0.5541 0.5541 -0.0
probLOGISTICS-15-0.pddl
0.5582 0.5582 -0.0 0.5539 0.5538 -0.0
probLOGISTICS-15-1.pddl
0.5588 0.5588 -0.0 0.5523 0.5523 -0.0
Sum of diffs
0.0011
0.0007
Arithmetic mean of diffs
0.0000
0.0000
logistics98
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.5595 0.5595 -0.0 0.5582 0.5582 0.0
prob02.pddl
0.5590 0.5587 -0.0002 0.5294 0.5294 -0.0
prob03.pddl
0.5568 0.5569 0.0001 0.2589 0.2589 0.0
prob04.pddl
0.5538 0.5537 -0.0001 0 0 0.0
prob05.pddl
0.5595 0.5595 0.0 0.5595 0.5595 0.0
prob06.pddl
0.5509 0.5509 0.0 0 0 0.0
prob07.pddl
0.5581 0.5581 -0.0001 0.4481 0.4481 -0.0
prob08.pddl
0.5552 0.5551 -0.0001 0 0 0.0
prob09.pddl
0.5422 0.5422 0.0 0 0 0.0
prob10.pddl
0.5436 0.5435 -0.0001 0.0584 0.0584 -0.0
prob11.pddl
0.5582 0.5581 -0.0 0.4033 0.4033 -0.0
prob12.pddl
0.5470 0.5469 -0.0001 0 0 0.0
prob13.pddl
0.5396 0.5395 -0.0 0 0 0.0
prob14.pddl
0.5401 0.5399 -0.0001 0 0 0.0
prob15.pddl
0.5551 0.5549 -0.0001 0.3937 0.3937 0.0001
prob16.pddl
0.5509 0.5510 0.0001 0 0 0.0
prob17.pddl
0.5563 0.5561 -0.0003 0 0 0.0
prob18.pddl
0.4762 0.4761 -0.0 0 0 0.0
prob19.pddl
0.5098 0.5100 0.0002 0 0 0.0
prob20.pddl
0.4732 0.4733 0.0 0 0 0.0
prob21.pddl
0.5160 0.5158 -0.0001 0 0 0.0
prob22.pddl
0.2934 0.2934 -0.0 0 0 0.0
prob23.pddl
0.5477 0.5476 -0.0001 0.0367 0.0367 -0.0
prob24.pddl
0.5426 0.5423 -0.0003 0 0 0.0
prob25.pddl
0.4138 0.4138 -0.0 0 0 0.0
prob26.pddl
0.4594 0.4594 -0.0 0 0 0.0
prob27.pddl
0.4534 0.4534 0.0 0 0 0.0
prob28.pddl
0.1377 0.1377 -0.0 0 0 0.0
prob29.pddl
0.3850 0.3850 -0.0 0 0 0.0
prob30.pddl
0.4285 0.4285 0.0 0 0 0.0
prob31.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
prob32.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
prob33.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
prob34.pddl
0.5588 0.5587 -0.0 0.5051 0.5051 -0.0
prob35.pddl
0.5591 0.5591 -0.0 0.5550 0.5550 0.0
Sum of diffs
-0.0014
-0.0001
Arithmetic mean of diffs
-0.0000
-0.0000
miconic
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s1-1.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s1-2.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s1-3.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s1-4.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s2-0.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s2-1.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s2-2.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s2-3.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s2-4.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s3-0.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s3-1.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s3-2.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s3-3.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s3-4.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s4-0.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s4-1.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s4-2.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s4-3.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s4-4.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s5-0.pddl
0.5598 0.5601 0.0003 0.5601 0.5601 -0.0
s5-1.pddl
0.5598 0.5601 0.0003 0.5601 0.5601 -0.0
s5-2.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
s5-3.pddl
0.5598 0.5601 0.0003 0.5601 0.5601 -0.0
s5-4.pddl
0.5598 0.5601 0.0003 0.5601 0.5601 -0.0
s6-0.pddl
0.5598 0.5598 -0.0 0.5601 0.5601 -0.0
s6-1.pddl
0.5598 0.5598 -0.0 0.5598 0.5601 0.0003
s6-2.pddl
0.5598 0.5598 -0.0 0.5598 0.5601 0.0003
s6-3.pddl
0.5598 0.5598 -0.0 0.5598 0.5601 0.0003
s6-4.pddl
0.5598 0.5598 -0.0 0.5598 0.5601 0.0003
s7-0.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
s7-1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
s7-2.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
s7-3.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
s7-4.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
s8-0.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
s8-1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
s8-2.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
s8-3.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
s8-4.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
s9-0.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
s9-1.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
s9-2.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
s9-3.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
s9-4.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
s10-0.pddl
0.5595 0.5595 0.0 0.5598 0.5598 0.0
s10-1.pddl
0.5595 0.5595 0.0 0.5598 0.5598 0.0
s10-2.pddl
0.5595 0.5595 0.0 0.5598 0.5598 0.0
s10-3.pddl
0.5595 0.5595 0.0 0.5598 0.5598 0.0
s10-4.pddl
0.5595 0.5595 0.0 0.5598 0.5598 0.0
s11-0.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 0.0
s11-1.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 0.0
s11-2.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 0.0
s11-3.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 0.0
s11-4.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 0.0
s12-0.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
s12-1.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
s12-2.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
s12-3.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
s12-4.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
s13-0.pddl
0.5593 0.5593 -0.0 0.5593 0.5593 0.0
s13-1.pddl
0.5593 0.5593 -0.0 0.5593 0.5593 0.0
s13-2.pddl
0.5593 0.5593 -0.0 0.5593 0.5593 0.0
s13-3.pddl
0.5593 0.5593 -0.0 0.5593 0.5593 0.0
s13-4.pddl
0.5593 0.5593 -0.0 0.5593 0.5593 0.0
s14-0.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 0.0
s14-1.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 0.0
s14-2.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 0.0
s14-3.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 0.0
s14-4.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 0.0
s15-0.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 -0.0
s15-1.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 -0.0
s15-2.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 -0.0
s15-3.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 -0.0
s15-4.pddl
0.5591 0.5591 -0.0 0.5591 0.5591 -0.0
s16-0.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
s16-1.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
s16-2.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
s16-3.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
s16-4.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
s17-0.pddl
0.5587 0.5587 -0.0 0.5587 0.5587 -0.0
s17-1.pddl
0.5587 0.5587 -0.0 0.5587 0.5587 -0.0
s17-2.pddl
0.5587 0.5587 -0.0 0.5587 0.5587 -0.0
s17-3.pddl
0.5584 0.5583 -0.0 0.5587 0.5587 -0.0
s17-4.pddl
0.5587 0.5587 -0.0 0.5587 0.5587 -0.0
s18-0.pddl
0.5584 0.5584 -0.0 0.5587 0.5587 -0.0
s18-1.pddl
0.5584 0.5584 -0.0 0.5587 0.5587 -0.0
s18-2.pddl
0.5584 0.5584 -0.0 0.5587 0.5587 -0.0
s18-3.pddl
0.5584 0.5584 -0.0 0.5587 0.5587 -0.0
s18-4.pddl
0.5584 0.5584 -0.0001 0.5587 0.5587 -0.0
s19-0.pddl
0.5583 0.5582 -0.0001 0.5586 0.5586 -0.0
s19-1.pddl
0.5583 0.5582 -0.0 0.5586 0.5586 -0.0
s19-2.pddl
0.5583 0.5582 -0.0001 0.5586 0.5586 -0.0
s19-3.pddl
0.5580 0.5579 -0.0001 0.5586 0.5586 -0.0
s19-4.pddl
0.5583 0.5582 -0.0 0.5586 0.5586 -0.0
s20-0.pddl
0.5579 0.5581 0.0003 0.5585 0.5585 0.0
s20-1.pddl
0.5578 0.5578 -0.0001 0.5585 0.5585 0.0
s20-2.pddl
0.5582 0.5581 -0.0 0.5585 0.5585 0.0
s20-3.pddl
0.5582 0.5581 -0.0 0.5585 0.5585 0.0
s20-4.pddl
0.5579 0.5581 0.0003 0.5585 0.5585 0.0
s21-0.pddl
0.5575 0.5574 -0.0 0.5584 0.5584 -0.0
s21-1.pddl
0.5575 0.5574 -0.0 0.5584 0.5584 -0.0
s21-2.pddl
0.5581 0.5581 -0.0 0.5581 0.5581 0.0
s21-3.pddl
0.5578 0.5578 0.0 0.5583 0.5583 0.0
s21-4.pddl
0.5578 0.5581 0.0003 0.5584 0.5584 -0.0
s22-0.pddl
0.5571 0.5571 0.0 0.5581 0.5580 -0.0
s22-1.pddl
0.5574 0.5571 -0.0002 0.5581 0.5580 -0.0
s22-2.pddl
0.5571 0.5571 0.0 0.5581 0.5580 -0.0
s22-3.pddl
0.5571 0.5571 -0.0 0.5581 0.5580 -0.0
s22-4.pddl
0.5574 0.5572 -0.0003 0.5581 0.5580 -0.0
s23-0.pddl
0.5566 0.5568 0.0003 0.5575 0.5577 0.0002
s23-1.pddl
0.5569 0.5568 -0.0 0.5575 0.5577 0.0002
s23-2.pddl
0.5572 0.5572 -0.0 0.5575 0.5577 0.0002
s23-3.pddl
0.5572 0.5572 -0.0 0.5575 0.5577 0.0002
s23-4.pddl
0.5569 0.5571 0.0003 0.5575 0.5577 0.0002
s24-0.pddl
0.5568 0.5568 -0.0 0.5575 0.5575 0.0
s24-1.pddl
0.5565 0.5565 -0.0 0.5575 0.5575 0.0
s24-2.pddl
0.5565 0.5565 -0.0001 0.5575 0.5575 0.0
s24-3.pddl
0.5565 0.5565 -0.0 0.5575 0.5575 0.0
s24-4.pddl
0.5565 0.5565 -0.0 0.5575 0.5575 0.0
s25-0.pddl
0.5562 0.5564 0.0002 0.5574 0.5574 -0.0
s25-1.pddl
0.5558 0.5558 -0.0 0.5574 0.5574 -0.0
s25-2.pddl
0.5564 0.5564 -0.0001 0.5574 0.5574 -0.0
s25-3.pddl
0.5558 0.5558 -0.0001 0.5574 0.5574 -0.0
s25-4.pddl
0.5558 0.5558 -0.0001 0.5574 0.5574 -0.0
s26-0.pddl
0.5554 0.5554 -0.0 0.5572 0.5572 0.0
s26-1.pddl
0.5560 0.5560 -0.0 0.5572 0.5572 0.0
s26-2.pddl
0.5551 0.5551 0.0 0.5573 0.5573 -0.0
s26-3.pddl
0.5554 0.5554 0.0 0.5573 0.5573 -0.0
s26-4.pddl
0.5561 0.5560 -0.0 0.5572 0.5572 -0.0
s27-0.pddl
0.5548 0.5547 -0.0001 0.5572 0.5569 -0.0003
s27-1.pddl
0.5554 0.5554 -0.0 0.5572 0.5569 -0.0003
s27-2.pddl
0.5548 0.5547 -0.0001 0.5569 0.5569 0.0
s27-3.pddl
0.5554 0.5553 -0.0 0.5572 0.5569 -0.0003
s27-4.pddl
0.5551 0.5550 -0.0 0.5572 0.5569 -0.0003
s28-0.pddl
0.5541 0.5540 -0.0 0.5568 0.5568 0.0
s28-1.pddl
0.5547 0.5547 -0.0 0.5568 0.5568 0.0
s28-2.pddl
0.5544 0.5543 -0.0001 0.5568 0.5568 0.0
s28-3.pddl
0.5556 0.5556 -0.0 0.5568 0.5568 0.0
s28-4.pddl
0.5547 0.5547 -0.0 0.5568 0.5568 -0.0
s29-0.pddl
0.5546 0.5546 -0.0 0.5568 0.5566 -0.0002
s29-1.pddl
0.5549 0.5549 -0.0 0.5568 0.5566 -0.0002
s29-2.pddl
0.5543 0.5543 0.0 0.5568 0.5566 -0.0002
s29-3.pddl
0.5537 0.5537 -0.0 0.5568 0.5566 -0.0002
s29-4.pddl
0.5534 0.5534 0.0 0.5568 0.5566 -0.0002
s30-0.pddl
0.5544 0.5543 -0.0001 0.5566 0.5564 -0.0002
s30-1.pddl
0.5538 0.5537 -0.0 0.5565 0.5567 0.0002
s30-2.pddl
0.5541 0.5540 -0.0001 0.5566 0.5564 -0.0002
s30-3.pddl
0.5532 0.5531 -0.0 0.5565 0.5567 0.0002
s30-4.pddl
0.5535 0.5537 0.0002 0.5566 0.5564 -0.0002
Sum of diffs
-0.0012
-0.0019
Arithmetic mean of diffs
-0.0000
-0.0000
movie
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob02.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob03.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob04.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob05.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob06.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob07.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob08.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob09.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob10.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob11.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob12.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob13.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob14.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob15.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob16.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob17.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob18.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob19.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob20.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob21.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob22.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob23.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob24.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob25.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob26.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob27.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob28.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob29.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
prob30.pddl
0.5598 0.5601 0.0003 0.5601 0.5601 -0.0
Sum of diffs
-0.0003
-0.0006
Arithmetic mean of diffs
-0.0000
-0.0000
mprime
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.5581 0.5581 0.0 0.5582 0.5581 -0.0
prob02.pddl
0.5527 0.5525 -0.0002 0.4006 0.4006 -0.0
prob03.pddl
0.5551 0.5553 0.0002 0.5409 0.5409 -0.0
prob04.pddl
0.5579 0.5578 -0.0001 0.5578 0.5578 0.0
prob05.pddl
0.5550 0.5550 -0.0 0.4037 0.4038 0.0001
prob06.pddl
0.5279 0.5273 -0.0006 0 0 0.0
prob07.pddl
0.5572 0.5572 -0.0 0.5481 0.5480 -0.0001
prob08.pddl
0.5443 0.5440 -0.0003 0 0 0.0
prob09.pddl
0.5554 0.5554 -0.0001 0.5408 0.5408 -0.0
prob10.pddl
0.5018 0.5009 -0.0008 0 0 0.0
prob11.pddl
0.5577 0.5577 -0.0001 0.5574 0.5575 0.0001
prob12.pddl
0.5561 0.5559 -0.0002 0.4647 0.4647 -0.0
prob13.pddl
0.5023 0.5014 -0.0009 0 0 0.0
prob14.pddl
0.4924 0.4920 -0.0004 0 0 0.0
prob15.pddl
0.5048 0.5040 -0.0009 0 0 0.0
prob16.pddl
0.5500 0.5496 -0.0004 0.4566 0.4566 -0.0
prob17.pddl
0.5274 0.5269 -0.0006 0.1976 0.1976 0.0
prob18.pddl
0.5226 0.5223 -0.0003 0 0 0.0
prob19.pddl
0.5390 0.5389 -0.0001 0 0 0.0
prob20.pddl
0.5051 0.5043 -0.0008 0 0 0.0
prob21.pddl
0.5395 0.5390 -0.0005 0.2266 0.2266 0.0
prob22.pddl
0.5017 0.5009 -0.0008 0 0 0.0
prob23.pddl
0.5296 0.5291 -0.0005 0 0 0.0
prob24.pddl
0.5270 0.5265 -0.0005 0 0 0.0
prob25.pddl
0.5595 0.5595 -0.0 0.5595 0.5593 -0.0002
prob26.pddl
0.5521 0.5520 -0.0001 0.2300 0.2300 -0.0
prob27.pddl
0.5504 0.5501 -0.0003 0.5494 0.5494 -0.0
prob28.pddl
0.5581 0.5581 -0.0 0.5582 0.5581 -0.0
prob29.pddl
0.5524 0.5524 -0.0 0.5478 0.5478 -0.0
prob30.pddl
0.5267 0.5261 -0.0006 0 0 0.0
prob31.pddl
0.5512 0.5509 -0.0003 0.5495 0.5495 0.0
prob32.pddl
0.5572 0.5571 -0.0 0.5211 0.5211 -0.0
prob33.pddl
0.5310 0.5304 -0.0005 0 0 0.0
prob34.pddl
0.5513 0.5512 -0.0001 0.5482 0.5482 0.0
prob35.pddl
0.5581 0.5581 -0.0 0.5572 0.5572 -0.0
Sum of diffs
-0.0108
-0.0003
Arithmetic mean of diffs
-0.0003
-0.0000
mystery
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
prob02.pddl
0.5546 0.5544 -0.0002 0.5343 0.5340 -0.0003
prob03.pddl
0.5575 0.5575 0.0 0.5569 0.5569 -0.0
prob04.pddl
0 0 0.0 0 0 0.0
prob05.pddl
0 0 0.0 0 0 0.0
prob06.pddl
0.5244 0.5244 -0.0 0 0 0.0
prob07.pddl
0 0 0.0 0 0 0.0
prob08.pddl
0 0 0.0 0 0 0.0
prob09.pddl
0.2250 0.2250 -0.0 0.5555 0.5555 0.0
prob10.pddl
0.5082 0.5075 -0.0007 0 0 0.0
prob11.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
prob12.pddl
0 0 0.0 0 0 0.0
prob13.pddl
0.5315 0.5310 -0.0005 0 0 0.0
prob14.pddl
0.5028 0.5020 -0.0008 0 0 0.0
prob15.pddl
0.5327 0.5323 -0.0004 0.2969 0.2969 -0.0
prob16.pddl
0 0 0.0 0 0 0.0
prob17.pddl
0.5328 0.5323 -0.0005 0.5302 0.5302 0.0
prob18.pddl
0 0 0.0 0 0 0.0
prob19.pddl
0.5504 0.5504 0.0 0.4824 0.4824 -0.0
prob20.pddl
0.5500 0.5497 -0.0002 0.1648 0.1648 -0.0
prob21.pddl
0 0 0.0 0 0 0.0
prob22.pddl
0 0 0.0 0 0 0.0
prob23.pddl
0 0 0.0 0 0 0.0
prob24.pddl
0 0 0.0 0 0 0.0
prob25.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
prob26.pddl
0.5577 0.5576 -0.0001 0.5536 0.5532 -0.0003
prob27.pddl
0.5580 0.5579 -0.0001 0.5580 0.5578 -0.0002
prob28.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
prob29.pddl
0.5579 0.5578 -0.0 0.5576 0.5575 -0.0
prob30.pddl
0.5542 0.5542 -0.0001 0.5361 0.5361 0.0
Sum of diffs
-0.0037
-0.0009
Arithmetic mean of diffs
-0.0001
-0.0000
nomystery-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 -0.0
p02.pddl
0.5581 0.5579 -0.0002 0.5581 0.5581 -0.0
p03.pddl
0.5587 0.5587 -0.0 0.5587 0.5587 -0.0
p04.pddl
0.5573 0.5573 -0.0001 0.5323 0.5323 -0.0
p05.pddl
0.5543 0.5539 -0.0004 0.1887 0.1887 -0.0
p06.pddl
0.5508 0.5505 -0.0004 0 0 0.0
p07.pddl
0.5508 0.5505 -0.0004 0 0 0.0
p08.pddl
0.5493 0.5490 -0.0003 0 0 0.0
p09.pddl
0.5450 0.5447 -0.0003 0.5455 0.5455 0.0
p10.pddl
0.5498 0.5497 -0.0 0 0 0.0
p11.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p12.pddl
0.5588 0.5587 -0.0 0.5584 0.5584 -0.0
p13.pddl
0.5591 0.5591 -0.0 0.5561 0.5561 0.0
p14.pddl
0.5569 0.5569 -0.0 0.5275 0.5275 0.0
p15.pddl
0.5554 0.5554 -0.0 0.5272 0.5271 -0.0001
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0.5538 0.5536 -0.0002 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0.5497 0.5495 -0.0002 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0026
-0.0002
Arithmetic mean of diffs
-0.0001
-0.0000
openstacks-opt08-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p02.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p03.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p04.pddl
0.5598 0.5597 -0.0001 0.5598 0.5597 -0.0001
p05.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
p06.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p07.pddl
0.5595 0.5595 0.0 0.5595 0.5595 0.0
p08.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p09.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p10.pddl
0.5594 0.5593 -0.0 0.5594 0.5594 0.0
p11.pddl
0.5592 0.5591 -0.0 0.5592 0.5592 -0.0
p12.pddl
0.5589 0.5588 -0.0 0.5589 0.5589 -0.0
p13.pddl
0.5588 0.5588 0.0 0.5588 0.5588 0.0
p14.pddl
0.5589 0.5588 -0.0 0.5589 0.5588 -0.0
p15.pddl
0.5585 0.5588 0.0003 0.5585 0.5588 0.0003
p16.pddl
0.5584 0.5584 -0.0 0.5584 0.5584 0.0
p17.pddl
0.5584 0.5582 -0.0002 0.5584 0.5584 -0.0
p18.pddl
0.5582 0.5582 -0.0 0.5582 0.5583 0.0001
p19.pddl
0.5578 0.5578 -0.0 0.5578 0.5578 -0.0
p20.pddl
0.5578 0.5577 -0.0 0.5578 0.5578 -0.0
p21.pddl
0.5578 0.5576 -0.0002 0.5578 0.5577 -0.0001
p22.pddl
0.5573 0.5572 -0.0 0.5573 0.5573 0.0
p23.pddl
0.5572 0.5572 -0.0 0.5572 0.5572 -0.0
p24.pddl
0.5572 0.5572 0.0 0.5572 0.5572 -0.0
p25.pddl
0.5570 0.5569 -0.0001 0.5570 0.5572 0.0002
p26.pddl
0.5569 0.5569 -0.0001 0.5569 0.5569 0.0
p27.pddl
0.5568 0.5565 -0.0003 0.5568 0.5568 0.0
p28.pddl
0.5559 0.5558 -0.0001 0.5559 0.5559 0.0
p29.pddl
0.5555 0.5556 0.0 0.5555 0.5555 -0.0001
p30.pddl
0.5556 0.5555 -0.0001 0.5553 0.5555 0.0002
Sum of diffs
-0.0012
0.0004
Arithmetic mean of diffs
-0.0000
0.0000
openstacks-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p02.pddl
0.5595 0.5595 0.0 0.5595 0.5595 0.0
p03.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p04.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p05.pddl
0.5594 0.5593 -0.0 0.5594 0.5594 0.0
p06.pddl
0.5592 0.5591 -0.0 0.5592 0.5592 -0.0
p07.pddl
0.5589 0.5588 -0.0 0.5589 0.5589 -0.0
p08.pddl
0.5588 0.5588 0.0 0.5588 0.5588 0.0
p09.pddl
0.5589 0.5588 -0.0 0.5589 0.5588 -0.0
p10.pddl
0.5573 0.5572 -0.0 0.5573 0.5573 0.0
p11.pddl
0.5585 0.5588 0.0003 0.5585 0.5588 0.0003
p12.pddl
0.5584 0.5584 -0.0 0.5584 0.5584 0.0
p13.pddl
0.5584 0.5582 -0.0002 0.5584 0.5584 -0.0
p14.pddl
0.5582 0.5582 -0.0 0.5582 0.5583 0.0001
p15.pddl
0.5578 0.5578 -0.0 0.5578 0.5578 -0.0
p16.pddl
0.5578 0.5576 -0.0002 0.5578 0.5577 -0.0001
p17.pddl
0.5578 0.5577 -0.0 0.5578 0.5578 -0.0
p18.pddl
0.5572 0.5572 -0.0 0.5572 0.5572 -0.0
p19.pddl
0.5572 0.5572 0.0 0.5572 0.5572 -0.0
p20.pddl
0.5570 0.5569 -0.0001 0.5570 0.5572 0.0002
Sum of diffs
-0.0006
0.0004
Arithmetic mean of diffs
-0.0000
0.0000
openstacks-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
0.5584 0.5584 -0.0 0.5584 0.5584 -0.0
p20_2.pddl
0.5584 0.5584 -0.0 0.5584 0.5584 0.0
p20_3.pddl
0.5584 0.5584 -0.0 0.5584 0.5584 0.0
p25_1.pddl
0.5578 0.5576 -0.0002 0.5578 0.5577 -0.0
p25_3.pddl
0.5574 0.5575 0.0001 0.5574 0.5574 -0.0
p30_1.pddl
0.5569 0.5569 -0.0001 0.5569 0.5569 -0.0
p30_2.pddl
0.5569 0.5569 -0.0001 0.5569 0.5569 -0.0
p30_3.pddl
0.5565 0.5565 0.0 0.5565 0.5565 0.0
p35_1.pddl
0.5552 0.5552 -0.0 0.5552 0.5552 0.0
p35_2.pddl
0.5552 0.5552 -0.0 0.5552 0.5552 0.0
p35_3.pddl
0.5548 0.5548 -0.0 0.5548 0.5547 -0.0002
p40_1.pddl
0.5544 0.5544 -0.0 0.5544 0.5544 -0.0
p40_2.pddl
0.5544 0.5544 -0.0 0.5544 0.5544 -0.0
p40_3.pddl
0.5537 0.5538 0.0001 0.5537 0.5537 -0.0
p45_1.pddl
0.5535 0.5532 -0.0003 0.5533 0.5533 0.0
p45_2.pddl
0.5533 0.5532 -0.0001 0.5532 0.5532 -0.0
p45_3.pddl
0.5524 0.5522 -0.0001 0.5523 0.5523 0.0
p50_1.pddl
0.5513 0.5510 -0.0003 0.5509 0.5509 -0.0
p50_2.pddl
0.5510 0.5510 0.0 0.5509 0.5509 0.0
p50_3.pddl
0.5502 0.5500 -0.0002 0.5499 0.5499 0.0
Sum of diffs
-0.0014
-0.0003
Arithmetic mean of diffs
-0.0001
-0.0000
openstacks-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p02.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p03.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p04.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p05.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p06.pddl
0.5593 0.5591 -0.0002 0.5593 0.5593 -0.0
p07.pddl
0.5593 0.5591 -0.0002 0.5593 0.5593 -0.0
p08.pddl
0.5565 0.5564 -0.0001 0.5568 0.5568 -0.0
p09.pddl
0.5564 0.5564 -0.0 0.5568 0.5568 -0.0
p10.pddl
0.5557 0.5554 -0.0002 0.5556 0.5556 -0.0
p11.pddl
0.5557 0.5554 -0.0002 0.5556 0.5556 -0.0
p12.pddl
0.5554 0.5553 -0.0 0.5554 0.5553 -0.0
p13.pddl
0.5550 0.5550 -0.0001 0.5554 0.5553 -0.0
p14.pddl
0.5550 0.5550 -0.0 0.5554 0.5553 -0.0
p15.pddl
0.5550 0.5549 -0.0001 0.5550 0.5550 0.0
p16.pddl
0.5550 0.5549 -0.0001 0.5550 0.5550 0.0
p17.pddl
0.5537 0.5536 -0.0001 0.5540 0.5540 0.0
p18.pddl
0.5481 0.5477 -0.0004 0.5484 0.5484 -0.0
p19.pddl
0.5539 0.5536 -0.0003 0.5542 0.5542 0.0
p20.pddl
0.5509 0.5506 -0.0003 0.5509 0.5509 0.0
p21.pddl
0.5509 0.5506 -0.0003 0.5509 0.5509 0.0
p22.pddl
0.5500 0.5500 0.0 0.5503 0.5503 -0.0
p23.pddl
0.5501 0.5500 -0.0001 0.5500 0.5503 0.0002
p24.pddl
0.5044 0.5041 -0.0003 0.5116 0.5118 0.0002
p25.pddl
0.5171 0.5168 -0.0003 0.5161 0.5161 0.0
p26.pddl
0.5373 0.5370 -0.0004 0.5376 0.5375 -0.0001
p27.pddl
0.5071 0.5063 -0.0008 0.5072 0.5072 -0.0
p28.pddl
0.3720 0.3716 -0.0004 0.3757 0.3757 -0.0
p29.pddl
0.3839 0.3835 -0.0004 0.3937 0.3937 0.0
p30.pddl
0.4840 0.4831 -0.0009 0.4843 0.4843 -0.0
Sum of diffs
-0.0064
0.0001
Arithmetic mean of diffs
-0.0002
0.0000
organic-synthesis-opt18-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5582 0.5580 -0.0002 0.5582 0.5582 0.0
p02.pddl
0.5579 0.5579 -0.0001 0.5579 0.5579 0.0
p03.pddl
0.5197 0.5192 -0.0005 0.5216 0.5216 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p08.pddl
None None - None None -
p09.pddl
0.4940 0.4935 -0.0004 0.4929 0.4929 -0.0
p10.pddl
0.4927 0.4910 -0.0017 0.4916 0.4916 -0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
0.5275 0.5271 -0.0004 0.5273 0.5273 -0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
-0.0032
-0.0000
Arithmetic mean of diffs
-0.0005
-0.0000
organic-synthesis-split-opt18-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5556 0.5554 -0.0002 0.5550 0.5550 0.0
p02.pddl
0.5521 0.5519 -0.0003 0.5512 0.5512 -0.0
p03.pddl
0.5138 0.5129 -0.0009 0.4937 0.4937 -0.0
p04.pddl
0.5348 0.5342 -0.0006 0.4847 0.4847 -0.0
p05.pddl
0.5073 0.5061 -0.0012 0.5020 0.5020 0.0
p06.pddl
0.5031 0.5018 -0.0013 0.1933 0.1933 0.0
p07.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p08.pddl
0.4690 0.4673 -0.0017 0.0158 0.0158 -0.0
p09.pddl
0.5466 0.5463 -0.0004 0.5455 0.5455 -0.0
p10.pddl
0.5466 0.5461 -0.0005 0.5396 0.5396 0.0
p11.pddl
0.5123 0.5112 -0.0011 0 0 0.0
p12.pddl
0.5096 0.5083 -0.0013 0 0 0.0
p13.pddl
0.4192 0.4169 -0.0023 0 0 0.0
p14.pddl
0.5424 0.5419 -0.0005 0.5403 0.5403 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
0.3608 0.3586 -0.0022 0 0 0.0
p17.pddl
0.3377 0.3352 -0.0025 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0.4332 0.4317 -0.0016 0 0 0.0
p20.pddl
0.3208 0.3208 -0.0 0 0 0.0
Sum of diffs
-0.0184
-0.0000
Arithmetic mean of diffs
-0.0009
-0.0000
parcprinter-08-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p02.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p03.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p04.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p05.pddl
0.5592 0.5592 0.0 0.5592 0.5592 0.0
p06.pddl
0.5592 0.5592 -0.0 0.5592 0.5591 -0.0
p07.pddl
0.5588 0.5588 0.0 0.5588 0.5588 -0.0
p08.pddl
0.5588 0.5585 -0.0003 0.5585 0.5585 -0.0
p09.pddl
0.5585 0.5584 -0.0001 0.5585 0.5585 -0.0
p10.pddl
0.5584 0.5584 -0.0001 0.5584 0.5584 0.0
p11.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p12.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
p13.pddl
0.5595 0.5595 -0.0 0.5560 0.5560 -0.0
p14.pddl
0.5592 0.5591 -0.0 0.4545 0.4545 0.0
p15.pddl
0.5591 0.5591 -0.0 0 0 0.0
p16.pddl
0.5588 0.5588 0.0 0 0 0.0
p17.pddl
0.5584 0.5584 -0.0 0 0 0.0
p18.pddl
0.5580 0.5580 -0.0 0 0 0.0
p19.pddl
0.5578 0.5577 -0.0 0 0 0.0
p20.pddl
0.5572 0.5571 -0.0001 0 0 0.0
p21.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p22.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p23.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
p24.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p25.pddl
0.5595 0.5592 -0.0003 0.4903 0.4903 -0.0
p26.pddl
0.5592 0.5591 -0.0 0.5592 0.5595 0.0003
p27.pddl
0.5588 0.5588 -0.0 0.5591 0.5591 -0.0
p28.pddl
0.5588 0.5588 0.0 0.5591 0.5591 -0.0
p29.pddl
0.5585 0.5585 -0.0 0 0 0.0
p30.pddl
0.5581 0.5580 -0.0001 0 0 0.0
Sum of diffs
-0.0014
-0.0000
Arithmetic mean of diffs
-0.0000
-0.0000
parcprinter-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p02.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p03.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
p04.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p05.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
p06.pddl
0.5592 0.5592 -0.0 0.5592 0.5591 -0.0
p07.pddl
0.5592 0.5592 0.0 0.5592 0.5592 0.0
p08.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p09.pddl
0.5595 0.5595 -0.0 0.5560 0.5560 -0.0
p10.pddl
0.5595 0.5592 -0.0003 0.4903 0.4903 -0.0
p11.pddl
0.5592 0.5591 -0.0 0.5592 0.5595 0.0003
p12.pddl
0.5592 0.5591 -0.0 0.4545 0.4545 0.0
p13.pddl
0.5588 0.5588 0.0 0.5588 0.5588 -0.0
p14.pddl
0.5588 0.5585 -0.0003 0.5585 0.5585 -0.0
p15.pddl
0.5585 0.5584 -0.0001 0.5585 0.5585 -0.0
p16.pddl
0.5584 0.5584 -0.0001 0.5584 0.5584 0.0
p17.pddl
0.5591 0.5591 -0.0 0 0 0.0
p18.pddl
0.5588 0.5588 0.0 0 0 0.0
p19.pddl
0.5584 0.5584 -0.0 0 0 0.0
p20.pddl
0.5588 0.5588 -0.0 0.5591 0.5591 -0.0
Sum of diffs
-0.0011
0.0001
Arithmetic mean of diffs
-0.0001
0.0000
parking-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
0.5498 0.5497 -0.0001 0 0 0.0
pfile03-012.pddl
0.5495 0.5494 -0.0001 0 0 0.0
pfile04-013.pddl
0.5426 0.5422 -0.0003 0 0 0.0
pfile04-014.pddl
0.5426 0.5422 -0.0003 0 0 0.0
pfile04-015.pddl
0.5426 0.5422 -0.0003 0 0 0.0
pfile04-016.pddl
0.5426 0.5422 -0.0003 0 0 0.0
pfile05-017.pddl
0.5372 0.5367 -0.0005 0 0 0.0
pfile05-018.pddl
0.5372 0.5369 -0.0002 0 0 0.0
pfile05-019.pddl
0.5372 0.5366 -0.0005 0 0 0.0
pfile05-020.pddl
0.5372 0.5367 -0.0005 0 0 0.0
pfile06-021.pddl
0.5271 0.5267 -0.0005 0 0 0.0
pfile06-022.pddl
0.5271 0.5267 -0.0004 0 0 0.0
pfile06-023.pddl
0.5271 0.5267 -0.0005 0 0 0.0
pfile06-024.pddl
0.5271 0.5267 -0.0005 0 0 0.0
pfile07-025.pddl
0.5184 0.5177 -0.0007 0 0 0.0
pfile07-026.pddl
0.5186 0.5179 -0.0007 0 0 0.0
pfile07-027.pddl
0.5184 0.5177 -0.0007 0 0 0.0
pfile07-028.pddl
0.5184 0.5177 -0.0007 0 0 0.0
pfile08-029.pddl
0.5033 0.5025 -0.0007 0 0 0.0
pfile08-030.pddl
0.5033 0.5025 -0.0008 0 0 0.0
Sum of diffs
-0.0095
0.0000
Arithmetic mean of diffs
-0.0005
0.0000
parking-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
0.5495 0.5494 -0.0001 0 0 0.0
p_12_7-02.pddl
0.5495 0.5494 -0.0001 0.4792 0.4792 -0.0
p_12_7-03.pddl
0.5495 0.5494 -0.0001 0 0 0.0
p_12_7-04.pddl
0.5495 0.5494 -0.0001 0 0 0.0
p_14_8-01.pddl
0.5426 0.5422 -0.0003 0 0 0.0
p_14_8-02.pddl
0.5426 0.5422 -0.0003 0 0 0.0
p_14_8-03.pddl
0.5426 0.5422 -0.0003 0 0 0.0
p_14_8-04.pddl
0.5426 0.5422 -0.0003 0 0 0.0
p_16_9-01.pddl
0.5372 0.5369 -0.0003 0 0 0.0
p_16_9-02.pddl
0.5372 0.5369 -0.0002 0 0 0.0
p_16_9-03.pddl
0.5372 0.5369 -0.0003 0 0 0.0
p_16_9-04.pddl
0.5372 0.5367 -0.0005 0 0 0.0
p_18_10-01.pddl
0.5269 0.5264 -0.0005 0 0 0.0
p_18_10-02.pddl
0.5271 0.5267 -0.0005 0 0 0.0
p_18_10-03.pddl
0.5271 0.5267 -0.0005 0 0 0.0
p_18_10-04.pddl
0.5271 0.5267 -0.0005 0 0 0.0
p_20_11-01.pddl
0.5184 0.5177 -0.0007 0 0 0.0
p_20_11-02.pddl
0.5186 0.5179 -0.0007 0 0 0.0
p_20_11-03.pddl
0.5184 0.5177 -0.0007 0 0 0.0
p_20_11-04.pddl
0.5184 0.5177 -0.0007 0 0 0.0
Sum of diffs
-0.0076
-0.0000
Arithmetic mean of diffs
-0.0004
-0.0000
pathways-noneg
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p02.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p03.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p04.pddl
0.5598 0.5598 -0.0 0.5592 0.5591 -0.0
p05.pddl
0.5595 0.5595 0.0 0.5223 0.5225 0.0002
p06.pddl
0.5591 0.5591 -0.0 0.2898 0.2898 0.0
p07.pddl
0.5588 0.5587 -0.0001 0.0566 0.0566 -0.0
p08.pddl
0.5581 0.5583 0.0003 0 0 0.0
p09.pddl
0.5585 0.5584 -0.0001 0.2763 0.2762 -0.0
p10.pddl
0 0 0.0 0 0 0.0
p11.pddl
0.5580 0.5579 -0.0001 0.1201 0.1201 -0.0
p12.pddl
0.5577 0.5577 -0.0 0 0 0.0
p13.pddl
0.5573 0.5571 -0.0002 0 0 0.0
p14.pddl
0.5570 0.5568 -0.0002 0 0 0.0
p15.pddl
0.5573 0.5574 0.0001 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
0.5557 0.5556 -0.0001 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0.5492 0.5491 -0.0 0 0 0.0
p24.pddl
0.5495 0.5497 0.0002 0 0 0.0
p25.pddl
0.5491 0.5492 0.0002 0 0 0.0
p26.pddl
0.5493 0.5494 0.0001 0 0 0.0
p27.pddl
0.5462 0.5463 0.0001 0 0 0.0
p28.pddl
0.5499 0.5498 -0.0001 0 0 0.0
p29.pddl
0.5422 0.5421 -0.0001 0 0 0.0
p30.pddl
0.5409 0.5411 0.0002 0 0 0.0
Sum of diffs
0.0002
0.0001
Arithmetic mean of diffs
0.0000
0.0000
pegsol-08-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5597 0.5597 -0.0 0.5597 0.5597 0.0
p02.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p03.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p04.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p05.pddl
0.5597 0.5597 -0.0 0.5597 0.5597 0.0
p06.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p07.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p08.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p09.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p10.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p11.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p12.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p13.pddl
0.5595 0.5594 -0.0 0.5579 0.5579 -0.0
p14.pddl
0.5595 0.5594 -0.0 0.5588 0.5588 -0.0
p15.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p16.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p17.pddl
0.5566 0.5566 0.0 0.5560 0.5560 0.0
p18.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p19.pddl
0.5595 0.5594 -0.0 0.5588 0.5588 0.0
p20.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p21.pddl
0.5595 0.5594 -0.0 0.5579 0.5579 -0.0
p22.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p23.pddl
0.5595 0.5594 -0.0 0.5556 0.5556 -0.0
p24.pddl
0.5595 0.5594 -0.0 0.5579 0.5579 -0.0
p25.pddl
0.5595 0.5594 -0.0 0.5588 0.5588 0.0
p26.pddl
0.5595 0.5594 -0.0 0.5556 0.5556 -0.0
p27.pddl
0.5507 0.5507 0.0 0.5595 0.5595 -0.0
p28.pddl
0.5372 0.5372 -0.0 0.4690 0.4690 0.0
p29.pddl
0.2380 0.2380 -0.0 0.5413 0.5413 -0.0
p30.pddl
0.5355 0.5355 -0.0 0.1755 0.1755 -0.0
Sum of diffs
-0.0007
-0.0003
Arithmetic mean of diffs
-0.0000
-0.0000
pegsol-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p02.pddl
0.5566 0.5566 0.0 0.5560 0.5560 0.0
p03.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p04.pddl
0.5595 0.5594 -0.0 0.5588 0.5588 0.0
p05.pddl
0.5595 0.5594 -0.0 0.5544 0.5547 0.0003
p06.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p07.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p08.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p09.pddl
0.5595 0.5594 -0.0 0.5591 0.5591 -0.0
p10.pddl
0.5595 0.5594 -0.0 0.5579 0.5579 -0.0
p11.pddl
0.5595 0.5594 -0.0 0.5595 0.5595 -0.0
p12.pddl
0.5595 0.5594 -0.0 0.5588 0.5588 0.0
p13.pddl
0.5595 0.5594 -0.0 0.5556 0.5556 -0.0
p14.pddl
0.5595 0.5594 -0.0 0.5579 0.5579 -0.0
p15.pddl
0.5595 0.5594 -0.0 0.5588 0.5588 0.0
p16.pddl
0.5595 0.5594 -0.0 0.5556 0.5556 -0.0
p17.pddl
0.5507 0.5507 0.0 0.5595 0.5595 -0.0
p18.pddl
0.5372 0.5372 -0.0 0.4690 0.4690 0.0
p19.pddl
0.2380 0.2380 -0.0 0.5413 0.5413 -0.0
p20.pddl
0.5355 0.5355 -0.0 0.1755 0.1755 -0.0
Sum of diffs
-0.0005
0.0002
Arithmetic mean of diffs
-0.0000
0.0000
petri-net-alignment-opt18-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5541 0.5542 0.0001 0.5544 0.5544 0.0
p02.pddl
0.5509 0.5509 0.0 0.5521 0.5520 -0.0001
p03.pddl
0.5473 0.5471 -0.0001 0.5495 0.5493 -0.0002
p04.pddl
0.5466 0.5465 -0.0001 0.5489 0.5489 0.0
p05.pddl
0.5515 0.5514 -0.0001 0.5524 0.5524 -0.0
p06.pddl
0.5464 0.5463 -0.0001 0.5489 0.5490 0.0001
p07.pddl
0.5479 0.5477 -0.0002 0.5496 0.5499 0.0002
p08.pddl
0.5464 0.5462 -0.0001 0.5489 0.5489 0.0
p09.pddl
0.5473 0.5471 -0.0002 0.5492 0.5492 0.0
p10.pddl
0.5397 0.5395 -0.0002 0.5441 0.5441 -0.0
p11.pddl
0.5444 0.5441 -0.0003 0.5474 0.5473 -0.0
p12.pddl
0.5328 0.5326 -0.0002 0.5393 0.5392 -0.0001
p13.pddl
0.5399 0.5398 -0.0001 0.5444 0.5444 0.0
p14.pddl
0.5391 0.5390 -0.0001 0.5435 0.5436 0.0001
p15.pddl
0.5401 0.5401 -0.0001 0.5447 0.5447 0.0
p16.pddl
0.5357 0.5357 0.0 0.5415 0.5415 -0.0
p17.pddl
0.5339 0.5337 -0.0002 0.5401 0.5400 -0.0
p18.pddl
0.5357 0.5357 0.0 0.5415 0.5415 -0.0
p19.pddl
0.5341 0.5339 -0.0002 0.5401 0.5401 0.0
p20.pddl
0.5325 0.5324 -0.0002 0.5392 0.5392 -0.0
Sum of diffs
-0.0023
-0.0000
Arithmetic mean of diffs
-0.0001
-0.0000
pipesworld-notankage
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p02-net1-b6-g4.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p03-net1-b8-g3.pddl
0.5594 0.5593 -0.0 0.5591 0.5591 0.0
p04-net1-b8-g5.pddl
0.5591 0.5590 -0.0 0.5591 0.5591 0.0
p05-net1-b10-g4.pddl
0.5585 0.5585 -0.0 0.5585 0.5585 -0.0
p06-net1-b10-g6.pddl
0.5582 0.5580 -0.0002 0.5585 0.5585 -0.0
p07-net1-b12-g5.pddl
0.5583 0.5582 -0.0001 0.5583 0.5582 -0.0001
p08-net1-b12-g7.pddl
0.5583 0.5582 -0.0001 0.5583 0.5582 -0.0001
p09-net1-b14-g6.pddl
0.5577 0.5576 -0.0001 0.5577 0.5579 0.0001
p10-net1-b14-g8.pddl
0.5577 0.5576 -0.0001 0.5577 0.5579 0.0001
p11-net2-b10-g2.pddl
0.5554 0.5554 -0.0 0.5572 0.5572 0.0
p12-net2-b10-g4.pddl
0.5555 0.5555 -0.0 0.5572 0.5572 0.0
p13-net2-b12-g3.pddl
0.5565 0.5562 -0.0002 0.5534 0.5534 -0.0001
p14-net2-b12-g5.pddl
0.5561 0.5562 0.0 0.5558 0.5558 0.0
p15-net2-b14-g4.pddl
0.5564 0.5562 -0.0002 0.5530 0.5530 0.0
p16-net2-b14-g6.pddl
0.5490 0.5490 -0.0 0.4853 0.4853 -0.0
p17-net2-b16-g5.pddl
0.5489 0.5489 -0.0 0.5544 0.5544 0.0
p18-net2-b16-g7.pddl
0.5443 0.5443 -0.0 0.5544 0.5543 -0.0001
p19-net2-b18-g6.pddl
0.5528 0.5526 -0.0002 0.5521 0.5522 0.0
p20-net2-b18-g8.pddl
0.5368 0.5368 -0.0 0.5481 0.5481 -0.0
p21-net3-b12-g2.pddl
0.5561 0.5557 -0.0004 0.5554 0.5554 -0.0
p22-net3-b12-g4.pddl
0.5355 0.5355 -0.0 0.5372 0.5372 0.0
p23-net3-b14-g3.pddl
0.5536 0.5535 -0.0001 0.5513 0.5512 -0.0
p24-net3-b14-g5.pddl
0.5453 0.5453 -0.0 0.4967 0.4967 -0.0
p25-net3-b16-g5.pddl
0.5521 0.5519 -0.0002 0.4970 0.4970 -0.0
p26-net3-b16-g7.pddl
0.5334 0.5334 -0.0 0.5473 0.5473 -0.0
p27-net3-b18-g6.pddl
0.5337 0.5337 0.0 0.1976 0.1976 -0.0
p28-net3-b18-g7.pddl
0.5317 0.5316 -0.0 0.2618 0.2618 -0.0
p29-net3-b20-g6.pddl
0.5468 0.5467 -0.0 0.3083 0.3083 0.0
p30-net3-b20-g8.pddl
0.5294 0.5294 0.0 0.5139 0.5139 0.0
p31-net4-b14-g3.pddl
0.5524 0.5522 -0.0002 0.5451 0.5450 -0.0
p32-net4-b14-g5.pddl
0.5489 0.5489 -0.0 0.5505 0.5505 -0.0
p33-net4-b16-g5.pddl
0.5512 0.5512 -0.0 0.5386 0.5386 -0.0
p34-net4-b16-g6.pddl
0.5352 0.5352 -0.0 0.5188 0.5188 -0.0
p35-net4-b18-g4.pddl
0.5432 0.5431 -0.0 0.1938 0.1938 -0.0
p36-net4-b18-g6.pddl
0.5468 0.5465 -0.0003 0.0474 0.0474 -0.0
p37-net4-b20-g5.pddl
0.5459 0.5456 -0.0003 0 0 0.0
p38-net4-b20-g7.pddl
0.5322 0.5322 0.0 0.2083 0.2083 -0.0
p39-net4-b22-g7.pddl
0.5427 0.5422 -0.0006 0 0 0.0
p40-net4-b22-g8.pddl
0.5427 0.5422 -0.0006 0.0311 0.0311 -0.0
p41-net5-b22-g2.pddl
0.5360 0.5354 -0.0006 0.3835 0.3835 -0.0
p42-net5-b22-g4.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6.pddl
0.5173 0.5164 -0.0009 0 0 0.0
p50-net5-b30-g8.pddl
0.4986 0.4986 -0.0 0 0 0.0
Sum of diffs
-0.0058
-0.0003
Arithmetic mean of diffs
-0.0001
-0.0000
pipesworld-tankage
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
0.5598 0.5598 -0.0 0.5595 0.5598 0.0003
p02-net1-b6-g4-t50.pddl
0.5595 0.5595 -0.0 0.5595 0.5598 0.0003
p03-net1-b8-g3-t80.pddl
0.5577 0.5576 -0.0001 0.5577 0.5576 -0.0001
p04-net1-b8-g5-t80.pddl
0.5577 0.5576 -0.0 0.5577 0.5576 -0.0001
p05-net1-b10-g4-t50.pddl
0.5575 0.5573 -0.0003 0.5572 0.5572 0.0
p06-net1-b10-g6-t50.pddl
0.5572 0.5573 0.0001 0.5572 0.5572 0.0
p07-net1-b12-g5-t80.pddl
0.5515 0.5513 -0.0002 0.5512 0.5511 -0.0
p08-net1-b12-g7-t80.pddl
0.5512 0.5510 -0.0002 0.5512 0.5512 0.0
p09-net1-b14-g6-t50.pddl
0.5350 0.5350 -0.0 0.5402 0.5402 -0.0
p10-net1-b14-g8-t50.pddl
0.5498 0.5498 -0.0 0.5498 0.5498 0.0001
p11-net2-b10-g2-t30.pddl
0.5550 0.5550 -0.0 0.5521 0.5522 0.0
p12-net2-b10-g4-t60.pddl
0.5518 0.5515 -0.0003 0.5448 0.5448 -0.0
p13-net2-b12-g3-t70.pddl
0.5497 0.5493 -0.0004 0.2601 0.2601 -0.0
p14-net2-b12-g5-t30.pddl
0.5521 0.5521 -0.0 0.5238 0.5238 -0.0
p15-net2-b14-g4-t30.pddl
0.5524 0.5521 -0.0003 0.4849 0.4849 0.0
p16-net2-b14-g6-t80.pddl
0.5434 0.5431 -0.0003 0 0 0.0
p17-net2-b16-g5-t20.pddl
0.5511 0.5508 -0.0002 0.4531 0.4531 -0.0
p18-net2-b16-g7-t60.pddl
0.5418 0.5414 -0.0004 0.3069 0.3069 -0.0
p19-net2-b18-g6-t60.pddl
0.5348 0.5344 -0.0004 0.3239 0.3239 -0.0
p20-net2-b18-g8-t90.pddl
0.5236 0.5229 -0.0007 0 0 0.0
p21-net3-b12-g2-t60.pddl
0.5504 0.5502 -0.0003 0.5365 0.5365 -0.0
p22-net3-b12-g4-t60.pddl
0.2161 0.2161 0.0 0.3349 0.3348 -0.0
p23-net3-b14-g3-t60.pddl
0.5398 0.5395 -0.0004 0 0 0.0
p24-net3-b14-g5-t60.pddl
0.5396 0.5392 -0.0004 0 0 0.0
p25-net3-b16-g5-t60.pddl
0.5233 0.5227 -0.0006 0 0 0.0
p26-net3-b16-g7-t70.pddl
0.4957 0.4957 -0.0 0 0 0.0
p27-net3-b18-g6-t70.pddl
0.5137 0.5131 -0.0007 0 0 0.0
p28-net3-b18-g7-t70.pddl
0.2122 0.2122 -0.0 0 0 0.0
p29-net3-b20-g6-t70.pddl
0.5026 0.5017 -0.0009 0 0 0.0
p30-net3-b20-g8-t70.pddl
0.5001 0.4990 -0.001 0 0 0.0
p31-net4-b14-g3-t20.pddl
0.5040 0.5040 -0.0 0.5396 0.5396 0.0
p32-net4-b14-g5-t30.pddl
0.5431 0.5429 -0.0002 0.2396 0.2396 -0.0
p33-net4-b16-g5-t60.pddl
0.5326 0.5321 -0.0005 0 0 0.0
p34-net4-b16-g6-t60.pddl
0.5263 0.5257 -0.0006 0 0 0.0
p35-net4-b18-g4-t90.pddl
0.4784 0.4773 -0.0011 0 0 0.0
p36-net4-b18-g6-t90.pddl
0.4725 0.4725 -0.0 0 0 0.0
p37-net4-b20-g5-t60.pddl
0.5038 0.5028 -0.001 0 0 0.0
p38-net4-b20-g7-t60.pddl
0.5036 0.5026 -0.001 0 0 0.0
p39-net4-b22-g7-t50.pddl
0.4794 0.4783 -0.0011 0 0 0.0
p40-net4-b22-g8-t50.pddl
0.4794 0.4783 -0.0011 0 0 0.0
p41-net5-b22-g2-t20.pddl
0.5221 0.5213 -0.0008 0 0 0.0
p42-net5-b22-g4-t50.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3-t80.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5-t80.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4-t50.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6-t50.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5-t50.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7-t50.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6-t50.pddl
0.4087 0.4069 -0.0018 0 0 0.0
p50-net5-b30-g8-t50.pddl
0.4084 0.4066 -0.0018 0 0 0.0
Sum of diffs
-0.0191
0.0003
Arithmetic mean of diffs
-0.0004
0.0000
psr-small
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p02-s5-n1-l3-f30.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p03-s7-n1-l3-f70.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p04-s8-n1-l4-f10.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p05-s9-n1-l4-f30.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p06-s10-n1-l4-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p07-s11-n1-l4-f70.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p08-s12-n1-l5-f10.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p09-s13-n1-l5-f30.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p10-s17-n2-l2-f30.pddl
0.5598 0.5601 0.0003 0.5598 0.5598 -0.0
p11-s18-n2-l2-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p12-s21-n2-l3-f30.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p13-s22-n2-l3-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p14-s23-n2-l3-f70.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p15-s24-n2-l4-f10.pddl
0.5585 0.5585 -0.0 0.5576 0.5575 -0.0
p16-s29-n2-l5-f30.pddl
0.5598 0.5601 0.0003 0.5598 0.5598 -0.0
p17-s30-n2-l5-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p18-s31-n2-l5-f70.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p19-s33-n3-l2-f30.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p20-s34-n3-l2-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p21-s35-n3-l2-f70.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p22-s37-n3-l3-f30.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p23-s38-n3-l3-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p24-s39-n3-l3-f70.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p25-s40-n3-l4-f10.pddl
0.5324 0.5323 -0.0001 0.5348 0.5348 0.0
p26-s41-n3-l4-f30.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p27-s42-n3-l4-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p28-s43-n3-l4-f70.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p29-s45-n3-l5-f30.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p30-s46-n3-l5-f50.pddl
0.5598 0.5601 0.0003 0.5598 0.5598 -0.0
p31-s49-n4-l2-f30.pddl
0.5585 0.5585 -0.0 0.5523 0.5526 0.0003
p32-s50-n4-l2-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p33-s51-n4-l2-f70.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p34-s55-n4-l3-f70.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p35-s57-n5-l2-f30.pddl
0.5598 0.5598 -0.0 0.5306 0.5305 -0.0
p36-s65-n6-l2-f30.pddl
0.5595 0.5595 -0.0 0.4709 0.4709 0.0
p37-s67-n6-l2-f70.pddl
0.5598 0.5601 0.0003 0.5598 0.5598 -0.0
p38-s78-n3-l3-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p39-s79-n3-l3-f70.pddl
0.5598 0.5601 0.0003 0.5598 0.5598 -0.0
p40-s80-n3-l4-f10.pddl
0.5581 0.5581 -0.0 0.3324 0.3324 0.0
p41-s81-n3-l4-f30.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p42-s82-n3-l4-f50.pddl
0.5598 0.5601 0.0003 0.5598 0.5598 -0.0
p43-s83-n3-l4-f70.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p44-s89-n4-l2-f30.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p45-s94-n4-l3-f50.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p46-s97-n5-l2-f30.pddl
0.5598 0.5598 -0.0 0.5523 0.5522 -0.0
p47-s98-n5-l2-f50.pddl
0.5598 0.5601 0.0003 0.5598 0.5598 -0.0
p48-s101-n5-l3-f30.pddl
0.5598 0.5598 -0.0 0.5595 0.5598 0.0003
p49-s105-n6-l2-f30.pddl
0.5595 0.5598 0.0003 0.5595 0.5595 -0.0
p50-s107-n6-l2-f70.pddl
0.5598 0.5601 0.0003 0.5598 0.5601 0.0003
Sum of diffs
0.0017
-0.0001
Arithmetic mean of diffs
0.0000
-0.0000
rovers
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p02.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p03.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p04.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p05.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p06.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p07.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p08.pddl
0.5598 0.5598 -0.0 0.5592 0.5592 -0.0
p09.pddl
0.5595 0.5595 0.0 0.5520 0.5520 -0.0
p10.pddl
0.5595 0.5595 -0.0 0.5438 0.5438 -0.0
p11.pddl
0.5595 0.5595 0.0 0.5576 0.5576 0.0
p12.pddl
0.5598 0.5598 -0.0 0.5592 0.5592 -0.0
p13.pddl
0.5594 0.5592 -0.0003 0.5553 0.5553 -0.0
p14.pddl
0.5595 0.5595 -0.0 0.5511 0.5513 0.0001
p15.pddl
0.5591 0.5591 -0.0 0.5439 0.5439 0.0
p16.pddl
0.5594 0.5594 -0.0 0.5433 0.5433 0.0
p17.pddl
0.5585 0.5585 -0.0 0.4066 0.4066 0.0
p18.pddl
0.5582 0.5581 -0.0001 0.1345 0.1345 0.0
p19.pddl
0.5569 0.5568 -0.0 0 0 0.0
p20.pddl
0.5555 0.5554 -0.0001 0 0 0.0
p21.pddl
0.5546 0.5545 -0.0001 0 0 0.0
p22.pddl
0.5548 0.5546 -0.0003 0.1463 0.1463 -0.0
p23.pddl
0.5534 0.5536 0.0002 0 0 0.0
p24.pddl
0.5514 0.5514 -0.0 0 0 0.0
p25.pddl
0.5553 0.5553 -0.0 0.4741 0.4741 0.0
p26.pddl
0.5564 0.5563 -0.0001 0 0 0.0
p27.pddl
0.5542 0.5540 -0.0002 0 0 0.0
p28.pddl
0.5509 0.5509 -0.0001 0 0 0.0
p29.pddl
0.5506 0.5505 -0.0001 0 0 0.0
p30.pddl
0.5492 0.5492 -0.0 0 0 0.0
p31.pddl
0.5468 0.5468 0.0001 0 0 0.0
p32.pddl
0.5364 0.5366 0.0001 0 0 0.0
p33.pddl
0.5243 0.5243 -0.0 0 0 0.0
p34.pddl
0.5378 0.5380 0.0002 0 0 0.0
p35.pddl
0.5042 0.5042 -0.0 0 0 0.0
p36.pddl
0.5263 0.5264 0.0001 0 0 0.0
p37.pddl
0.4785 0.4785 -0.0 0 0 0.0
p38.pddl
0.4912 0.4912 -0.0 0 0 0.0
p39.pddl
0.4963 0.4963 -0.0 0 0 0.0
p40.pddl
0.4665 0.4667 0.0001 0 0 0.0
Sum of diffs
-0.0009
-0.0001
Arithmetic mean of diffs
-0.0000
-0.0000
satellite
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p02-pfile2.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p03-pfile3.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p04-pfile4.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p05-pfile5.pddl
0.5595 0.5595 -0.0 0.5547 0.5547 -0.0
p06-pfile6.pddl
0.5595 0.5595 -0.0 0.5582 0.5582 -0.0
p07-pfile7.pddl
0.5594 0.5591 -0.0003 0.5408 0.5408 0.0
p08-pfile8.pddl
0.5590 0.5590 -0.0 0.4529 0.4529 -0.0
p09-pfile9.pddl
0.5585 0.5584 -0.0 0.3980 0.3981 0.0001
p10-pfile10.pddl
0.5584 0.5583 -0.0001 0.2654 0.2654 -0.0
p11-pfile11.pddl
0.5577 0.5577 -0.0 0.3445 0.3445 -0.0
p12-pfile12.pddl
0.5563 0.5562 -0.0001 0.1590 0.1590 0.0
p13-pfile13.pddl
0.5529 0.5529 0.0 0 0 0.0
p14-pfile14.pddl
0.5559 0.5558 -0.0001 0.1353 0.1353 -0.0
p15-pfile15.pddl
0.5538 0.5537 -0.0 0 0 0.0
p16-pfile16.pddl
0.5534 0.5532 -0.0003 0 0 0.0
p17-pfile17.pddl
0.5507 0.5509 0.0002 0 0 0.0
p18-pfile18.pddl
0.5566 0.5566 -0.0001 0 0 0.0
p19-pfile19.pddl
0.5557 0.5557 -0.0001 0 0 0.0
p20-pfile20.pddl
0.5486 0.5488 0.0002 0 0 0.0
p21-HC-pfile1.pddl
0.5495 0.5496 0.0001 0.2976 0.2976 0.0
p22-HC-pfile2.pddl
0.5450 0.5448 -0.0002 0 0 0.0
p23-HC-pfile3.pddl
0.5341 0.5341 0.0 0.2855 0.2855 -0.0
p24-HC-pfile4.pddl
0.5081 0.5081 0.0 0 0 0.0
p25-HC-pfile5.pddl
0.4947 0.4946 -0.0 0 0 0.0
p26-HC-pfile6.pddl
0.5117 0.5117 -0.0 0 0 0.0
p27-HC-pfile7.pddl
0.5074 0.5074 -0.0 0 0 0.0
p28-HC-pfile8.pddl
0.4023 0.4023 -0.0 0 0 0.0
p29-HC-pfile9.pddl
0.4323 0.4323 -0.0 0 0 0.0
p30-HC-pfile10.pddl
0.3284 0.3284 0.0 0 0 0.0
p31-HC-pfile11.pddl
0.3402 0.3402 -0.0 0 0 0.0
p32-HC-pfile12.pddl
0.2101 0.2102 0.0001 0 0 0.0
p33-HC-pfile13.pddl
0.1158 0.1158 -0.0 0 0 0.0
p34-HC-pfile14.pddl
0.4253 0.4244 -0.001 0 0 0.0
p35-HC-pfile15.pddl
0.3194 0.3193 -0.0 0 0 0.0
p36-HC-pfile16.pddl
0.3677 0.3664 -0.0012 0 0 0.0
Sum of diffs
-0.0032
-0.0001
Arithmetic mean of diffs
-0.0001
-0.0000
scanalyzer-08-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5592 0.5591 -0.0 0.5592 0.5591 -0.0001
p02.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p03.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p04.pddl
0.5563 0.5562 -0.0001 0.5563 0.5563 0.0
p05.pddl
0.5581 0.5579 -0.0002 0.5581 0.5581 -0.0
p06.pddl
0.5585 0.5585 -0.0 0.5585 0.5585 -0.0
p07.pddl
0.5521 0.5520 -0.0001 0.5520 0.5520 0.0
p08.pddl
0.5559 0.5558 -0.0001 0.5556 0.5555 -0.0
p09.pddl
0.5562 0.5561 -0.0 0.5558 0.5558 -0.0
p10.pddl
0.5438 0.5434 -0.0004 0.5432 0.5432 -0.0
p11.pddl
0.5515 0.5512 -0.0003 0.5507 0.5507 0.0
p12.pddl
0.5519 0.5520 0.0 0.5515 0.5515 -0.0
p13.pddl
0.5312 0.5307 -0.0005 0.5308 0.5308 -0.0
p14.pddl
0.5445 0.5443 -0.0003 0.5436 0.5436 -0.0
p15.pddl
0.5453 0.5451 -0.0002 0.5448 0.5448 0.0
p16.pddl
0.5112 0.5104 -0.0007 0.5100 0.5100 0.0
p17.pddl
0.5326 0.5321 -0.0005 0.5311 0.5311 0.0
p18.pddl
0.5390 0.5393 0.0002 0.5377 0.5377 0.0
p19.pddl
0.4963 0.4951 -0.0012 0.4945 0.4945 -0.0
p20.pddl
0.5248 0.5241 -0.0008 0.5221 0.5221 -0.0
p21.pddl
0.5268 0.5262 -0.0006 0.5246 0.5246 -0.0
p22.pddl
0.5585 0.5585 -0.0 0.5585 0.5585 0.0
p23.pddl
0.5585 0.5585 -0.0 0.5585 0.5585 0.0
p24.pddl
0.5585 0.5585 -0.0 0.5585 0.5585 0.0
p25.pddl
0.4916 0.4908 -0.0008 0.4908 0.4908 0.0
p26.pddl
0.5026 0.5018 -0.0008 0.5020 0.5020 0.0
p27.pddl
0.5068 0.5062 -0.0007 0.5062 0.5062 -0.0
p28.pddl
0.2555 0.2531 -0.0024 0.2533 0.2533 0.0
p29.pddl
0.3177 0.3154 -0.0023 0.3156 0.3156 0.0
p30.pddl
0.3299 0.3278 -0.002 0.3279 0.3279 -0.0
Sum of diffs
-0.0148
-0.0002
Arithmetic mean of diffs
-0.0005
-0.0000
scanalyzer-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5585 0.5585 -0.0 0.5585 0.5585 0.0
p02.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p03.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p04.pddl
0.5563 0.5562 -0.0001 0.5563 0.5563 0.0
p05.pddl
0.5521 0.5520 -0.0001 0.5520 0.5520 0.0
p06.pddl
0.5581 0.5579 -0.0002 0.5581 0.5581 -0.0
p07.pddl
0.4963 0.4951 -0.0012 0.4945 0.4945 -0.0
p08.pddl
0.5438 0.5434 -0.0004 0.5432 0.5432 -0.0
p09.pddl
0.5312 0.5307 -0.0005 0.5308 0.5308 -0.0
p10.pddl
0.5112 0.5104 -0.0007 0.5100 0.5100 0.0
p11.pddl
0.4916 0.4908 -0.0008 0.4908 0.4908 0.0
p12.pddl
0.5585 0.5585 -0.0 0.5585 0.5585 -0.0
p13.pddl
0.5068 0.5062 -0.0007 0.5062 0.5062 -0.0
p14.pddl
0.5026 0.5018 -0.0008 0.5020 0.5020 0.0
p15.pddl
0.5559 0.5558 -0.0001 0.5556 0.5555 -0.0
p16.pddl
0.5515 0.5512 -0.0003 0.5507 0.5507 0.0
p17.pddl
0.5445 0.5443 -0.0003 0.5436 0.5436 -0.0
p18.pddl
0.5326 0.5321 -0.0005 0.5311 0.5311 0.0
p19.pddl
0.5248 0.5241 -0.0008 0.5221 0.5221 -0.0
p20.pddl
0.2555 0.2531 -0.0024 0.2533 0.2533 0.0
Sum of diffs
-0.0098
-0.0001
Arithmetic mean of diffs
-0.0005
-0.0000
snake-opt18-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5342 0.5337 -0.0005 0.5333 0.5333 0.0
p02.pddl
0.5331 0.5325 -0.0006 0.5165 0.5164 -0.0
p03.pddl
0.5303 0.5303 0.0 0.4710 0.4710 0.0
p04.pddl
0.5355 0.5351 -0.0004 0.5348 0.5348 0.0
p05.pddl
0.5354 0.5351 -0.0003 0.5343 0.5343 0.0
p06.pddl
0.5258 0.5252 -0.0006 0.5054 0.5054 0.0
p07.pddl
0.3666 0.3666 0.0 0.1904 0.1904 -0.0
p08.pddl
0 0 0.0 0.0195 0.0195 -0.0
p09.pddl
0.5275 0.5270 -0.0005 0.5264 0.5264 0.0
p10.pddl
0.5268 0.5261 -0.0007 0.5257 0.5258 0.0001
p11.pddl
0.5094 0.5087 -0.0007 0.4714 0.4714 0.0
p12.pddl
0.4617 0.4617 -0.0 0.1488 0.1488 -0.0
p13.pddl
0.5064 0.5055 -0.0009 0 0 0.0
p14.pddl
0 0 0.0 0 0 0.0
p15.pddl
0.5110 0.5104 -0.0007 0.5089 0.5089 -0.0
p16.pddl
0.5000 0.4985 -0.0014 0.1982 0.1982 0.0
p17.pddl
0.4133 0.4133 -0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0.5014 0.5003 -0.0011 0.4995 0.4995 0.0
Sum of diffs
-0.0086
0.0001
Arithmetic mean of diffs
-0.0004
0.0000
sokoban-opt08-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p02.pddl
0.5598 0.5598 -0.0 0.5595 0.5595 -0.0
p03.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
p04.pddl
0.5592 0.5591 -0.0 0.5588 0.5590 0.0002
p05.pddl
0.5562 0.5563 0.0001 0 0 0.0
p06.pddl
0.5595 0.5594 -0.0 0.5582 0.5579 -0.0003
p07.pddl
0.5588 0.5588 -0.0 0.5512 0.5512 0.0
p08.pddl
0.5532 0.5532 -0.0 0.3508 0.3508 0.0
p09.pddl
0.5588 0.5588 -0.0 0.4659 0.4658 -0.0
p10.pddl
0.5582 0.5581 -0.0001 0.5047 0.5047 0.0
p11.pddl
0.5458 0.5457 -0.0 0.5273 0.5273 -0.0
p12.pddl
0.5572 0.5571 -0.0 0.3207 0.3207 -0.0
p13.pddl
0.4748 0.4748 0.0 0.3279 0.3279 -0.0
p14.pddl
0.5594 0.5594 -0.0 0.5544 0.5544 0.0
p15.pddl
0.5434 0.5434 0.0 0.3854 0.3854 0.0
p16.pddl
0.5536 0.5536 -0.0 0.5397 0.5397 0.0
p17.pddl
0.5592 0.5591 -0.0 0.5495 0.5497 0.0002
p18.pddl
0.5524 0.5524 -0.0001 0.3112 0.3112 -0.0
p19.pddl
0.5422 0.5422 0.0 0.2303 0.2303 -0.0
p20.pddl
0.5584 0.5583 -0.0002 0.5486 0.5486 0.0
p21.pddl
0.5555 0.5553 -0.0002 0.5549 0.5549 -0.0
p22.pddl
0.5456 0.5456 0.0 0.2614 0.2614 0.0
p23.pddl
0.5588 0.5587 -0.0 0.4957 0.4957 -0.0
p24.pddl
0.5296 0.5296 -0.0001 0 0 0.0
p25.pddl
0.2316 0.2316 -0.0 0 0 0.0
p26.pddl
0.5480 0.5480 -0.0 0 0 0.0
p27.pddl
0.5557 0.5557 -0.0 0.5546 0.5546 0.0
p28.pddl
0.3567 0.3567 -0.0 0.1844 0.1844 -0.0
p29.pddl
0.5543 0.5539 -0.0004 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0013
-0.0000
Arithmetic mean of diffs
-0.0000
-0.0000
sokoban-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5595 0.5594 -0.0 0.5582 0.5579 -0.0003
p02.pddl
0.5592 0.5591 -0.0 0.5495 0.5497 0.0002
p03.pddl
0.5594 0.5594 -0.0 0.5544 0.5544 0.0
p04.pddl
0.5592 0.5591 -0.0 0.5588 0.5590 0.0002
p05.pddl
0.5536 0.5536 -0.0 0.5397 0.5397 0.0
p06.pddl
0.5458 0.5457 -0.0 0.5273 0.5273 -0.0
p07.pddl
0.5582 0.5581 -0.0001 0.5047 0.5047 0.0
p08.pddl
0.5588 0.5588 -0.0 0.4659 0.4658 -0.0
p09.pddl
0.5588 0.5588 -0.0 0.5512 0.5512 0.0
p10.pddl
0.5562 0.5563 0.0001 0 0 0.0
p11.pddl
0.4748 0.4748 0.0 0.3279 0.3279 -0.0
p12.pddl
0.5584 0.5583 -0.0002 0.5486 0.5486 0.0
p13.pddl
0.5532 0.5532 -0.0 0.3508 0.3508 0.0
p14.pddl
0.5572 0.5571 -0.0 0.3207 0.3207 -0.0
p15.pddl
0.5524 0.5524 -0.0001 0.3112 0.3112 -0.0
p16.pddl
0.5434 0.5434 0.0 0.3854 0.3854 0.0
p17.pddl
0.5422 0.5422 0.0 0.2303 0.2303 -0.0
p18.pddl
0.5555 0.5553 -0.0002 0.5549 0.5549 -0.0
p19.pddl
0.5456 0.5456 0.0 0.2614 0.2614 0.0
p20.pddl
0.5588 0.5587 -0.0 0.4957 0.4957 -0.0
Sum of diffs
-0.0008
0.0000
Arithmetic mean of diffs
-0.0000
0.0000
spider-opt18-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5430 0.5427 -0.0003 0.5423 0.5423 0.0
p02.pddl
0.5374 0.5370 -0.0004 0.5365 0.5365 0.0
p03.pddl
0.5135 0.5147 0.0012 0.5144 0.5144 0.0
p04.pddl
0.5005 0.4998 -0.0007 0.4994 0.4994 0.0
p05.pddl
0.4771 0.4760 -0.0011 0.4761 0.4759 -0.0002
p06.pddl
0.4377 0.4340 -0.0037 0.2222 0.2222 0.0
p07.pddl
0.5460 0.5457 -0.0003 0.5456 0.5456 0.0
p08.pddl
0.5375 0.5371 -0.0003 0.5367 0.5367 0.0
p09.pddl
0.5174 0.5167 -0.0006 0.5165 0.5165 0.0
p10.pddl
0.5034 0.5028 -0.0006 0.4497 0.4497 0.0
p11.pddl
0.4770 0.4759 -0.0011 0.4751 0.4752 0.0
p12.pddl
0.4397 0.4384 -0.0012 0.3379 0.3379 -0.0
p13.pddl
0.4314 0.4300 -0.0014 0.4287 0.4287 0.0
p14.pddl
0.5463 0.5461 -0.0002 0.5460 0.5460 -0.0
p15.pddl
0.5385 0.5382 -0.0003 0.5377 0.5377 0.0
p16.pddl
0.5177 0.5172 -0.0006 0.5167 0.5167 0.0
p17.pddl
0.5096 0.5111 0.0015 0.5102 0.5102 0.0
p18.pddl
0.4784 0.4774 -0.001 0.4102 0.4102 0.0
p19.pddl
0.4437 0.4426 -0.0011 0.4443 0.4443 -0.0
p20.pddl
0.4349 0.4336 -0.0013 0.4321 0.4321 -0.0
Sum of diffs
-0.0134
-0.0002
Arithmetic mean of diffs
-0.0007
-0.0000
storage
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p02.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p03.pddl
0.5598 0.5598 0.0 0.5598 0.5598 -0.0
p04.pddl
0.5598 0.5598 0.0 0.5598 0.5598 -0.0
p05.pddl
0.5598 0.5598 -0.0 0.5598 0.5597 -0.0001
p06.pddl
0.5595 0.5595 -0.0 0.5595 0.5594 -0.0001
p07.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p08.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 -0.0
p09.pddl
0.5589 0.5588 -0.0 0.5589 0.5589 -0.0
p10.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 -0.0
p11.pddl
0.5585 0.5585 -0.0001 0.5587 0.5587 0.0
p12.pddl
0.5582 0.5581 -0.0001 0.5510 0.5509 -0.0001
p13.pddl
0.5573 0.5573 -0.0 0.5594 0.5590 -0.0003
p14.pddl
0.5516 0.5516 -0.0 0.5585 0.5585 -0.0
p15.pddl
0.5563 0.5561 -0.0002 0.5515 0.5515 -0.0
p16.pddl
0.5541 0.5540 -0.0001 0.4964 0.4962 -0.0001
p17.pddl
0.5517 0.5519 0.0002 0.2484 0.2484 -0.0
p18.pddl
0.3472 0.3472 -0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0.4507 0.4507 -0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0005
-0.0008
Arithmetic mean of diffs
-0.0000
-0.0000
termes-opt18-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5594 0.5593 -0.0 0.5581 0.5581 0.0
p02.pddl
0.5571 0.5568 -0.0003 0.5581 0.5581 0.0
p03.pddl
0.5560 0.5560 -0.0 0.5435 0.5434 -0.0001
p04.pddl
0.5567 0.5569 0.0002 0.5444 0.5444 -0.0001
p05.pddl
0.4478 0.4478 -0.0 0.4164 0.4164 0.0
p06.pddl
0.5159 0.5159 -0.0 0.3508 0.3509 0.0
p07.pddl
0.3402 0.3402 -0.0 0.1021 0.1021 -0.0
p08.pddl
0.3195 0.3195 -0.0 0.2781 0.2781 -0.0
p09.pddl
0 0 0.0 0 0 0.0
p10.pddl
0.1599 0.1599 0.0 0 0 0.0
p11.pddl
0.5594 0.5593 -0.0 0.5521 0.5521 0.0
p12.pddl
0.5590 0.5590 -0.0 0.5593 0.5593 0.0
p13.pddl
0.5576 0.5576 -0.0 0.5445 0.5447 0.0002
p14.pddl
0.5582 0.5582 -0.0 0.5557 0.5556 -0.0001
p15.pddl
0.5331 0.5331 -0.0 0.5304 0.5304 -0.0
p16.pddl
0.5427 0.5427 0.0 0.5070 0.5068 -0.0002
p17.pddl
0.5512 0.5511 -0.0001 0.5521 0.5522 0.0
p18.pddl
0.5594 0.5593 -0.0 0.5590 0.5590 0.0
p19.pddl
0.5535 0.5535 -0.0 0.5575 0.5572 -0.0003
p20.pddl
0.5500 0.5499 -0.0 0.5447 0.5446 -0.0001
Sum of diffs
-0.0004
-0.0006
Arithmetic mean of diffs
-0.0000
-0.0000
tetris-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
0.5453 0.5451 -0.0001 0.5449 0.5446 -0.0003
p01-8.pddl
0.5279 0.5272 -0.0007 0.5278 0.5278 0.0
p01-10.pddl
0.2567 0.2566 -0.0 0.5127 0.5127 -0.0
p02-4.pddl
0.5524 0.5522 -0.0002 0.5521 0.5521 0.0
p02-6.pddl
0.5341 0.5336 -0.0006 0.5336 0.5336 0.0
p02-8.pddl
0.5276 0.5267 -0.0009 0.5276 0.5276 0.0
p02-10.pddl
0.4651 0.4651 -0.0 0.5330 0.5330 -0.0
p03-4.pddl
0.5524 0.5522 -0.0002 0.5521 0.5521 0.0001
p03-6.pddl
0.5461 0.5457 -0.0004 0.5454 0.5456 0.0002
p03-8.pddl
0.5030 0.5018 -0.0013 0.5022 0.5022 -0.0
p03-10.pddl
0.4813 0.4799 -0.0014 0.4808 0.4808 0.0
p04-6.pddl
0.5455 0.5451 -0.0004 0.5452 0.5452 -0.0001
p04-8.pddl
0.5103 0.5093 -0.0011 0.5096 0.5096 -0.0
p04-10.pddl
0.5011 0.4997 -0.0014 0.5001 0.5001 0.0
p05-6.pddl
0.5461 0.5457 -0.0004 0.5455 0.5455 -0.0
p05-8.pddl
0.3817 0.3817 -0.0 0.5018 0.5018 0.0
p05-10.pddl
0.4821 0.4807 -0.0014 0.4819 0.4819 0.0
Sum of diffs
-0.0104
-0.0001
Arithmetic mean of diffs
-0.0006
-0.0000
tidybot-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5457 0.5455 -0.0002 0.5449 0.5451 0.0002
p02.pddl
0.5339 0.5335 -0.0004 0.5331 0.5332 0.0001
p03.pddl
0.5342 0.5338 -0.0004 0.5330 0.5332 0.0002
p04.pddl
0.5339 0.5335 -0.0004 0.5331 0.5330 -0.0001
p05.pddl
0.5163 0.5156 -0.0007 0.5149 0.5149 0.0
p06.pddl
0.5161 0.5154 -0.0007 0.5145 0.5145 -0.0
p07.pddl
0.5163 0.5156 -0.0007 0.5151 0.5151 0.0
p08.pddl
0.3270 0.3270 -0.0 0.5149 0.5149 -0.0
p09.pddl
0.5034 0.5024 -0.001 0.5010 0.5010 0.0
p10.pddl
0.5031 0.5022 -0.001 0.5010 0.5011 0.0001
p11.pddl
0.5034 0.5024 -0.001 0.5011 0.5011 0.0
p12.pddl
0.5031 0.5022 -0.001 0.5010 0.5011 0.0002
p13.pddl
0.5034 0.5024 -0.001 0.5010 0.5010 -0.0
p14.pddl
0.4714 0.4700 -0.0014 0.4688 0.4688 0.0
p15.pddl
0 0 0.0 0.4689 0.4689 0.0
p16.pddl
0.4707 0.4693 -0.0014 0.4679 0.4679 0.0
p17.pddl
0.4710 0.4697 -0.0013 0.4684 0.4684 0.0
p18.pddl
0.4715 0.4700 -0.0015 0.4688 0.4688 0.0
p19.pddl
0.4711 0.4697 -0.0014 0.4684 0.4683 -0.0
p20.pddl
0.4707 0.4693 -0.0014 0.4678 0.4678 0.0
Sum of diffs
-0.0166
0.0006
Arithmetic mean of diffs
-0.0008
0.0000
tidybot-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.4708 0.4694 -0.0014 0.3806 0.3806 -0.0
p02.pddl
0.4705 0.4692 -0.0014 0.4680 0.4680 0.0
p03.pddl
0.4715 0.4701 -0.0014 0.4688 0.4688 0.0
p04.pddl
0.4716 0.4701 -0.0015 0.4684 0.4687 0.0003
p05.pddl
0.4714 0.4701 -0.0013 0.4688 0.4688 -0.0
p06.pddl
0.4706 0.4691 -0.0015 0.4680 0.4680 -0.0
p07.pddl
0.4714 0.4701 -0.0013 0.4688 0.4688 0.0
p08.pddl
0.4714 0.4701 -0.0013 0.4687 0.4687 -0.0
p09.pddl
0.4355 0.4338 -0.0017 0.4324 0.4324 0.0
p10.pddl
0.4355 0.4338 -0.0017 0.4323 0.4323 -0.0
p11.pddl
0.5034 0.5024 -0.001 0.5011 0.5011 0.0
p12.pddl
0.5031 0.5022 -0.001 0.5010 0.5011 0.0002
p13.pddl
0.5034 0.5024 -0.001 0.5010 0.5010 -0.0
p14.pddl
0.4714 0.4700 -0.0014 0.4688 0.4688 0.0
p15.pddl
0 0 0.0 0.4689 0.4689 0.0
p16.pddl
0.4707 0.4693 -0.0014 0.4679 0.4679 0.0
p17.pddl
0.4710 0.4697 -0.0013 0.4684 0.4684 0.0
p18.pddl
0.4715 0.4700 -0.0015 0.4688 0.4688 0.0
p19.pddl
0.4711 0.4697 -0.0014 0.4684 0.4683 -0.0
p20.pddl
0.4707 0.4693 -0.0014 0.4678 0.4678 0.0
Sum of diffs
-0.0255
0.0005
Arithmetic mean of diffs
-0.0013
0.0000
tpp
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p02.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p03.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p04.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
p05.pddl
0.5598 0.5601 0.0003 0.5601 0.5601 -0.0
p06.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p07.pddl
0.5595 0.5595 0.0 0.5592 0.5592 -0.0
p08.pddl
0.5595 0.5595 -0.0 0.5579 0.5579 0.0
p09.pddl
0.5594 0.5594 -0.0 0.5572 0.5572 -0.0
p10.pddl
0.5591 0.5591 0.0 0.5541 0.5541 0.0
p11.pddl
0.5587 0.5586 -0.0001 0.5504 0.5503 -0.0
p12.pddl
0.5585 0.5584 -0.0001 0.5410 0.5409 -0.0
p13.pddl
0.5576 0.5576 -0.0 0.5484 0.5484 -0.0
p14.pddl
0.5572 0.5572 -0.0 0.5370 0.5369 -0.0001
p15.pddl
0.5570 0.5569 -0.0001 0.5385 0.5384 -0.0
p16.pddl
0.5542 0.5540 -0.0002 0.4579 0.4579 0.0
p17.pddl
0.5513 0.5512 -0.0001 0.1942 0.1942 -0.0
p18.pddl
0.5510 0.5508 -0.0001 0.3252 0.3252 0.0
p19.pddl
0.5502 0.5498 -0.0004 0.2320 0.2320 -0.0
p20.pddl
0.5495 0.5494 -0.0001 0.1006 0.1006 -0.0
p21.pddl
0.5429 0.5426 -0.0003 0.3810 0.3810 0.0
p22.pddl
0.5419 0.5415 -0.0003 0.3541 0.3542 0.0
p23.pddl
0.5410 0.5407 -0.0003 0.2581 0.2581 0.0
p24.pddl
0.5386 0.5387 0.0001 0.2942 0.2942 -0.0
p25.pddl
0.5317 0.5312 -0.0005 0.1329 0.1329 -0.0
p26.pddl
0.5218 0.5212 -0.0006 0.1121 0.1121 -0.0
p27.pddl
0.5206 0.5198 -0.0008 0.1163 0.1163 -0.0
p28.pddl
0.5188 0.5182 -0.0006 0 0 0.0
p29.pddl
0.5051 0.5042 -0.001 0 0 0.0
p30.pddl
0.5033 0.5024 -0.0009 0 0 0.0
Sum of diffs
-0.0064
-0.0003
Arithmetic mean of diffs
-0.0002
-0.0000
transport-opt08-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p02.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p03.pddl
0.5588 0.5588 0.0 0.5589 0.5588 -0.0001
p04.pddl
0.5585 0.5584 -0.0 0.5585 0.5585 -0.0
p05.pddl
0.5577 0.5576 -0.0001 0.5573 0.5573 0.0
p06.pddl
0.5550 0.5551 0.0001 0.5547 0.5547 0.0
p07.pddl
0.5524 0.5525 0.0001 0.5467 0.5467 -0.0
p08.pddl
0.5512 0.5510 -0.0002 0.5442 0.5442 -0.0
p09.pddl
0.5495 0.5494 -0.0001 0.5336 0.5336 0.0
p10.pddl
0.5479 0.5479 -0.0 0.5120 0.5120 -0.0
p11.pddl
0.5597 0.5597 -0.0 0.5598 0.5597 -0.0001
p12.pddl
0.5594 0.5593 -0.0 0.5593 0.5593 0.0
p13.pddl
0.5587 0.5587 -0.0 0.5587 0.5587 -0.0
p14.pddl
0.5579 0.5579 -0.0 0.5575 0.5575 0.0
p15.pddl
0.5569 0.5569 -0.0001 0.5566 0.5565 -0.0002
p16.pddl
0.5525 0.5524 -0.0001 0.5268 0.5268 0.0001
p17.pddl
0.5509 0.5508 -0.0001 0.4641 0.4642 0.0
p18.pddl
0.5487 0.5487 -0.0 0.4450 0.4449 -0.0
p19.pddl
0.5447 0.5444 -0.0003 0.3403 0.3403 -0.0
p20.pddl
0.5425 0.5422 -0.0003 0.2590 0.2590 -0.0
p21.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p22.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p23.pddl
0.5592 0.5588 -0.0003 0.5588 0.5588 -0.0
p24.pddl
0.5585 0.5584 -0.0 0.5585 0.5585 0.0
p25.pddl
0.5576 0.5576 0.0 0.5574 0.5574 -0.0
p26.pddl
0.5550 0.5551 0.0001 0.5547 0.5547 -0.0
p27.pddl
0.5523 0.5524 0.0001 0.5517 0.5517 0.0
p28.pddl
0.5512 0.5510 -0.0002 0.5247 0.5246 -0.0
p29.pddl
0.5495 0.5494 -0.0001 0.5326 0.5326 -0.0
p30.pddl
0.5476 0.5476 -0.0 0.5303 0.5304 0.0
Sum of diffs
-0.0017
-0.0005
Arithmetic mean of diffs
-0.0001
-0.0000
transport-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5592 0.5588 -0.0003 0.5588 0.5588 -0.0
p02.pddl
0.5588 0.5588 0.0 0.5589 0.5588 -0.0001
p03.pddl
0.5594 0.5593 -0.0 0.5593 0.5593 0.0
p04.pddl
0.5587 0.5587 -0.0 0.5587 0.5587 -0.0
p05.pddl
0.5585 0.5584 -0.0 0.5585 0.5585 0.0
p06.pddl
0.5585 0.5584 -0.0 0.5585 0.5585 -0.0
p07.pddl
0.5579 0.5578 -0.0001 0.5578 0.5578 0.0
p08.pddl
0.5571 0.5570 -0.0002 0.5562 0.5562 0.0
p09.pddl
0.5576 0.5575 -0.0001 0.5573 0.5573 -0.0
p10.pddl
0.5558 0.5558 -0.0001 0.5554 0.5554 -0.0
p11.pddl
0.5572 0.5571 -0.0001 0.5569 0.5568 -0.0
p12.pddl
0.5555 0.5554 -0.0001 0.5496 0.5496 -0.0
p13.pddl
0.5571 0.5571 0.0 0.5567 0.5568 0.0
p14.pddl
0.5551 0.5550 -0.0001 0.5545 0.5545 0.0
p15.pddl
0.5562 0.5559 -0.0003 0.5555 0.5555 0.0
p16.pddl
0.5547 0.5547 -0.0 0.5519 0.5519 -0.0
p17.pddl
0.5577 0.5576 -0.0001 0.5573 0.5573 0.0
p18.pddl
0.5579 0.5579 -0.0 0.5575 0.5575 0.0
p19.pddl
0.5576 0.5576 0.0 0.5574 0.5574 -0.0
p20.pddl
0.5550 0.5551 0.0001 0.5547 0.5547 0.0
Sum of diffs
-0.0013
-0.0001
Arithmetic mean of diffs
-0.0001
-0.0000
transport-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 -0.0
p02.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 0.0
p03.pddl
0.5585 0.5584 -0.0 0.5585 0.5585 0.0
p04.pddl
0.5571 0.5571 -0.0 0.5568 0.5568 0.0
p05.pddl
0.5555 0.5554 -0.0001 0.5493 0.5492 -0.0
p06.pddl
0.5554 0.5550 -0.0004 0.5544 0.5544 -0.0
p07.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 0.0
p08.pddl
0.5576 0.5577 0.0001 0.5576 0.5575 -0.0
p09.pddl
0.5569 0.5569 -0.0001 0.5558 0.5558 -0.0
p10.pddl
0.5542 0.5539 -0.0003 0.5240 0.5239 -0.0
p11.pddl
0.5509 0.5510 0.0001 0.4822 0.4822 0.0001
p12.pddl
0.5505 0.5502 -0.0003 0.4428 0.4428 -0.0
p13.pddl
0.5585 0.5584 -0.0 0.5585 0.5585 -0.0
p14.pddl
0.5569 0.5568 -0.0001 0.5566 0.5566 -0.0
p15.pddl
0.5551 0.5551 -0.0001 0.5542 0.5542 0.0
p16.pddl
0.5508 0.5505 -0.0003 0.5186 0.5187 0.0002
p17.pddl
0.5479 0.5476 -0.0003 0.4925 0.4923 -0.0002
p18.pddl
0.5446 0.5443 -0.0003 0.4601 0.4601 -0.0
p19.pddl
0.5431 0.5428 -0.0003 0.5169 0.5169 0.0
p20.pddl
0.5431 0.5428 -0.0003 0.5169 0.5169 0.0
Sum of diffs
-0.0027
-0.0002
Arithmetic mean of diffs
-0.0001
-0.0000
trucks-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p02.pddl
0.5598 0.5598 -0.0 0.5592 0.5591 -0.0
p03.pddl
0.5592 0.5592 -0.0 0.5332 0.5331 -0.0001
p04.pddl
0.5562 0.5562 -0.0 0.5588 0.5588 -0.0
p05.pddl
0.5579 0.5578 -0.0 0.5579 0.5578 -0.0001
p06.pddl
0.5578 0.5577 -0.0 0.5574 0.5574 -0.0
p07.pddl
0.5568 0.5567 -0.0 0.2748 0.2748 -0.0
p08.pddl
0.5574 0.5574 -0.0 0 0 0.0
p09.pddl
0.5547 0.5549 0.0002 0 0 0.0
p10.pddl
0.4875 0.4875 0.0 0 0 0.0
p11.pddl
0.5120 0.5120 -0.0 0 0 0.0
p12.pddl
0.3028 0.3028 -0.0 0 0 0.0
p13.pddl
0.2628 0.2628 -0.0 0 0 0.0
p14.pddl
0.4910 0.4910 -0.0 0 0 0.0
p15.pddl
0.2407 0.2407 -0.0 0 0 0.0
p16.pddl
0.0210 0.0210 -0.0 0 0 0.0
p17.pddl
0.0110 0.0110 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0 0 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0001
-0.0002
Arithmetic mean of diffs
-0.0000
-0.0000
visitall-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
problem02-half.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
problem03-full.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
problem03-half.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
problem04-full.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
problem04-half.pddl
0.5601 0.5601 -0.0 0.5601 0.5601 -0.0
problem05-full.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
problem05-half.pddl
0.5598 0.5598 0.0 0.5601 0.5601 -0.0
problem06-full.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
problem06-half.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
problem07-full.pddl
0.5595 0.5595 0.0 0.5598 0.5598 -0.0
problem07-half.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
problem08-full.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
problem08-half.pddl
0.5595 0.5595 -0.0 0.5598 0.5598 -0.0
problem09-full.pddl
0.5590 0.5591 0.0001 0.5593 0.5593 -0.0
problem09-half.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
problem10-full.pddl
0.5588 0.5588 -0.0 0.5592 0.5591 -0.0001
problem10-half.pddl
0.5594 0.5593 -0.0 0.5594 0.5593 -0.0
problem11-full.pddl
0.5585 0.5585 -0.0 0.5591 0.5591 -0.0
problem11-half.pddl
0.5591 0.5591 -0.0 0.5594 0.5594 0.0
Sum of diffs
-0.0003
-0.0004
Arithmetic mean of diffs
-0.0000
-0.0000
visitall-opt14-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p-1-6.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 0.0
p-1-7.pddl
0.5595 0.5595 0.0 0.5598 0.5598 -0.0
p-1-8.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p-1-9.pddl
0.5590 0.5591 0.0001 0.5593 0.5593 -0.0
p-1-10.pddl
0.5588 0.5588 -0.0 0.5592 0.5591 -0.0001
p-1-11.pddl
0.5585 0.5585 -0.0 0.5591 0.5591 -0.0
p-1-12.pddl
0.5581 0.5580 -0.0001 0.5587 0.5587 0.0
p-1-13.pddl
0.5579 0.5579 -0.0 0.5585 0.5585 -0.0
p-1-14.pddl
0.5572 0.5572 -0.0001 0.5582 0.5582 -0.0
p-1-15.pddl
0.5567 0.5566 -0.0001 0.5580 0.5580 0.0001
p-1-16.pddl
0.5560 0.5562 0.0002 0.5579 0.5579 -0.0
p-1-17.pddl
0.5557 0.5556 -0.0001 0.5573 0.5572 -0.0
p-1-18.pddl
0.5550 0.5548 -0.0001 0.5569 0.5568 -0.0
p-05-5.pddl
0.5598 0.5598 -0.0 0.5598 0.5601 0.0003
p-05-6.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p-05-7.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p-05-8.pddl
0.5595 0.5595 -0.0 0.5598 0.5598 -0.0
p-05-9.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p-05-10.pddl
0.5594 0.5593 -0.0 0.5594 0.5594 0.0
Sum of diffs
-0.0004
0.0000
Arithmetic mean of diffs
-0.0000
0.0000
woodworking-opt08-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5595 0.5595 -0.0 0.5595 0.5595 -0.0
p02.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p03.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
p04.pddl
0.5583 0.5579 -0.0004 0 0 0.0
p05.pddl
0.5544 0.5546 0.0002 0.5575 0.5575 -0.0
p06.pddl
0.5579 0.5575 -0.0003 0.5528 0.5527 -0.0
p07.pddl
0.5562 0.5562 -0.0 0.5565 0.5565 -0.0
p08.pddl
0.5557 0.5557 -0.0 0 0 0.0
p09.pddl
0.5475 0.5475 -0.0 0 0 0.0
p10.pddl
0.5547 0.5546 -0.0 0.5035 0.5035 -0.0
p11.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p12.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
p13.pddl
0.5585 0.5584 -0.0 0.5585 0.5585 -0.0
p14.pddl
0.5566 0.5566 -0.0 0.5588 0.5588 -0.0
p15.pddl
0.5538 0.5538 -0.0 0.5579 0.5579 -0.0
p16.pddl
0.5541 0.5540 -0.0001 0 0 0.0
p17.pddl
0.5510 0.5510 -0.0001 0.5535 0.5535 -0.0
p18.pddl
0.5560 0.5557 -0.0003 0.5465 0.5465 0.0
p19.pddl
0.5555 0.5554 -0.0001 0.5555 0.5553 -0.0001
p20.pddl
0.5448 0.5448 -0.0001 0.5183 0.5183 0.0
p21.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p22.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 -0.0
p23.pddl
0.5594 0.5593 -0.0 0.5594 0.5594 0.0
p24.pddl
0.5561 0.5561 -0.0 0.1734 0.1734 -0.0
p25.pddl
0.5515 0.5517 0.0002 0.5578 0.5578 -0.0
p26.pddl
0.5576 0.5575 -0.0001 0 0 0.0
p27.pddl
0.5513 0.5513 -0.0001 0 0 0.0
p28.pddl
0.5423 0.5422 -0.0001 0 0 0.0
p29.pddl
0.5550 0.5550 0.0 0.5553 0.5553 -0.0
p30.pddl
0.5350 0.5352 0.0002 0.3651 0.3650 -0.0
Sum of diffs
-0.0013
-0.0005
Arithmetic mean of diffs
-0.0000
-0.0000
woodworking-opt11-strips
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5594 0.5593 -0.0 0.5594 0.5594 0.0
p02.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
p03.pddl
0.5585 0.5584 -0.0 0.5585 0.5585 -0.0
p04.pddl
0.5588 0.5588 -0.0 0.5588 0.5588 -0.0
p05.pddl
0.5561 0.5561 -0.0 0.1734 0.1734 -0.0
p06.pddl
0.5583 0.5579 -0.0004 0 0 0.0
p07.pddl
0.5566 0.5566 -0.0 0.5588 0.5588 -0.0
p08.pddl
0.5515 0.5517 0.0002 0.5578 0.5578 -0.0
p09.pddl
0.5544 0.5546 0.0002 0.5575 0.5575 -0.0
p10.pddl
0.5538 0.5538 -0.0 0.5579 0.5579 -0.0
p11.pddl
0.5576 0.5575 -0.0001 0 0 0.0
p12.pddl
0.5541 0.5540 -0.0001 0 0 0.0
p13.pddl
0.5579 0.5575 -0.0003 0.5528 0.5527 -0.0
p14.pddl
0.5513 0.5513 -0.0001 0 0 0.0
p15.pddl
0.5510 0.5510 -0.0001 0.5535 0.5535 -0.0
p16.pddl
0.5562 0.5562 -0.0 0.5565 0.5565 -0.0
p17.pddl
0.5423 0.5422 -0.0001 0 0 0.0
p18.pddl
0.5560 0.5557 -0.0003 0.5465 0.5465 0.0
p19.pddl
0.5557 0.5557 -0.0 0 0 0.0
p20.pddl
0.5550 0.5550 0.0 0.5553 0.5553 -0.0
Sum of diffs
-0.0012
-0.0002
Arithmetic mean of diffs
-0.0001
-0.0000
zenotravel
Show table
score_memory
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.5598 0.5601 0.0003 0.5601 0.5601 -0.0
p02.pddl
0.5598 0.5598 -0.0 0.5601 0.5601 -0.0
p03.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p04.pddl
0.5598 0.5598 -0.0 0.5598 0.5598 -0.0
p05.pddl
0.5594 0.5594 -0.0 0.5594 0.5594 0.0
p06.pddl
0.5594 0.5593 -0.0 0.5594 0.5594 -0.0
p07.pddl
0.5594 0.5593 -0.0 0.5594 0.5594 -0.0
p08.pddl
0.5587 0.5586 -0.0 0.5586 0.5586 0.0
p09.pddl
0.5585 0.5585 -0.0 0.5585 0.5586 0.0001
p10.pddl
0.5585 0.5585 -0.0 0.5575 0.5577 0.0002
p11.pddl
0.5579 0.5579 0.0 0.5569 0.5568 -0.0001
p12.pddl
0.5579 0.5579 -0.0 0.5572 0.5571 -0.0001
p13.pddl
0.5576 0.5575 -0.0001 0.5541 0.5541 0.0
p14.pddl
0.5516 0.5515 -0.0001 0.4483 0.4482 -0.0001
p15.pddl
0.5455 0.5454 -0.0001 0.4960 0.4960 -0.0
p16.pddl
0.5435 0.5431 -0.0004 0.3787 0.3788 0.0001
p17.pddl
0.5401 0.5395 -0.0006 0.1968 0.1968 -0.0
p18.pddl
0.5311 0.5305 -0.0006 0.3889 0.3888 -0.0001
p19.pddl
0.5280 0.5275 -0.0005 0.3781 0.3781 -0.0
p20.pddl
0.5241 0.5236 -0.0005 0.3140 0.3140 -0.0
Sum of diffs
-0.0028
-0.0001
Arithmetic mean of diffs
-0.0001
-0.0000
score_search_time
Show table
The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 0.9594 0.9590 -0.0003
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 0.9881 0.9888 0.0008
p09.pddl
1.0000 1.0000 0.0 0.9782 0.9760 -0.0022
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 0.9926 0.9935 0.0008
p12.pddl
1.0000 1.0000 0.0 0.9951 0.9934 -0.0017
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0.9129 0.9005 -0.0125 0.9514 0.9517 0.0004
p16.pddl
1.0000 1.0000 0.0 0.9743 0.9732 -0.0011
p17.pddl
1.0000 1.0000 0.0 0.9779 0.9712 -0.0066
p18.pddl
0.7848 0.7795 -0.0053 0.9522 0.9591 0.0069
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 0.9684 0.9680 -0.0004
Sum of diffs
-0.0178
-0.0035
Arithmetic mean of diffs
-0.0009
-0.0002
airport
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-airport1-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-airport1-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-airport2-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-airport2-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-airport2-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-airport2-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-airport2-p3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-airport2-p4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10-airport3-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-airport3-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-airport3-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-airport3-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14-airport3-p3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-airport3-p3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16-airport3-p4.pddl
0.8679 0.8695 0.0016 1.0000 1.0000 0.0
p17-airport3-p5.pddl
1.0000 1.0000 0.0 0.7782 0.7785 0.0003
p18-airport3-p6.pddl
0.8168 0.8162 -0.0006 0.4661 0.4685 0.0023
p19-airport3-p6.pddl
1.0000 1.0000 0.0 0.4198 0.4229 0.0031
p20-airport3-p7.pddl
0.6922 0.6933 0.001 0.1616 0.1586 -0.003
p21-airport4halfMUC-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22-airport4halfMUC-p3.pddl
0.6026 0.6020 -0.0007 1.0000 1.0000 0.0
p23-airport4halfMUC-p4.pddl
0.5124 0.5173 0.0048 1.0000 1.0000 0.0
p24-airport4halfMUC-p4.pddl
0.5307 0.5294 -0.0013 1.0000 1.0000 0.0
p25-airport4halfMUC-p5.pddl
0.4792 0.4739 -0.0053 0 0 0.0
p26-airport4halfMUC-p6.pddl
0 0 0.0 0 0 0.0
p27-airport4halfMUC-p6.pddl
0.4513 0.4537 0.0023 0 0 0.0
p28-airport4halfMUC-p7.pddl
0 0 0.0 0 0 0.0
p29-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p30-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p31-airport4halfMUC-p9.pddl
0 0 0.0 0 0 0.0
p32-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p33-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p34-airport4halfMUC-p11.pddl
0 0 0.0 0 0 0.0
p35-airport4halfMUC-p12.pddl
0 0 0.0 0 0 0.0
p36-airport5MUC-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p37-airport5MUC-p3.pddl
0.5985 0.5993 0.0008 0.4987 0.4990 0.0003
p38-airport5MUC-p3.pddl
0.5611 0.5626 0.0015 0.7792 0.7821 0.0029
p39-airport5MUC-p4.pddl
0.4952 0.4997 0.0045 0 0 0.0
p40-airport5MUC-p4.pddl
0.7887 0.7898 0.0011 0.4588 0.4604 0.0016
p41-airport5MUC-p4.pddl
0.5281 0.5251 -0.003 0 0 0.0
p42-airport5MUC-p5.pddl
0 0 0.0 0 0 0.0
p43-airport5MUC-p5.pddl
0.4839 0.4824 -0.0015 0.6511 0.6480 -0.0031
p44-airport5MUC-p5.pddl
0.4495 0.4473 -0.0023 0 0 0.0
p45-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p46-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p47-airport5MUC-p8.pddl
0 0 0.0 0 0 0.0
p48-airport5MUC-p9.pddl
0 0 0.0 0 0 0.0
p49-airport5MUC-p10.pddl
0 0 0.0 0 0 0.0
p50-airport5MUC-p15.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0030
0.0044
Arithmetic mean of diffs
0.0001
0.0001
barman-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile01-002.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile01-003.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile01-004.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile02-005.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile02-006.pddl
1.0000 1.0000 0.0 0.8376 0.8424 0.0048
pfile02-007.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile02-008.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile03-009.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile03-010.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile03-011.pddl
1.0000 1.0000 0.0 0.9893 1.0000 0.0107
pfile03-012.pddl
1.0000 1.0000 0.0 0.9887 0.9898 0.0011
pfile04-013.pddl
1.0000 1.0000 0.0 0.7975 0.7931 -0.0044
pfile04-014.pddl
1.0000 1.0000 0.0 0.6829 0.6767 -0.0062
pfile04-015.pddl
1.0000 1.0000 0.0 0.7780 0.7816 0.0036
pfile04-016.pddl
1.0000 1.0000 0.0 0.7989 0.7926 -0.0063
pfile05-017.pddl
1.0000 1.0000 0.0 0.7171 0.7189 0.0018
pfile05-018.pddl
1.0000 1.0000 0.0 0.6913 0.6903 -0.0009
pfile05-019.pddl
1.0000 1.0000 0.0 0.6308 0.6294 -0.0014
pfile05-020.pddl
1.0000 1.0000 0.0 0.5828 0.5859 0.0031
Sum of diffs
0.0000
0.0060
Arithmetic mean of diffs
0.0000
0.0003
barman-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
1.0000 1.0000 0.0 0.8414 0.8417 0.0003
p435-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p435-3.pddl
1.0000 1.0000 0.0 0.8433 0.8386 -0.0047
p536-1.pddl
1.0000 1.0000 0.0 0.5306 0.5341 0.0035
p536-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p536-3.pddl
1.0000 1.0000 0.0 0.9870 1.0000 0.013
p638-1.pddl
1.0000 1.0000 0.0 0.7933 0.7988 0.0055
p638-2.pddl
1.0000 1.0000 0.0 0.6985 0.7044 0.0058
p638-3.pddl
1.0000 1.0000 0.0 0.7775 0.7833 0.0058
p739-1.pddl
1.0000 1.0000 0.0 0.6464 0.6406 -0.0058
p739-2.pddl
1.0000 1.0000 0.0 0.6270 0.6257 -0.0013
p739-3.pddl
1.0000 1.0000 0.0 0.6266 0.6259 -0.0007
p839-1.pddl
1.0000 1.0000 0.0 0.5490 0.5430 -0.006
p839-2.pddl
1.0000 1.0000 0.0 0.5609 0.5627 0.0018
Sum of diffs
0.0000
0.0173
Arithmetic mean of diffs
0.0000
0.0012
blocks
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-6-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-7-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-7-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-7-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-8-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-8-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-9-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-9-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-9-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-10-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-10-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-10-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-11-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-11-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-11-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-12-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-12-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-13-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-13-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-14-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-14-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-15-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-15-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-16-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-16-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-17-0.pddl
1.0000 1.0000 0.0 0.8210 0.8104 -0.0106
Sum of diffs
0.0000
-0.0106
Arithmetic mean of diffs
0.0000
-0.0003
childsnack-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
1.0000 1.0000 0.0 0.7586 0.7670 0.0084
child-snack_pfile01.pddl
1.0000 1.0000 0.0 0.7505 0.7564 0.0059
child-snack_pfile02-2.pddl
1.0000 1.0000 0.0 0.5236 0.5305 0.007
child-snack_pfile02.pddl
1.0000 1.0000 0.0 0.5121 0.5113 -0.0008
child-snack_pfile03-2.pddl
1.0000 1.0000 0.0 0.3064 0.3067 0.0004
child-snack_pfile03.pddl
1.0000 1.0000 0.0 0.3005 0.3035 0.003
child-snack_pfile04-2.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile04.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile05-2.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile05.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile06-2.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile06.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile07-2.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile07.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile08-2.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile08.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0238
Arithmetic mean of diffs
0.0000
0.0012
data-network-opt18-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 0.6036 0.6017 -0.0018
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 0.7057 0.7098 0.0041
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 0.5081 0.5040 -0.0041
Sum of diffs
0.0000
-0.0018
Arithmetic mean of diffs
0.0000
-0.0001
depot
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.8041 0.8028 -0.0013 1.0000 1.0000 0.0
p06.pddl
0.1175 0.1151 -0.0024 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
0.8294 0.8260 -0.0035 0.7355 0.7351 -0.0004
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0.9175 0.9180 0.0005 1.0000 1.0000 0.0
p12.pddl
0.7507 0.7518 0.0011 0 0 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 0.6370 0.6404 0.0035
p15.pddl
0.4348 0.4373 0.0025 0.3301 0.3296 -0.0005
p16.pddl
1.0000 1.0000 0.0 0.6332 0.6362 0.003
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 0 0 0.0
p19.pddl
0.9322 0.9336 0.0014 0.2590 0.2545 -0.0044
p20.pddl
0 0 0.0 0.9519 0.9526 0.0007
p21.pddl
1.0000 1.0000 0.0 0.4311 0.4288 -0.0022
p22.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0017
-0.0004
Arithmetic mean of diffs
-0.0001
-0.0000
driverlog
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
0.8447 0.8464 0.0017 0.9521 0.9500 -0.002
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
0.7676 0.7645 -0.003 0.7482 0.7429 -0.0052
p19.pddl
0.7487 0.7477 -0.0009 0.5442 0.5423 -0.0019
p20.pddl
0.8007 0.8047 0.004 0.7091 0.7097 0.0006
Sum of diffs
0.0018
-0.0085
Arithmetic mean of diffs
0.0001
-0.0004
elevators-opt08-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
elevators-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
floortile-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
1.0000 1.0000 0.0 0.8884 0.8883 -0.0001
opt-p01-002.pddl
1.0000 1.0000 0.0 0.9525 0.9545 0.002
opt-p02-003.pddl
0.6398 0.6363 -0.0035 0 0 0.0
opt-p02-004.pddl
0.7138 0.7226 0.0088 0 0 0.0
opt-p03-005.pddl
0.6635 0.6576 -0.0058 0 0 0.0
opt-p03-006.pddl
0.3990 0.3984 -0.0005 0 0 0.0
opt-p04-007.pddl
0.3295 0.3268 -0.0028 0 0 0.0
opt-p04-008.pddl
0.2039 0.1992 -0.0048 0 0 0.0
opt-p05-009.pddl
0.4008 0.4058 0.005 0 0 0.0
opt-p05-010.pddl
0 0 0.0 0 0 0.0
opt-p06-011.pddl
0 0 0.0 0 0 0.0
opt-p06-012.pddl
0 0 0.0 0 0 0.0
opt-p07-013.pddl
0 0 0.0 0 0 0.0
opt-p07-014.pddl
0 0 0.0 0 0 0.0
opt-p08-015.pddl
0 0 0.0 0 0 0.0
opt-p08-016.pddl
0 0 0.0 0 0 0.0
opt-p09-017.pddl
0 0 0.0 0 0 0.0
opt-p09-018.pddl
0 0 0.0 0 0 0.0
opt-p10-019.pddl
0 0 0.0 0 0 0.0
opt-p10-020.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0036
0.0019
Arithmetic mean of diffs
-0.0002
0.0001
floortile-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
0.6866 0.6865 -0.0001 0 0 0.0
p01-4-4-2.pddl
0.2799 0.2790 -0.0008 0 0 0.0
p01-5-3-2.pddl
0.3256 0.3225 -0.0031 0 0 0.0
p01-5-4-2.pddl
0 0 0.0 0 0 0.0
p01-5-5-2.pddl
0 0 0.0 0 0 0.0
p01-6-4-2.pddl
0 0 0.0 0 0 0.0
p01-6-5-2.pddl
0 0 0.0 0 0 0.0
p02-4-4-2.pddl
0.2576 0.2517 -0.0059 0 0 0.0
p02-5-3-2.pddl
0.4196 0.4177 -0.0019 0 0 0.0
p02-5-4-2.pddl
0 0 0.0 0 0 0.0
p02-5-5-2.pddl
0 0 0.0 0 0 0.0
p02-6-4-2.pddl
0 0 0.0 0 0 0.0
p02-6-5-2.pddl
0 0 0.0 0 0 0.0
p03-4-3-2.pddl
0.6611 0.6602 -0.0009 0 0 0.0
p03-4-4-2.pddl
0.2977 0.2990 0.0013 0 0 0.0
p03-5-3-2.pddl
0.4053 0.4082 0.0029 0 0 0.0
p03-5-4-2.pddl
0.2876 0.2898 0.0022 0 0 0.0
p03-5-5-2.pddl
0 0 0.0 0 0 0.0
p03-6-4-2.pddl
0 0 0.0 0 0 0.0
p03-6-5-2.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0063
0.0000
Arithmetic mean of diffs
-0.0003
0.0000
freecell
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0.9805 0.9803 -0.0002 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
0.9350 0.9355 0.0005 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 0.9928 -0.0072 1.0000 1.0000 0.0
p19.pddl
0.6258 0.6328 0.007 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-9-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-9-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-9-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-9-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-9-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-10-1.pddl
0.9502 0.9445 -0.0058 1.0000 1.0000 0.0
probfreecell-10-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-10-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-10-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-10-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-11-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-11-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-11-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-11-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-11-5.pddl
0 0 0.0 1.0000 1.0000 0.0
probfreecell-12-1.pddl
0.6121 0.6233 0.0112 1.0000 1.0000 0.0
probfreecell-12-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-12-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-12-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-12-5.pddl
0.1393 0.1380 -0.0013 1.0000 1.0000 0.0
probfreecell-13-1.pddl
0.5162 0.5189 0.0027 1.0000 1.0000 0.0
probfreecell-13-2.pddl
0.6172 0.6062 -0.0111 1.0000 1.0000 0.0
probfreecell-13-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-13-4.pddl
0.7738 0.7810 0.0072 1.0000 1.0000 0.0
probfreecell-13-5.pddl
0.1413 0.1369 -0.0044 0.7239 0.7281 0.0043
Sum of diffs
-0.0014
0.0043
Arithmetic mean of diffs
-0.0000
0.0001
ged-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-7-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-7-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-9.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
grid
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 0 0 0.0
prob04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob05.pddl
1.0000 1.0000 0.0 0.7345 0.7355 0.001
Sum of diffs
0.0000
0.0010
Arithmetic mean of diffs
0.0000
0.0002
gripper
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
hiking-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-1-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-1-2-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-1-2-7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-1-2-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-2-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-2-6.pddl
1.0000 1.0000 0.0 0.9628 0.9561 -0.0067
ptesting-2-2-7.pddl
0.9727 0.9777 0.0049 0.8081 0.8120 0.0039
ptesting-2-2-8.pddl
0.9351 0.9350 -0.0001 0.7948 0.7993 0.0045
ptesting-2-3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-3-5.pddl
1.0000 1.0000 0.0 0.9678 0.9597 -0.0081
ptesting-2-3-6.pddl
1.0000 1.0000 0.0 0.8206 0.8159 -0.0047
ptesting-2-3-7.pddl
0.9256 0.9321 0.0065 0.7906 0.7926 0.0021
ptesting-2-4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-4-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-4-5.pddl
1.0000 1.0000 0.0 0.9111 0.9119 0.0008
ptesting-2-4-6.pddl
1.0000 1.0000 0.0 0.7966 0.7839 -0.0127
ptesting-2-4-7.pddl
0.9205 0.9196 -0.0009 0.6654 0.6709 0.0054
Sum of diffs
0.0105
-0.0155
Arithmetic mean of diffs
0.0005
-0.0008
logistics00
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-9.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-7-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-7-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-8-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-9-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-9-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-10-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-10-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-11-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-11-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-12-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-12-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-13-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-13-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-14-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-14-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-15-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-15-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
logistics98
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 0.5634 0.5536 -0.0098
prob04.pddl
1.0000 1.0000 0.0 0 0 0.0
prob05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob06.pddl
1.0000 1.0000 0.0 0 0 0.0
prob07.pddl
1.0000 1.0000 0.0 0.8127 0.8106 -0.0022
prob08.pddl
1.0000 1.0000 0.0 0 0 0.0
prob09.pddl
1.0000 1.0000 0.0 0 0 0.0
prob10.pddl
1.0000 1.0000 0.0 0.3182 0.3131 -0.005
prob11.pddl
1.0000 1.0000 0.0 0.8173 0.8095 -0.0078
prob12.pddl
1.0000 1.0000 0.0 0 0 0.0
prob13.pddl
1.0000 1.0000 0.0 0 0 0.0
prob14.pddl
1.0000 1.0000 0.0 0 0 0.0
prob15.pddl
1.0000 1.0000 0.0 0.7464 0.7452 -0.0012
prob16.pddl
1.0000 1.0000 0.0 0 0 0.0
prob17.pddl
1.0000 1.0000 0.0 0 0 0.0
prob18.pddl
0.8596 0.8660 0.0064 0 0 0.0
prob19.pddl
0.9883 0.9781 -0.0102 0 0 0.0
prob20.pddl
0.8674 0.8664 -0.001 0 0 0.0
prob21.pddl
1.0000 1.0000 0.0 0 0 0.0
prob22.pddl
0.5070 0.5069 -0.0001 0 0 0.0
prob23.pddl
1.0000 1.0000 0.0 0.3376 0.3407 0.0032
prob24.pddl
1.0000 1.0000 0.0 0 0 0.0
prob25.pddl
0.7475 0.7455 -0.002 0 0 0.0
prob26.pddl
0.7537 0.7549 0.0011 0 0 0.0
prob27.pddl
0.8237 0.8225 -0.0012 0 0 0.0
prob28.pddl
0.3133 0.3569 0.0436 0 0 0.0
prob29.pddl
0.6253 0.6272 0.0019 0 0 0.0
prob30.pddl
0.7923 0.7915 -0.0007 0 0 0.0
prob31.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob32.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob33.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob34.pddl
1.0000 1.0000 0.0 0.9723 0.9746 0.0023
prob35.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0378
-0.0205
Arithmetic mean of diffs
0.0011
-0.0006
miconic
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s11-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s11-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s11-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s11-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s11-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s12-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s12-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s12-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s12-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s12-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s13-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s13-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s13-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s13-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s13-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s14-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s14-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s14-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s14-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s14-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s15-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s15-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s15-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s15-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s15-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s16-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s16-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s16-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s16-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s16-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s17-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s17-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s17-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s17-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s17-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s18-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s18-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s18-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s18-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s18-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s19-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s19-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s19-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s19-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s19-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s20-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s20-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s20-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s20-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s20-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s21-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s21-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s21-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s21-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s21-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s22-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s22-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s22-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s22-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s22-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s23-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s23-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s23-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s23-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s23-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s24-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s24-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s24-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s24-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s24-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s25-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s25-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s25-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s25-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s25-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s26-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s26-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s26-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s26-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s26-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s27-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s27-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s27-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s27-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s27-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s28-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s28-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s28-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s28-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s28-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s29-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s29-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s29-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s29-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s29-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s30-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s30-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s30-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s30-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s30-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
movie
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
mprime
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 0.7965 0.7914 -0.0051
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob05.pddl
1.0000 1.0000 0.0 0.7668 0.7603 -0.0065
prob06.pddl
1.0000 1.0000 0.0 0 0 0.0
prob07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob08.pddl
1.0000 1.0000 0.0 0 0 0.0
prob09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob10.pddl
1.0000 1.0000 0.0 0 0 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
1.0000 1.0000 0.0 0.8486 0.8486 0.0001
prob13.pddl
1.0000 1.0000 0.0 0 0 0.0
prob14.pddl
1.0000 1.0000 0.0 0 0 0.0
prob15.pddl
1.0000 1.0000 0.0 0 0 0.0
prob16.pddl
1.0000 1.0000 0.0 0.8607 0.8624 0.0016
prob17.pddl
1.0000 1.0000 0.0 0.5125 0.5114 -0.0011
prob18.pddl
1.0000 1.0000 0.0 0 0 0.0
prob19.pddl
1.0000 1.0000 0.0 0 0 0.0
prob20.pddl
1.0000 1.0000 0.0 0 0 0.0
prob21.pddl
1.0000 1.0000 0.0 0.5441 0.5377 -0.0064
prob22.pddl
1.0000 1.0000 0.0 0 0 0.0
prob23.pddl
1.0000 1.0000 0.0 0 0 0.0
prob24.pddl
1.0000 1.0000 0.0 0 0 0.0
prob25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob26.pddl
1.0000 1.0000 0.0 0.4722 0.4814 0.0092
prob27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob30.pddl
1.0000 1.0000 0.0 0 0 0.0
prob31.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob32.pddl
1.0000 1.0000 0.0 0.9745 0.9775 0.003
prob33.pddl
1.0000 1.0000 0.0 0 0 0.0
prob34.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob35.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
-0.0050
Arithmetic mean of diffs
0.0000
-0.0001
mystery
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
0 0 0.0 0 0 0.0
prob05.pddl
0 0 0.0 0 0 0.0
prob06.pddl
0.7808 0.7797 -0.0011 0 0 0.0
prob07.pddl
0 0 0.0 0 0 0.0
prob08.pddl
0 0 0.0 0 0 0.0
prob09.pddl
0.3132 0.3083 -0.0048 1.0000 1.0000 0.0
prob10.pddl
1.0000 1.0000 0.0 0 0 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
0 0 0.0 0 0 0.0
prob13.pddl
1.0000 1.0000 0.0 0 0 0.0
prob14.pddl
1.0000 1.0000 0.0 0 0 0.0
prob15.pddl
1.0000 1.0000 0.0 0.6197 0.6224 0.0027
prob16.pddl
0 0 0.0 0 0 0.0
prob17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob18.pddl
0 0 0.0 0 0 0.0
prob19.pddl
1.0000 1.0000 0.0 0.9004 0.9003 -0.0002
prob20.pddl
1.0000 1.0000 0.0 0.4792 0.4719 -0.0073
prob21.pddl
0 0 0.0 0 0 0.0
prob22.pddl
0 0 0.0 0 0 0.0
prob23.pddl
0 0 0.0 0 0 0.0
prob24.pddl
0 0 0.0 0 0 0.0
prob25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
-0.0060
-0.0047
Arithmetic mean of diffs
-0.0002
-0.0002
nomystery-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.4591 0.4572 -0.0019
p06.pddl
1.0000 1.0000 0.0 0 0 0.0
p07.pddl
1.0000 1.0000 0.0 0 0 0.0
p08.pddl
1.0000 1.0000 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 0 0 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 0.9837 0.9830 -0.0007
p15.pddl
1.0000 1.0000 0.0 0.9947 0.9969 0.0022
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
-0.0004
Arithmetic mean of diffs
0.0000
-0.0000
openstacks-opt08-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p35_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p35_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p35_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p40_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p40_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p40_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p45_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p45_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p45_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p50_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p50_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p50_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
0.7723 0.7778 0.0055 0.7690 0.7831 0.0141
p29.pddl
0.8034 0.8047 0.0014 0.8121 0.8305 0.0184
p30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0068
0.0325
Arithmetic mean of diffs
0.0002
0.0011
organic-synthesis-opt18-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
None None - None None -
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
organic-synthesis-split-opt18-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.9068 0.9057 -0.0011
p04.pddl
1.0000 1.0000 0.0 0.8597 0.8608 0.0011
p05.pddl
1.0000 1.0000 0.0 0.9768 0.9763 -0.0005
p06.pddl
1.0000 1.0000 0.0 0.4468 0.4457 -0.0011
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 0.2640 0.2634 -0.0006
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 0 0 0.0
p12.pddl
0.9516 0.9476 -0.004 0 0 0.0
p13.pddl
0.7045 0.7001 -0.0044 0 0 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
0.6333 0.6128 -0.0205 0 0 0.0
p17.pddl
0.4591 0.4441 -0.0151 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0.8166 0.8116 -0.005 0 0 0.0
p20.pddl
0.2001 0.1938 -0.0064 0 0 0.0
Sum of diffs
-0.0553
-0.0022
Arithmetic mean of diffs
-0.0028
-0.0001
parcprinter-08-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 0.7857 0.7864 0.0007
p15.pddl
1.0000 1.0000 0.0 0 0 0.0
p16.pddl
1.0000 1.0000 0.0 0 0 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
1.0000 1.0000 0.0 0 0 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 0 0 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 0.8373 0.8383 0.001
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
1.0000 1.0000 0.0 0 0 0.0
p30.pddl
1.0000 1.0000 0.0 0 0 0.0
Sum of diffs
0.0000
0.0017
Arithmetic mean of diffs
0.0000
0.0001
parcprinter-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 0.8414 0.8430 0.0017
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 0.7878 0.7873 -0.0004
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
1.0000 1.0000 0.0 0 0 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0012
Arithmetic mean of diffs
0.0000
0.0001
parking-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile03-012.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile04-013.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile04-014.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile04-015.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile04-016.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile05-017.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile05-018.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile05-019.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile05-020.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile06-021.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile06-022.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile06-023.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile06-024.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile07-025.pddl
0.9565 0.9546 -0.0019 0 0 0.0
pfile07-026.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile07-027.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile07-028.pddl
0.9615 0.9578 -0.0037 0 0 0.0
pfile08-029.pddl
0.9397 0.9399 0.0002 0 0 0.0
pfile08-030.pddl
0.9993 0.9953 -0.004 0 0 0.0
Sum of diffs
-0.0094
0.0000
Arithmetic mean of diffs
-0.0005
0.0000
parking-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
1.0000 1.0000 0.0 0 0 0.0
p_12_7-02.pddl
1.0000 1.0000 0.0 0.8710 0.8662 -0.0048
p_12_7-03.pddl
1.0000 1.0000 0.0 0 0 0.0
p_12_7-04.pddl
1.0000 1.0000 0.0 0 0 0.0
p_14_8-01.pddl
1.0000 1.0000 0.0 0 0 0.0
p_14_8-02.pddl
1.0000 1.0000 0.0 0 0 0.0
p_14_8-03.pddl
1.0000 1.0000 0.0 0 0 0.0
p_14_8-04.pddl
1.0000 1.0000 0.0 0 0 0.0
p_16_9-01.pddl
1.0000 1.0000 0.0 0 0 0.0
p_16_9-02.pddl
1.0000 1.0000 0.0 0 0 0.0
p_16_9-03.pddl
1.0000 1.0000 0.0 0 0 0.0
p_16_9-04.pddl
1.0000 1.0000 0.0 0 0 0.0
p_18_10-01.pddl
1.0000 1.0000 0.0 0 0 0.0
p_18_10-02.pddl
1.0000 1.0000 0.0 0 0 0.0
p_18_10-03.pddl
1.0000 1.0000 0.0 0 0 0.0
p_18_10-04.pddl
1.0000 1.0000 0.0 0 0 0.0
p_20_11-01.pddl
0.9904 1.0000 0.0096 0 0 0.0
p_20_11-02.pddl
1.0000 1.0000 0.0 0 0 0.0
p_20_11-03.pddl
1.0000 1.0000 0.0 0 0 0.0
p_20_11-04.pddl
0.9253 0.9252 -0.0002 0 0 0.0
Sum of diffs
0.0094
-0.0048
Arithmetic mean of diffs
0.0005
-0.0002
pathways-noneg
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.9825 0.9868 0.0043
p06.pddl
1.0000 1.0000 0.0 0.5598 0.5595 -0.0003
p07.pddl
1.0000 1.0000 0.0 0.3089 0.3079 -0.001
p08.pddl
1.0000 1.0000 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 0.5383 0.5415 0.0033
p10.pddl
0 0 0.0 0 0 0.0
p11.pddl
1.0000 1.0000 0.0 0.3691 0.3698 0.0008
p12.pddl
1.0000 1.0000 0.0 0 0 0.0
p13.pddl
1.0000 1.0000 0.0 0 0 0.0
p14.pddl
1.0000 1.0000 0.0 0 0 0.0
p15.pddl
1.0000 1.0000 0.0 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
1.0000 1.0000 0.0 0 0 0.0
p24.pddl
1.0000 1.0000 0.0 0 0 0.0
p25.pddl
1.0000 1.0000 0.0 0 0 0.0
p26.pddl
1.0000 1.0000 0.0 0 0 0.0
p27.pddl
1.0000 1.0000 0.0 0 0 0.0
p28.pddl
1.0000 1.0000 0.0 0 0 0.0
p29.pddl
1.0000 1.0000 0.0 0 0 0.0
p30.pddl
1.0000 1.0000 0.0 0 0 0.0
Sum of diffs
0.0000
0.0070
Arithmetic mean of diffs
0.0000
0.0002
pegsol-08-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
0.8619 0.8638 0.0019 0.8139 0.8175 0.0036
p29.pddl
0.3060 0.3087 0.0028 1.0000 1.0000 0.0
p30.pddl
0.8540 0.8539 -0.0001 0.4235 0.4259 0.0024
Sum of diffs
0.0046
0.0060
Arithmetic mean of diffs
0.0002
0.0002
pegsol-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
0.8592 0.8596 0.0003 0.8139 0.8160 0.0021
p19.pddl
0.3080 0.3090 0.001 1.0000 1.0000 0.0
p20.pddl
0.8538 0.8558 0.002 0.4259 0.4233 -0.0027
Sum of diffs
0.0033
-0.0006
Arithmetic mean of diffs
0.0002
-0.0000
petri-net-alignment-opt18-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 0.9235 -0.0765 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
0.8814 0.8707 -0.0107 1.0000 1.0000 0.0
p13.pddl
1.0000 0.9763 -0.0237 1.0000 1.0000 0.0
p14.pddl
0.9174 0.9361 0.0187 1.0000 1.0000 0.0
p15.pddl
1.0000 0.9644 -0.0356 1.0000 1.0000 0.0
p16.pddl
0.9448 0.8893 -0.0555 1.0000 1.0000 0.0
p17.pddl
0.8845 0.9336 0.0492 1.0000 1.0000 0.0
p18.pddl
0.8808 0.8977 0.0169 1.0000 1.0000 0.0
p19.pddl
0.8725 0.9354 0.0629 1.0000 1.0000 0.0
p20.pddl
0.8662 0.8608 -0.0055 1.0000 1.0000 0.0
Sum of diffs
-0.0599
0.0000
Arithmetic mean of diffs
-0.0030
0.0000
pipesworld-notankage
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-net1-b6-g4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-net1-b8-g3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-net1-b8-g5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-net1-b10-g4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-net1-b10-g6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-net1-b12-g5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-net1-b12-g7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-net1-b14-g6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10-net1-b14-g8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-net2-b10-g2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-net2-b10-g4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-net2-b12-g3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14-net2-b12-g5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-net2-b14-g4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16-net2-b14-g6.pddl
0.9419 0.9411 -0.0007 0.8923 0.8985 0.0062
p17-net2-b16-g5.pddl
0.9454 0.9442 -0.0012 1.0000 1.0000 0.0
p18-net2-b16-g7.pddl
0.8754 0.8737 -0.0017 1.0000 1.0000 0.0
p19-net2-b18-g6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20-net2-b18-g8.pddl
0.8033 0.8055 0.0022 1.0000 1.0000 0.0
p21-net3-b12-g2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22-net3-b12-g4.pddl
0.8388 0.8351 -0.0037 1.0000 1.0000 0.0
p23-net3-b14-g3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24-net3-b14-g5.pddl
0.9167 0.9228 0.0061 0.9243 0.9258 0.0015
p25-net3-b16-g5.pddl
1.0000 1.0000 0.0 0.9334 0.9268 -0.0066
p26-net3-b16-g7.pddl
0.8108 0.8007 -0.0101 1.0000 1.0000 0.0
p27-net3-b18-g6.pddl
0.7844 0.7897 0.0053 0.5303 0.5321 0.0018
p28-net3-b18-g7.pddl
0.7889 0.7878 -0.0011 0.5879 0.5955 0.0075
p29-net3-b20-g6.pddl
0.9902 0.9881 -0.0021 0.6258 0.6312 0.0054
p30-net3-b20-g8.pddl
0.7834 0.7813 -0.0022 1.0000 1.0000 0.0
p31-net4-b14-g3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p32-net4-b14-g5.pddl
0.9667 0.9660 -0.0008 1.0000 1.0000 0.0
p33-net4-b16-g5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p34-net4-b16-g6.pddl
0.8154 0.8132 -0.0022 1.0000 1.0000 0.0
p35-net4-b18-g4.pddl
0.8774 0.8771 -0.0004 0.5211 0.5263 0.0052
p36-net4-b18-g6.pddl
1.0000 1.0000 0.0 0.3571 0.3619 0.0048
p37-net4-b20-g5.pddl
1.0000 1.0000 0.0 0 0 0.0
p38-net4-b20-g7.pddl
0.7567 0.7603 0.0037 0.5573 0.5509 -0.0064
p39-net4-b22-g7.pddl
1.0000 1.0000 0.0 0 0 0.0
p40-net4-b22-g8.pddl
0.9671 0.9695 0.0025 0.3621 0.3609 -0.0012
p41-net5-b22-g2.pddl
1.0000 1.0000 0.0 0.7500 0.7472 -0.0028
p42-net5-b22-g4.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6.pddl
1.0000 1.0000 0.0 0 0 0.0
p50-net5-b30-g8.pddl
0.6090 0.6092 0.0001 0 0 0.0
Sum of diffs
-0.0062
0.0156
Arithmetic mean of diffs
-0.0001
0.0003
pipesworld-tankage
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-net1-b6-g4-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-net1-b8-g3-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-net1-b8-g5-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-net1-b10-g4-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-net1-b10-g6-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-net1-b12-g5-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-net1-b12-g7-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-net1-b14-g6-t50.pddl
0.8785 0.8786 0.0001 1.0000 1.0000 0.0
p10-net1-b14-g8-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-net2-b10-g2-t30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-net2-b10-g4-t60.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-net2-b12-g3-t70.pddl
1.0000 1.0000 0.0 0.5813 0.5812 -0.0001
p14-net2-b12-g5-t30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-net2-b14-g4-t30.pddl
1.0000 1.0000 0.0 0.9085 0.9096 0.0011
p16-net2-b14-g6-t80.pddl
1.0000 1.0000 0.0 0 0 0.0
p17-net2-b16-g5-t20.pddl
1.0000 1.0000 0.0 0.8391 0.8431 0.004
p18-net2-b16-g7-t60.pddl
0.9158 0.9181 0.0023 0.6437 0.6404 -0.0034
p19-net2-b18-g6-t60.pddl
1.0000 1.0000 0.0 0.6731 0.6677 -0.0053
p20-net2-b18-g8-t90.pddl
0.8980 0.8853 -0.0128 0 0 0.0
p21-net3-b12-g2-t60.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22-net3-b12-g4-t60.pddl
0.2164 0.2151 -0.0013 0.6457 0.6487 0.003
p23-net3-b14-g3-t60.pddl
0.8715 0.8764 0.0049 0 0 0.0
p24-net3-b14-g5-t60.pddl
1.0000 1.0000 0.0 0 0 0.0
p25-net3-b16-g5-t60.pddl
1.0000 1.0000 0.0 0 0 0.0
p26-net3-b16-g7-t70.pddl
0.5820 0.5803 -0.0017 0 0 0.0
p27-net3-b18-g6-t70.pddl
1.0000 1.0000 0.0 0 0 0.0
p28-net3-b18-g7-t70.pddl
0.0953 0.0955 0.0002 0 0 0.0
p29-net3-b20-g6-t70.pddl
0.9577 0.9601 0.0024 0 0 0.0
p30-net3-b20-g8-t70.pddl
0.7318 0.7403 0.0084 0 0 0.0
p31-net4-b14-g3-t20.pddl
0.5264 0.5245 -0.0019 1.0000 1.0000 0.0
p32-net4-b14-g5-t30.pddl
0.8780 0.8792 0.0012 0.5270 0.5273 0.0003
p33-net4-b16-g5-t60.pddl
1.0000 1.0000 0.0 0 0 0.0
p34-net4-b16-g6-t60.pddl
1.0000 1.0000 0.0 0 0 0.0
p35-net4-b18-g4-t90.pddl
1.0000 1.0000 0.0 0 0 0.0
p36-net4-b18-g6-t90.pddl
0.5443 0.5277 -0.0166 0 0 0.0
p37-net4-b20-g5-t60.pddl
1.0000 1.0000 0.0 0 0 0.0
p38-net4-b20-g7-t60.pddl
0.8211 0.8234 0.0023 0 0 0.0
p39-net4-b22-g7-t50.pddl
1.0000 1.0000 0.0 0 0 0.0
p40-net4-b22-g8-t50.pddl
1.0000 1.0000 0.0 0 0 0.0
p41-net5-b22-g2-t20.pddl
1.0000 1.0000 0.0 0 0 0.0
p42-net5-b22-g4-t50.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3-t80.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5-t80.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4-t50.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6-t50.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5-t50.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7-t50.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6-t50.pddl
0.7083 0.6686 -0.0397 0 0 0.0
p50-net5-b30-g8-t50.pddl
0.3293 0.3563 0.027 0 0 0.0
Sum of diffs
-0.0252
-0.0003
Arithmetic mean of diffs
-0.0005
-0.0000
psr-small
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-s5-n1-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-s7-n1-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-s8-n1-l4-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-s9-n1-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-s10-n1-l4-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-s11-n1-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-s12-n1-l5-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-s13-n1-l5-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10-s17-n2-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-s18-n2-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-s21-n2-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-s22-n2-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14-s23-n2-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-s24-n2-l4-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16-s29-n2-l5-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17-s30-n2-l5-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18-s31-n2-l5-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19-s33-n3-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20-s34-n3-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21-s35-n3-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22-s37-n3-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23-s38-n3-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24-s39-n3-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25-s40-n3-l4-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26-s41-n3-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27-s42-n3-l4-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28-s43-n3-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29-s45-n3-l5-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30-s46-n3-l5-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p31-s49-n4-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p32-s50-n4-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p33-s51-n4-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p34-s55-n4-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p35-s57-n5-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p36-s65-n6-l2-f30.pddl
1.0000 1.0000 0.0 0.8313 0.8355 0.0043
p37-s67-n6-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p38-s78-n3-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p39-s79-n3-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p40-s80-n3-l4-f10.pddl
1.0000 1.0000 0.0 0.6272 0.6238 -0.0035
p41-s81-n3-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p42-s82-n3-l4-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p43-s83-n3-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p44-s89-n4-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p45-s94-n4-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p46-s97-n5-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p47-s98-n5-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p48-s101-n5-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p49-s105-n6-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p50-s107-n6-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0008
Arithmetic mean of diffs
0.0000
0.0000
rovers
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 0.7091 0.7063 -0.0028
p18.pddl
1.0000 1.0000 0.0 0.3975 0.4019 0.0043
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 0 0 0.0
p21.pddl
1.0000 1.0000 0.0 0 0 0.0
p22.pddl
1.0000 1.0000 0.0 0.4178 0.4198 0.0019
p23.pddl
1.0000 1.0000 0.0 0 0 0.0
p24.pddl
1.0000 1.0000 0.0 0 0 0.0
p25.pddl
1.0000 1.0000 0.0 0.9059 0.9106 0.0047
p26.pddl
1.0000 1.0000 0.0 0 0 0.0
p27.pddl
1.0000 1.0000 0.0 0 0 0.0
p28.pddl
1.0000 1.0000 0.0 0 0 0.0
p29.pddl
1.0000 1.0000 0.0 0 0 0.0
p30.pddl
1.0000 1.0000 0.0 0 0 0.0
p31.pddl
1.0000 1.0000 0.0 0 0 0.0
p32.pddl
1.0000 1.0000 0.0 0 0 0.0
p33.pddl
0.9481 0.9505 0.0024 0 0 0.0
p34.pddl
1.0000 1.0000 0.0 0 0 0.0
p35.pddl
0.8643 0.8718 0.0075 0 0 0.0
p36.pddl
0.9401 0.9399 -0.0002 0 0 0.0
p37.pddl
0.7589 0.7592 0.0004 0 0 0.0
p38.pddl
0.8171 0.8117 -0.0053 0 0 0.0
p39.pddl
0.8464 0.8489 0.0026 0 0 0.0
p40.pddl
0.7407 0.7478 0.007 0 0 0.0
Sum of diffs
0.0142
0.0082
Arithmetic mean of diffs
0.0004
0.0002
satellite
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-pfile2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-pfile3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-pfile4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-pfile5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-pfile6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-pfile7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-pfile8.pddl
1.0000 1.0000 0.0 0.7639 0.7622 -0.0017
p09-pfile9.pddl
1.0000 1.0000 0.0 0.7796 0.7800 0.0004
p10-pfile10.pddl
1.0000 1.0000 0.0 0.5768 0.5825 0.0057
p11-pfile11.pddl
1.0000 1.0000 0.0 0.7445 0.7458 0.0013
p12-pfile12.pddl
1.0000 1.0000 0.0 0.3902 0.3834 -0.0068
p13-pfile13.pddl
1.0000 1.0000 0.0 0 0 0.0
p14-pfile14.pddl
1.0000 1.0000 0.0 0.4708 0.4722 0.0014
p15-pfile15.pddl
1.0000 1.0000 0.0 0 0 0.0
p16-pfile16.pddl
1.0000 1.0000 0.0 0 0 0.0
p17-pfile17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18-pfile18.pddl
1.0000 1.0000 0.0 0 0 0.0
p19-pfile19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20-pfile20.pddl
1.0000 1.0000 0.0 0 0 0.0
p21-HC-pfile1.pddl
1.0000 1.0000 0.0 0.6296 0.6329 0.0033
p22-HC-pfile2.pddl
1.0000 1.0000 0.0 0 0 0.0
p23-HC-pfile3.pddl
1.0000 1.0000 0.0 0.6164 0.6144 -0.002
p24-HC-pfile4.pddl
1.0000 1.0000 0.0 0 0 0.0
p25-HC-pfile5.pddl
0.9601 0.9613 0.0012 0 0 0.0
p26-HC-pfile6.pddl
1.0000 1.0000 0.0 0 0 0.0
p27-HC-pfile7.pddl
1.0000 1.0000 0.0 0 0 0.0
p28-HC-pfile8.pddl
0.7316 0.7341 0.0024 0 0 0.0
p29-HC-pfile9.pddl
0.8253 0.8046 -0.0207 0 0 0.0
p30-HC-pfile10.pddl
0.5478 0.5420 -0.0058 0 0 0.0
p31-HC-pfile11.pddl
0.5744 0.5796 0.0052 0 0 0.0
p32-HC-pfile12.pddl
0.3425 0.3454 0.0029 0 0 0.0
p33-HC-pfile13.pddl
0.2132 0.2119 -0.0012 0 0 0.0
p34-HC-pfile14.pddl
0.9762 0.9687 -0.0075 0 0 0.0
p35-HC-pfile15.pddl
0.4947 0.5056 0.0109 0 0 0.0
p36-HC-pfile16.pddl
0.7009 0.7066 0.0057 0 0 0.0
Sum of diffs
-0.0067
0.0016
Arithmetic mean of diffs
-0.0002
0.0000
scanalyzer-08-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
0.5842 0.5924 0.0083 1.0000 1.0000 0.0
p30.pddl
0.7594 0.7654 0.006 1.0000 1.0000 0.0
Sum of diffs
0.0142
0.0000
Arithmetic mean of diffs
0.0005
0.0000
scanalyzer-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
snake-opt18-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.9090 0.9141 0.0052 0.9650 0.9688 0.0038
p03.pddl
0.5783 0.5817 0.0034 0.7812 0.7820 0.0009
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
0.9898 0.9864 -0.0034 0.9056 0.9122 0.0067
p07.pddl
0.0752 0.0708 -0.0044 0.3908 0.3958 0.005
p08.pddl
0 0 0.0 0.1990 0.2056 0.0066
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0.9480 0.9526 0.0047 0.8026 0.7991 -0.0036
p12.pddl
0.2249 0.2197 -0.0053 0.3757 0.3834 0.0077
p13.pddl
0.4634 0.4828 0.0194 0 0 0.0
p14.pddl
0 0 0.0 0 0 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
0.4600 0.4463 -0.0136 0.4061 0.4046 -0.0016
p17.pddl
0.0967 0.0776 -0.0191 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0.7748 0.7956 0.0209 1.0000 1.0000 0.0
Sum of diffs
0.0077
0.0255
Arithmetic mean of diffs
0.0004
0.0013
sokoban-opt08-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0 0 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0.9940 0.9965 0.0025 0.5711 0.5675 -0.0036
p09.pddl
1.0000 1.0000 0.0 0.7724 0.7653 -0.0071
p10.pddl
1.0000 1.0000 0.0 0.8881 0.8965 0.0084
p11.pddl
0.8722 0.8718 -0.0004 0.9515 0.9513 -0.0003
p12.pddl
1.0000 1.0000 0.0 0.5155 0.5152 -0.0003
p13.pddl
0.6269 0.6280 0.0011 0.5614 0.5561 -0.0054
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0.8150 0.8168 0.0018 0.5693 0.5722 0.0029
p16.pddl
1.0000 0.9974 -0.0026 0.9871 0.9854 -0.0017
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
0.9115 0.9126 0.0011 0.4927 0.4905 -0.0023
p19.pddl
0.8391 0.8396 0.0005 0.3897 0.3910 0.0013
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
0.8836 0.8850 0.0014 0.4488 0.4481 -0.0007
p23.pddl
1.0000 1.0000 0.0 0.8016 0.8019 0.0003
p24.pddl
0.7725 0.7756 0.0032 0 0 0.0
p25.pddl
0.2505 0.2508 0.0003 0 0 0.0
p26.pddl
0.9219 0.9148 -0.0071 0 0 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
0.3837 0.3832 -0.0005 0.3865 0.3861 -0.0004
p29.pddl
1.0000 1.0000 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0013
-0.0089
Arithmetic mean of diffs
0.0000
-0.0003
sokoban-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.9847 0.9867 0.0019
p06.pddl
0.8722 0.8692 -0.003 0.9528 0.9517 -0.0011
p07.pddl
1.0000 1.0000 0.0 0.8888 0.8897 0.0008
p08.pddl
1.0000 1.0000 0.0 0.7659 0.7651 -0.0008
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 0 0 0.0
p11.pddl
0.6321 0.6257 -0.0065 0.5540 0.5558 0.0019
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
0.9945 0.9948 0.0004 0.5698 0.5621 -0.0078
p14.pddl
1.0000 1.0000 0.0 0.5165 0.5175 0.0011
p15.pddl
0.9115 0.9133 0.0018 0.4903 0.4905 0.0002
p16.pddl
0.8162 0.8177 0.0015 0.5682 0.5690 0.0009
p17.pddl
0.8453 0.8404 -0.0049 0.3905 0.3879 -0.0026
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
0.8844 0.8848 0.0003 0.4485 0.4482 -0.0004
p20.pddl
1.0000 1.0000 0.0 0.8126 0.8056 -0.007
Sum of diffs
-0.0103
-0.0129
Arithmetic mean of diffs
-0.0005
-0.0006
spider-opt18-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.9940 0.9914 -0.0027 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.6697 0.6643 -0.0054 1.0000 1.0000 0.0
p06.pddl
0.4490 0.4547 0.0057 0.3776 0.3765 -0.0011
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
0.6586 0.6647 0.0061 1.0000 1.0000 0.0
p10.pddl
0.4391 0.4514 0.0123 0.7212 0.7143 -0.0069
p11.pddl
0.8151 0.8145 -0.0006 1.0000 1.0000 0.0
p12.pddl
0.5989 0.6037 0.0047 0.5624 0.5637 0.0013
p13.pddl
0.3130 0.3169 0.0039 0.9088 0.9094 0.0006
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
0.9527 0.9621 0.0094 0.6722 0.6776 0.0054
p19.pddl
0.8982 0.9141 0.0159 1.0000 1.0000 0.0
p20.pddl
0.7622 0.7981 0.0359 1.0000 1.0000 0.0
Sum of diffs
0.0853
-0.0008
Arithmetic mean of diffs
0.0043
-0.0000
storage
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 0.9144 0.9158 0.0014
p17.pddl
1.0000 1.0000 0.0 0.5359 0.5343 -0.0016
p18.pddl
0.4691 0.4669 -0.0021 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0.5324 0.5199 -0.0125 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0146
-0.0002
Arithmetic mean of diffs
-0.0005
-0.0000
termes-opt18-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.5910 0.5906 -0.0004 0.7920 0.7859 -0.006
p06.pddl
0.7621 0.7624 0.0002 0.6839 0.6878 0.0039
p07.pddl
0.4298 0.4311 0.0013 0.3820 0.3843 0.0022
p08.pddl
0.3966 0.3972 0.0006 0.5760 0.5796 0.0036
p09.pddl
0 0 0.0 0 0 0.0
p10.pddl
0.2028 0.2069 0.0042 0 0 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0.8430 0.8437 0.0007 1.0000 1.0000 0.0
p16.pddl
0.9332 0.9328 -0.0004 0.9578 0.9627 0.0048
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0063
0.0086
Arithmetic mean of diffs
0.0003
0.0004
tetris-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
1.0000 0.9992 -0.0008 1.0000 1.0000 0.0
p01-8.pddl
0.9271 0.9336 0.0066 1.0000 1.0000 0.0
p01-10.pddl
0.2673 0.2656 -0.0017 1.0000 1.0000 0.0
p02-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-8.pddl
0.9843 0.9856 0.0013 1.0000 1.0000 0.0
p02-10.pddl
0.5632 0.5659 0.0028 1.0000 1.0000 0.0
p03-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-8.pddl
0.8794 0.8750 -0.0044 1.0000 1.0000 0.0
p03-10.pddl
0.7573 0.7625 0.0051 1.0000 1.0000 0.0
p04-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-8.pddl
0.7230 0.7247 0.0017 1.0000 1.0000 0.0
p04-10.pddl
0.6862 0.6878 0.0016 1.0000 1.0000 0.0
p05-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-8.pddl
0.2956 0.2969 0.0013 1.0000 1.0000 0.0
p05-10.pddl
0.8222 0.8133 -0.0089 1.0000 1.0000 0.0
Sum of diffs
0.0046
0.0000
Arithmetic mean of diffs
0.0003
0.0000
tidybot-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0.0172 0.0053 -0.0119 1.0000 1.0000 0.0
p09.pddl
0.7593 0.7582 -0.0012 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
0.7823 0.7787 -0.0037 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0 0 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
0.8046 0.7899 -0.0147 1.0000 1.0000 0.0
p18.pddl
0.6248 0.6405 0.0157 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
0.9441 0.9600 0.0159 1.0000 1.0000 0.0
Sum of diffs
0.0003
0.0000
Arithmetic mean of diffs
0.0000
0.0000
tidybot-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.9593 0.9548 -0.0045 0.6691 0.6665 -0.0026
p02.pddl
0.9517 0.9485 -0.0032 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.8554 0.8370 -0.0185 1.0000 1.0000 0.0
p06.pddl
0.6758 0.7148 0.039 0.9906 0.9931 0.0025
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
0.8893 0.9454 0.0561 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
0.7757 0.7865 0.0108 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0 0 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
0.8152 0.7453 -0.0699 1.0000 1.0000 0.0
p18.pddl
0.6215 0.6491 0.0276 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
0.9504 0.9552 0.0048 1.0000 1.0000 0.0
Sum of diffs
0.0423
-0.0001
Arithmetic mean of diffs
0.0021
-0.0000
tpp
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 0.8712 0.8751 0.0038
p17.pddl
1.0000 1.0000 0.0 0.5388 0.5424 0.0036
p18.pddl
1.0000 1.0000 0.0 0.6916 0.6919 0.0002
p19.pddl
1.0000 1.0000 0.0 0.5790 0.5785 -0.0005
p20.pddl
1.0000 1.0000 0.0 0.4374 0.4372 -0.0003
p21.pddl
1.0000 1.0000 0.0 0.7457 0.7549 0.0092
p22.pddl
1.0000 1.0000 0.0 0.7406 0.7433 0.0027
p23.pddl
1.0000 1.0000 0.0 0.6112 0.6167 0.0056
p24.pddl
0.9596 0.9531 -0.0065 0.6566 0.6500 -0.0066
p25.pddl
1.0000 1.0000 0.0 0.4670 0.4656 -0.0013
p26.pddl
0.9535 0.9525 -0.0011 0.4559 0.4548 -0.0011
p27.pddl
0.9162 0.9138 -0.0024 0.4637 0.4626 -0.0011
p28.pddl
0.8941 0.8901 -0.004 0 0 0.0
p29.pddl
0.7696 0.7552 -0.0144 0 0 0.0
p30.pddl
0.7921 0.7892 -0.0029 0 0 0.0
Sum of diffs
-0.0312
0.0142
Arithmetic mean of diffs
-0.0010
0.0005
transport-opt08-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 0.9552 0.9523 -0.0029
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 0.8434 0.8510 0.0076
p18.pddl
1.0000 1.0000 0.0 0.7785 0.7733 -0.0052
p19.pddl
1.0000 1.0000 0.0 0.6607 0.6628 0.0021
p20.pddl
1.0000 1.0000 0.0 0.5665 0.5623 -0.0042
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
-0.0025
Arithmetic mean of diffs
0.0000
-0.0001
transport-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 0.9990 0.9980 -0.001
p11.pddl
1.0000 1.0000 0.0 0.8677 0.8731 0.0054
p12.pddl
1.0000 1.0000 0.0 0.7781 0.7738 -0.0043
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 0.9662 0.9683 0.0021
p17.pddl
1.0000 1.0000 0.0 0.8919 0.8864 -0.0055
p18.pddl
1.0000 1.0000 0.0 0.8376 0.8325 -0.0052
p19.pddl
1.0000 1.0000 0.0 0.9815 0.9862 0.0047
p20.pddl
1.0000 1.0000 0.0 0.9906 0.9870 -0.0037
Sum of diffs
0.0000
-0.0074
Arithmetic mean of diffs
0.0000
-0.0004
trucks-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.9698 0.9688 -0.001
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 0.4832 0.4886 0.0053
p08.pddl
1.0000 1.0000 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 0 0 0.0
p10.pddl
0.7888 0.7893 0.0005 0 0 0.0
p11.pddl
0.9578 0.9644 0.0066 0 0 0.0
p12.pddl
0.5989 0.5962 -0.0026 0 0 0.0
p13.pddl
0.3835 0.3815 -0.0019 0 0 0.0
p14.pddl
0.8024 0.7998 -0.0026 0 0 0.0
p15.pddl
0.4195 0.4229 0.0034 0 0 0.0
p16.pddl
0.2068 0.2050 -0.0018 0 0 0.0
p17.pddl
0.2670 0.2645 -0.0025 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0 0 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0010
0.0043
Arithmetic mean of diffs
-0.0000
0.0001
visitall-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem02-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem03-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem03-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem04-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem04-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem05-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem05-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem06-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem06-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem07-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem07-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem08-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem08-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem09-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem09-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem10-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem10-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem11-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem11-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
visitall-opt14-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-9.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-9.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
woodworking-opt08-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 0 0 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 0 0 0.0
p10.pddl
1.0000 1.0000 0.0 0.9449 0.9480 0.0031
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 0 0 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 0.3028 0.3052 0.0024
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 0 0 0.0
p27.pddl
1.0000 1.0000 0.0 0 0 0.0
p28.pddl
1.0000 1.0000 0.0 0 0 0.0
p29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30.pddl
1.0000 1.0000 0.0 0.6749 0.6790 0.0041
Sum of diffs
0.0000
0.0095
Arithmetic mean of diffs
0.0000
0.0003
woodworking-opt11-strips
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.3054 0.3071 0.0017
p06.pddl
1.0000 1.0000 0.0 0 0 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 0 0 0.0
p12.pddl
1.0000 1.0000 0.0 0 0 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 0 0 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0017
Arithmetic mean of diffs
0.0000
0.0001
zenotravel
Show table
score_search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 0.8650 0.8641 -0.0009
p15.pddl
1.0000 1.0000 0.0 0.9678 0.9641 -0.0037
p16.pddl
1.0000 1.0000 0.0 0.7638 0.7637 -0.0001
p17.pddl
1.0000 1.0000 0.0 0.5381 0.5379 -0.0002
p18.pddl
1.0000 1.0000 0.0 0.7887 0.7875 -0.0012
p19.pddl
1.0000 1.0000 0.0 0.7407 0.7403 -0.0004
p20.pddl
1.0000 1.0000 0.0 0.6503 0.6546 0.0043
Sum of diffs
0.0000
-0.0021
Arithmetic mean of diffs
0.0000
-0.0001
score_total_time
Show table
The bottom row reports the sum across all domains.
agricola-opt18-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 0.8847 0.8840 -0.0007
p02.pddl
0.9086 0.9143 0.0057 0.8740 0.8711 -0.0029
p03.pddl
0.8564 0.8816 0.0252 0.7684 0.7689 0.0005
p04.pddl
0.9573 0.9741 0.0168 0.8809 0.8822 0.0013
p05.pddl
0.8764 0.9070 0.0306 0.7945 0.7914 -0.0031
p06.pddl
0.8153 0.8367 0.0215 0.7795 0.7800 0.0005
p07.pddl
0.8685 0.8811 0.0126 0.8165 0.8141 -0.0024
p08.pddl
0.8397 0.8541 0.0144 0.8015 0.8030 0.0015
p09.pddl
0.7709 0.7907 0.0198 0.7544 0.7546 0.0002
p10.pddl
0.8550 0.8640 0.009 0.8521 0.8583 0.0062
p11.pddl
0.8030 0.8302 0.0272 0.7405 0.7397 -0.0008
p12.pddl
0.7461 0.7627 0.0166 0.7446 0.7399 -0.0047
p13.pddl
0.8467 0.8610 0.0143 0.7910 0.7804 -0.0106
p14.pddl
0.7868 0.8078 0.021 0.7314 0.7333 0.0019
p15.pddl
0.7050 0.7160 0.011 0.7203 0.7219 0.0016
p16.pddl
0.8385 0.8394 0.0009 0.8031 0.8022 -0.0008
p17.pddl
0.7599 0.7811 0.0212 0.7579 0.7525 -0.0054
p18.pddl
0.6534 0.6635 0.0101 0.7066 0.7110 0.0045
p19.pddl
0.7996 0.8312 0.0316 0.7937 0.7974 0.0037
p20.pddl
0.7308 0.7509 0.0201 0.7405 0.7401 -0.0004
Sum of diffs
0.3294
-0.0099
Arithmetic mean of diffs
0.0165
-0.0005
airport
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-airport1-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-airport1-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-airport2-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-airport2-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-airport2-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-airport2-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-airport2-p3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-airport2-p4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10-airport3-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-airport3-p1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-airport3-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-airport3-p2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14-airport3-p3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-airport3-p3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16-airport3-p4.pddl
0.8641 0.8657 0.0016 1.0000 1.0000 0.0
p17-airport3-p5.pddl
0.9916 0.9892 -0.0025 0.7739 0.7742 0.0004
p18-airport3-p6.pddl
0.8118 0.8112 -0.0006 0.4656 0.4679 0.0023
p19-airport3-p6.pddl
1.0000 1.0000 0.0 0.4195 0.4225 0.0031
p20-airport3-p7.pddl
0.6896 0.6906 0.0011 0.1615 0.1586 -0.003
p21-airport4halfMUC-p2.pddl
1.0000 1.0000 0.0 0.9735 0.9827 0.0092
p22-airport4halfMUC-p3.pddl
0.5983 0.5976 -0.0007 0.8990 0.8941 -0.005
p23-airport4halfMUC-p4.pddl
0.5092 0.5138 0.0046 0.8167 0.8102 -0.0066
p24-airport4halfMUC-p4.pddl
0.5267 0.5251 -0.0016 0.8345 0.8328 -0.0017
p25-airport4halfMUC-p5.pddl
0.4749 0.4695 -0.0054 0 0 0.0
p26-airport4halfMUC-p6.pddl
0 0 0.0 0 0 0.0
p27-airport4halfMUC-p6.pddl
0.4460 0.4485 0.0025 0 0 0.0
p28-airport4halfMUC-p7.pddl
0 0 0.0 0 0 0.0
p29-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p30-airport4halfMUC-p8.pddl
0 0 0.0 0 0 0.0
p31-airport4halfMUC-p9.pddl
0 0 0.0 0 0 0.0
p32-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p33-airport4halfMUC-p10.pddl
0 0 0.0 0 0 0.0
p34-airport4halfMUC-p11.pddl
0 0 0.0 0 0 0.0
p35-airport4halfMUC-p12.pddl
0 0 0.0 0 0 0.0
p36-airport5MUC-p2.pddl
1.0000 1.0000 0.0 0.8712 0.8621 -0.0091
p37-airport5MUC-p3.pddl
0.5917 0.5929 0.0011 0.4902 0.4911 0.0009
p38-airport5MUC-p3.pddl
0.5563 0.5578 0.0016 0.6870 0.6893 0.0023
p39-airport5MUC-p4.pddl
0.4902 0.4945 0.0043 0 0 0.0
p40-airport5MUC-p4.pddl
0.7506 0.7516 0.0011 0.4452 0.4460 0.0008
p41-airport5MUC-p4.pddl
0.5228 0.5195 -0.0032 0 0 0.0
p42-airport5MUC-p5.pddl
0 0 0.0 0 0 0.0
p43-airport5MUC-p5.pddl
0.4776 0.4760 -0.0016 0.5748 0.5701 -0.0047
p44-airport5MUC-p5.pddl
0.4444 0.4421 -0.0023 0 0 0.0
p45-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p46-airport5MUC-p6.pddl
0 0 0.0 0 0 0.0
p47-airport5MUC-p8.pddl
0 0 0.0 0 0 0.0
p48-airport5MUC-p9.pddl
0 0 0.0 0 0 0.0
p49-airport5MUC-p10.pddl
0 0 0.0 0 0 0.0
p50-airport5MUC-p15.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0001
-0.0110
Arithmetic mean of diffs
-0.0000
-0.0002
barman-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile01-002.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile01-003.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile01-004.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile02-005.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile02-006.pddl
1.0000 1.0000 0.0 0.8369 0.8416 0.0048
pfile02-007.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile02-008.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
pfile03-009.pddl
1.0000 1.0000 0.0 0.9998 0.9975 -0.0023
pfile03-010.pddl
1.0000 1.0000 0.0 0.9978 1.0000 0.0022
pfile03-011.pddl
1.0000 1.0000 0.0 0.9866 0.9974 0.0108
pfile03-012.pddl
1.0000 1.0000 0.0 0.9860 0.9871 0.0012
pfile04-013.pddl
1.0000 1.0000 0.0 0.7966 0.7923 -0.0043
pfile04-014.pddl
1.0000 1.0000 0.0 0.6825 0.6764 -0.0061
pfile04-015.pddl
1.0000 1.0000 0.0 0.7772 0.7808 0.0036
pfile04-016.pddl
1.0000 1.0000 0.0 0.7980 0.7917 -0.0063
pfile05-017.pddl
1.0000 1.0000 0.0 0.7165 0.7180 0.0015
pfile05-018.pddl
1.0000 1.0000 0.0 0.6908 0.6899 -0.0009
pfile05-019.pddl
1.0000 1.0000 0.0 0.6305 0.6291 -0.0014
pfile05-020.pddl
1.0000 1.0000 0.0 0.5826 0.5857 0.0031
Sum of diffs
0.0000
0.0058
Arithmetic mean of diffs
0.0000
0.0003
barman-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
1.0000 1.0000 0.0 0.8407 0.8410 0.0003
p435-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p435-3.pddl
1.0000 1.0000 0.0 0.8426 0.8379 -0.0047
p536-1.pddl
1.0000 1.0000 0.0 0.5305 0.5340 0.0035
p536-2.pddl
1.0000 1.0000 0.0 1.0000 0.9998 -0.0002
p536-3.pddl
1.0000 1.0000 0.0 0.9843 0.9989 0.0145
p638-1.pddl
1.0000 1.0000 0.0 0.7924 0.7979 0.0055
p638-2.pddl
1.0000 1.0000 0.0 0.6981 0.7039 0.0058
p638-3.pddl
1.0000 1.0000 0.0 0.7767 0.7825 0.0058
p739-1.pddl
1.0000 1.0000 0.0 0.6460 0.6403 -0.0058
p739-2.pddl
1.0000 1.0000 0.0 0.6267 0.6254 -0.0013
p739-3.pddl
1.0000 1.0000 0.0 0.6263 0.6256 -0.0007
p839-1.pddl
1.0000 1.0000 0.0 0.5488 0.5428 -0.006
p839-2.pddl
1.0000 1.0000 0.0 0.5607 0.5625 0.0018
Sum of diffs
0.0000
0.0187
Arithmetic mean of diffs
0.0000
0.0013
blocks
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-6-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-7-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-7-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-7-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-8-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-8-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-9-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-9-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-9-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-10-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-10-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-10-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-11-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-11-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-11-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-12-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-12-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-13-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-13-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-14-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-14-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-15-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-15-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-16-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-16-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probBLOCKS-17-0.pddl
1.0000 1.0000 0.0 0.8202 0.8097 -0.0105
Sum of diffs
0.0000
-0.0105
Arithmetic mean of diffs
0.0000
-0.0003
childsnack-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
1.0000 1.0000 0.0 0.7584 0.7668 0.0084
child-snack_pfile01.pddl
1.0000 1.0000 0.0 0.7503 0.7562 0.0059
child-snack_pfile02-2.pddl
1.0000 1.0000 0.0 0.5235 0.5305 0.007
child-snack_pfile02.pddl
1.0000 1.0000 0.0 0.5121 0.5113 -0.0008
child-snack_pfile03-2.pddl
1.0000 1.0000 0.0 0.3064 0.3067 0.0004
child-snack_pfile03.pddl
1.0000 1.0000 0.0 0.3005 0.3035 0.003
child-snack_pfile04-2.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile04.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile05-2.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile05.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile06-2.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile06.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile07-2.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile07.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile08-2.pddl
1.0000 1.0000 0.0 0 0 0.0
child-snack_pfile08.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile09.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10-2.pddl
0 0 0.0 0 0 0.0
child-snack_pfile10.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
0.0238
Arithmetic mean of diffs
0.0000
0.0012
data-network-opt18-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 0.6034 0.6015 -0.0018
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 0.7047 0.7088 0.0041
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 0.5078 0.5037 -0.0041
Sum of diffs
0.0000
-0.0018
Arithmetic mean of diffs
0.0000
-0.0001
depot
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.8030 0.8016 -0.0013 1.0000 1.0000 0.0
p06.pddl
0.1175 0.1150 -0.0024 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
0.8253 0.8218 -0.0035 0.7339 0.7335 -0.0004
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0.9117 0.9122 0.0005 1.0000 1.0000 0.0
p12.pddl
0.7465 0.7476 0.0011 0 0 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 0.6363 0.6398 0.0035
p15.pddl
0.4343 0.4369 0.0026 0.3300 0.3294 -0.0005
p16.pddl
1.0000 1.0000 0.0 0.6328 0.6359 0.003
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 0 0 0.0
p19.pddl
0.9253 0.9267 0.0014 0.2589 0.2545 -0.0044
p20.pddl
0 0 0.0 0.9281 0.9288 0.0008
p21.pddl
1.0000 1.0000 0.0 0.4306 0.4283 -0.0023
p22.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0018
-0.0003
Arithmetic mean of diffs
-0.0001
-0.0000
driverlog
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
0.8423 0.8439 0.0016 0.9456 0.9437 -0.0019
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
0.7653 0.7622 -0.0031 0.7457 0.7404 -0.0053
p19.pddl
0.7461 0.7450 -0.001 0.5435 0.5417 -0.0018
p20.pddl
0.7947 0.7980 0.0034 0.7057 0.7063 0.0006
Sum of diffs
0.0009
-0.0085
Arithmetic mean of diffs
0.0000
-0.0004
elevators-opt08-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
elevators-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
floortile-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
1.0000 1.0000 0.0 0.8881 0.8879 -0.0001
opt-p01-002.pddl
1.0000 1.0000 0.0 0.9519 0.9540 0.0021
opt-p02-003.pddl
0.6397 0.6362 -0.0035 0 0 0.0
opt-p02-004.pddl
0.7137 0.7225 0.0088 0 0 0.0
opt-p03-005.pddl
0.6634 0.6575 -0.0058 0 0 0.0
opt-p03-006.pddl
0.3989 0.3984 -0.0005 0 0 0.0
opt-p04-007.pddl
0.3295 0.3268 -0.0028 0 0 0.0
opt-p04-008.pddl
0.2039 0.1991 -0.0048 0 0 0.0
opt-p05-009.pddl
0.4008 0.4058 0.005 0 0 0.0
opt-p05-010.pddl
0 0 0.0 0 0 0.0
opt-p06-011.pddl
0 0 0.0 0 0 0.0
opt-p06-012.pddl
0 0 0.0 0 0 0.0
opt-p07-013.pddl
0 0 0.0 0 0 0.0
opt-p07-014.pddl
0 0 0.0 0 0 0.0
opt-p08-015.pddl
0 0 0.0 0 0 0.0
opt-p08-016.pddl
0 0 0.0 0 0 0.0
opt-p09-017.pddl
0 0 0.0 0 0 0.0
opt-p09-018.pddl
0 0 0.0 0 0 0.0
opt-p10-019.pddl
0 0 0.0 0 0 0.0
opt-p10-020.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0036
0.0019
Arithmetic mean of diffs
-0.0002
0.0001
floortile-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
0.6865 0.6864 -0.0001 0 0 0.0
p01-4-4-2.pddl
0.2798 0.2790 -0.0008 0 0 0.0
p01-5-3-2.pddl
0.3256 0.3225 -0.0031 0 0 0.0
p01-5-4-2.pddl
0 0 0.0 0 0 0.0
p01-5-5-2.pddl
0 0 0.0 0 0 0.0
p01-6-4-2.pddl
0 0 0.0 0 0 0.0
p01-6-5-2.pddl
0 0 0.0 0 0 0.0
p02-4-4-2.pddl
0.2575 0.2517 -0.0059 0 0 0.0
p02-5-3-2.pddl
0.4196 0.4177 -0.0019 0 0 0.0
p02-5-4-2.pddl
0 0 0.0 0 0 0.0
p02-5-5-2.pddl
0 0 0.0 0 0 0.0
p02-6-4-2.pddl
0 0 0.0 0 0 0.0
p02-6-5-2.pddl
0 0 0.0 0 0 0.0
p03-4-3-2.pddl
0.6610 0.6601 -0.0009 0 0 0.0
p03-4-4-2.pddl
0.2977 0.2990 0.0013 0 0 0.0
p03-5-3-2.pddl
0.4053 0.4081 0.0029 0 0 0.0
p03-5-4-2.pddl
0.2876 0.2898 0.0022 0 0 0.0
p03-5-5-2.pddl
0 0 0.0 0 0 0.0
p03-6-4-2.pddl
0 0 0.0 0 0 0.0
p03-6-5-2.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0063
0.0000
Arithmetic mean of diffs
-0.0003
0.0000
freecell
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0.9345 0.9383 0.0039 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
0.8915 0.8927 0.0012 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0.9892 0.9718 -0.0174 1.0000 1.0000 0.0
p16.pddl
0.9911 0.9872 -0.0039 1.0000 1.0000 0.0
p17.pddl
0.9308 0.9445 0.0137 0.9558 0.9467 -0.0091
p18.pddl
0.9018 0.8862 -0.0156 0.9544 0.9441 -0.0103
p19.pddl
0.6102 0.6191 0.0089 0.9279 0.9243 -0.0036
p20.pddl
0.9002 0.8756 -0.0246 0.9337 0.9191 -0.0145
probfreecell-2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-2-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-3-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-4-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-5-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-6-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-7-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-8-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-9-1.pddl
0.9906 1.0000 0.0094 0.9836 0.9817 -0.0019
probfreecell-9-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probfreecell-9-3.pddl
0.9916 1.0000 0.0084 1.0000 1.0000 0.0
probfreecell-9-4.pddl
1.0000 1.0000 0.0 0.9958 1.0000 0.0042
probfreecell-9-5.pddl
0.9929 1.0000 0.0071 1.0000 1.0000 0.0
probfreecell-10-1.pddl
0.8769 0.8760 -0.0009 0.9881 0.9824 -0.0056
probfreecell-10-2.pddl
0.9740 0.9860 0.012 1.0000 1.0000 0.0
probfreecell-10-3.pddl
0.9638 0.9723 0.0086 0.9806 0.9682 -0.0124
probfreecell-10-4.pddl
0.9443 0.9608 0.0165 0.9749 0.9746 -0.0003
probfreecell-10-5.pddl
0.9443 0.9528 0.0086 0.9829 0.9754 -0.0074
probfreecell-11-1.pddl
0.9345 0.9425 0.0081 0.9506 0.9468 -0.0039
probfreecell-11-2.pddl
0.9336 0.9410 0.0074 0.9326 0.9326 -0.0001
probfreecell-11-3.pddl
0.9413 0.9568 0.0155 0.9361 0.9408 0.0047
probfreecell-11-4.pddl
0.9439 0.9540 0.0101 0.9341 0.9361 0.002
probfreecell-11-5.pddl
0 0 0.0 0.9675 0.9551 -0.0124
probfreecell-12-1.pddl
0.6003 0.6127 0.0124 0.9341 0.9457 0.0116
probfreecell-12-2.pddl
0.8616 0.8966 0.035 0.9375 0.9342 -0.0033
probfreecell-12-3.pddl
0.9291 0.9203 -0.0088 0.9091 0.8998 -0.0094
probfreecell-12-4.pddl
0.9211 0.9044 -0.0167 0.9563 0.9632 0.0069
probfreecell-12-5.pddl
0.1390 0.1377 -0.0013 0.9258 0.9272 0.0015
probfreecell-13-1.pddl
0.5107 0.5133 0.0026 0.9215 0.9317 0.0102
probfreecell-13-2.pddl
0.6053 0.5930 -0.0122 0.9268 0.9293 0.0025
probfreecell-13-3.pddl
0.9001 0.8974 -0.0027 0.9513 0.9525 0.0013
probfreecell-13-4.pddl
0.7326 0.7452 0.0125 0.9524 0.9447 -0.0078
probfreecell-13-5.pddl
0.1409 0.1365 -0.0044 0.7022 0.7061 0.004
Sum of diffs
0.0935
-0.0533
Arithmetic mean of diffs
0.0012
-0.0007
ged-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-1-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-2-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-4-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-7-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-7-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
d-8-9.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
grid
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 0 0 0.0
prob04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob05.pddl
1.0000 1.0000 0.0 0.7244 0.7254 0.001
Sum of diffs
0.0000
0.0010
Arithmetic mean of diffs
0.0000
0.0002
gripper
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
hiking-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-1-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-1-2-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-1-2-7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-1-2-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-2-5.pddl
1.0000 1.0000 0.0 1.0000 0.9960 -0.004
ptesting-2-2-6.pddl
1.0000 1.0000 0.0 0.9566 0.9501 -0.0065
ptesting-2-2-7.pddl
0.9587 0.9633 0.0046 0.8052 0.8091 0.0039
ptesting-2-2-8.pddl
0.9191 0.9198 0.0007 0.7911 0.7955 0.0045
ptesting-2-3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-3-5.pddl
1.0000 1.0000 0.0 0.9616 0.9538 -0.0078
ptesting-2-3-6.pddl
1.0000 1.0000 0.0 0.8176 0.8129 -0.0047
ptesting-2-3-7.pddl
0.9110 0.9168 0.0058 0.7868 0.7888 0.002
ptesting-2-4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-4-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
ptesting-2-4-5.pddl
1.0000 1.0000 0.0 0.9058 0.9065 0.0007
ptesting-2-4-6.pddl
0.9983 0.9944 -0.0039 0.7931 0.7806 -0.0125
ptesting-2-4-7.pddl
0.9025 0.9014 -0.0011 0.6635 0.6689 0.0054
Sum of diffs
0.0060
-0.0190
Arithmetic mean of diffs
0.0003
-0.0009
logistics00
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-6-9.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-7-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-7-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-8-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-9-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-9-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-10-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-10-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-11-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-11-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-12-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-12-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-13-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-13-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-14-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-14-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-15-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
probLOGISTICS-15-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
logistics98
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 0.5632 0.5534 -0.0098
prob04.pddl
1.0000 1.0000 0.0 0 0 0.0
prob05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob06.pddl
1.0000 1.0000 0.0 0 0 0.0
prob07.pddl
1.0000 1.0000 0.0 0.8120 0.8099 -0.0022
prob08.pddl
1.0000 1.0000 0.0 0 0 0.0
prob09.pddl
1.0000 1.0000 0.0 0 0 0.0
prob10.pddl
1.0000 1.0000 0.0 0.3181 0.3131 -0.005
prob11.pddl
1.0000 1.0000 0.0 0.8166 0.8088 -0.0078
prob12.pddl
1.0000 1.0000 0.0 0 0 0.0
prob13.pddl
1.0000 1.0000 0.0 0 0 0.0
prob14.pddl
1.0000 1.0000 0.0 0 0 0.0
prob15.pddl
1.0000 1.0000 0.0 0.7458 0.7447 -0.0012
prob16.pddl
1.0000 1.0000 0.0 0 0 0.0
prob17.pddl
1.0000 1.0000 0.0 0 0 0.0
prob18.pddl
0.8301 0.8383 0.0082 0 0 0.0
prob19.pddl
0.9571 0.9472 -0.0099 0 0 0.0
prob20.pddl
0.8446 0.8411 -0.0035 0 0 0.0
prob21.pddl
0.9879 0.9890 0.0011 0 0 0.0
prob22.pddl
0.5011 0.5012 0.0001 0 0 0.0
prob23.pddl
1.0000 1.0000 0.0 0.3375 0.3407 0.0032
prob24.pddl
1.0000 1.0000 0.0 0 0 0.0
prob25.pddl
0.7168 0.7138 -0.003 0 0 0.0
prob26.pddl
0.7353 0.7353 0.0 0 0 0.0
prob27.pddl
0.7995 0.7965 -0.003 0 0 0.0
prob28.pddl
0.3090 0.3521 0.0431 0 0 0.0
prob29.pddl
0.6111 0.6131 0.002 0 0 0.0
prob30.pddl
0.7626 0.7613 -0.0013 0 0 0.0
prob31.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob32.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob33.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob34.pddl
1.0000 1.0000 0.0 0.9709 0.9732 0.0023
prob35.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0338
-0.0205
Arithmetic mean of diffs
0.0010
-0.0006
miconic
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s1-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s2-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s3-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s4-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s5-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s6-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s7-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s8-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s9-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s10-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s11-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s11-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s11-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s11-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s11-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s12-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s12-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s12-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s12-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s12-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s13-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s13-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s13-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s13-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s13-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s14-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s14-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s14-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s14-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s14-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s15-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s15-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s15-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s15-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s15-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s16-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s16-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s16-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s16-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s16-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s17-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s17-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s17-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s17-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s17-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s18-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s18-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s18-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s18-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s18-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s19-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s19-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s19-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s19-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s19-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s20-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s20-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s20-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s20-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s20-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s21-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s21-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s21-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s21-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s21-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s22-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s22-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s22-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s22-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s22-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s23-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s23-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s23-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s23-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s23-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s24-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s24-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s24-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s24-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s24-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s25-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s25-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s25-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s25-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s25-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s26-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s26-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s26-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s26-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s26-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s27-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s27-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s27-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s27-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s27-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s28-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s28-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s28-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s28-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s28-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s29-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s29-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s29-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s29-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s29-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s30-0.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s30-1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s30-2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s30-3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
s30-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
movie
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
mprime
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 0.7946 0.7896 -0.005
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob05.pddl
1.0000 1.0000 0.0 0.7654 0.7590 -0.0064
prob06.pddl
1.0000 1.0000 0.0 0 0 0.0
prob07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob08.pddl
1.0000 1.0000 0.0 0 0 0.0
prob09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob10.pddl
1.0000 1.0000 0.0 0 0 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
1.0000 1.0000 0.0 0.8471 0.8472 0.0001
prob13.pddl
1.0000 1.0000 0.0 0 0 0.0
prob14.pddl
1.0000 1.0000 0.0 0 0 0.0
prob15.pddl
1.0000 1.0000 0.0 0 0 0.0
prob16.pddl
1.0000 1.0000 0.0 0.8551 0.8566 0.0015
prob17.pddl
1.0000 1.0000 0.0 0.5111 0.5100 -0.0011
prob18.pddl
1.0000 1.0000 0.0 0 0 0.0
prob19.pddl
1.0000 1.0000 0.0 0 0 0.0
prob20.pddl
1.0000 1.0000 0.0 0 0 0.0
prob21.pddl
1.0000 1.0000 0.0 0.5428 0.5364 -0.0064
prob22.pddl
1.0000 1.0000 0.0 0 0 0.0
prob23.pddl
1.0000 1.0000 0.0 0 0 0.0
prob24.pddl
1.0000 1.0000 0.0 0 0 0.0
prob25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob26.pddl
1.0000 1.0000 0.0 0.4720 0.4812 0.0092
prob27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob30.pddl
1.0000 1.0000 0.0 0 0 0.0
prob31.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob32.pddl
1.0000 1.0000 0.0 0.9705 0.9734 0.0029
prob33.pddl
1.0000 1.0000 0.0 0 0 0.0
prob34.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob35.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
-0.0052
Arithmetic mean of diffs
0.0000
-0.0001
mystery
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob04.pddl
0 0 0.0 0 0 0.0
prob05.pddl
0 0 0.0 0 0 0.0
prob06.pddl
0.7777 0.7764 -0.0013 0 0 0.0
prob07.pddl
0 0 0.0 0 0 0.0
prob08.pddl
0 0 0.0 0 0 0.0
prob09.pddl
0.3131 0.3083 -0.0048 1.0000 1.0000 0.0
prob10.pddl
1.0000 1.0000 0.0 0 0 0.0
prob11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob12.pddl
0 0 0.0 0 0 0.0
prob13.pddl
1.0000 1.0000 0.0 0 0 0.0
prob14.pddl
1.0000 1.0000 0.0 0 0 0.0
prob15.pddl
1.0000 1.0000 0.0 0.6170 0.6197 0.0027
prob16.pddl
0 0 0.0 0 0 0.0
prob17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob18.pddl
0 0 0.0 0 0 0.0
prob19.pddl
1.0000 1.0000 0.0 0.8923 0.8921 -0.0002
prob20.pddl
1.0000 1.0000 0.0 0.4788 0.4715 -0.0073
prob21.pddl
0 0 0.0 0 0 0.0
prob22.pddl
0 0 0.0 0 0 0.0
prob23.pddl
0 0 0.0 0 0 0.0
prob24.pddl
0 0 0.0 0 0 0.0
prob25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
prob30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
-0.0061
-0.0048
Arithmetic mean of diffs
-0.0002
-0.0002
nomystery-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.4590 0.4570 -0.0019
p06.pddl
1.0000 1.0000 0.0 0 0 0.0
p07.pddl
1.0000 1.0000 0.0 0 0 0.0
p08.pddl
1.0000 1.0000 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 0 0 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 0.9815 0.9809 -0.0006
p15.pddl
1.0000 1.0000 0.0 0.9899 0.9920 0.002
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
Sum of diffs
0.0000
-0.0005
Arithmetic mean of diffs
0.0000
-0.0000
openstacks-opt08-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p35_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p35_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p35_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p40_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p40_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p40_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p45_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p45_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p45_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p50_1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p50_2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p50_3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
openstacks-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
0.8507 0.8251 -0.0256 0.8343 0.8362 0.0019
p25.pddl
0.8545 0.8617 0.0072 0.8639 0.8673 0.0033
p26.pddl
0.9289 0.9313 0.0024 1.0000 1.0000 0.0
p27.pddl
0.7711 0.7558 -0.0153 0.8516 0.8595 0.0079
p28.pddl
0.4824 0.4864 0.0039 0.4712 0.4756 0.0044
p29.pddl
0.5131 0.5148 0.0017 0.5056 0.5113 0.0057
p30.pddl
0.6447 0.6630 0.0183 0.7278 0.7165 -0.0113
Sum of diffs
-0.0074
0.0120
Arithmetic mean of diffs
-0.0002
0.0004
organic-synthesis-opt18-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
None None - None None -
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
organic-synthesis-split-opt18-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 0.9842 -0.0158 0.8692 0.8674 -0.0017
p04.pddl
1.0000 1.0000 0.0 0.8280 0.8292 0.0012
p05.pddl
1.0000 1.0000 0.0 0.8649 0.8646 -0.0002
p06.pddl
0.9891 1.0000 0.0109 0.4433 0.4419 -0.0014
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0.8718 0.8544 -0.0174 0.2627 0.2621 -0.0006
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0.9591 0.9640 0.005 0 0 0.0
p12.pddl
0.9108 0.9049 -0.0059 0 0 0.0
p13.pddl
0.6602 0.6564 -0.0039 0 0 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0 0 0.0 0 0 0.0
p16.pddl
0.5948 0.5778 -0.0169 0 0 0.0
p17.pddl
0.4438 0.4300 -0.0138 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0.7703 0.7671 -0.0031 0 0 0.0
p20.pddl
0.1993 0.1930 -0.0063 0 0 0.0
Sum of diffs
-0.0673
-0.0028
Arithmetic mean of diffs
-0.0034
-0.0001
parcprinter-08-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 0.7855 0.7861 0.0007
p15.pddl
1.0000 1.0000 0.0 0 0 0.0
p16.pddl
1.0000 1.0000 0.0 0 0 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
1.0000 1.0000 0.0 0 0 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 0 0 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 0.8369 0.8379 0.001
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
1.0000 1.0000 0.0 0 0 0.0
p30.pddl
1.0000 1.0000 0.0 0 0 0.0
Sum of diffs
0.0000
0.0016
Arithmetic mean of diffs
0.0000
0.0001
parcprinter-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 0.8409 0.8426 0.0017
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 0.7875 0.7870 -0.0004
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
1.0000 1.0000 0.0 0 0 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0012
Arithmetic mean of diffs
0.0000
0.0001
parking-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile03-012.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile04-013.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile04-014.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile04-015.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile04-016.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile05-017.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile05-018.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile05-019.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile05-020.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile06-021.pddl
0.9940 1.0000 0.006 0 0 0.0
pfile06-022.pddl
1.0000 0.9934 -0.0066 0 0 0.0
pfile06-023.pddl
1.0000 1.0000 0.0 0 0 0.0
pfile06-024.pddl
0.9450 0.9353 -0.0097 0 0 0.0
pfile07-025.pddl
0.8831 0.8830 -0.0001 0 0 0.0
pfile07-026.pddl
0.9584 0.9492 -0.0092 0 0 0.0
pfile07-027.pddl
0.9486 0.9463 -0.0023 0 0 0.0
pfile07-028.pddl
0.8888 0.8831 -0.0057 0 0 0.0
pfile08-029.pddl
0.8442 0.8461 0.0019 0 0 0.0
pfile08-030.pddl
0.8853 0.8873 0.002 0 0 0.0
Sum of diffs
-0.0238
0.0000
Arithmetic mean of diffs
-0.0012
0.0000
parking-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
1.0000 1.0000 0.0 0 0 0.0
p_12_7-02.pddl
1.0000 1.0000 0.0 0.8659 0.8612 -0.0047
p_12_7-03.pddl
1.0000 1.0000 0.0 0 0 0.0
p_12_7-04.pddl
1.0000 1.0000 0.0 0 0 0.0
p_14_8-01.pddl
1.0000 1.0000 0.0 0 0 0.0
p_14_8-02.pddl
1.0000 1.0000 0.0 0 0 0.0
p_14_8-03.pddl
1.0000 1.0000 0.0 0 0 0.0
p_14_8-04.pddl
1.0000 1.0000 0.0 0 0 0.0
p_16_9-01.pddl
1.0000 1.0000 0.0 0 0 0.0
p_16_9-02.pddl
1.0000 1.0000 0.0 0 0 0.0
p_16_9-03.pddl
1.0000 1.0000 0.0 0 0 0.0
p_16_9-04.pddl
1.0000 1.0000 0.0 0 0 0.0
p_18_10-01.pddl
0.9617 0.9827 0.0211 0 0 0.0
p_18_10-02.pddl
1.0000 1.0000 0.0 0 0 0.0
p_18_10-03.pddl
1.0000 1.0000 0.0 0 0 0.0
p_18_10-04.pddl
1.0000 1.0000 0.0 0 0 0.0
p_20_11-01.pddl
0.8993 0.9175 0.0181 0 0 0.0
p_20_11-02.pddl
0.9434 0.9436 0.0002 0 0 0.0
p_20_11-03.pddl
0.9265 0.8962 -0.0304 0 0 0.0
p_20_11-04.pddl
0.8723 0.8678 -0.0045 0 0 0.0
Sum of diffs
0.0045
-0.0047
Arithmetic mean of diffs
0.0002
-0.0002
pathways-noneg
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.9816 0.9859 0.0043
p06.pddl
1.0000 1.0000 0.0 0.5597 0.5594 -0.0003
p07.pddl
1.0000 1.0000 0.0 0.3088 0.3079 -0.001
p08.pddl
1.0000 1.0000 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 0.5382 0.5414 0.0033
p10.pddl
0 0 0.0 0 0 0.0
p11.pddl
1.0000 1.0000 0.0 0.3690 0.3698 0.0007
p12.pddl
1.0000 1.0000 0.0 0 0 0.0
p13.pddl
1.0000 1.0000 0.0 0 0 0.0
p14.pddl
1.0000 1.0000 0.0 0 0 0.0
p15.pddl
1.0000 1.0000 0.0 0 0 0.0
p16.pddl
0 0 0.0 0 0 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
1.0000 1.0000 0.0 0 0 0.0
p24.pddl
1.0000 1.0000 0.0 0 0 0.0
p25.pddl
1.0000 1.0000 0.0 0 0 0.0
p26.pddl
1.0000 1.0000 0.0 0 0 0.0
p27.pddl
1.0000 1.0000 0.0 0 0 0.0
p28.pddl
1.0000 1.0000 0.0 0 0 0.0
p29.pddl
1.0000 1.0000 0.0 0 0 0.0
p30.pddl
1.0000 1.0000 0.0 0 0 0.0
Sum of diffs
0.0000
0.0070
Arithmetic mean of diffs
0.0000
0.0002
pegsol-08-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
0.9991 1.0000 0.0009 1.0000 1.0000 0.0
p28.pddl
0.8614 0.8632 0.0019 0.8136 0.8172 0.0036
p29.pddl
0.3059 0.3087 0.0028 1.0000 1.0000 0.0
p30.pddl
0.8533 0.8532 -0.0001 0.4235 0.4259 0.0024
Sum of diffs
0.0054
0.0060
Arithmetic mean of diffs
0.0002
0.0002
pegsol-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
0.9989 1.0000 0.0011 1.0000 1.0000 0.0
p18.pddl
0.8587 0.8590 0.0003 0.8136 0.8157 0.0021
p19.pddl
0.3080 0.3090 0.001 1.0000 1.0000 0.0
p20.pddl
0.8531 0.8550 0.002 0.4259 0.4233 -0.0027
Sum of diffs
0.0043
-0.0006
Arithmetic mean of diffs
0.0002
-0.0000
petri-net-alignment-opt18-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
0.9774 0.9844 0.007 1.0000 1.0000 0.0
p04.pddl
0.9752 0.9768 0.0016 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
0.9574 0.9707 0.0133 1.0000 1.0000 0.0
p07.pddl
0.9846 0.9993 0.0147 1.0000 1.0000 0.0
p08.pddl
0.9768 0.9730 -0.0038 1.0000 1.0000 0.0
p09.pddl
0.9381 0.9892 0.0511 1.0000 1.0000 0.0
p10.pddl
0.8620 0.8243 -0.0377 0.9494 0.9363 -0.0131
p11.pddl
0.9274 0.9350 0.0076 1.0000 0.9981 -0.0019
p12.pddl
0.7711 0.7651 -0.006 0.8858 0.8891 0.0033
p13.pddl
0.8808 0.8481 -0.0327 0.9432 0.9454 0.0022
p14.pddl
0.8186 0.8261 0.0076 0.9284 0.9376 0.0091
p15.pddl
0.8809 0.8468 -0.0341 0.9549 0.9393 -0.0156
p16.pddl
0.8124 0.7878 -0.0246 0.9126 0.9144 0.0017
p17.pddl
0.7799 0.7969 0.017 0.9103 0.8897 -0.0206
p18.pddl
0.7843 0.7917 0.0074 0.9170 0.9297 0.0126
p19.pddl
0.7713 0.8002 0.0288 0.9211 0.8984 -0.0228
p20.pddl
0.7630 0.7594 -0.0036 0.8806 0.8950 0.0144
Sum of diffs
0.0137
-0.0305
Arithmetic mean of diffs
0.0007
-0.0015
pipesworld-notankage
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-net1-b6-g4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-net1-b8-g3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-net1-b8-g5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-net1-b10-g4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-net1-b10-g6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-net1-b12-g5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-net1-b12-g7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-net1-b14-g6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10-net1-b14-g8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-net2-b10-g2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-net2-b10-g4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-net2-b12-g3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14-net2-b12-g5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-net2-b14-g4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16-net2-b14-g6.pddl
0.9390 0.9382 -0.0007 0.8894 0.8955 0.0061
p17-net2-b16-g5.pddl
0.9409 0.9398 -0.0011 1.0000 1.0000 0.0
p18-net2-b16-g7.pddl
0.8724 0.8707 -0.0017 1.0000 1.0000 0.0
p19-net2-b18-g6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20-net2-b18-g8.pddl
0.8012 0.8034 0.0022 1.0000 1.0000 0.0
p21-net3-b12-g2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22-net3-b12-g4.pddl
0.8372 0.8335 -0.0037 1.0000 1.0000 0.0
p23-net3-b14-g3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24-net3-b14-g5.pddl
0.9127 0.9186 0.006 0.9187 0.9202 0.0015
p25-net3-b16-g5.pddl
1.0000 1.0000 0.0 0.9256 0.9192 -0.0064
p26-net3-b16-g7.pddl
0.8081 0.7982 -0.01 1.0000 1.0000 0.0
p27-net3-b18-g6.pddl
0.7819 0.7872 0.0052 0.5299 0.5317 0.0018
p28-net3-b18-g7.pddl
0.7860 0.7849 -0.001 0.5872 0.5947 0.0075
p29-net3-b20-g6.pddl
0.9758 0.9736 -0.0022 0.6246 0.6300 0.0054
p30-net3-b20-g8.pddl
0.7803 0.7783 -0.0021 0.9959 0.9884 -0.0076
p31-net4-b14-g3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p32-net4-b14-g5.pddl
0.9589 0.9584 -0.0006 1.0000 1.0000 0.0
p33-net4-b16-g5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p34-net4-b16-g6.pddl
0.8117 0.8101 -0.0016 0.9981 0.9974 -0.0007
p35-net4-b18-g4.pddl
0.8714 0.8711 -0.0003 0.5205 0.5258 0.0052
p36-net4-b18-g6.pddl
1.0000 1.0000 0.0 0.3569 0.3617 0.0048
p37-net4-b20-g5.pddl
1.0000 1.0000 0.0 0 0 0.0
p38-net4-b20-g7.pddl
0.7534 0.7572 0.0038 0.5564 0.5500 -0.0064
p39-net4-b22-g7.pddl
1.0000 1.0000 0.0 0 0 0.0
p40-net4-b22-g8.pddl
0.9447 0.9494 0.0047 0.3618 0.3606 -0.0012
p41-net5-b22-g2.pddl
1.0000 1.0000 0.0 0.7441 0.7413 -0.0029
p42-net5-b22-g4.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6.pddl
1.0000 1.0000 0.0 0 0 0.0
p50-net5-b30-g8.pddl
0.6052 0.6055 0.0003 0 0 0.0
Sum of diffs
-0.0029
0.0072
Arithmetic mean of diffs
-0.0001
0.0001
pipesworld-tankage
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-net1-b6-g4-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-net1-b8-g3-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-net1-b8-g5-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-net1-b10-g4-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-net1-b10-g6-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-net1-b12-g5-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-net1-b12-g7-t80.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-net1-b14-g6-t50.pddl
0.8724 0.8725 0.0001 1.0000 1.0000 0.0
p10-net1-b14-g8-t50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-net2-b10-g2-t30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-net2-b10-g4-t60.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-net2-b12-g3-t70.pddl
1.0000 1.0000 0.0 0.5805 0.5804 -0.0001
p14-net2-b12-g5-t30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-net2-b14-g4-t30.pddl
1.0000 1.0000 0.0 0.9007 0.9018 0.0011
p16-net2-b14-g6-t80.pddl
1.0000 1.0000 0.0 0 0 0.0
p17-net2-b16-g5-t20.pddl
0.9978 0.9964 -0.0014 0.8341 0.8380 0.0039
p18-net2-b16-g7-t60.pddl
0.9012 0.9041 0.0028 0.6414 0.6379 -0.0035
p19-net2-b18-g6-t60.pddl
1.0000 1.0000 0.0 0.6698 0.6643 -0.0055
p20-net2-b18-g8-t90.pddl
0.8700 0.8545 -0.0155 0 0 0.0
p21-net3-b12-g2-t60.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22-net3-b12-g4-t60.pddl
0.2164 0.2150 -0.0013 0.6441 0.6472 0.003
p23-net3-b14-g3-t60.pddl
0.8598 0.8656 0.0059 0 0 0.0
p24-net3-b14-g5-t60.pddl
1.0000 1.0000 0.0 0 0 0.0
p25-net3-b16-g5-t60.pddl
1.0000 1.0000 0.0 0 0 0.0
p26-net3-b16-g7-t70.pddl
0.5778 0.5763 -0.0014 0 0 0.0
p27-net3-b18-g6-t70.pddl
1.0000 1.0000 0.0 0 0 0.0
p28-net3-b18-g7-t70.pddl
0.0952 0.0954 0.0002 0 0 0.0
p29-net3-b20-g6-t70.pddl
0.8884 0.8901 0.0017 0 0 0.0
p30-net3-b20-g8-t70.pddl
0.7123 0.7214 0.0091 0 0 0.0
p31-net4-b14-g3-t20.pddl
0.5262 0.5243 -0.0019 1.0000 1.0000 0.0
p32-net4-b14-g5-t30.pddl
0.8680 0.8686 0.0005 0.5260 0.5263 0.0003
p33-net4-b16-g5-t60.pddl
1.0000 1.0000 0.0 0 0 0.0
p34-net4-b16-g6-t60.pddl
0.9947 0.9794 -0.0154 0 0 0.0
p35-net4-b18-g4-t90.pddl
0.9210 0.9011 -0.0199 0 0 0.0
p36-net4-b18-g6-t90.pddl
0.5386 0.5225 -0.0161 0 0 0.0
p37-net4-b20-g5-t60.pddl
0.9770 0.9749 -0.0021 0 0 0.0
p38-net4-b20-g7-t60.pddl
0.7954 0.7986 0.0032 0 0 0.0
p39-net4-b22-g7-t50.pddl
0.8891 0.8909 0.0018 0 0 0.0
p40-net4-b22-g8-t50.pddl
0.8933 0.8915 -0.0019 0 0 0.0
p41-net5-b22-g2-t20.pddl
1.0000 1.0000 0.0 0 0 0.0
p42-net5-b22-g4-t50.pddl
0 0 0.0 0 0 0.0
p43-net5-b24-g3-t80.pddl
0 0 0.0 0 0 0.0
p44-net5-b24-g5-t80.pddl
0 0 0.0 0 0 0.0
p45-net5-b26-g4-t50.pddl
0 0 0.0 0 0 0.0
p46-net5-b26-g6-t50.pddl
0 0 0.0 0 0 0.0
p47-net5-b28-g5-t50.pddl
0 0 0.0 0 0 0.0
p48-net5-b28-g7-t50.pddl
0 0 0.0 0 0 0.0
p49-net5-b30-g6-t50.pddl
0.6517 0.6260 -0.0257 0 0 0.0
p50-net5-b30-g8-t50.pddl
0.3246 0.3511 0.0266 0 0 0.0
Sum of diffs
-0.0508
-0.0007
Arithmetic mean of diffs
-0.0010
-0.0000
psr-small
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-s5-n1-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-s7-n1-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-s8-n1-l4-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-s9-n1-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-s10-n1-l4-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-s11-n1-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-s12-n1-l5-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09-s13-n1-l5-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10-s17-n2-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11-s18-n2-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12-s21-n2-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13-s22-n2-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14-s23-n2-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15-s24-n2-l4-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16-s29-n2-l5-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17-s30-n2-l5-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18-s31-n2-l5-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19-s33-n3-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20-s34-n3-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21-s35-n3-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22-s37-n3-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23-s38-n3-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24-s39-n3-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25-s40-n3-l4-f10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26-s41-n3-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27-s42-n3-l4-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28-s43-n3-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29-s45-n3-l5-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30-s46-n3-l5-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p31-s49-n4-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p32-s50-n4-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p33-s51-n4-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p34-s55-n4-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p35-s57-n5-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p36-s65-n6-l2-f30.pddl
1.0000 1.0000 0.0 0.8308 0.8350 0.0043
p37-s67-n6-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p38-s78-n3-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p39-s79-n3-l3-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p40-s80-n3-l4-f10.pddl
1.0000 1.0000 0.0 0.6270 0.6235 -0.0035
p41-s81-n3-l4-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p42-s82-n3-l4-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p43-s83-n3-l4-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p44-s89-n4-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p45-s94-n4-l3-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p46-s97-n5-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p47-s98-n5-l2-f50.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p48-s101-n5-l3-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p49-s105-n6-l2-f30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p50-s107-n6-l2-f70.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0008
Arithmetic mean of diffs
0.0000
0.0000
rovers
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 0.7089 0.7061 -0.0028
p18.pddl
1.0000 1.0000 0.0 0.3975 0.4019 0.0043
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 0 0 0.0
p21.pddl
1.0000 1.0000 0.0 0 0 0.0
p22.pddl
1.0000 1.0000 0.0 0.4178 0.4197 0.0019
p23.pddl
1.0000 1.0000 0.0 0 0 0.0
p24.pddl
1.0000 1.0000 0.0 0 0 0.0
p25.pddl
1.0000 1.0000 0.0 0.9034 0.9081 0.0047
p26.pddl
1.0000 1.0000 0.0 0 0 0.0
p27.pddl
1.0000 1.0000 0.0 0 0 0.0
p28.pddl
1.0000 1.0000 0.0 0 0 0.0
p29.pddl
1.0000 1.0000 0.0 0 0 0.0
p30.pddl
1.0000 1.0000 0.0 0 0 0.0
p31.pddl
1.0000 1.0000 0.0 0 0 0.0
p32.pddl
1.0000 1.0000 0.0 0 0 0.0
p33.pddl
0.9304 0.9324 0.002 0 0 0.0
p34.pddl
1.0000 1.0000 0.0 0 0 0.0
p35.pddl
0.8453 0.8514 0.0061 0 0 0.0
p36.pddl
0.9197 0.9208 0.0011 0 0 0.0
p37.pddl
0.7473 0.7472 -0.0001 0 0 0.0
p38.pddl
0.7983 0.7928 -0.0055 0 0 0.0
p39.pddl
0.8227 0.8246 0.0019 0 0 0.0
p40.pddl
0.7257 0.7341 0.0084 0 0 0.0
Sum of diffs
0.0139
0.0081
Arithmetic mean of diffs
0.0003
0.0002
satellite
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-pfile2.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-pfile3.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04-pfile4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-pfile5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06-pfile6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07-pfile7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08-pfile8.pddl
1.0000 1.0000 0.0 0.7637 0.7620 -0.0017
p09-pfile9.pddl
1.0000 1.0000 0.0 0.7793 0.7797 0.0004
p10-pfile10.pddl
1.0000 1.0000 0.0 0.5767 0.5824 0.0057
p11-pfile11.pddl
1.0000 1.0000 0.0 0.7442 0.7454 0.0013
p12-pfile12.pddl
1.0000 1.0000 0.0 0.3902 0.3833 -0.0068
p13-pfile13.pddl
1.0000 1.0000 0.0 0 0 0.0
p14-pfile14.pddl
1.0000 1.0000 0.0 0.4707 0.4721 0.0014
p15-pfile15.pddl
1.0000 1.0000 0.0 0 0 0.0
p16-pfile16.pddl
1.0000 1.0000 0.0 0 0 0.0
p17-pfile17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18-pfile18.pddl
1.0000 1.0000 0.0 0 0 0.0
p19-pfile19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20-pfile20.pddl
1.0000 1.0000 0.0 0 0 0.0
p21-HC-pfile1.pddl
1.0000 1.0000 0.0 0.6289 0.6323 0.0033
p22-HC-pfile2.pddl
1.0000 1.0000 0.0 0 0 0.0
p23-HC-pfile3.pddl
1.0000 1.0000 0.0 0.6149 0.6129 -0.002
p24-HC-pfile4.pddl
0.9468 0.9436 -0.0031 0 0 0.0
p25-HC-pfile5.pddl
0.8985 0.8935 -0.005 0 0 0.0
p26-HC-pfile6.pddl
0.9525 0.9569 0.0045 0 0 0.0
p27-HC-pfile7.pddl
0.9220 0.9309 0.0089 0 0 0.0
p28-HC-pfile8.pddl
0.6886 0.6950 0.0064 0 0 0.0
p29-HC-pfile9.pddl
0.7214 0.7103 -0.0111 0 0 0.0
p30-HC-pfile10.pddl
0.5172 0.5116 -0.0056 0 0 0.0
p31-HC-pfile11.pddl
0.5166 0.5208 0.0042 0 0 0.0
p32-HC-pfile12.pddl
0.3154 0.3179 0.0025 0 0 0.0
p33-HC-pfile13.pddl
0.1936 0.1919 -0.0017 0 0 0.0
p34-HC-pfile14.pddl
0.6500 0.6470 -0.003 0 0 0.0
p35-HC-pfile15.pddl
0.4421 0.4536 0.0115 0 0 0.0
p36-HC-pfile16.pddl
0.5460 0.5517 0.0057 0 0 0.0
Sum of diffs
0.0142
0.0015
Arithmetic mean of diffs
0.0004
0.0000
scanalyzer-08-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
0.9640 0.9777 0.0137 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
0.9428 0.9515 0.0086 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
0.9670 0.9801 0.0131 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
0.5490 0.5794 0.0305 0.6514 0.6528 0.0014
p29.pddl
0.5118 0.5266 0.0147 0.7078 0.7106 0.0028
p30.pddl
0.5864 0.6022 0.0158 0.7163 0.7139 -0.0024
Sum of diffs
0.0965
0.0018
Arithmetic mean of diffs
0.0032
0.0001
scanalyzer-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
0.9740 0.9749 0.0009 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0.9807 0.9739 -0.0068 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
0.5540 0.5815 0.0275 0.6494 0.6509 0.0015
Sum of diffs
0.0217
0.0015
Arithmetic mean of diffs
0.0011
0.0001
snake-opt18-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.8809 0.8895 0.0087 0.9151 0.9180 0.0028
p03.pddl
0.5758 0.5790 0.0033 0.7647 0.7657 0.0009
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
0.9349 0.9205 -0.0144 0.8622 0.8682 0.006
p07.pddl
0.0751 0.0708 -0.0043 0.3897 0.3946 0.005
p08.pddl
0 0 0.0 0.1987 0.2053 0.0066
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
0.8797 0.8930 0.0133 0.7776 0.7746 -0.0031
p12.pddl
0.2246 0.2193 -0.0053 0.3742 0.3820 0.0077
p13.pddl
0.4601 0.4797 0.0196 0 0 0.0
p14.pddl
0 0 0.0 0 0 0.0
p15.pddl
1.0000 0.9924 -0.0076 0.9959 1.0000 0.0041
p16.pddl
0.4567 0.4431 -0.0136 0.4041 0.4022 -0.0018
p17.pddl
0.0965 0.0774 -0.0191 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0.7450 0.7671 0.0221 0.9056 0.8987 -0.0069
Sum of diffs
0.0026
0.0214
Arithmetic mean of diffs
0.0001
0.0011
sokoban-opt08-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0 0 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
0.9922 0.9948 0.0025 0.5710 0.5674 -0.0036
p09.pddl
1.0000 1.0000 0.0 0.7717 0.7646 -0.0071
p10.pddl
1.0000 1.0000 0.0 0.8870 0.8953 0.0083
p11.pddl
0.8717 0.8713 -0.0004 0.9492 0.9490 -0.0003
p12.pddl
1.0000 1.0000 0.0 0.5154 0.5151 -0.0003
p13.pddl
0.6268 0.6279 0.0011 0.5614 0.5560 -0.0054
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0.8146 0.8164 0.0018 0.5691 0.5719 0.0029
p16.pddl
0.9991 0.9953 -0.0038 0.9837 0.9821 -0.0016
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
0.9107 0.9118 0.0011 0.4926 0.4904 -0.0023
p19.pddl
0.8387 0.8392 0.0005 0.3897 0.3910 0.0013
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
0.8823 0.8837 0.0014 0.4487 0.4480 -0.0007
p23.pddl
1.0000 1.0000 0.0 0.8008 0.8012 0.0003
p24.pddl
0.7721 0.7752 0.0031 0 0 0.0
p25.pddl
0.2505 0.2507 0.0003 0 0 0.0
p26.pddl
0.9206 0.9135 -0.0071 0 0 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
0.3836 0.3832 -0.0005 0.3865 0.3861 -0.0004
p29.pddl
1.0000 1.0000 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0000
-0.0088
Arithmetic mean of diffs
-0.0000
-0.0003
sokoban-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 0.9985 -0.0015 0.9812 0.9832 0.0021
p06.pddl
0.8717 0.8687 -0.003 0.9505 0.9494 -0.001
p07.pddl
1.0000 1.0000 0.0 0.8877 0.8885 0.0008
p08.pddl
1.0000 1.0000 0.0 0.7652 0.7644 -0.0008
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 0 0 0.0
p11.pddl
0.6321 0.6256 -0.0065 0.5539 0.5558 0.0019
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
0.9927 0.9930 0.0003 0.5697 0.5620 -0.0078
p14.pddl
1.0000 1.0000 0.0 0.5164 0.5174 0.0011
p15.pddl
0.9108 0.9125 0.0018 0.4902 0.4903 0.0002
p16.pddl
0.8158 0.8173 0.0015 0.5679 0.5688 0.0009
p17.pddl
0.8448 0.8400 -0.0049 0.3904 0.3879 -0.0026
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
0.8831 0.8834 0.0003 0.4485 0.4481 -0.0004
p20.pddl
1.0000 1.0000 0.0 0.8118 0.8048 -0.007
Sum of diffs
-0.0119
-0.0126
Arithmetic mean of diffs
-0.0006
-0.0006
spider-opt18-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
0.9281 0.9233 -0.0048 1.0000 1.0000 0.0
p03.pddl
0.8853 0.8819 -0.0034 0.8690 0.8691 0.0001
p04.pddl
0.8281 0.8320 0.0039 0.8113 0.8064 -0.0049
p05.pddl
0.6146 0.6062 -0.0084 0.7324 0.7316 -0.0009
p06.pddl
0.4211 0.4268 0.0058 0.3629 0.3617 -0.0011
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
0.6412 0.6470 0.0058 0.8913 0.8943 0.003
p10.pddl
0.4335 0.4459 0.0124 0.6700 0.6649 -0.0051
p11.pddl
0.6870 0.6855 -0.0015 0.7349 0.7346 -0.0002
p12.pddl
0.5357 0.5376 0.002 0.5205 0.5208 0.0003
p13.pddl
0.3001 0.3043 0.0043 0.6141 0.6195 0.0053
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
0.9194 0.9310 0.0116 0.9149 0.9155 0.0006
p17.pddl
0.8558 0.8547 -0.0011 0.8821 0.8757 -0.0064
p18.pddl
0.7332 0.7489 0.0157 0.6077 0.6150 0.0073
p19.pddl
0.6511 0.6634 0.0122 0.7115 0.7080 -0.0036
p20.pddl
0.5837 0.6112 0.0275 0.6298 0.6353 0.0055
Sum of diffs
0.0819
-0.0000
Arithmetic mean of diffs
0.0041
-0.0000
storage
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 0.9119 0.9133 0.0014
p17.pddl
1.0000 1.0000 0.0 0.5357 0.5341 -0.0016
p18.pddl
0.4689 0.4667 -0.0022 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0.5315 0.5190 -0.0124 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0146
-0.0002
Arithmetic mean of diffs
-0.0005
-0.0000
termes-opt18-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.5909 0.5905 -0.0004 0.7915 0.7855 -0.006
p06.pddl
0.7618 0.7620 0.0002 0.6837 0.6876 0.0039
p07.pddl
0.4297 0.4311 0.0013 0.3820 0.3843 0.0022
p08.pddl
0.3966 0.3972 0.0006 0.5759 0.5795 0.0036
p09.pddl
0 0 0.0 0 0 0.0
p10.pddl
0.2028 0.2069 0.0042 0 0 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
0.8423 0.8431 0.0007 1.0000 1.0000 0.0
p16.pddl
0.9320 0.9315 -0.0004 0.9563 0.9611 0.0048
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0062
0.0086
Arithmetic mean of diffs
0.0003
0.0004
tetris-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
0.9844 0.9817 -0.0027 1.0000 1.0000 0.0
p01-8.pddl
0.9019 0.9071 0.0052 1.0000 1.0000 0.0
p01-10.pddl
0.2671 0.2654 -0.0017 0.9882 0.9886 0.0004
p02-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02-6.pddl
0.9936 0.9839 -0.0097 1.0000 1.0000 0.0
p02-8.pddl
0.9440 0.9469 0.003 1.0000 1.0000 0.0
p02-10.pddl
0.5616 0.5645 0.0028 1.0000 1.0000 0.0
p03-4.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03-8.pddl
0.8426 0.8408 -0.0018 1.0000 1.0000 0.0
p03-10.pddl
0.7332 0.7400 0.0068 0.9788 0.9677 -0.0111
p04-6.pddl
0.9983 0.9979 -0.0004 1.0000 1.0000 0.0
p04-8.pddl
0.7119 0.7136 0.0017 1.0000 1.0000 0.0
p04-10.pddl
0.6740 0.6753 0.0014 1.0000 1.0000 0.0
p05-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05-8.pddl
0.2950 0.2964 0.0013 1.0000 1.0000 0.0
p05-10.pddl
0.7874 0.7788 -0.0086 0.9898 0.9938 0.004
Sum of diffs
-0.0026
-0.0067
Arithmetic mean of diffs
-0.0002
-0.0004
tidybot-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
0.9477 0.9656 0.0179 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
0.9954 0.9788 -0.0166 1.0000 1.0000 0.0
p08.pddl
0.0172 0.0053 -0.0119 1.0000 1.0000 0.0
p09.pddl
0.7350 0.7288 -0.0062 0.9579 0.9642 0.0062
p10.pddl
0.9476 0.9387 -0.0089 0.9910 0.9877 -0.0033
p11.pddl
0.9113 0.8886 -0.0227 0.9717 0.9760 0.0043
p12.pddl
0.9065 0.9220 0.0155 0.9926 0.9895 -0.0031
p13.pddl
0.7521 0.7438 -0.0084 0.9932 0.9860 -0.0072
p14.pddl
0.8522 0.8522 -0.0001 0.9425 0.9608 0.0183
p15.pddl
0 0 0.0 0.9357 0.9345 -0.0012
p16.pddl
0.8342 0.8621 0.0279 0.9353 0.9355 0.0002
p17.pddl
0.7442 0.7352 -0.009 0.8894 0.8923 0.0029
p18.pddl
0.6041 0.6217 0.0176 0.9051 0.9067 0.0016
p19.pddl
0.8502 0.8278 -0.0224 0.9227 0.9250 0.0023
p20.pddl
0.7996 0.8174 0.0178 0.8794 0.8736 -0.0058
Sum of diffs
-0.0093
0.0151
Arithmetic mean of diffs
-0.0005
0.0008
tidybot-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.8208 0.8206 -0.0001 0.6537 0.6506 -0.0031
p02.pddl
0.8066 0.8124 0.0058 0.9425 0.9363 -0.0062
p03.pddl
0.8483 0.8634 0.0151 0.9247 0.9379 0.0133
p04.pddl
0.9006 0.8770 -0.0236 0.9422 0.9400 -0.0022
p05.pddl
0.7766 0.7565 -0.0201 0.8811 0.8798 -0.0013
p06.pddl
0.6448 0.6798 0.035 0.8541 0.8560 0.002
p07.pddl
0.8360 0.8406 0.0046 0.9241 0.9267 0.0026
p08.pddl
0.8576 0.8524 -0.0052 0.9384 0.9451 0.0066
p09.pddl
0.7907 0.8130 0.0222 0.8861 0.8805 -0.0056
p10.pddl
0.7414 0.7666 0.0252 0.8584 0.8568 -0.0015
p11.pddl
0.8869 0.8911 0.0042 0.9686 0.9725 0.0039
p12.pddl
0.9278 0.9252 -0.0026 0.9889 0.9944 0.0055
p13.pddl
0.7437 0.7562 0.0126 0.9895 0.9986 0.0092
p14.pddl
0.8840 0.8711 -0.0129 0.9554 0.9483 -0.0071
p15.pddl
0 0 0.0 0.9337 0.9363 0.0026
p16.pddl
0.8755 0.8695 -0.006 0.9394 0.9376 -0.0018
p17.pddl
0.7489 0.6990 -0.0498 0.8906 0.8906 0.0
p18.pddl
0.6022 0.6285 0.0262 0.9066 0.9065 -0.0002
p19.pddl
0.8506 0.8400 -0.0106 0.9206 0.9194 -0.0012
p20.pddl
0.8048 0.8068 0.002 0.8705 0.8708 0.0004
Sum of diffs
0.0219
0.0158
Arithmetic mean of diffs
0.0011
0.0008
tpp
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 0.8670 0.8709 0.0038
p17.pddl
1.0000 1.0000 0.0 0.5383 0.5419 0.0036
p18.pddl
1.0000 1.0000 0.0 0.6900 0.6903 0.0002
p19.pddl
1.0000 1.0000 0.0 0.5782 0.5777 -0.0005
p20.pddl
1.0000 1.0000 0.0 0.4371 0.4369 -0.0003
p21.pddl
1.0000 1.0000 0.0 0.7404 0.7494 0.009
p22.pddl
1.0000 1.0000 0.0 0.7354 0.7380 0.0026
p23.pddl
1.0000 1.0000 0.0 0.6090 0.6146 0.0056
p24.pddl
0.9354 0.9260 -0.0094 0.6536 0.6469 -0.0067
p25.pddl
0.9676 0.9603 -0.0074 0.4658 0.4645 -0.0013
p26.pddl
0.8964 0.8923 -0.0041 0.4542 0.4530 -0.0012
p27.pddl
0.8636 0.8611 -0.0025 0.4615 0.4603 -0.0012
p28.pddl
0.8438 0.8395 -0.0043 0 0 0.0
p29.pddl
0.7403 0.7258 -0.0145 0 0 0.0
p30.pddl
0.7580 0.7578 -0.0002 0 0 0.0
Sum of diffs
-0.0424
0.0137
Arithmetic mean of diffs
-0.0014
0.0005
transport-opt08-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 0.9410 0.9381 -0.0029
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 0.8388 0.8463 0.0075
p18.pddl
1.0000 1.0000 0.0 0.7750 0.7698 -0.0052
p19.pddl
1.0000 1.0000 0.0 0.6586 0.6607 0.0021
p20.pddl
1.0000 1.0000 0.0 0.5650 0.5608 -0.0042
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p27.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p28.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
-0.0026
Arithmetic mean of diffs
0.0000
-0.0001
transport-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
transport-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 0.9879 0.9869 -0.001
p11.pddl
1.0000 1.0000 0.0 0.8621 0.8673 0.0052
p12.pddl
1.0000 1.0000 0.0 0.7746 0.7703 -0.0043
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 0.9528 0.9550 0.0022
p17.pddl
1.0000 1.0000 0.0 0.8807 0.8753 -0.0054
p18.pddl
1.0000 1.0000 0.0 0.8294 0.8244 -0.005
p19.pddl
1.0000 1.0000 0.0 0.9552 0.9601 0.0049
p20.pddl
1.0000 1.0000 0.0 0.9639 0.9607 -0.0032
Sum of diffs
0.0000
-0.0065
Arithmetic mean of diffs
0.0000
-0.0003
trucks-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 0.9685 0.9675 -0.001
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 0.4832 0.4885 0.0053
p08.pddl
1.0000 1.0000 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 0 0 0.0
p10.pddl
0.7878 0.7883 0.0005 0 0 0.0
p11.pddl
0.9515 0.9580 0.0064 0 0 0.0
p12.pddl
0.5984 0.5958 -0.0026 0 0 0.0
p13.pddl
0.3834 0.3815 -0.0019 0 0 0.0
p14.pddl
0.8001 0.7975 -0.0026 0 0 0.0
p15.pddl
0.4194 0.4228 0.0034 0 0 0.0
p16.pddl
0.2067 0.2050 -0.0018 0 0 0.0
p17.pddl
0.2669 0.2644 -0.0025 0 0 0.0
p18.pddl
0 0 0.0 0 0 0.0
p19.pddl
0 0 0.0 0 0 0.0
p20.pddl
0 0 0.0 0 0 0.0
p21.pddl
0 0 0.0 0 0 0.0
p22.pddl
0 0 0.0 0 0 0.0
p23.pddl
0 0 0.0 0 0 0.0
p24.pddl
0 0 0.0 0 0 0.0
p25.pddl
0 0 0.0 0 0 0.0
p26.pddl
0 0 0.0 0 0 0.0
p27.pddl
0 0 0.0 0 0 0.0
p28.pddl
0 0 0.0 0 0 0.0
p29.pddl
0 0 0.0 0 0 0.0
p30.pddl
0 0 0.0 0 0 0.0
Sum of diffs
-0.0010
0.0043
Arithmetic mean of diffs
-0.0000
0.0001
visitall-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem02-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem03-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem03-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem04-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem04-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem05-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem05-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem06-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem06-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem07-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem07-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem08-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem08-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem09-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem09-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem10-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem10-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem11-full.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
problem11-half.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
visitall-opt14-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-9.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-1-18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-5.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-6.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-7.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-8.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-9.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p-05-10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0000
Arithmetic mean of diffs
0.0000
0.0000
woodworking-opt08-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 0 0 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 0 0 0.0
p09.pddl
1.0000 1.0000 0.0 0 0 0.0
p10.pddl
1.0000 1.0000 0.0 0.9395 0.9426 0.0031
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 0 0 0.0
p17.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p21.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p22.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p23.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p24.pddl
1.0000 1.0000 0.0 0.3028 0.3052 0.0024
p25.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p26.pddl
1.0000 1.0000 0.0 0 0 0.0
p27.pddl
1.0000 1.0000 0.0 0 0 0.0
p28.pddl
1.0000 1.0000 0.0 0 0 0.0
p29.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p30.pddl
1.0000 1.0000 0.0 0.6742 0.6782 0.0041
Sum of diffs
0.0000
0.0095
Arithmetic mean of diffs
0.0000
0.0003
woodworking-opt11-strips
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 0.3054 0.3071 0.0017
p06.pddl
1.0000 1.0000 0.0 0 0 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 0 0 0.0
p12.pddl
1.0000 1.0000 0.0 0 0 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 0 0 0.0
p15.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p16.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p17.pddl
1.0000 1.0000 0.0 0 0 0.0
p18.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p19.pddl
1.0000 1.0000 0.0 0 0 0.0
p20.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
Sum of diffs
0.0000
0.0017
Arithmetic mean of diffs
0.0000
0.0001
zenotravel
Show table
score_total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p02.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p03.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p04.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p05.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p06.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p07.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p08.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p09.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p10.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p11.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p12.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p13.pddl
1.0000 1.0000 0.0 1.0000 1.0000 0.0
p14.pddl
1.0000 1.0000 0.0 0.8613 0.8604 -0.0009
p15.pddl
1.0000 1.0000 0.0 0.9564 0.9528 -0.0036
p16.pddl
1.0000 1.0000 0.0 0.7602 0.7600 -0.0002
p17.pddl
1.0000 1.0000 0.0 0.5371 0.5368 -0.0002
p18.pddl
1.0000 1.0000 0.0 0.7811 0.7799 -0.0011
p19.pddl
1.0000 1.0000 0.0 0.7330 0.7328 -0.0002
p20.pddl
0.9641 0.9762 0.0121 0.6457 0.6503 0.0046
Sum of diffs
0.0121
-0.0016
Arithmetic mean of diffs
0.0006
-0.0001
search_time
Show table
Only instances where all algorithms have a value for "search_time" are considered. Each table entry gives the geometric mean of "search_time" for that domain. The bottom row reports the geometric mean across all domains.
agricola-opt18-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.07 0.07 0.0 0.62 0.62 0.0
p02.pddl
0.49 0.50 0.01 0.67 0.69 0.02
p03.pddl
0.26 0.24 -0.02 0.77 0.77 0.0
p04.pddl
0.14 0.14 -0.0 0.86 0.87 0.0
p05.pddl
0.19 0.18 -0.01 0.69 0.67 -0.03
p06.pddl
0.26 0.24 -0.02 1.36 1.36 0.0
p07.pddl
0.80 0.77 -0.03 0.80 0.81 0.02
p08.pddl
0.24 0.24 0.0 1.09 1.09 -0.01
p09.pddl
0.38 0.40 0.03 1.18 1.20 0.02
p10.pddl
0.87 0.89 0.02 0.69 0.65 -0.04
p11.pddl
0.38 0.35 -0.03 1.06 1.05 -0.01
p12.pddl
0.79 0.80 0.01 1.04 1.05 0.01
p13.pddl
0.31 0.32 0.01 0.72 0.77 0.05
p14.pddl
0.36 0.35 -0.01 0.93 0.87 -0.06
p15.pddl
1.92 2.11 0.19 1.44 1.43 -0.0
p16.pddl
0.29 0.30 0.01 1.21 1.22 0.01
p17.pddl
0.52 0.51 -0.01 1.18 1.24 0.06
p18.pddl
5.00 5.20 0.2 1.43 1.36 -0.07
p19.pddl
0.36 0.35 -0.01 0.94 0.95 0.0
p20.pddl
0.83 0.81 -0.03 1.27 1.27 0.0
Sum of diffs
0.32
-0.00
Arithmetic mean of diffs
0.02
-0.00
airport
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02-airport1-p1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03-airport1-p2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04-airport2-p1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05-airport2-p1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06-airport2-p2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07-airport2-p2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08-airport2-p3.pddl
0.03 0.03 -0.0 0.01 0.01 0.0
p09-airport2-p4.pddl
0.06 0.06 0.0 0.17 0.17 -0.0
p10-airport3-p1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11-airport3-p1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12-airport3-p2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13-airport3-p2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p14-airport3-p3.pddl
0.28 0.28 0.0 0.01 0.01 0.0
p15-airport3-p3.pddl
0.04 0.04 0.0 0.01 0.01 0.0
p16-airport3-p4.pddl
2.69 2.66 -0.03 0.24 0.24 0.0
p17-airport3-p5.pddl
0.96 0.98 0.02 5.27 5.26 -0.01
p18-airport3-p6.pddl
3.95 3.97 0.02 54.67 53.73 -0.94
p19-airport3-p6.pddl
0.84 0.84 0.01 77.38 75.61 -1.77
p20-airport3-p7.pddl
10.04 9.96 -0.08 535.79 547.85 12.05
p21-airport4halfMUC-p2.pddl
0.11 0.11 -0.0 0.02 0.01 -0.0
p22-airport4halfMUC-p3.pddl
19.65 19.75 0.1 0.03 0.03 0.0
p23-airport4halfMUC-p4.pddl
38.62 37.25 -1.37 0.05 0.05 0.0
p24-airport4halfMUC-p4.pddl
33.67 33.99 0.32 0.05 0.05 0.0
p25-airport4halfMUC-p5.pddl
49.51 51.53 2.02 None None -
p26-airport4halfMUC-p6.pddl
None None - None None -
p27-airport4halfMUC-p6.pddl
61.00 59.94 -1.06 None None -
p28-airport4halfMUC-p7.pddl
None None - None None -
p29-airport4halfMUC-p8.pddl
None None - None None -
p30-airport4halfMUC-p8.pddl
None None - None None -
p31-airport4halfMUC-p9.pddl
None None - None None -
p32-airport4halfMUC-p10.pddl
None None - None None -
p33-airport4halfMUC-p10.pddl
None None - None None -
p34-airport4halfMUC-p11.pddl
None None - None None -
p35-airport4halfMUC-p12.pddl
None None - None None -
p36-airport5MUC-p2.pddl
0.04 0.04 0.0 0.03 0.03 0.0
p37-airport5MUC-p3.pddl
20.26 20.14 -0.12 42.80 42.70 -0.1
p38-airport5MUC-p3.pddl
26.81 26.51 -0.3 5.23 5.12 -0.11
p39-airport5MUC-p4.pddl
43.91 42.46 -1.45 None None -
p40-airport5MUC-p4.pddl
4.87 4.83 -0.04 57.68 57.01 -0.67
p41-airport5MUC-p4.pddl
34.32 35.09 0.77 None None -
p42-airport5MUC-p5.pddl
None None - None None -
p43-airport5MUC-p5.pddl
47.79 48.33 0.54 13.66 13.97 0.32
p44-airport5MUC-p5.pddl
61.80 62.86 1.06 None None -
p45-airport5MUC-p6.pddl
None None - None None -
p46-airport5MUC-p6.pddl
None None - None None -
p47-airport5MUC-p8.pddl
None None - None None -
p48-airport5MUC-p9.pddl
None None - None None -
p49-airport5MUC-p10.pddl
None None - None None -
p50-airport5MUC-p15.pddl
None None - None None -
Sum of diffs
0.41
8.77
Arithmetic mean of diffs
0.01
0.30
barman-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
0.03 0.03 0.0 0.07 0.07 -0.0
pfile01-002.pddl
0.02 0.02 -0.0 0.05 0.05 -0.0
pfile01-003.pddl
0.02 0.02 0.0 0.05 0.05 -0.0
pfile01-004.pddl
0.02 0.01 -0.0 0.05 0.05 0.0
pfile02-005.pddl
0.04 0.04 0.0 0.24 0.25 0.01
pfile02-006.pddl
0.03 0.03 0.0 3.38 3.26 -0.12
pfile02-007.pddl
0.03 0.03 0.0 0.24 0.23 -0.0
pfile02-008.pddl
0.03 0.03 0.0 0.31 0.30 -0.01
pfile03-009.pddl
0.06 0.06 -0.0 0.98 1.00 0.02
pfile03-010.pddl
0.10 0.10 0.0 1.00 0.97 -0.03
pfile03-011.pddl
0.06 0.06 0.0 1.08 1.00 -0.08
pfile03-012.pddl
0.09 0.09 0.0 1.09 1.08 -0.01
pfile04-013.pddl
0.14 0.14 0.0 4.56 4.71 0.15
pfile04-014.pddl
0.14 0.14 0.0 10.77 11.28 0.51
pfile04-015.pddl
0.20 0.20 0.0 5.28 5.14 -0.14
pfile04-016.pddl
0.20 0.20 -0.0 4.51 4.73 0.22
pfile05-017.pddl
0.19 0.19 0.0 8.33 8.22 -0.11
pfile05-018.pddl
0.18 0.18 -0.0 10.12 10.19 0.07
pfile05-019.pddl
0.19 0.21 0.01 15.92 16.08 0.17
pfile05-020.pddl
0.16 0.16 0.0 22.81 22.28 -0.53
Sum of diffs
0.02
0.11
Arithmetic mean of diffs
0.00
0.01
barman-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
0.04 0.04 0.0 3.28 3.28 -0.01
p435-2.pddl
0.05 0.05 0.0 0.26 0.24 -0.01
p435-3.pddl
0.04 0.03 -0.0 3.24 3.35 0.12
p536-1.pddl
0.06 0.06 0.0 33.72 32.85 -0.87
p536-2.pddl
0.10 0.10 0.0 0.96 0.98 0.01
p536-3.pddl
0.06 0.06 -0.0 1.10 0.99 -0.12
p638-1.pddl
0.12 0.11 -0.0 4.71 4.52 -0.19
p638-2.pddl
0.08 0.08 0.0 9.58 9.17 -0.41
p638-3.pddl
0.15 0.15 -0.0 5.30 5.08 -0.22
p739-1.pddl
0.16 0.16 0.0 14.16 14.79 0.63
p739-2.pddl
0.29 0.29 -0.0 16.37 16.53 0.16
p739-3.pddl
0.20 0.20 -0.0 16.43 16.51 0.08
p839-1.pddl
0.28 0.28 0.0 29.39 30.74 1.35
p839-2.pddl
0.25 0.26 0.01 26.88 26.51 -0.36
Sum of diffs
0.02
0.16
Arithmetic mean of diffs
0.00
0.01
blocks
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-4-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-4-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-5-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-5-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-5-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-6-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-6-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-6-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-7-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-7-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-7-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-8-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-8-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-8-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-9-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-9-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-9-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-10-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-10-1.pddl
0.01 0.01 0.0 0.03 0.03 -0.0
probBLOCKS-10-2.pddl
0.01 0.01 0.0 0.02 0.02 0.0
probBLOCKS-11-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-11-1.pddl
0.01 0.01 0.0 0.04 0.04 -0.0
probBLOCKS-11-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-12-0.pddl
0.01 0.01 0.0 0.02 0.02 0.0
probBLOCKS-12-1.pddl
0.01 0.01 0.0 0.04 0.04 -0.0
probBLOCKS-13-0.pddl
0.02 0.02 -0.0 0.03 0.03 -0.0
probBLOCKS-13-1.pddl
0.01 0.02 0.0 0.03 0.03 -0.0
probBLOCKS-14-0.pddl
0.01 0.01 0.0 0.02 0.02 0.0
probBLOCKS-14-1.pddl
0.01 0.01 0.0 0.04 0.04 0.0
probBLOCKS-15-0.pddl
0.04 0.04 -0.0 0.06 0.06 0.0
probBLOCKS-15-1.pddl
0.01 0.01 0.0 0.59 0.59 -0.0
probBLOCKS-16-1.pddl
0.02 0.02 -0.0 0.13 0.13 -0.01
probBLOCKS-16-2.pddl
0.10 0.10 0.0 0.10 0.10 0.01
probBLOCKS-17-0.pddl
0.12 0.12 0.0 3.83 4.14 0.32
Sum of diffs
-0.00
0.31
Arithmetic mean of diffs
-0.00
0.01
childsnack-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
0.01 0.01 -0.0 6.11 5.73 -0.37
child-snack_pfile01.pddl
0.01 0.01 0.0 6.49 6.21 -0.28
child-snack_pfile02-2.pddl
0.02 0.02 0.0 35.55 33.74 -1.81
child-snack_pfile02.pddl
0.01 0.01 0.0 38.73 38.97 0.24
child-snack_pfile03-2.pddl
0.06 0.06 -0.0 181.08 180.59 -0.49
child-snack_pfile03.pddl
0.05 0.05 0.0 189.21 185.06 -4.16
child-snack_pfile04-2.pddl
0.07 0.07 -0.0 None None -
child-snack_pfile04.pddl
0.09 0.09 -0.0 None None -
child-snack_pfile05-2.pddl
0.12 0.13 0.01 None None -
child-snack_pfile05.pddl
0.12 0.12 -0.0 None None -
child-snack_pfile06-2.pddl
0.17 0.16 -0.0 None None -
child-snack_pfile06.pddl
0.18 0.18 -0.0 None None -
child-snack_pfile07-2.pddl
0.25 0.27 0.02 None None -
child-snack_pfile07.pddl
0.33 0.33 -0.0 None None -
child-snack_pfile08-2.pddl
0.35 0.35 -0.0 None None -
child-snack_pfile08.pddl
None None - None None -
child-snack_pfile09-2.pddl
None None - None None -
child-snack_pfile09.pddl
None None - None None -
child-snack_pfile10-2.pddl
None None - None None -
child-snack_pfile10.pddl
None None - None None -
Sum of diffs
0.02
-6.87
Arithmetic mean of diffs
0.00
-1.14
data-network-opt18-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 -0.0 19.51 19.79 0.27
p08.pddl
0.27 0.25 -0.02 0.02 0.02 -0.0
p09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p14.pddl
0.10 0.11 0.0 0.01 0.01 0.0
p15.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p16.pddl
0.02 0.02 0.0 0.12 0.11 -0.0
p17.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p18.pddl
0.63 0.62 -0.01 9.08 8.80 -0.28
p19.pddl
0.01 0.01 0.0 0.55 0.59 0.03
p20.pddl
0.21 0.23 0.01 39.92 41.17 1.25
Sum of diffs
-0.01
1.27
Arithmetic mean of diffs
-0.00
0.06
depot
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.12 0.12 -0.0 0.05 0.05 -0.0
p04.pddl
0.08 0.08 -0.0 0.01 0.01 0.0
p05.pddl
4.34 4.38 0.04 0.01 0.01 0.0
p06.pddl
746.04 759.66 13.62 0.01 0.02 0.0
p07.pddl
0.02 0.02 0.0 0.77 0.80 0.03
p08.pddl
0.44 0.45 0.01 0.03 0.03 0.0
p09.pddl
3.59 3.69 0.09 7.26 7.28 0.02
p10.pddl
0.43 0.44 0.01 0.02 0.02 0.0
p11.pddl
1.86 1.85 -0.01 0.04 0.04 0.0
p12.pddl
6.48 6.43 -0.05 None None -
p13.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p14.pddl
0.07 0.06 -0.01 15.20 14.81 -0.39
p15.pddl
69.13 67.84 -1.29 151.48 152.09 0.61
p16.pddl
0.02 0.02 -0.0 15.63 15.28 -0.35
p17.pddl
0.02 0.02 -0.0 0.23 0.23 -0.01
p18.pddl
0.23 0.22 -0.0 None None -
p19.pddl
1.66 1.65 -0.02 258.33 267.04 8.72
p20.pddl
None None - 1.43 1.43 -0.01
p21.pddl
0.09 0.09 0.0 71.08 72.29 1.2
p22.pddl
None None - None None -
Sum of diffs
12.39
9.83
Arithmetic mean of diffs
0.62
0.52
driverlog
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.07 0.07 -0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.07 0.07 -0.0 0.01 0.01 0.0
p05.pddl
0.09 0.08 -0.0 0.04 0.04 0.0
p06.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.13 0.12 -0.0 0.01 0.01 0.0
p09.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.21 0.21 -0.0 0.01 0.01 0.0
p13.pddl
0.11 0.11 -0.0 0.01 0.01 -0.0
p14.pddl
0.01 0.01 -0.0 0.02 0.02 0.0
p15.pddl
0.02 0.02 0.0 0.20 0.21 0.0
p16.pddl
3.20 3.16 -0.04 1.43 1.45 0.02
p17.pddl
0.20 0.21 0.01 None None -
p18.pddl
5.71 5.84 0.13 6.60 6.87 0.26
p19.pddl
6.58 6.62 0.05 30.45 30.88 0.42
p20.pddl
4.45 4.32 -0.13 8.85 8.81 -0.04
Sum of diffs
-0.01
0.67
Arithmetic mean of diffs
-0.00
0.04
elevators-opt08-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.04 0.04 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p06.pddl
0.01 0.01 0.0 0.03 0.03 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p09.pddl
0.01 0.01 -0.0 0.05 0.05 -0.0
p10.pddl
0.01 0.01 0.0 0.04 0.04 -0.0
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p14.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p15.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p16.pddl
0.01 0.01 0.0 0.07 0.08 0.0
p17.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p18.pddl
0.01 0.01 0.0 0.03 0.03 0.0
p19.pddl
0.01 0.01 -0.0 0.03 0.03 0.0
p20.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p21.pddl
0.01 0.01 0.0 0.04 0.04 0.0
p22.pddl
0.01 0.01 0.0 0.10 0.10 -0.0
p23.pddl
0.01 0.01 0.0 0.07 0.07 0.0
p24.pddl
0.01 0.01 0.0 0.25 0.25 -0.01
p25.pddl
0.01 0.01 0.0 0.04 0.04 0.0
p26.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p27.pddl
0.01 0.01 0.0 0.05 0.05 -0.0
p28.pddl
0.01 0.01 0.0 0.06 0.06 -0.0
p29.pddl
0.01 0.01 0.0 0.07 0.08 0.0
p30.pddl
0.02 0.02 -0.0 0.59 0.57 -0.02
Sum of diffs
0.00
-0.03
Arithmetic mean of diffs
0.00
-0.00
elevators-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.04 0.04 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.04 0.04 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p09.pddl
0.01 0.01 0.0 0.10 0.10 -0.0
p10.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
p11.pddl
0.01 0.01 0.0 0.06 0.06 0.0
p12.pddl
0.01 0.01 0.0 0.03 0.03 0.0
p13.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p14.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
p15.pddl
0.01 0.01 -0.0 0.05 0.05 0.0
p16.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p17.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p18.pddl
0.01 0.01 0.0 0.03 0.03 0.0
p19.pddl
0.01 0.01 0.0 0.07 0.07 0.0
p20.pddl
0.01 0.01 0.0 0.25 0.24 -0.0
Sum of diffs
-0.00
-0.00
Arithmetic mean of diffs
-0.00
-0.00
floortile-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
0.03 0.03 0.0 2.31 2.31 0.0
opt-p01-002.pddl
0.01 0.01 0.0 1.43 1.41 -0.02
opt-p02-003.pddl
14.88 15.27 0.39 None None -
opt-p02-004.pddl
8.55 8.00 -0.55 None None -
opt-p03-005.pddl
12.46 13.02 0.56 None None -
opt-p03-006.pddl
90.48 90.84 0.36 None None -
opt-p04-007.pddl
152.23 155.44 3.2 None None -
opt-p04-008.pddl
390.29 404.53 14.24 None None -
opt-p05-009.pddl
89.24 85.96 -3.29 None None -
opt-p05-010.pddl
None None - None None -
opt-p06-011.pddl
None None - None None -
opt-p06-012.pddl
None None - None None -
opt-p07-013.pddl
None None - None None -
opt-p07-014.pddl
None None - None None -
opt-p08-015.pddl
None None - None None -
opt-p08-016.pddl
None None - None None -
opt-p09-017.pddl
None None - None None -
opt-p09-018.pddl
None None - None None -
opt-p10-019.pddl
None None - None None -
opt-p10-020.pddl
None None - None None -
Sum of diffs
14.92
-0.02
Arithmetic mean of diffs
1.66
-0.01
floortile-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
10.47 10.48 0.01 None None -
p01-4-4-2.pddl
220.93 222.30 1.37 None None -
p01-5-3-2.pddl
156.78 160.45 3.67 None None -
p01-5-4-2.pddl
None None - None None -
p01-5-5-2.pddl
None None - None None -
p01-6-4-2.pddl
None None - None None -
p01-6-5-2.pddl
None None - None None -
p02-4-4-2.pddl
261.12 272.84 11.72 None None -
p02-5-3-2.pddl
77.50 78.63 1.13 None None -
p02-5-4-2.pddl
None None - None None -
p02-5-5-2.pddl
None None - None None -
p02-6-4-2.pddl
None None - None None -
p02-6-5-2.pddl
None None - None None -
p03-4-3-2.pddl
12.69 12.77 0.08 None None -
p03-4-4-2.pddl
193.31 191.38 -1.93 None None -
p03-5-3-2.pddl
86.29 84.45 -1.84 None None -
p03-5-4-2.pddl
208.45 205.10 -3.35 None None -
p03-5-5-2.pddl
None None - None None -
p03-6-4-2.pddl
None None - None None -
p03-6-5-2.pddl
None None - None None -
Sum of diffs
10.87
None
Arithmetic mean of diffs
1.21
None
freecell
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p07.pddl
0.21 0.21 -0.0 0.02 0.02 -0.0
p08.pddl
0.03 0.03 0.0 0.01 0.01 0.0
p09.pddl
0.03 0.03 0.0 0.01 0.01 0.0
p10.pddl
0.21 0.21 -0.0 0.01 0.01 0.0
p11.pddl
1.16 1.16 0.0 0.03 0.03 -0.0
p12.pddl
0.04 0.04 0.0 0.01 0.01 0.0
p13.pddl
1.63 1.62 -0.01 0.01 0.01 0.0
p14.pddl
0.08 0.08 0.0 0.01 0.01 0.0
p15.pddl
0.21 0.23 0.01 0.01 0.01 0.0
p16.pddl
0.19 0.20 0.01 0.02 0.02 -0.0
p17.pddl
0.20 0.19 -0.0 0.01 0.01 0.0
p18.pddl
0.95 1.06 0.1 0.36 0.37 0.01
p19.pddl
16.50 15.66 -0.85 0.36 0.36 0.0
p20.pddl
0.58 0.65 0.08 0.22 0.22 0.0
probfreecell-2-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-2-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-2-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-2-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-2-5.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-3-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-3-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-3-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-3-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-3-5.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-4-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-4-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-4-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-4-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-4-5.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-5-1.pddl
0.01 0.02 0.0 0.01 0.01 0.0
probfreecell-5-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-5-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-5-4.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
probfreecell-5-5.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probfreecell-6-1.pddl
0.02 0.02 0.0 0.01 0.01 0.0
probfreecell-6-2.pddl
0.02 0.02 0.0 0.01 0.01 0.0
probfreecell-6-3.pddl
0.02 0.02 0.0 0.01 0.01 0.0
probfreecell-6-4.pddl
0.02 0.02 0.0 0.01 0.01 0.0
probfreecell-6-5.pddl
0.02 0.02 0.0 0.01 0.01 0.0
probfreecell-7-1.pddl
0.04 0.04 0.0 0.01 0.01 0.0
probfreecell-7-2.pddl
0.02 0.02 0.0 0.01 0.01 0.0
probfreecell-7-3.pddl
0.04 0.04 0.01 0.01 0.01 0.0
probfreecell-7-4.pddl
0.05 0.05 0.0 0.01 0.01 0.0
probfreecell-7-5.pddl
0.04 0.04 0.0 0.01 0.01 0.0
probfreecell-8-1.pddl
0.10 0.10 0.0 0.01 0.01 0.0
probfreecell-8-2.pddl
0.05 0.05 -0.0 0.01 0.01 0.0
probfreecell-8-3.pddl
0.06 0.06 0.0 0.01 0.01 0.0
probfreecell-8-4.pddl
0.06 0.06 -0.0 0.01 0.01 0.0
probfreecell-8-5.pddl
0.09 0.09 0.0 0.01 0.01 0.0
probfreecell-9-1.pddl
0.13 0.13 -0.01 0.01 0.01 0.0
probfreecell-9-2.pddl
0.08 0.08 0.0 0.01 0.01 0.0
probfreecell-9-3.pddl
0.08 0.07 -0.0 0.01 0.01 0.0
probfreecell-9-4.pddl
0.11 0.11 0.0 0.01 0.01 0.0
probfreecell-9-5.pddl
0.12 0.12 -0.01 0.01 0.01 0.0
probfreecell-10-1.pddl
1.45 1.52 0.06 0.03 0.03 0.0
probfreecell-10-2.pddl
0.12 0.12 -0.0 0.01 0.01 -0.0
probfreecell-10-3.pddl
0.17 0.17 -0.0 0.05 0.05 0.0
probfreecell-10-4.pddl
0.22 0.20 -0.02 0.04 0.04 -0.0
probfreecell-10-5.pddl
0.48 0.46 -0.02 0.01 0.01 0.0
probfreecell-11-1.pddl
0.26 0.26 0.0 0.16 0.16 -0.0
probfreecell-11-2.pddl
0.36 0.36 0.0 0.38 0.38 -0.0
probfreecell-11-3.pddl
0.22 0.22 -0.0 0.08 0.08 -0.0
probfreecell-11-4.pddl
0.25 0.25 0.0 0.01 0.01 -0.0
probfreecell-11-5.pddl
None None - 0.02 0.02 0.0
probfreecell-12-1.pddl
18.29 16.82 -1.47 0.27 0.27 -0.0
probfreecell-12-2.pddl
0.89 0.75 -0.14 0.07 0.07 0.0
probfreecell-12-3.pddl
0.18 0.19 0.01 0.05 0.05 0.0
probfreecell-12-4.pddl
0.46 0.49 0.03 0.10 0.10 -0.0
probfreecell-12-5.pddl
632.07 638.33 6.25 0.16 0.16 -0.0
probfreecell-13-1.pddl
37.51 36.77 -0.74 0.26 0.25 -0.01
probfreecell-13-2.pddl
17.60 19.12 1.52 0.28 0.28 0.0
probfreecell-13-3.pddl
0.47 0.47 -0.0 0.06 0.06 -0.0
probfreecell-13-4.pddl
5.44 5.16 -0.28 0.05 0.05 0.0
probfreecell-13-5.pddl
622.47 643.48 21.01 7.92 7.67 -0.25
Sum of diffs
25.57
-0.25
Arithmetic mean of diffs
0.32
-0.00
ged-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-1-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-1-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-1-8.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-2-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-2-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-2-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-2-8.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-3-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-3-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-3-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-4-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-4-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-4-8.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-7-5.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-7-6.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-8-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-8-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-8-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-8-9.pddl
0.01 0.01 0.0 0.01 0.01 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
grid
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob03.pddl
0.03 0.03 0.0 None None -
prob04.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
prob05.pddl
0.14 0.15 0.01 7.31 7.26 -0.05
Sum of diffs
0.01
-0.05
Arithmetic mean of diffs
0.00
-0.01
gripper
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob08.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob10.pddl
0.01 0.01 0.0 0.01 0.02 0.0
prob11.pddl
0.01 0.01 0.0 0.02 0.02 0.0
prob12.pddl
0.01 0.01 0.0 0.02 0.02 0.0
prob13.pddl
0.01 0.01 -0.0 0.03 0.03 0.0
prob14.pddl
0.01 0.01 -0.0 0.04 0.04 -0.0
prob15.pddl
0.01 0.01 0.0 0.05 0.05 0.0
prob16.pddl
0.01 0.01 0.0 0.06 0.06 0.0
prob17.pddl
0.02 0.02 -0.0 0.07 0.07 -0.0
prob18.pddl
0.02 0.02 0.0 0.08 0.08 0.0
prob19.pddl
0.02 0.02 -0.0 0.10 0.10 -0.0
prob20.pddl
0.02 0.02 -0.0 0.11 0.12 0.0
Sum of diffs
-0.00
0.00
Arithmetic mean of diffs
-0.00
0.00
hiking-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
ptesting-1-2-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
ptesting-1-2-5.pddl
0.05 0.05 -0.0 0.03 0.03 0.0
ptesting-1-2-7.pddl
0.25 0.25 0.0 0.17 0.17 0.0
ptesting-1-2-8.pddl
0.51 0.51 -0.0 0.36 0.36 -0.0
ptesting-2-2-3.pddl
0.01 0.01 0.0 0.03 0.03 -0.0
ptesting-2-2-4.pddl
0.09 0.09 -0.0 0.37 0.36 -0.01
ptesting-2-2-5.pddl
0.24 0.23 -0.01 0.96 0.99 0.03
ptesting-2-2-6.pddl
0.48 0.49 0.01 1.32 1.39 0.07
ptesting-2-2-7.pddl
1.23 1.18 -0.04 4.21 4.09 -0.12
ptesting-2-2-8.pddl
1.63 1.63 0.0 4.65 4.50 -0.15
ptesting-2-3-4.pddl
0.14 0.14 0.0 0.37 0.37 0.0
ptesting-2-3-5.pddl
0.33 0.34 0.01 1.27 1.35 0.08
ptesting-2-3-6.pddl
0.73 0.73 -0.0 3.84 3.97 0.14
ptesting-2-3-7.pddl
1.75 1.66 -0.08 4.81 4.73 -0.07
ptesting-2-4-3.pddl
0.01 0.01 0.0 0.09 0.10 0.01
ptesting-2-4-4.pddl
0.17 0.16 -0.01 0.59 0.62 0.04
ptesting-2-4-5.pddl
0.57 0.57 0.0 1.95 1.94 -0.01
ptesting-2-4-6.pddl
0.84 0.86 0.02 4.59 5.05 0.46
ptesting-2-4-7.pddl
1.81 1.83 0.01 12.27 11.78 -0.49
Sum of diffs
-0.09
-0.04
Arithmetic mean of diffs
-0.00
-0.00
logistics00
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-4-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-4-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-5-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-5-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-5-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-6-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-6-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-6-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-6-9.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-7-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-7-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-8-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-8-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-9-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-9-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-10-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-10-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-11-0.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
probLOGISTICS-11-1.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
probLOGISTICS-12-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-12-1.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
probLOGISTICS-13-0.pddl
0.03 0.03 -0.0 0.09 0.09 0.0
probLOGISTICS-13-1.pddl
0.02 0.02 0.0 0.07 0.07 0.0
probLOGISTICS-14-0.pddl
0.02 0.02 -0.0 0.09 0.09 0.0
probLOGISTICS-14-1.pddl
0.03 0.03 -0.0 0.13 0.13 0.0
probLOGISTICS-15-0.pddl
0.03 0.03 0.0 0.15 0.14 -0.01
probLOGISTICS-15-1.pddl
0.02 0.02 0.0 0.17 0.18 0.0
Sum of diffs
-0.00
0.00
Arithmetic mean of diffs
-0.00
0.00
logistics98
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.01 0.01 0.0 0.04 0.04 0.0
prob02.pddl
0.01 0.01 -0.0 0.72 0.70 -0.02
prob03.pddl
0.02 0.03 0.0 26.38 28.39 2.02
prob04.pddl
0.07 0.07 0.0 None None -
prob05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob06.pddl
0.14 0.14 0.0 None None -
prob07.pddl
0.02 0.02 -0.0 4.07 4.14 0.07
prob08.pddl
0.03 0.03 0.0 None None -
prob09.pddl
0.27 0.27 0.0 None None -
prob10.pddl
0.31 0.31 0.0 165.75 172.09 6.34
prob11.pddl
0.01 0.01 -0.0 3.93 4.17 0.24
prob12.pddl
0.08 0.07 -0.01 None None -
prob13.pddl
0.20 0.20 0.0 None None -
prob14.pddl
0.36 0.36 -0.0 None None -
prob15.pddl
0.09 0.09 -0.0 6.69 6.75 0.06
prob16.pddl
0.07 0.07 0.0 None None -
prob17.pddl
0.03 0.02 -0.0 None None -
prob18.pddl
2.86 2.73 -0.13 None None -
prob19.pddl
1.09 1.18 0.09 None None -
prob20.pddl
2.70 2.72 0.02 None None -
prob21.pddl
0.76 0.76 -0.0 None None -
prob22.pddl
40.20 40.22 0.02 None None -
prob23.pddl
0.27 0.27 0.0 143.31 139.94 -3.36
prob24.pddl
0.11 0.12 0.01 None None -
prob25.pddl
6.63 6.73 0.1 None None -
prob26.pddl
6.33 6.28 -0.05 None None -
prob27.pddl
3.74 3.78 0.03 None None -
prob28.pddl
170.64 123.14 -47.5 None None -
prob29.pddl
16.56 16.32 -0.24 None None -
prob30.pddl
4.74 4.77 0.03 None None -
prob31.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob32.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob33.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob34.pddl
0.03 0.03 -0.0 1.23 1.21 -0.02
prob35.pddl
0.01 0.01 0.0 0.10 0.10 0.0
Sum of diffs
-47.63
5.32
Arithmetic mean of diffs
-1.36
0.38
miconic
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s1-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s1-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s1-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s1-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s2-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s2-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s2-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s2-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s2-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s3-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s3-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s3-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s3-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s3-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s4-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s4-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s4-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s4-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s4-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s5-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s5-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s5-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s5-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s5-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s6-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s6-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s6-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s6-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s6-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s7-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s7-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s7-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s7-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s7-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s8-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s8-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s8-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s8-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s8-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s9-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s9-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s9-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s9-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s9-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s10-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s10-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s10-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s10-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s10-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s11-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s11-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s11-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s11-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s11-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s12-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s12-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s12-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s12-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s12-4.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
s13-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s13-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s13-2.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
s13-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s13-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s14-0.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
s14-1.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
s14-2.pddl
0.02 0.01 -0.0 0.01 0.01 0.0
s14-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s14-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s15-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s15-1.pddl
0.02 0.02 0.0 0.01 0.01 0.0
s15-2.pddl
0.02 0.02 0.0 0.01 0.01 0.0
s15-3.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
s15-4.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
s16-0.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
s16-1.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s16-2.pddl
0.02 0.02 0.0 0.01 0.01 0.0
s16-3.pddl
0.02 0.02 0.0 0.01 0.01 0.0
s16-4.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s17-0.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
s17-1.pddl
0.02 0.02 0.0 0.01 0.01 0.0
s17-2.pddl
0.02 0.02 0.0 0.01 0.01 0.0
s17-3.pddl
0.03 0.03 -0.0 0.01 0.01 0.0
s17-4.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
s18-0.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
s18-1.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
s18-2.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
s18-3.pddl
0.03 0.03 -0.0 0.01 0.01 -0.0
s18-4.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s19-0.pddl
0.03 0.03 -0.0 0.02 0.02 0.0
s19-1.pddl
0.03 0.03 0.0 0.02 0.01 -0.0
s19-2.pddl
0.03 0.03 -0.0 0.01 0.01 0.0
s19-3.pddl
0.03 0.03 0.0 0.01 0.01 0.0
s19-4.pddl
0.03 0.03 -0.0 0.01 0.01 -0.0
s20-0.pddl
0.03 0.03 0.0 0.01 0.01 -0.0
s20-1.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
s20-2.pddl
0.03 0.03 0.0 0.01 0.01 -0.0
s20-3.pddl
0.03 0.03 0.0 0.02 0.02 0.0
s20-4.pddl
0.03 0.03 0.0 0.02 0.02 0.0
s21-0.pddl
0.04 0.04 -0.0 0.02 0.02 -0.0
s21-1.pddl
0.04 0.04 -0.0 0.02 0.02 0.0
s21-2.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
s21-3.pddl
0.03 0.03 -0.0 0.02 0.02 -0.0
s21-4.pddl
0.03 0.03 0.0 0.02 0.02 0.0
s22-0.pddl
0.05 0.05 -0.0 0.02 0.02 0.0
s22-1.pddl
0.04 0.04 -0.0 0.02 0.02 -0.0
s22-2.pddl
0.04 0.04 -0.0 0.02 0.02 0.0
s22-3.pddl
0.04 0.05 0.0 0.02 0.02 0.0
s22-4.pddl
0.04 0.04 0.0 0.02 0.02 0.0
s23-0.pddl
0.05 0.05 0.0 0.02 0.02 0.0
s23-1.pddl
0.04 0.04 0.0 0.02 0.02 0.0
s23-2.pddl
0.04 0.04 -0.0 0.02 0.02 -0.0
s23-3.pddl
0.04 0.04 0.0 0.02 0.02 0.0
s23-4.pddl
0.04 0.05 0.0 0.02 0.02 0.0
s24-0.pddl
0.05 0.05 -0.0 0.02 0.02 0.0
s24-1.pddl
0.05 0.05 -0.0 0.02 0.02 -0.0
s24-2.pddl
0.06 0.06 -0.0 0.02 0.02 -0.0
s24-3.pddl
0.06 0.05 -0.0 0.02 0.02 0.0
s24-4.pddl
0.05 0.05 -0.0 0.02 0.03 0.0
s25-0.pddl
0.06 0.06 -0.0 0.03 0.03 -0.0
s25-1.pddl
0.07 0.07 -0.0 0.03 0.03 0.0
s25-2.pddl
0.05 0.05 -0.0 0.03 0.03 0.0
s25-3.pddl
0.07 0.06 -0.0 0.03 0.03 0.0
s25-4.pddl
0.07 0.07 0.0 0.02 0.02 0.0
s26-0.pddl
0.07 0.07 0.0 0.03 0.03 -0.0
s26-1.pddl
0.06 0.06 0.0 0.03 0.03 0.0
s26-2.pddl
0.08 0.08 0.0 0.03 0.03 0.0
s26-3.pddl
0.07 0.07 0.0 0.03 0.03 -0.0
s26-4.pddl
0.06 0.06 0.0 0.03 0.03 0.0
s27-0.pddl
0.08 0.08 -0.0 0.03 0.03 0.0
s27-1.pddl
0.07 0.07 0.0 0.03 0.03 -0.0
s27-2.pddl
0.08 0.08 -0.0 0.03 0.03 0.0
s27-3.pddl
0.07 0.07 -0.0 0.03 0.03 -0.0
s27-4.pddl
0.07 0.07 -0.0 0.03 0.03 -0.0
s28-0.pddl
0.10 0.09 -0.0 0.04 0.04 0.0
s28-1.pddl
0.09 0.08 -0.0 0.04 0.04 0.0
s28-2.pddl
0.09 0.09 -0.0 0.04 0.03 -0.0
s28-3.pddl
0.07 0.07 -0.0 0.03 0.03 0.0
s28-4.pddl
0.08 0.09 0.01 0.03 0.03 0.0
s29-0.pddl
0.08 0.09 0.0 0.04 0.04 0.0
s29-1.pddl
0.08 0.08 0.0 0.04 0.04 0.0
s29-2.pddl
0.09 0.09 -0.0 0.04 0.04 0.0
s29-3.pddl
0.10 0.10 -0.0 0.04 0.04 -0.0
s29-4.pddl
0.11 0.11 0.0 0.03 0.04 0.0
s30-0.pddl
0.09 0.09 -0.0 0.04 0.04 0.0
s30-1.pddl
0.10 0.10 -0.0 0.04 0.04 -0.0
s30-2.pddl
0.10 0.09 -0.0 0.04 0.04 0.0
s30-3.pddl
0.11 0.11 0.0 0.04 0.04 -0.0
s30-4.pddl
0.10 0.10 -0.0 0.04 0.04 0.0
Sum of diffs
-0.02
0.01
Arithmetic mean of diffs
-0.00
0.00
movie
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob08.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob12.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob13.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob14.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob15.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob16.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob17.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob18.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob19.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob20.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob21.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob22.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob23.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob24.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob25.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob26.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob27.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob28.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob29.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mprime
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob02.pddl
0.01 0.01 0.0 4.60 4.77 0.18
prob03.pddl
0.01 0.01 0.0 0.31 0.31 -0.0
prob04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob05.pddl
0.01 0.01 0.0 5.74 6.03 0.29
prob06.pddl
0.33 0.34 0.01 None None -
prob07.pddl
0.01 0.01 0.0 0.25 0.25 0.0
prob08.pddl
0.01 0.01 0.0 None None -
prob09.pddl
0.01 0.01 0.0 0.32 0.32 0.0
prob10.pddl
0.03 0.03 -0.0 None None -
prob11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob12.pddl
0.01 0.01 0.0 3.11 3.11 -0.0
prob13.pddl
0.12 0.11 -0.01 None None -
prob14.pddl
0.12 0.15 0.03 None None -
prob15.pddl
0.08 0.08 0.0 None None -
prob16.pddl
0.01 0.01 0.0 2.84 2.81 -0.03
prob17.pddl
0.01 0.01 0.0 38.60 38.91 0.31
prob18.pddl
0.20 0.21 0.01 None None -
prob19.pddl
0.04 0.04 0.0 None None -
prob20.pddl
0.05 0.06 0.0 None None -
prob21.pddl
0.11 0.12 0.0 30.46 31.96 1.49
prob22.pddl
0.15 0.13 -0.02 None None -
prob23.pddl
0.06 0.06 -0.0 None None -
prob24.pddl
0.02 0.02 0.0 None None -
prob25.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob26.pddl
0.01 0.01 0.0 52.24 48.75 -3.49
prob27.pddl
0.01 0.01 0.0 0.05 0.05 0.0
prob28.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob29.pddl
0.01 0.01 0.0 0.15 0.15 0.01
prob30.pddl
0.01 0.01 -0.0 None None -
prob31.pddl
0.01 0.01 0.0 0.09 0.09 -0.0
prob32.pddl
0.01 0.01 0.0 1.21 1.18 -0.03
prob33.pddl
0.09 0.08 -0.0 None None -
prob34.pddl
0.01 0.01 0.0 0.11 0.11 0.0
prob35.pddl
0.01 0.01 0.0 0.05 0.05 -0.0
Sum of diffs
0.02
-1.29
Arithmetic mean of diffs
0.00
-0.06
mystery
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob02.pddl
0.04 0.04 -0.0 0.37 0.39 0.02
prob03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob04.pddl
136.98 139.27 2.3 108.11 101.98 -6.13
prob05.pddl
None None - None None -
prob06.pddl
5.17 5.21 0.04 None None -
prob07.pddl
0.01 0.01 0.0 None None -
prob08.pddl
None None - None None -
prob09.pddl
172.10 178.45 6.35 0.02 0.02 0.0
prob10.pddl
0.02 0.02 -0.0 None None -
prob11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob12.pddl
17.77 17.61 -0.16 6.69 6.77 0.08
prob13.pddl
0.05 0.05 0.0 None None -
prob14.pddl
0.09 0.09 0.0 None None -
prob15.pddl
0.03 0.03 0.0 17.29 16.94 -0.35
prob16.pddl
None None - None None -
prob17.pddl
0.01 0.01 0.0 0.12 0.13 0.01
prob18.pddl
0.01 0.01 0.0 None None -
prob19.pddl
0.11 0.11 -0.0 2.11 2.11 0.0
prob20.pddl
0.01 0.01 0.0 49.57 52.36 2.78
prob21.pddl
None None - None None -
prob22.pddl
None None - None None -
prob23.pddl
None None - None None -
prob24.pddl
None None - None None -
prob25.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob26.pddl
0.01 0.01 0.0 0.10 0.10 0.0
prob27.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob28.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob29.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob30.pddl
0.01 0.01 0.0 0.37 0.37 -0.0
Sum of diffs
8.53
-3.58
Arithmetic mean of diffs
0.37
-0.21
nomystery-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.68 0.69 0.01
p05.pddl
0.01 0.01 0.0 57.62 58.46 0.84
p06.pddl
0.01 0.01 0.0 None None -
p07.pddl
0.01 0.01 0.0 None None -
p08.pddl
0.02 0.02 0.0 None None -
p09.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p10.pddl
0.03 0.03 -0.0 None None -
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.04 0.04 0.0 0.03 0.03 0.0
p13.pddl
0.01 0.01 0.0 0.10 0.10 -0.0
p14.pddl
0.14 0.14 0.0 1.13 1.14 0.01
p15.pddl
0.01 0.01 -0.0 1.04 1.02 -0.02
p16.pddl
None None - None None -
p17.pddl
0.09 0.09 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
0.04 0.04 0.0 None None -
p20.pddl
None None - None None -
Sum of diffs
0.01
0.84
Arithmetic mean of diffs
0.00
0.08
openstacks-opt08-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p14.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p15.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p16.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p17.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p18.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p19.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p20.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p21.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p22.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p23.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
p24.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p25.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p26.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p27.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
p28.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p29.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p30.pddl
0.02 0.02 -0.0 0.02 0.02 -0.0
Sum of diffs
-0.00
0.00
Arithmetic mean of diffs
-0.00
0.00
openstacks-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p13.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p14.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p15.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p16.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p17.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p18.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
p19.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
p20.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
Sum of diffs
-0.00
-0.00
Arithmetic mean of diffs
-0.00
-0.00
openstacks-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p20_2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p20_3.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p25_1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p25_3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p30_1.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
p30_2.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p30_3.pddl
0.02 0.02 0.0 0.01 0.02 0.0
p35_1.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p35_2.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p35_3.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p40_1.pddl
0.02 0.03 0.0 0.02 0.02 -0.0
p40_2.pddl
0.02 0.02 -0.0 0.02 0.02 -0.0
p40_3.pddl
0.03 0.03 -0.0 0.03 0.02 -0.0
p45_1.pddl
0.03 0.03 -0.0 0.03 0.03 0.0
p45_2.pddl
0.03 0.03 0.0 0.03 0.03 -0.0
p45_3.pddl
0.04 0.04 -0.0 0.03 0.03 -0.0
p50_1.pddl
0.04 0.03 -0.0 0.03 0.03 0.0
p50_2.pddl
0.04 0.04 -0.0 0.04 0.03 -0.0
p50_3.pddl
0.05 0.05 0.0 0.04 0.04 -0.0
Sum of diffs
0.01
-0.00
Arithmetic mean of diffs
0.00
-0.00
openstacks-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p09.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
p10.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
p11.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p12.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p13.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p14.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
p15.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p16.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p17.pddl
0.03 0.03 -0.0 0.02 0.02 0.0
p18.pddl
0.06 0.07 0.0 0.06 0.05 -0.0
p19.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p20.pddl
0.03 0.03 0.0 0.03 0.03 0.0
p21.pddl
0.03 0.03 -0.0 0.03 0.03 0.0
p22.pddl
0.04 0.04 0.0 0.03 0.03 -0.0
p23.pddl
0.04 0.04 0.0 0.03 0.03 -0.0
p24.pddl
0.34 0.42 0.07 0.21 0.20 -0.01
p25.pddl
0.31 0.30 -0.0 0.17 0.17 -0.01
p26.pddl
0.12 0.12 -0.0 0.09 0.09 0.0
p27.pddl
0.35 0.41 0.06 0.31 0.30 -0.01
p28.pddl
5.40 5.19 -0.21 5.54 4.99 -0.55
p29.pddl
4.30 4.26 -0.04 4.03 3.52 -0.51
p30.pddl
0.97 0.81 -0.16 0.89 0.99 0.1
Sum of diffs
-0.28
-0.99
Arithmetic mean of diffs
-0.01
-0.03
organic-synthesis-opt18-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
None None - None None -
p09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
organic-synthesis-split-opt18-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.10 0.11 0.01 2.01 2.02 0.02
p04.pddl
0.02 0.03 0.0 2.85 2.83 -0.02
p05.pddl
0.11 0.12 0.0 1.19 1.19 0.0
p06.pddl
0.09 0.08 -0.01 62.38 62.92 0.53
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.72 0.95 0.23 244.36 245.22 0.86
p09.pddl
0.01 0.01 0.0 0.26 0.26 0.0
p10.pddl
0.01 0.01 0.0 0.44 0.43 -0.01
p11.pddl
0.83 0.82 -0.0 None None -
p12.pddl
1.44 1.48 0.04 None None -
p13.pddl
9.07 9.38 0.31 None None -
p14.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p15.pddl
None None - None None -
p16.pddl
15.35 17.86 2.52 None None -
p17.pddl
55.37 62.10 6.73 None None -
p18.pddl
None None - None None -
p19.pddl
3.93 4.08 0.15 None None -
p20.pddl
390.86 410.56 19.7 None None -
Sum of diffs
29.68
1.39
Arithmetic mean of diffs
1.65
0.13
parcprinter-08-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13.pddl
0.01 0.01 0.0 0.10 0.10 -0.01
p14.pddl
0.01 0.01 0.0 4.98 4.96 -0.03
p15.pddl
0.01 0.01 0.0 None None -
p16.pddl
0.01 0.01 0.0 None None -
p17.pddl
0.01 0.01 0.0 None None -
p18.pddl
0.01 0.01 0.0 None None -
p19.pddl
0.02 0.02 0.0 None None -
p20.pddl
0.02 0.02 0.0 None None -
p21.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p22.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p23.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p24.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p25.pddl
0.01 0.01 0.0 3.39 3.36 -0.02
p26.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p27.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p28.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p29.pddl
0.02 0.02 -0.0 None None -
p30.pddl
0.01 0.01 -0.0 None None -
Sum of diffs
0.00
-0.06
Arithmetic mean of diffs
0.00
-0.00
parcprinter-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09.pddl
0.01 0.01 0.0 0.10 0.10 0.0
p10.pddl
0.01 0.01 0.0 3.28 3.24 -0.04
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 0.0 4.91 4.92 0.02
p13.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p14.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p15.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p16.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p17.pddl
0.01 0.01 0.0 None None -
p18.pddl
0.01 0.01 0.0 None None -
p19.pddl
0.01 0.01 0.0 None None -
p20.pddl
0.01 0.01 0.0 0.01 0.01 0.0
Sum of diffs
-0.00
-0.02
Arithmetic mean of diffs
-0.00
-0.00
parking-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
0.02 0.02 0.0 None None -
pfile03-012.pddl
0.07 0.07 -0.0 None None -
pfile04-013.pddl
0.12 0.11 -0.0 None None -
pfile04-014.pddl
0.17 0.17 0.0 None None -
pfile04-015.pddl
0.08 0.08 -0.0 None None -
pfile04-016.pddl
0.12 0.12 -0.0 None None -
pfile05-017.pddl
0.13 0.12 -0.0 None None -
pfile05-018.pddl
0.11 0.11 -0.0 None None -
pfile05-019.pddl
0.34 0.33 -0.0 None None -
pfile05-020.pddl
0.26 0.26 0.0 None None -
pfile06-021.pddl
0.39 0.38 -0.0 None None -
pfile06-022.pddl
0.36 0.39 0.02 None None -
pfile06-023.pddl
0.31 0.31 -0.0 None None -
pfile06-024.pddl
0.94 0.97 0.03 None None -
pfile07-025.pddl
1.39 1.41 0.02 None None -
pfile07-026.pddl
0.52 0.54 0.02 None None -
pfile07-027.pddl
0.40 0.42 0.02 None None -
pfile07-028.pddl
1.33 1.37 0.04 None None -
pfile08-029.pddl
1.57 1.57 -0.0 None None -
pfile08-030.pddl
1.01 1.04 0.03 None None -
Sum of diffs
0.17
None
Arithmetic mean of diffs
0.01
None
parking-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
0.04 0.04 -0.0 None None -
p_12_7-02.pddl
0.04 0.04 0.0 2.63 2.73 0.1
p_12_7-03.pddl
0.08 0.08 0.0 None None -
p_12_7-04.pddl
0.06 0.06 0.0 None None -
p_14_8-01.pddl
0.07 0.07 0.0 None None -
p_14_8-02.pddl
0.11 0.11 0.0 None None -
p_14_8-03.pddl
0.21 0.21 0.0 None None -
p_14_8-04.pddl
0.10 0.11 0.0 None None -
p_16_9-01.pddl
0.20 0.20 0.0 None None -
p_16_9-02.pddl
0.15 0.15 -0.0 None None -
p_16_9-03.pddl
0.10 0.10 0.0 None None -
p_16_9-04.pddl
0.11 0.11 -0.0 None None -
p_18_10-01.pddl
0.59 0.54 -0.04 None None -
p_18_10-02.pddl
0.29 0.29 -0.0 None None -
p_18_10-03.pddl
0.14 0.14 0.0 None None -
p_18_10-04.pddl
0.11 0.11 -0.0 None None -
p_20_11-01.pddl
1.07 0.99 -0.08 None None -
p_20_11-02.pddl
0.63 0.64 0.01 None None -
p_20_11-03.pddl
0.87 1.00 0.13 None None -
p_20_11-04.pddl
1.75 1.75 0.0 None None -
Sum of diffs
0.02
0.10
Arithmetic mean of diffs
0.00
0.10
pathways-noneg
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.03 0.03 -0.0
p05.pddl
0.01 0.01 0.0 1.14 1.10 -0.04
p06.pddl
0.01 0.01 0.0 27.10 27.16 0.06
p07.pddl
0.02 0.02 0.0 177.76 179.03 1.28
p08.pddl
0.03 0.03 0.0 None None -
p09.pddl
0.03 0.03 0.0 31.85 31.08 -0.77
p10.pddl
None None - None None -
p11.pddl
0.04 0.03 -0.0 113.20 112.57 -0.64
p12.pddl
0.04 0.04 -0.0 None None -
p13.pddl
0.04 0.05 0.0 None None -
p14.pddl
0.06 0.06 -0.0 None None -
p15.pddl
0.04 0.04 0.0 None None -
p16.pddl
None None - None None -
p17.pddl
0.08 0.08 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
0.21 0.21 -0.0 None None -
p24.pddl
0.22 0.21 -0.02 None None -
p25.pddl
0.22 0.22 -0.0 None None -
p26.pddl
0.24 0.24 0.0 None None -
p27.pddl
0.31 0.31 -0.0 None None -
p28.pddl
0.20 0.20 -0.0 None None -
p29.pddl
0.40 0.39 -0.01 None None -
p30.pddl
0.47 0.48 0.01 None None -
Sum of diffs
-0.02
-0.10
Arithmetic mean of diffs
-0.00
-0.01
pegsol-08-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10.pddl
0.03 0.03 0.0 0.01 0.01 0.0
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p13.pddl
0.01 0.01 0.0 0.06 0.06 0.0
p14.pddl
0.01 0.01 0.0 0.05 0.05 0.0
p15.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p16.pddl
0.01 0.01 0.0 0.03 0.02 -0.0
p17.pddl
0.25 0.27 0.02 0.12 0.12 -0.0
p18.pddl
0.05 0.05 0.0 0.01 0.01 0.0
p19.pddl
0.01 0.01 0.0 0.04 0.04 -0.0
p20.pddl
0.01 0.02 0.0 0.01 0.01 0.0
p21.pddl
0.01 0.01 0.0 0.08 0.08 0.0
p22.pddl
0.02 0.02 -0.0 0.03 0.03 -0.0
p23.pddl
0.01 0.01 0.0 0.15 0.15 -0.0
p24.pddl
0.02 0.02 -0.0 0.06 0.07 0.0
p25.pddl
0.02 0.02 -0.0 0.05 0.05 -0.0
p26.pddl
0.01 0.01 0.0 0.15 0.15 0.0
p27.pddl
1.00 0.98 -0.01 0.01 0.01 0.0
p28.pddl
2.82 2.78 -0.04 4.04 3.93 -0.11
p29.pddl
181.67 177.92 -3.75 0.71 0.72 0.01
p30.pddl
2.99 2.99 0.0 75.28 73.93 -1.35
Sum of diffs
-3.78
-1.44
Arithmetic mean of diffs
-0.13
-0.05
pegsol-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.28 0.27 -0.0 0.12 0.12 0.0
p03.pddl
0.05 0.05 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.04 0.04 -0.0
p05.pddl
0.01 0.01 0.0 0.19 0.19 -0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p08.pddl
0.01 0.02 0.0 0.01 0.01 0.0
p09.pddl
0.05 0.05 -0.0 0.03 0.03 -0.0
p10.pddl
0.01 0.01 0.0 0.08 0.08 -0.0
p11.pddl
0.02 0.02 0.0 0.03 0.03 -0.0
p12.pddl
0.02 0.02 0.0 0.05 0.05 0.0
p13.pddl
0.01 0.01 -0.0 0.15 0.15 -0.0
p14.pddl
0.02 0.02 0.0 0.07 0.07 0.0
p15.pddl
0.02 0.02 -0.0 0.05 0.05 -0.0
p16.pddl
0.01 0.01 -0.0 0.15 0.15 0.0
p17.pddl
1.00 0.99 -0.01 0.01 0.01 0.0
p18.pddl
2.87 2.87 -0.01 4.03 3.97 -0.06
p19.pddl
178.86 177.53 -1.33 0.72 0.72 0.01
p20.pddl
2.99 2.95 -0.04 73.91 75.40 1.49
Sum of diffs
-1.39
1.43
Arithmetic mean of diffs
-0.07
0.07
petri-net-alignment-opt18-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.09 0.08 -0.0 0.04 0.04 -0.0
p02.pddl
0.20 0.19 -0.0 0.05 0.05 -0.0
p03.pddl
0.39 0.32 -0.07 0.06 0.06 0.0
p04.pddl
0.33 0.31 -0.02 0.06 0.06 0.0
p05.pddl
0.18 0.17 -0.0 0.05 0.05 -0.0
p06.pddl
0.49 0.36 -0.13 0.06 0.06 -0.0
p07.pddl
0.38 0.27 -0.11 0.06 0.06 -0.0
p08.pddl
0.33 0.33 -0.0 0.06 0.06 -0.0
p09.pddl
0.77 0.31 -0.46 0.06 0.06 0.0
p10.pddl
0.91 1.77 0.87 0.08 0.08 -0.0
p11.pddl
0.54 0.43 -0.11 0.07 0.07 0.0
p12.pddl
2.43 2.64 0.2 0.10 0.10 -0.0
p13.pddl
0.64 1.19 0.56 0.08 0.08 -0.0
p14.pddl
1.86 1.61 -0.24 0.09 0.08 -0.0
p15.pddl
0.63 1.31 0.68 0.08 0.08 0.0
p16.pddl
1.51 2.29 0.78 0.09 0.09 -0.0
p17.pddl
2.38 1.64 -0.73 0.09 0.09 0.0
p18.pddl
2.44 2.15 -0.29 0.09 0.09 -0.0
p19.pddl
2.60 1.62 -0.98 0.09 0.10 0.0
p20.pddl
2.73 2.84 0.11 0.10 0.10 -0.0
Sum of diffs
0.04
0.00
Arithmetic mean of diffs
0.00
0.00
pipesworld-notankage
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02-net1-b6-g4.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p03-net1-b8-g3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04-net1-b8-g5.pddl
0.01 0.02 0.0 0.01 0.01 0.0
p05-net1-b10-g4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06-net1-b10-g6.pddl
0.08 0.08 0.0 0.01 0.01 0.0
p07-net1-b12-g5.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08-net1-b12-g7.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09-net1-b14-g6.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10-net1-b14-g8.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11-net2-b10-g2.pddl
0.51 0.52 0.01 0.02 0.02 0.0
p12-net2-b10-g4.pddl
0.50 0.50 0.0 0.04 0.04 -0.0
p13-net2-b12-g3.pddl
0.01 0.01 0.0 0.13 0.13 -0.0
p14-net2-b12-g5.pddl
0.24 0.24 0.0 0.04 0.04 0.0
p15-net2-b14-g4.pddl
0.06 0.06 0.0 0.12 0.12 -0.0
p16-net2-b14-g6.pddl
1.55 1.55 0.01 2.24 2.14 -0.1
p17-net2-b16-g5.pddl
1.51 1.52 0.01 0.04 0.04 -0.0
p18-net2-b16-g7.pddl
2.55 2.58 0.03 0.07 0.07 -0.0
p19-net2-b18-g6.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p20-net2-b18-g8.pddl
4.37 4.30 -0.07 0.21 0.20 -0.0
p21-net3-b12-g2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p22-net3-b12-g4.pddl
3.35 3.44 0.09 0.43 0.43 0.01
p23-net3-b14-g3.pddl
0.03 0.03 -0.0 0.14 0.14 0.0
p24-net3-b14-g5.pddl
1.87 1.78 -0.08 1.76 1.74 -0.02
p25-net3-b16-g5.pddl
0.04 0.04 0.0 1.65 1.73 0.08
p26-net3-b16-g7.pddl
4.13 4.45 0.32 0.19 0.18 -0.01
p27-net3-b18-g6.pddl
5.03 4.84 -0.2 33.79 33.35 -0.45
p28-net3-b18-g7.pddl
4.87 4.90 0.04 21.94 20.74 -1.2
p29-net3-b20-g6.pddl
1.08 1.09 0.02 16.51 15.86 -0.65
p30-net3-b20-g8.pddl
5.07 5.15 0.08 0.90 0.96 0.05
p31-net4-b14-g3.pddl
0.02 0.02 -0.0 0.24 0.24 -0.0
p32-net4-b14-g5.pddl
1.28 1.29 0.01 0.12 0.12 -0.0
p33-net4-b16-g5.pddl
0.79 0.77 -0.01 0.43 0.43 -0.0
p34-net4-b16-g6.pddl
3.99 4.05 0.07 0.90 0.90 0.0
p35-net4-b18-g4.pddl
2.51 2.51 0.01 36.21 34.83 -1.39
p36-net4-b18-g6.pddl
0.07 0.07 0.0 123.80 119.40 -4.4
p37-net4-b20-g5.pddl
0.47 0.46 -0.01 None None -
p38-net4-b20-g7.pddl
6.19 6.03 -0.17 27.61 28.96 1.35
p39-net4-b22-g7.pddl
0.08 0.08 0.0 None None -
p40-net4-b22-g8.pddl
1.28 1.26 -0.02 119.24 120.30 1.06
p41-net5-b22-g2.pddl
0.16 0.17 0.0 6.51 6.65 0.14
p42-net5-b22-g4.pddl
None None - None None -
p43-net5-b24-g3.pddl
None None - None None -
p44-net5-b24-g5.pddl
None None - None None -
p45-net5-b26-g4.pddl
None None - None None -
p46-net5-b26-g6.pddl
None None - None None -
p47-net5-b28-g5.pddl
None None - None None -
p48-net5-b28-g7.pddl
None None - None None -
p49-net5-b30-g6.pddl
0.28 0.28 0.0 None None -
p50-net5-b30-g8.pddl
18.72 18.70 -0.02 None None -
Sum of diffs
0.13
-5.54
Arithmetic mean of diffs
0.00
-0.14
pipesworld-tankage
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02-net1-b6-g4-t50.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p03-net1-b8-g3-t80.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04-net1-b8-g5-t80.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05-net1-b10-g4-t50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06-net1-b10-g6-t50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07-net1-b12-g5-t80.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08-net1-b12-g7-t80.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09-net1-b14-g6-t50.pddl
2.49 2.48 -0.0 0.41 0.43 0.02
p10-net1-b14-g8-t50.pddl
0.02 0.02 -0.0 0.03 0.03 0.0
p11-net2-b10-g2-t30.pddl
0.04 0.04 0.0 0.14 0.13 -0.0
p12-net2-b10-g4-t60.pddl
0.03 0.03 -0.0 0.34 0.35 0.01
p13-net2-b12-g3-t70.pddl
0.02 0.02 -0.0 23.06 23.07 0.01
p14-net2-b12-g5-t30.pddl
0.09 0.09 0.0 0.77 0.74 -0.03
p15-net2-b14-g4-t30.pddl
0.19 0.19 -0.0 1.99 1.97 -0.02
p16-net2-b14-g6-t80.pddl
0.63 0.61 -0.02 None None -
p17-net2-b16-g5-t20.pddl
0.93 0.93 0.01 3.34 3.24 -0.1
p18-net2-b16-g7-t60.pddl
1.88 1.85 -0.03 14.44 14.81 0.37
p19-net2-b18-g6-t60.pddl
0.06 0.07 0.0 11.59 12.06 0.47
p20-net2-b18-g8-t90.pddl
2.15 2.36 0.22 None None -
p21-net3-b12-g2-t60.pddl
0.01 0.01 0.0 0.47 0.48 0.01
p22-net3-b12-g4-t60.pddl
355.33 358.86 3.53 14.23 13.91 -0.32
p23-net3-b14-g3-t60.pddl
2.62 2.52 -0.09 None None -
p24-net3-b14-g5-t60.pddl
0.66 0.68 0.03 None None -
p25-net3-b16-g5-t60.pddl
0.25 0.26 0.01 None None -
p26-net3-b16-g7-t70.pddl
22.92 23.22 0.3 None None -
p27-net3-b18-g6-t70.pddl
0.30 0.28 -0.02 None None -
p28-net3-b18-g7-t70.pddl
879.18 877.92 -1.25 None None -
p29-net3-b20-g6-t70.pddl
1.37 1.35 -0.02 None None -
p30-net3-b20-g8-t70.pddl
7.45 7.00 -0.45 None None -
p31-net4-b14-g3-t20.pddl
34.81 35.30 0.49 0.47 0.47 0.01
p32-net4-b14-g5-t30.pddl
2.50 2.47 -0.02 34.63 34.56 -0.08
p33-net4-b16-g5-t60.pddl
0.38 0.40 0.02 None None -
p34-net4-b16-g6-t60.pddl
0.64 0.69 0.04 None None -
p35-net4-b18-g4-t90.pddl
0.71 0.87 0.16 None None -
p36-net4-b18-g6-t90.pddl
30.37 34.38 4.01 None None -
p37-net4-b20-g5-t60.pddl
0.44 0.47 0.02 None None -
p38-net4-b20-g7-t60.pddl
3.82 3.76 -0.06 None None -
p39-net4-b22-g7-t50.pddl
0.93 0.98 0.05 None None -
p40-net4-b22-g8-t50.pddl
0.71 0.82 0.11 None None -
p41-net5-b22-g2-t20.pddl
0.05 0.05 0.0 None None -
p42-net5-b22-g4-t50.pddl
None None - None None -
p43-net5-b24-g3-t80.pddl
None None - None None -
p44-net5-b24-g5-t80.pddl
None None - None None -
p45-net5-b26-g4-t50.pddl
None None - None None -
p46-net5-b26-g6-t50.pddl
None None - None None -
p47-net5-b28-g5-t50.pddl
None None - None None -
p48-net5-b28-g7-t50.pddl
None None - None None -
p49-net5-b30-g6-t50.pddl
8.87 11.93 3.06 None None -
p50-net5-b30-g8-t50.pddl
150.93 123.36 -27.57 None None -
Sum of diffs
-17.49
0.36
Arithmetic mean of diffs
-0.41
0.02
psr-small
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02-s5-n1-l3-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03-s7-n1-l3-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04-s8-n1-l4-f10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05-s9-n1-l4-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06-s10-n1-l4-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07-s11-n1-l4-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08-s12-n1-l5-f10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09-s13-n1-l5-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10-s17-n2-l2-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11-s18-n2-l2-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12-s21-n2-l3-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13-s22-n2-l3-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p14-s23-n2-l3-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p15-s24-n2-l4-f10.pddl
0.01 0.01 0.0 0.06 0.06 0.0
p16-s29-n2-l5-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p17-s30-n2-l5-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p18-s31-n2-l5-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p19-s33-n3-l2-f30.pddl
0.01 0.01 -0.0 0.02 0.02 0.0
p20-s34-n3-l2-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p21-s35-n3-l2-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p22-s37-n3-l3-f30.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p23-s38-n3-l3-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p24-s39-n3-l3-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p25-s40-n3-l4-f10.pddl
0.01 0.01 0.0 0.32 0.32 0.0
p26-s41-n3-l4-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p27-s42-n3-l4-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p28-s43-n3-l4-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p29-s45-n3-l5-f30.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p30-s46-n3-l5-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p31-s49-n4-l2-f30.pddl
0.01 0.01 0.0 0.18 0.18 -0.0
p32-s50-n4-l2-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p33-s51-n4-l2-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p34-s55-n4-l3-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p35-s57-n5-l2-f30.pddl
0.01 0.01 0.0 0.82 0.82 0.0
p36-s65-n6-l2-f30.pddl
0.01 0.01 0.0 3.54 3.43 -0.11
p37-s67-n6-l2-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p38-s78-n3-l3-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p39-s79-n3-l3-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p40-s80-n3-l4-f10.pddl
0.01 0.01 0.0 16.34 16.78 0.43
p41-s81-n3-l4-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p42-s82-n3-l4-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p43-s83-n3-l4-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p44-s89-n4-l2-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p45-s94-n4-l3-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p46-s97-n5-l2-f30.pddl
0.01 0.01 0.0 0.22 0.22 0.0
p47-s98-n5-l2-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p48-s101-n5-l3-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p49-s105-n6-l2-f30.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p50-s107-n6-l2-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
Sum of diffs
0.00
0.33
Arithmetic mean of diffs
0.00
0.01
rovers
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
p09.pddl
0.01 0.01 0.0 0.24 0.24 0.01
p10.pddl
0.01 0.01 0.0 0.50 0.52 0.02
p11.pddl
0.01 0.01 0.0 0.08 0.08 0.0
p12.pddl
0.01 0.01 0.0 0.03 0.03 0.0
p13.pddl
0.01 0.01 -0.0 0.12 0.12 0.0
p14.pddl
0.01 0.01 0.0 0.28 0.28 -0.0
p15.pddl
0.02 0.02 -0.0 0.45 0.46 0.0
p16.pddl
0.01 0.01 0.0 0.36 0.36 -0.01
p17.pddl
0.01 0.01 -0.0 8.85 9.04 0.19
p18.pddl
0.01 0.01 -0.0 91.43 88.50 -2.93
p19.pddl
0.04 0.04 0.0 None None -
p20.pddl
0.07 0.06 -0.0 None None -
p21.pddl
0.05 0.05 0.0 None None -
p22.pddl
0.06 0.06 -0.0 78.50 77.38 -1.11
p23.pddl
0.08 0.09 0.0 None None -
p24.pddl
0.16 0.16 -0.0 None None -
p25.pddl
0.01 0.01 -0.0 2.02 1.95 -0.07
p26.pddl
0.04 0.04 -0.0 None None -
p27.pddl
0.10 0.10 -0.0 None None -
p28.pddl
0.12 0.12 -0.0 None None -
p29.pddl
0.06 0.06 -0.0 None None -
p30.pddl
0.17 0.18 0.01 None None -
p31.pddl
0.29 0.29 -0.01 None None -
p32.pddl
0.67 0.67 -0.0 None None -
p33.pddl
1.47 1.45 -0.03 None None -
p34.pddl
0.59 0.59 -0.0 None None -
p35.pddl
2.76 2.61 -0.15 None None -
p36.pddl
1.57 1.57 0.0 None None -
p37.pddl
6.09 6.07 -0.02 None None -
p38.pddl
3.93 4.09 0.16 None None -
p39.pddl
3.16 3.10 -0.06 None None -
p40.pddl
6.96 6.61 -0.36 None None -
Sum of diffs
-0.46
-3.90
Arithmetic mean of diffs
-0.01
-0.19
satellite
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02-pfile2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03-pfile3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04-pfile4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05-pfile5.pddl
0.01 0.01 0.0 0.08 0.08 0.0
p06-pfile6.pddl
0.01 0.01 0.0 0.09 0.09 0.0
p07-pfile7.pddl
0.01 0.01 0.0 0.33 0.33 -0.0
p08-pfile8.pddl
0.01 0.01 0.0 5.87 5.94 0.07
p09-pfile9.pddl
0.01 0.01 0.0 5.22 5.20 -0.01
p10-pfile10.pddl
0.01 0.01 -0.0 23.86 22.86 -1.0
p11-pfile11.pddl
0.01 0.01 0.0 6.79 6.72 -0.07
p12-pfile12.pddl
0.01 0.01 0.0 96.61 101.69 5.08
p13-pfile13.pddl
0.07 0.07 0.0 None None -
p14-pfile14.pddl
0.02 0.02 -0.0 52.80 52.26 -0.55
p15-pfile15.pddl
0.05 0.05 -0.0 None None -
p16-pfile16.pddl
0.02 0.02 -0.0 None None -
p17-pfile17.pddl
0.08 0.07 -0.01 None None -
p18-pfile18.pddl
0.02 0.02 0.0 None None -
p19-pfile19.pddl
0.04 0.04 0.0 None None -
p20-pfile20.pddl
0.16 0.16 0.0 None None -
p21-HC-pfile1.pddl
0.05 0.05 -0.0 16.05 15.66 -0.39
p22-HC-pfile2.pddl
0.08 0.08 0.0 None None -
p23-HC-pfile3.pddl
0.30 0.29 -0.01 17.72 17.99 0.26
p24-HC-pfile4.pddl
0.84 0.87 0.03 None None -
p25-HC-pfile5.pddl
1.35 1.34 -0.01 None None -
p26-HC-pfile6.pddl
0.67 0.67 -0.0 None None -
p27-HC-pfile7.pddl
0.62 0.64 0.02 None None -
p28-HC-pfile8.pddl
7.46 7.33 -0.14 None None -
p29-HC-pfile9.pddl
3.70 4.32 0.62 None None -
p30-HC-pfile10.pddl
29.46 30.76 1.3 None None -
p31-HC-pfile11.pddl
24.07 23.15 -0.92 None None -
p32-HC-pfile12.pddl
134.55 131.78 -2.77 None None -
p33-HC-pfile13.pddl
347.00 348.61 1.61 None None -
p34-HC-pfile14.pddl
1.20 1.26 0.07 None None -
p35-HC-pfile15.pddl
43.68 40.27 -3.41 None None -
p36-HC-pfile16.pddl
9.34 8.95 -0.39 None None -
Sum of diffs
-4.01
3.39
Arithmetic mean of diffs
-0.11
0.23
scanalyzer-08-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.02 0.0 0.01 0.01 0.0
p09.pddl
0.02 0.03 0.0 0.01 0.01 0.0
p10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11.pddl
0.04 0.04 -0.0 0.01 0.01 0.0
p12.pddl
0.07 0.07 -0.0 0.01 0.02 0.0
p13.pddl
0.03 0.03 0.0 0.01 0.01 0.0
p14.pddl
0.08 0.08 0.0 0.02 0.03 0.0
p15.pddl
0.16 0.16 0.01 0.03 0.03 -0.0
p16.pddl
0.06 0.06 -0.0 0.01 0.01 0.0
p17.pddl
0.18 0.19 0.01 0.05 0.05 0.0
p18.pddl
0.39 0.38 -0.0 0.06 0.06 0.0
p19.pddl
0.13 0.13 -0.0 0.02 0.02 0.0
p20.pddl
0.41 0.42 0.0 0.10 0.09 -0.01
p21.pddl
0.89 0.89 -0.0 0.11 0.10 -0.01
p22.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p23.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p24.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p25.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p26.pddl
0.11 0.11 0.0 0.01 0.01 0.0
p27.pddl
0.13 0.12 -0.0 0.02 0.02 0.0
p28.pddl
0.53 0.52 -0.02 0.01 0.01 0.0
p29.pddl
22.25 20.91 -1.33 0.01 0.01 0.0
p30.pddl
6.03 5.76 -0.26 0.02 0.02 0.0
Sum of diffs
-1.60
-0.01
Arithmetic mean of diffs
-0.05
-0.00
scanalyzer-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.12 0.13 0.0 0.02 0.02 0.0
p08.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09.pddl
0.03 0.03 0.0 0.01 0.01 0.0
p10.pddl
0.06 0.06 0.0 0.01 0.01 0.0
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13.pddl
0.12 0.13 0.0 0.02 0.02 -0.0
p14.pddl
0.11 0.11 -0.0 0.01 0.01 0.0
p15.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p16.pddl
0.04 0.04 0.0 0.01 0.01 -0.0
p17.pddl
0.08 0.08 0.0 0.02 0.03 0.0
p18.pddl
0.18 0.19 0.01 0.05 0.05 0.0
p19.pddl
0.41 0.41 -0.01 0.09 0.09 -0.0
p20.pddl
0.47 0.52 0.06 0.01 0.01 0.0
Sum of diffs
0.07
-0.00
Arithmetic mean of diffs
0.00
-0.00
snake-opt18-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.36 0.37 0.01 0.07 0.07 0.0
p02.pddl
1.98 1.90 -0.08 1.30 1.26 -0.04
p03.pddl
23.58 22.99 -0.59 5.15 5.12 -0.03
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p06.pddl
1.08 1.11 0.03 2.03 1.93 -0.1
p07.pddl
1022.54 1056.54 34.0 96.10 92.55 -3.55
p08.pddl
None None - 404.12 384.71 -19.41
p09.pddl
0.04 0.04 -0.0 0.01 0.01 0.0
p10.pddl
0.27 0.27 0.0 0.08 0.09 0.0
p11.pddl
1.48 1.43 -0.05 4.39 4.51 0.12
p12.pddl
332.69 346.18 13.49 107.55 101.50 -6.05
p13.pddl
55.71 48.18 -7.54 None None -
p14.pddl
None None - None None -
p15.pddl
0.21 0.20 -0.0 0.24 0.22 -0.01
p16.pddl
57.15 63.30 6.14 85.55 86.56 1.01
p17.pddl
868.63 1002.35 133.72 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
5.40 4.62 -0.78 0.94 0.99 0.05
Sum of diffs
178.35
-28.00
Arithmetic mean of diffs
11.15
-1.87
sokoban-opt08-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.02 0.02 0.0 0.05 0.05 -0.0
p05.pddl
0.02 0.02 0.0 None None -
p06.pddl
0.01 0.01 0.0 0.04 0.04 -0.0
p07.pddl
0.03 0.03 -0.0 0.40 0.41 0.0
p08.pddl
1.05 1.03 -0.02 24.89 25.57 0.68
p09.pddl
0.12 0.12 -0.0 5.51 5.81 0.3
p10.pddl
0.29 0.29 -0.0 2.31 2.17 -0.14
p11.pddl
2.61 2.61 0.01 1.44 1.44 0.0
p12.pddl
0.42 0.41 -0.01 37.77 37.86 0.09
p13.pddl
16.39 16.25 -0.14 26.77 27.87 1.1
p14.pddl
0.04 0.04 -0.0 0.26 0.26 -0.0
p15.pddl
4.00 3.95 -0.05 25.23 24.70 -0.54
p16.pddl
0.99 1.02 0.03 1.10 1.12 0.01
p17.pddl
0.13 0.13 -0.0 0.54 0.54 -0.0
p18.pddl
1.94 1.93 -0.02 44.80 45.57 0.76
p19.pddl
3.34 3.33 -0.01 96.95 96.03 -0.92
p20.pddl
0.07 0.07 0.0 0.02 0.02 0.0
p21.pddl
0.13 0.13 0.0 0.03 0.03 0.0
p22.pddl
2.39 2.37 -0.03 62.28 62.60 0.33
p23.pddl
0.12 0.12 0.0 4.42 4.41 -0.01
p24.pddl
5.50 5.37 -0.13 None None -
p25.pddl
275.28 274.76 -0.52 None None -
p26.pddl
1.80 1.89 0.1 None None -
p27.pddl
0.47 0.47 0.01 0.19 0.20 0.01
p28.pddl
101.47 101.82 0.35 99.30 99.60 0.31
p29.pddl
0.01 0.01 -0.0 None None -
p30.pddl
None None - None None -
Sum of diffs
-0.43
1.99
Arithmetic mean of diffs
-0.01
0.08
sokoban-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.04 0.04 0.0
p02.pddl
0.13 0.13 -0.0 0.55 0.54 -0.01
p03.pddl
0.04 0.04 0.0 0.27 0.26 -0.01
p04.pddl
0.02 0.02 -0.0 0.05 0.05 0.0
p05.pddl
0.98 0.99 0.01 1.12 1.11 -0.02
p06.pddl
2.61 2.67 0.06 1.42 1.44 0.01
p07.pddl
0.29 0.29 -0.0 2.30 2.29 -0.01
p08.pddl
0.12 0.12 0.0 5.78 5.82 0.03
p09.pddl
0.03 0.03 -0.0 0.40 0.40 0.0
p10.pddl
0.02 0.02 -0.0 None None -
p11.pddl
15.76 16.54 0.78 28.30 27.91 -0.39
p12.pddl
0.07 0.07 0.0 0.02 0.02 -0.0
p13.pddl
1.04 1.04 -0.0 25.14 26.64 1.51
p14.pddl
0.40 0.41 0.01 37.50 37.20 -0.3
p15.pddl
1.94 1.91 -0.03 45.62 45.57 -0.06
p16.pddl
3.97 3.92 -0.05 25.45 25.28 -0.17
p17.pddl
3.19 3.31 0.12 96.43 98.30 1.87
p18.pddl
0.13 0.13 0.0 0.03 0.03 0.0
p19.pddl
2.38 2.37 -0.01 62.40 62.57 0.17
p20.pddl
0.12 0.12 0.0 4.07 4.29 0.22
Sum of diffs
0.90
2.85
Arithmetic mean of diffs
0.05
0.15
spider-opt18-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.04 0.04 0.0 0.01 0.01 0.0
p02.pddl
1.05 1.07 0.02 0.05 0.05 -0.0
p03.pddl
0.46 0.46 0.0 0.04 0.04 -0.0
p04.pddl
0.57 0.56 -0.0 0.18 0.18 0.0
p05.pddl
11.87 12.36 0.49 0.66 0.70 0.04
p06.pddl
61.89 59.32 -2.57 105.66 106.55 0.89
p07.pddl
0.06 0.06 -0.0 0.01 0.01 0.0
p08.pddl
0.08 0.08 -0.0 0.01 0.01 0.0
p09.pddl
12.91 12.33 -0.58 0.37 0.36 -0.01
p10.pddl
66.87 61.01 -5.87 8.08 8.51 0.43
p11.pddl
4.00 4.01 0.02 0.59 0.60 0.0
p12.pddl
20.14 19.45 -0.7 26.49 26.23 -0.25
p13.pddl
171.17 166.27 -4.9 1.98 1.97 -0.01
p14.pddl
0.03 0.02 -0.0 0.01 0.01 0.0
p15.pddl
0.05 0.05 0.0 0.01 0.01 0.0
p16.pddl
0.17 0.17 -0.01 0.01 0.01 -0.0
p17.pddl
0.45 0.45 -0.01 0.01 0.01 0.0
p18.pddl
1.43 1.33 -0.1 11.65 11.19 -0.46
p19.pddl
2.14 1.90 -0.24 0.20 0.20 -0.01
p20.pddl
5.93 4.53 -1.4 0.27 0.27 0.0
Sum of diffs
-15.84
0.62
Arithmetic mean of diffs
-0.79
0.03
storage
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11.pddl
0.07 0.07 0.0 0.03 0.03 0.0
p12.pddl
0.06 0.06 -0.0 0.21 0.23 0.02
p13.pddl
0.18 0.18 -0.0 0.01 0.01 0.0
p14.pddl
0.48 0.50 0.02 0.02 0.02 0.0
p15.pddl
0.17 0.17 -0.01 0.15 0.14 -0.01
p16.pddl
0.27 0.27 0.01 1.90 1.88 -0.02
p17.pddl
0.42 0.43 0.0 32.41 32.80 0.39
p18.pddl
53.49 54.36 0.86 None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
33.26 36.52 3.27 None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
4.15
0.39
Arithmetic mean of diffs
0.22
0.02
termes-opt18-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.02 0.02 0.0 0.04 0.04 -0.0
p02.pddl
0.19 0.19 -0.0 0.06 0.06 -0.0
p03.pddl
0.29 0.29 0.0 0.40 0.40 0.0
p04.pddl
0.24 0.24 0.0 0.37 0.36 -0.01
p05.pddl
21.45 21.52 0.07 4.76 4.98 0.22
p06.pddl
5.95 5.94 -0.01 10.69 10.38 -0.31
p07.pddl
71.82 71.11 -0.71 102.71 101.00 -1.72
p08.pddl
92.08 91.66 -0.42 24.00 23.35 -0.64
p09.pddl
None None - None None -
p10.pddl
393.70 381.55 -12.15 None None -
p11.pddl
0.03 0.03 -0.0 0.22 0.22 -0.0
p12.pddl
0.06 0.06 -0.0 0.02 0.02 0.0
p13.pddl
0.17 0.17 -0.0 0.34 0.35 0.01
p14.pddl
0.12 0.12 0.0 0.12 0.12 0.0
p15.pddl
3.24 3.23 -0.02 0.76 0.75 -0.01
p16.pddl
1.65 1.65 0.01 1.37 1.32 -0.05
p17.pddl
0.60 0.63 0.03 0.22 0.22 -0.0
p18.pddl
0.03 0.03 -0.0 0.02 0.02 0.0
p19.pddl
0.51 0.50 -0.0 0.06 0.06 0.0
p20.pddl
0.69 0.69 -0.01 0.40 0.39 -0.02
Sum of diffs
-13.22
-2.53
Arithmetic mean of diffs
-0.70
-0.14
tetris-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
0.99 1.01 0.02 0.01 0.01 0.0
p01-8.pddl
1.73 1.64 -0.08 0.01 0.01 0.0
p01-10.pddl
242.49 245.54 3.06 0.81 0.81 -0.0
p02-4.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p02-6.pddl
0.82 0.88 0.05 0.01 0.01 0.0
p02-8.pddl
1.12 1.11 -0.01 0.03 0.03 0.0
p02-10.pddl
26.40 25.86 -0.54 0.13 0.13 -0.0
p03-4.pddl
0.12 0.12 0.0 0.01 0.01 0.0
p03-6.pddl
0.64 0.63 -0.01 0.01 0.01 0.0
p03-8.pddl
2.47 2.55 0.08 0.01 0.01 0.0
p03-10.pddl
6.15 5.92 -0.23 0.05 0.05 0.0
p04-6.pddl
0.88 0.88 0.0 0.01 0.01 0.0
p04-8.pddl
7.96 7.86 -0.1 0.02 0.02 0.0
p04-10.pddl
10.49 10.36 -0.13 0.03 0.03 0.0
p05-6.pddl
0.27 0.27 0.0 0.01 0.01 0.0
p05-8.pddl
195.59 193.76 -1.83 0.02 0.02 -0.0
p05-10.pddl
3.79 4.05 0.26 0.05 0.05 -0.0
Sum of diffs
0.55
0.00
Arithmetic mean of diffs
0.03
0.00
tidybot-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.35 0.36 0.01 0.01 0.01 0.0
p03.pddl
0.03 0.02 -0.0 0.01 0.01 0.0
p04.pddl
0.11 0.11 0.0 0.01 0.01 0.0
p05.pddl
0.69 0.66 -0.02 0.03 0.03 0.0
p06.pddl
0.13 0.14 0.01 0.01 0.01 0.0
p07.pddl
0.32 0.34 0.02 0.01 0.01 0.0
p08.pddl
1578.41 1725.74 147.33 0.04 0.04 -0.0
p09.pddl
6.07 6.12 0.05 0.01 0.01 0.0
p10.pddl
0.12 0.12 0.0 0.03 0.03 -0.0
p11.pddl
0.62 0.66 0.04 0.01 0.01 0.0
p12.pddl
0.30 0.26 -0.04 0.03 0.03 0.0
p13.pddl
5.11 5.25 0.14 0.02 0.02 0.0
p14.pddl
0.45 0.44 -0.01 0.01 0.01 0.0
p15.pddl
None None - 0.03 0.03 0.0
p16.pddl
0.47 0.33 -0.14 0.01 0.01 -0.0
p17.pddl
4.32 4.82 0.5 0.51 0.51 -0.01
p18.pddl
16.62 14.77 -1.84 0.10 0.09 -0.0
p19.pddl
0.77 0.96 0.19 0.02 0.02 -0.0
p20.pddl
1.52 1.35 -0.17 0.22 0.24 0.01
Sum of diffs
146.06
0.00
Arithmetic mean of diffs
7.69
0.00
tidybot-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
1.36 1.40 0.05 11.92 12.15 0.24
p02.pddl
1.44 1.47 0.03 0.09 0.09 0.0
p03.pddl
0.37 0.34 -0.04 0.01 0.01 0.0
p04.pddl
0.18 0.20 0.01 0.03 0.03 -0.0
p05.pddl
2.95 3.39 0.44 0.81 0.82 0.0
p06.pddl
11.34 8.47 -2.87 1.07 1.05 -0.02
p07.pddl
0.66 0.63 -0.04 0.01 0.01 -0.0
p08.pddl
0.18 0.20 0.02 0.01 0.01 0.0
p09.pddl
0.73 0.59 -0.13 0.05 0.05 0.0
p10.pddl
2.29 1.51 -0.79 0.31 0.31 -0.0
p11.pddl
0.66 0.66 0.0 0.01 0.01 0.0
p12.pddl
0.26 0.27 0.02 0.03 0.03 -0.0
p13.pddl
5.37 4.95 -0.42 0.02 0.02 -0.0
p14.pddl
0.35 0.37 0.02 0.01 0.01 0.0
p15.pddl
None None - 0.03 0.03 -0.0
p16.pddl
0.29 0.31 0.02 0.01 0.01 0.0
p17.pddl
3.99 6.74 2.75 0.51 0.51 -0.0
p18.pddl
17.03 13.85 -3.18 0.09 0.10 0.0
p19.pddl
0.74 0.77 0.02 0.02 0.02 0.0
p20.pddl
1.45 1.40 -0.05 0.24 0.24 -0.01
Sum of diffs
-4.13
0.21
Arithmetic mean of diffs
-0.22
0.01
tpp
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p08.pddl
0.01 0.01 0.0 0.04 0.05 0.0
p09.pddl
0.01 0.01 0.0 0.07 0.07 0.0
p10.pddl
0.02 0.02 0.0 0.13 0.13 -0.0
p11.pddl
0.02 0.02 -0.0 0.22 0.21 -0.01
p12.pddl
0.02 0.02 -0.0 0.36 0.37 0.01
p13.pddl
0.02 0.02 -0.0 0.21 0.19 -0.01
p14.pddl
0.03 0.04 0.0 0.49 0.48 -0.01
p15.pddl
0.05 0.05 -0.0 0.39 0.40 0.01
p16.pddl
0.12 0.12 0.0 2.63 2.55 -0.07
p17.pddl
0.17 0.17 -0.0 31.72 30.87 -0.85
p18.pddl
0.10 0.10 -0.0 10.09 10.07 -0.02
p19.pddl
0.30 0.30 0.0 23.46 23.56 0.1
p20.pddl
0.40 0.40 -0.0 67.79 67.92 0.13
p21.pddl
0.39 0.38 -0.01 6.72 6.27 -0.45
p22.pddl
0.21 0.22 0.01 6.98 6.85 -0.14
p23.pddl
0.48 0.48 0.0 18.43 17.68 -0.75
p24.pddl
1.35 1.42 0.07 13.11 13.78 0.67
p25.pddl
0.85 0.86 0.02 54.29 54.83 0.54
p26.pddl
1.42 1.43 0.01 58.94 59.45 0.51
p27.pddl
1.87 1.91 0.03 55.62 56.05 0.43
p28.pddl
2.21 2.28 0.07 None None -
p29.pddl
5.62 6.26 0.64 None None -
p30.pddl
4.75 4.85 0.1 None None -
Sum of diffs
0.94
0.09
Arithmetic mean of diffs
0.03
0.00
transport-opt08-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.02 0.02 0.0 0.05 0.05 -0.0
p07.pddl
0.03 0.03 -0.0 0.23 0.24 0.01
p08.pddl
0.03 0.03 0.0 0.28 0.28 -0.0
p09.pddl
0.06 0.06 0.0 0.62 0.60 -0.03
p10.pddl
0.08 0.08 0.0 1.40 1.43 0.03
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p14.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p15.pddl
0.03 0.03 0.0 0.03 0.03 -0.0
p16.pddl
0.04 0.04 0.0 0.85 0.89 0.04
p17.pddl
0.13 0.12 -0.0 3.23 3.05 -0.18
p18.pddl
0.20 0.20 0.0 5.26 5.47 0.21
p19.pddl
0.23 0.23 0.0 12.72 12.52 -0.2
p20.pddl
0.40 0.39 -0.01 25.77 26.59 0.83
p21.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p22.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p23.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p24.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p25.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p26.pddl
0.01 0.01 0.0 0.06 0.06 0.0
p27.pddl
0.02 0.02 0.0 0.05 0.05 0.0
p28.pddl
0.08 0.09 0.0 0.86 0.81 -0.05
p29.pddl
0.06 0.06 -0.0 0.59 0.61 0.02
p30.pddl
0.07 0.07 0.0 0.77 0.73 -0.04
Sum of diffs
0.00
0.63
Arithmetic mean of diffs
0.00
0.02
transport-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.05 0.04 -0.0
p09.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p10.pddl
0.02 0.02 -0.0 0.06 0.06 0.0
p11.pddl
0.02 0.02 0.0 0.03 0.03 0.0
p12.pddl
0.02 0.02 0.0 0.16 0.16 -0.0
p13.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p14.pddl
0.02 0.02 0.0 0.07 0.07 -0.0
p15.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
p16.pddl
0.04 0.04 0.0 0.12 0.12 -0.0
p17.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p18.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p19.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p20.pddl
0.02 0.02 -0.0 0.05 0.05 0.0
Sum of diffs
0.00
-0.00
Arithmetic mean of diffs
0.00
-0.00
transport-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.03 0.03 0.0
p05.pddl
0.01 0.01 0.0 0.21 0.21 0.0
p06.pddl
0.02 0.02 0.0 0.07 0.07 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.03 0.03 -0.0
p09.pddl
0.01 0.01 0.0 0.06 0.06 -0.0
p10.pddl
0.02 0.02 0.0 1.01 1.02 0.01
p11.pddl
0.06 0.05 -0.0 2.69 2.59 -0.11
p12.pddl
0.07 0.07 0.0 5.28 5.45 0.17
p13.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p14.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p15.pddl
0.01 0.01 -0.0 0.03 0.03 0.0
p16.pddl
0.02 0.02 0.0 1.29 1.27 -0.02
p17.pddl
0.07 0.07 -0.0 2.25 2.34 0.09
p18.pddl
0.06 0.06 0.0 3.38 3.51 0.13
p19.pddl
0.11 0.10 -0.0 1.15 1.11 -0.04
p20.pddl
0.10 0.11 0.0 1.07 1.10 0.03
Sum of diffs
0.00
0.27
Arithmetic mean of diffs
0.00
0.01
trucks-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.05 0.05 0.0
p03.pddl
0.01 0.01 0.0 1.25 1.26 0.01
p04.pddl
0.11 0.11 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p07.pddl
0.09 0.08 -0.0 48.03 46.15 -1.88
p08.pddl
0.02 0.02 0.0 None None -
p09.pddl
0.09 0.09 -0.0 None None -
p10.pddl
4.86 4.84 -0.02 None None -
p11.pddl
1.37 1.31 -0.07 None None -
p12.pddl
19.99 20.45 0.46 None None -
p13.pddl
99.65 101.28 1.64 None None -
p14.pddl
4.36 4.45 0.09 None None -
p15.pddl
75.11 73.99 -1.12 None None -
p16.pddl
362.07 367.50 5.43 None None -
p17.pddl
235.40 240.31 4.91 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
None None - None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
11.32
-1.87
Arithmetic mean of diffs
0.67
-0.27
visitall-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem02-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem03-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem03-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem04-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem04-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem05-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem05-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem06-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem06-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem07-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem07-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem08-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem08-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem09-full.pddl
0.02 0.01 -0.0 0.01 0.01 0.0
problem09-half.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
problem10-full.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
problem10-half.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
problem11-full.pddl
0.03 0.03 0.0 0.01 0.01 -0.0
problem11-half.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
Sum of diffs
-0.00
-0.00
Arithmetic mean of diffs
-0.00
-0.00
visitall-opt14-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-1-6.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-1-7.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-1-8.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-1-9.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-1-10.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p-1-11.pddl
0.03 0.03 -0.0 0.01 0.01 -0.0
p-1-12.pddl
0.03 0.03 0.0 0.02 0.02 0.0
p-1-13.pddl
0.05 0.05 -0.0 0.02 0.02 -0.0
p-1-14.pddl
0.07 0.07 0.0 0.02 0.02 0.0
p-1-15.pddl
0.08 0.08 -0.0 0.03 0.03 -0.0
p-1-16.pddl
0.12 0.11 -0.0 0.03 0.03 -0.0
p-1-17.pddl
0.12 0.12 0.0 0.04 0.04 -0.0
p-1-18.pddl
0.16 0.16 -0.0 0.04 0.04 -0.0
p-05-5.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-05-6.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-05-7.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-05-8.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-05-9.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-05-10.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
Sum of diffs
-0.01
-0.00
Arithmetic mean of diffs
-0.00
-0.00
woodworking-opt08-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 None None -
p05.pddl
0.13 0.14 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.16 0.16 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 None None -
p09.pddl
0.43 0.45 0.02 None None -
p10.pddl
0.01 0.01 0.0 1.51 1.48 -0.03
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p14.pddl
0.09 0.09 0.0 0.01 0.01 0.0
p15.pddl
0.16 0.16 -0.0 0.01 0.01 0.0
p16.pddl
0.17 0.16 -0.0 None None -
p17.pddl
0.22 0.22 -0.0 0.11 0.10 -0.0
p18.pddl
0.01 0.01 0.0 0.26 0.27 0.02
p19.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p20.pddl
0.39 0.39 0.01 0.86 0.87 0.01
p21.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p22.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p23.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p24.pddl
0.12 0.13 0.01 185.95 182.69 -3.27
p25.pddl
0.20 0.20 -0.0 0.01 0.01 0.0
p26.pddl
0.01 0.01 0.0 None None -
p27.pddl
0.21 0.22 0.01 None None -
p28.pddl
0.43 0.39 -0.04 None None -
p29.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p30.pddl
0.61 0.62 0.02 11.44 11.09 -0.34
Sum of diffs
0.02
-3.61
Arithmetic mean of diffs
0.00
-0.16
woodworking-opt11-strips
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.12 0.13 0.01 182.43 180.06 -2.38
p06.pddl
0.01 0.01 0.0 None None -
p07.pddl
0.09 0.09 0.0 0.01 0.01 0.0
p08.pddl
0.20 0.20 0.0 0.01 0.01 0.0
p09.pddl
0.14 0.13 -0.0 0.01 0.01 0.0
p10.pddl
0.16 0.16 0.0 0.01 0.01 0.0
p11.pddl
0.01 0.01 0.0 None None -
p12.pddl
0.17 0.16 -0.0 None None -
p13.pddl
0.01 0.01 0.0 0.16 0.16 0.0
p14.pddl
0.21 0.21 -0.0 None None -
p15.pddl
0.21 0.21 0.0 0.11 0.10 -0.0
p16.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p17.pddl
0.43 0.41 -0.02 None None -
p18.pddl
0.01 0.01 0.0 0.28 0.28 -0.01
p19.pddl
0.01 0.01 0.0 None None -
p20.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
Sum of diffs
-0.01
-2.38
Arithmetic mean of diffs
-0.00
-0.17
zenotravel
Show table
search_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
p09.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p10.pddl
0.01 0.01 0.0 0.03 0.03 0.0
p11.pddl
0.01 0.01 0.0 0.04 0.04 0.0
p12.pddl
0.01 0.01 0.0 0.04 0.04 0.0
p13.pddl
0.01 0.01 -0.0 0.10 0.09 -0.0
p14.pddl
0.03 0.03 -0.0 2.75 2.77 0.02
p15.pddl
0.07 0.07 0.0 1.27 1.31 0.04
p16.pddl
0.06 0.06 0.0 5.87 5.88 0.01
p17.pddl
0.14 0.14 0.0 31.86 31.91 0.05
p18.pddl
0.22 0.22 -0.01 4.87 4.91 0.04
p19.pddl
0.30 0.29 -0.01 6.98 7.00 0.02
p20.pddl
0.80 0.74 -0.06 13.74 13.30 -0.44
Sum of diffs
-0.06
-0.26
Arithmetic mean of diffs
-0.00
-0.01
total_time
Show table
Only instances where all algorithms have a value for "total_time" are considered. Each table entry gives the geometric mean of "total_time" for that domain. The bottom row reports the geometric mean across all domains.
agricola-opt18-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.87 0.89 0.01 2.37 2.38 0.01
p02.pddl
1.98 1.90 -0.08 2.57 2.63 0.06
p03.pddl
2.93 2.43 -0.5 5.66 5.64 -0.02
p04.pddl
1.38 1.21 -0.16 2.44 2.42 -0.02
p05.pddl
2.52 2.01 -0.52 4.66 4.77 0.11
p06.pddl
3.99 3.39 -0.59 5.21 5.19 -0.02
p07.pddl
2.68 2.44 -0.24 3.95 4.03 0.07
p08.pddl
3.32 2.98 -0.34 4.42 4.37 -0.05
p09.pddl
5.55 4.79 -0.76 6.29 6.27 -0.01
p10.pddl
2.96 2.77 -0.19 3.03 2.89 -0.14
p11.pddl
4.37 3.56 -0.81 6.98 7.02 0.04
p12.pddl
6.68 5.90 -0.78 6.76 7.00 0.24
p13.pddl
3.15 2.83 -0.32 4.78 5.18 0.4
p14.pddl
4.93 4.21 -0.72 7.47 7.36 -0.11
p15.pddl
9.08 8.37 -0.72 8.10 8.01 -0.09
p16.pddl
3.35 3.33 -0.02 4.37 4.40 0.03
p17.pddl
6.03 5.15 -0.88 6.12 6.37 0.25
p18.pddl
13.36 12.38 -0.98 8.97 8.68 -0.29
p19.pddl
4.48 3.54 -0.94 4.69 4.56 -0.13
p20.pddl
7.49 6.45 -1.04 6.97 6.99 0.02
Sum of diffs
-10.59
0.34
Arithmetic mean of diffs
-0.53
0.02
airport
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-airport1-p1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02-airport1-p1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03-airport1-p2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04-airport2-p1.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
p05-airport2-p1.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p06-airport2-p2.pddl
0.03 0.03 0.0 0.04 0.04 -0.0
p07-airport2-p2.pddl
0.03 0.03 0.0 0.04 0.04 0.0
p08-airport2-p3.pddl
0.07 0.07 0.0 0.08 0.08 0.0
p09-airport2-p4.pddl
0.12 0.12 0.0 0.27 0.27 -0.0
p10-airport3-p1.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p11-airport3-p1.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p12-airport3-p2.pddl
0.03 0.03 0.0 0.05 0.05 -0.0
p13-airport3-p2.pddl
0.03 0.03 0.0 0.05 0.05 -0.0
p14-airport3-p3.pddl
0.33 0.33 0.0 0.09 0.09 -0.0
p15-airport3-p3.pddl
0.08 0.08 0.0 0.09 0.09 0.0
p16-airport3-p4.pddl
2.77 2.74 -0.03 0.37 0.37 0.0
p17-airport3-p5.pddl
1.06 1.08 0.02 5.45 5.43 -0.01
p18-airport3-p6.pddl
4.10 4.12 0.02 54.91 53.97 -0.94
p19-airport3-p6.pddl
0.95 0.96 0.01 77.58 75.81 -1.77
p20-airport3-p7.pddl
10.24 10.16 -0.08 536.11 548.17 12.06
p21-airport4halfMUC-p2.pddl
0.46 0.46 -0.0 1.22 1.14 -0.08
p22-airport4halfMUC-p3.pddl
20.29 20.40 0.1 2.13 2.21 0.08
p23-airport4halfMUC-p4.pddl
39.55 38.21 -1.34 3.95 4.15 0.2
p24-airport4halfMUC-p4.pddl
34.69 35.12 0.42 3.46 3.50 0.05
p25-airport4halfMUC-p5.pddl
51.13 53.23 2.11 None None -
p26-airport4halfMUC-p6.pddl
None None - None None -
p27-airport4halfMUC-p6.pddl
63.50 62.32 -1.18 None None -
p28-airport4halfMUC-p7.pddl
None None - None None -
p29-airport4halfMUC-p8.pddl
None None - None None -
p30-airport4halfMUC-p8.pddl
None None - None None -
p31-airport4halfMUC-p9.pddl
None None - None None -
p32-airport4halfMUC-p10.pddl
None None - None None -
p33-airport4halfMUC-p10.pddl
None None - None None -
p34-airport4halfMUC-p11.pddl
None None - None None -
p35-airport4halfMUC-p12.pddl
None None - None None -
p36-airport5MUC-p2.pddl
0.56 0.57 0.01 2.62 2.81 0.19
p37-airport5MUC-p3.pddl
21.31 21.13 -0.18 45.61 45.31 -0.3
p38-airport5MUC-p3.pddl
27.80 27.48 -0.32 10.44 10.26 -0.18
p39-airport5MUC-p4.pddl
45.58 44.15 -1.43 None None -
p40-airport5MUC-p4.pddl
6.48 6.43 -0.05 63.87 63.47 -0.41
p41-airport5MUC-p4.pddl
35.72 36.60 0.87 None None -
p42-airport5MUC-p5.pddl
None None - None None -
p43-airport5MUC-p5.pddl
50.09 50.70 0.61 24.18 25.05 0.87
p44-airport5MUC-p5.pddl
64.24 65.34 1.1 None None -
p45-airport5MUC-p6.pddl
None None - None None -
p46-airport5MUC-p6.pddl
None None - None None -
p47-airport5MUC-p8.pddl
None None - None None -
p48-airport5MUC-p9.pddl
None None - None None -
p49-airport5MUC-p10.pddl
None None - None None -
p50-airport5MUC-p15.pddl
None None - None None -
Sum of diffs
0.67
9.75
Arithmetic mean of diffs
0.02
0.34
barman-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile01-001.pddl
0.04 0.04 0.0 0.08 0.08 0.0
pfile01-002.pddl
0.03 0.03 -0.0 0.07 0.07 0.0
pfile01-003.pddl
0.03 0.03 0.0 0.07 0.07 -0.0
pfile01-004.pddl
0.03 0.03 -0.0 0.07 0.07 0.0
pfile02-005.pddl
0.05 0.06 0.0 0.26 0.26 0.01
pfile02-006.pddl
0.05 0.05 0.0 3.40 3.28 -0.12
pfile02-007.pddl
0.05 0.05 0.0 0.26 0.25 -0.0
pfile02-008.pddl
0.05 0.05 0.0 0.32 0.32 -0.01
pfile03-009.pddl
0.08 0.08 -0.0 1.00 1.02 0.02
pfile03-010.pddl
0.12 0.12 0.0 1.02 0.99 -0.03
pfile03-011.pddl
0.09 0.09 0.0 1.11 1.02 -0.09
pfile03-012.pddl
0.11 0.12 0.0 1.11 1.10 -0.01
pfile04-013.pddl
0.17 0.18 0.0 4.59 4.74 0.15
pfile04-014.pddl
0.18 0.18 0.0 10.80 11.31 0.51
pfile04-015.pddl
0.23 0.25 0.02 5.31 5.17 -0.14
pfile04-016.pddl
0.24 0.24 -0.0 4.54 4.76 0.22
pfile05-017.pddl
0.23 0.23 0.0 8.37 8.28 -0.09
pfile05-018.pddl
0.23 0.24 0.01 10.15 10.22 0.07
pfile05-019.pddl
0.23 0.25 0.02 15.95 16.12 0.17
pfile05-020.pddl
0.21 0.21 0.0 22.84 22.31 -0.53
Sum of diffs
0.06
0.12
Arithmetic mean of diffs
0.00
0.01
barman-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p435-1.pddl
0.05 0.06 0.0 3.30 3.29 -0.01
p435-2.pddl
0.07 0.07 0.0 0.27 0.26 -0.01
p435-3.pddl
0.06 0.06 -0.0 3.25 3.37 0.12
p536-1.pddl
0.08 0.08 0.0 33.75 32.88 -0.87
p536-2.pddl
0.12 0.12 0.0 0.99 1.00 0.01
p536-3.pddl
0.08 0.08 -0.0 1.12 1.01 -0.12
p638-1.pddl
0.16 0.15 -0.01 4.74 4.55 -0.19
p638-2.pddl
0.12 0.12 0.0 9.61 9.20 -0.41
p638-3.pddl
0.18 0.18 0.0 5.33 5.11 -0.23
p739-1.pddl
0.21 0.21 0.0 14.20 14.82 0.63
p739-2.pddl
0.33 0.33 -0.0 16.41 16.57 0.16
p739-3.pddl
0.25 0.25 -0.0 16.46 16.54 0.08
p839-1.pddl
0.33 0.33 0.0 29.43 30.78 1.35
p839-2.pddl
0.29 0.31 0.02 26.91 26.55 -0.36
Sum of diffs
0.02
0.15
Arithmetic mean of diffs
0.00
0.01
blocks
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probBLOCKS-4-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-4-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-4-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-5-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-5-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-5-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-6-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-6-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-6-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-7-0.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
probBLOCKS-7-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-7-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-8-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probBLOCKS-8-1.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
probBLOCKS-8-2.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
probBLOCKS-9-0.pddl
0.01 0.01 0.0 0.02 0.02 0.0
probBLOCKS-9-1.pddl
0.02 0.02 -0.0 0.02 0.02 -0.0
probBLOCKS-9-2.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
probBLOCKS-10-0.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
probBLOCKS-10-1.pddl
0.02 0.02 -0.0 0.04 0.04 -0.0
probBLOCKS-10-2.pddl
0.02 0.02 0.0 0.02 0.03 0.0
probBLOCKS-11-0.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
probBLOCKS-11-1.pddl
0.02 0.02 0.0 0.05 0.05 -0.0
probBLOCKS-11-2.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
probBLOCKS-12-0.pddl
0.02 0.02 0.0 0.03 0.03 -0.0
probBLOCKS-12-1.pddl
0.02 0.03 0.0 0.05 0.05 -0.0
probBLOCKS-13-0.pddl
0.04 0.04 0.0 0.04 0.04 -0.0
probBLOCKS-13-1.pddl
0.03 0.03 0.0 0.04 0.04 -0.0
probBLOCKS-14-0.pddl
0.03 0.04 0.02 0.04 0.04 -0.0
probBLOCKS-14-1.pddl
0.03 0.03 0.0 0.05 0.05 0.0
probBLOCKS-15-0.pddl
0.06 0.06 -0.0 0.08 0.08 0.0
probBLOCKS-15-1.pddl
0.04 0.04 0.0 0.61 0.61 -0.0
probBLOCKS-16-1.pddl
0.05 0.05 -0.0 0.16 0.15 -0.01
probBLOCKS-16-2.pddl
0.13 0.13 0.0 0.12 0.13 0.01
probBLOCKS-17-0.pddl
0.16 0.16 -0.0 3.85 4.16 0.32
Sum of diffs
0.02
0.31
Arithmetic mean of diffs
0.00
0.01
childsnack-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
child-snack_pfile01-2.pddl
0.02 0.02 -0.0 6.12 5.74 -0.37
child-snack_pfile01.pddl
0.02 0.02 -0.0 6.50 6.22 -0.28
child-snack_pfile02-2.pddl
0.04 0.04 0.0 35.56 33.76 -1.81
child-snack_pfile02.pddl
0.03 0.03 0.0 38.75 38.99 0.24
child-snack_pfile03-2.pddl
0.08 0.08 -0.0 181.09 180.60 -0.49
child-snack_pfile03.pddl
0.07 0.07 0.0 189.23 185.07 -4.16
child-snack_pfile04-2.pddl
0.10 0.10 -0.0 None None -
child-snack_pfile04.pddl
0.11 0.11 -0.0 None None -
child-snack_pfile05-2.pddl
0.16 0.17 0.01 None None -
child-snack_pfile05.pddl
0.15 0.15 0.0 None None -
child-snack_pfile06-2.pddl
0.21 0.21 -0.0 None None -
child-snack_pfile06.pddl
0.23 0.23 -0.0 None None -
child-snack_pfile07-2.pddl
0.31 0.33 0.02 None None -
child-snack_pfile07.pddl
0.39 0.39 -0.0 None None -
child-snack_pfile08-2.pddl
0.42 0.42 -0.0 None None -
child-snack_pfile08.pddl
None None - None None -
child-snack_pfile09-2.pddl
None None - None None -
child-snack_pfile09.pddl
None None - None None -
child-snack_pfile10-2.pddl
None None - None None -
child-snack_pfile10.pddl
None None - None None -
Sum of diffs
0.02
-6.87
Arithmetic mean of diffs
0.00
-1.14
data-network-opt18-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
p02.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p03.pddl
0.02 0.02 -0.0 0.03 0.03 0.0
p04.pddl
0.03 0.03 0.0 0.05 0.05 -0.0
p05.pddl
0.02 0.02 0.0 0.03 0.04 0.0
p06.pddl
0.03 0.03 0.0 0.04 0.04 -0.0
p07.pddl
0.04 0.04 0.0 19.55 19.82 0.27
p08.pddl
0.29 0.28 -0.02 0.05 0.05 -0.0
p09.pddl
0.02 0.02 0.0 0.03 0.03 -0.0
p10.pddl
0.02 0.02 -0.0 0.03 0.03 -0.0
p11.pddl
0.02 0.02 -0.0 0.04 0.04 0.0
p12.pddl
0.02 0.03 0.0 0.04 0.04 -0.0
p13.pddl
0.03 0.03 0.0 0.05 0.05 -0.0
p14.pddl
0.14 0.15 0.0 0.06 0.06 -0.0
p15.pddl
0.03 0.03 0.0 0.05 0.05 -0.0
p16.pddl
0.05 0.05 0.0 0.19 0.19 -0.0
p17.pddl
0.04 0.04 0.0 0.08 0.08 0.0
p18.pddl
0.68 0.67 -0.01 9.15 8.87 -0.28
p19.pddl
0.06 0.06 0.0 0.65 0.68 0.04
p20.pddl
0.27 0.28 0.01 40.00 41.25 1.25
Sum of diffs
-0.00
1.28
Arithmetic mean of diffs
-0.00
0.06
depot
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p03.pddl
0.14 0.14 -0.0 0.06 0.06 -0.0
p04.pddl
0.11 0.11 -0.0 0.03 0.03 -0.0
p05.pddl
4.38 4.42 0.04 0.04 0.04 0.0
p06.pddl
746.13 759.75 13.62 0.10 0.10 0.0
p07.pddl
0.04 0.04 0.0 0.79 0.82 0.03
p08.pddl
0.49 0.49 0.01 0.07 0.07 0.0
p09.pddl
3.70 3.80 0.1 7.35 7.37 0.02
p10.pddl
0.46 0.47 0.01 0.05 0.05 0.0
p11.pddl
1.94 1.93 -0.01 0.11 0.12 0.0
p12.pddl
6.69 6.63 -0.05 None None -
p13.pddl
0.05 0.05 0.0 0.04 0.04 -0.0
p14.pddl
0.15 0.13 -0.01 15.27 14.88 -0.39
p15.pddl
69.38 68.07 -1.31 151.68 152.28 0.6
p16.pddl
0.06 0.06 0.0 15.67 15.32 -0.35
p17.pddl
0.12 0.11 -0.0 0.32 0.31 -0.01
p18.pddl
0.59 0.57 -0.02 None None -
p19.pddl
1.75 1.73 -0.02 258.40 267.12 8.72
p20.pddl
None None - 1.71 1.70 -0.01
p21.pddl
0.34 0.34 0.0 71.33 72.55 1.22
p22.pddl
None None - None None -
Sum of diffs
12.35
9.83
Arithmetic mean of diffs
0.62
0.52
driverlog
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.08 0.07 -0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.08 0.08 -0.0 0.01 0.01 0.0
p05.pddl
0.09 0.09 -0.0 0.04 0.04 0.0
p06.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
p08.pddl
0.13 0.13 -0.0 0.01 0.02 0.0
p09.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
p10.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p11.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p12.pddl
0.23 0.22 -0.0 0.02 0.02 -0.0
p13.pddl
0.13 0.13 -0.0 0.03 0.03 -0.0
p14.pddl
0.03 0.03 0.0 0.04 0.04 0.0
p15.pddl
0.06 0.06 -0.0 0.24 0.24 0.0
p16.pddl
3.26 3.22 -0.04 1.50 1.52 0.02
p17.pddl
0.28 0.28 0.01 None None -
p18.pddl
5.81 5.94 0.13 6.73 7.00 0.27
p19.pddl
6.71 6.76 0.05 30.62 31.04 0.41
p20.pddl
4.66 4.54 -0.12 9.08 9.04 -0.04
Sum of diffs
0.03
0.67
Arithmetic mean of diffs
0.00
0.04
elevators-opt08-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p02.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.02 0.02 0.0 0.05 0.05 0.0
p05.pddl
0.02 0.02 -0.0 0.02 0.02 -0.0
p06.pddl
0.02 0.02 -0.0 0.05 0.05 0.0
p07.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
p08.pddl
0.02 0.02 0.0 0.03 0.03 -0.0
p09.pddl
0.03 0.03 0.0 0.06 0.06 -0.0
p10.pddl
0.03 0.03 0.0 0.06 0.06 -0.0
p11.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
p12.pddl
0.01 0.01 -0.0 0.02 0.02 0.0
p13.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p14.pddl
0.02 0.02 0.0 0.04 0.04 0.0
p15.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p16.pddl
0.03 0.03 0.0 0.11 0.09 -0.01
p17.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p18.pddl
0.02 0.02 -0.0 0.05 0.05 0.0
p19.pddl
0.03 0.03 -0.0 0.04 0.04 0.0
p20.pddl
0.03 0.03 0.0 0.04 0.04 -0.0
p21.pddl
0.01 0.01 -0.0 0.05 0.05 0.0
p22.pddl
0.01 0.01 0.0 0.12 0.11 -0.0
p23.pddl
0.02 0.02 0.0 0.08 0.08 0.0
p24.pddl
0.02 0.02 -0.0 0.27 0.26 -0.01
p25.pddl
0.02 0.02 0.0 0.06 0.06 0.0
p26.pddl
0.02 0.02 0.0 0.03 0.03 -0.0
p27.pddl
0.03 0.03 0.0 0.07 0.06 -0.0
p28.pddl
0.03 0.03 -0.0 0.08 0.08 -0.0
p29.pddl
0.03 0.03 0.0 0.09 0.09 0.0
p30.pddl
0.04 0.04 0.0 0.61 0.59 -0.03
Sum of diffs
0.01
-0.04
Arithmetic mean of diffs
0.00
-0.00
elevators-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
p02.pddl
0.01 0.01 0.0 0.05 0.06 0.0
p03.pddl
0.02 0.01 -0.0 0.02 0.02 -0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p05.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
p06.pddl
0.02 0.02 0.0 0.05 0.05 0.0
p07.pddl
0.02 0.02 0.0 0.03 0.03 0.0
p08.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p09.pddl
0.01 0.01 0.0 0.12 0.11 -0.0
p10.pddl
0.02 0.02 0.0 0.04 0.03 -0.0
p11.pddl
0.03 0.03 0.0 0.08 0.08 0.0
p12.pddl
0.02 0.02 -0.0 0.05 0.05 0.0
p13.pddl
0.02 0.02 -0.0 0.02 0.02 -0.0
p14.pddl
0.02 0.02 0.0 0.04 0.03 -0.0
p15.pddl
0.03 0.03 -0.0 0.06 0.06 0.0
p16.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p17.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
p18.pddl
0.03 0.02 -0.0 0.05 0.05 0.0
p19.pddl
0.02 0.02 0.0 0.08 0.08 0.0
p20.pddl
0.02 0.02 -0.0 0.26 0.26 -0.0
Sum of diffs
0.00
-0.00
Arithmetic mean of diffs
0.00
-0.00
floortile-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
opt-p01-001.pddl
0.04 0.04 0.0 2.31 2.32 0.0
opt-p01-002.pddl
0.01 0.01 -0.0 1.43 1.41 -0.02
opt-p02-003.pddl
14.89 15.28 0.39 None None -
opt-p02-004.pddl
8.55 8.01 -0.55 None None -
opt-p03-005.pddl
12.47 13.03 0.56 None None -
opt-p03-006.pddl
90.49 90.85 0.36 None None -
opt-p04-007.pddl
152.24 155.45 3.2 None None -
opt-p04-008.pddl
390.30 404.54 14.24 None None -
opt-p05-009.pddl
89.25 85.97 -3.29 None None -
opt-p05-010.pddl
None None - None None -
opt-p06-011.pddl
None None - None None -
opt-p06-012.pddl
None None - None None -
opt-p07-013.pddl
None None - None None -
opt-p07-014.pddl
None None - None None -
opt-p08-015.pddl
None None - None None -
opt-p08-016.pddl
None None - None None -
opt-p09-017.pddl
None None - None None -
opt-p09-018.pddl
None None - None None -
opt-p10-019.pddl
None None - None None -
opt-p10-020.pddl
None None - None None -
Sum of diffs
14.92
-0.02
Arithmetic mean of diffs
1.66
-0.01
floortile-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-4-3-2.pddl
10.48 10.49 0.01 None None -
p01-4-4-2.pddl
220.94 222.31 1.37 None None -
p01-5-3-2.pddl
156.79 160.46 3.67 None None -
p01-5-4-2.pddl
None None - None None -
p01-5-5-2.pddl
None None - None None -
p01-6-4-2.pddl
None None - None None -
p01-6-5-2.pddl
None None - None None -
p02-4-4-2.pddl
261.13 272.85 11.72 None None -
p02-5-3-2.pddl
77.51 78.64 1.13 None None -
p02-5-4-2.pddl
None None - None None -
p02-5-5-2.pddl
None None - None None -
p02-6-4-2.pddl
None None - None None -
p02-6-5-2.pddl
None None - None None -
p03-4-3-2.pddl
12.69 12.78 0.08 None None -
p03-4-4-2.pddl
193.32 191.39 -1.93 None None -
p03-5-3-2.pddl
86.30 84.46 -1.84 None None -
p03-5-4-2.pddl
208.46 205.11 -3.35 None None -
p03-5-5-2.pddl
None None - None None -
p03-6-4-2.pddl
None None - None None -
p03-6-5-2.pddl
None None - None None -
Sum of diffs
10.87
None
Arithmetic mean of diffs
1.21
None
freecell
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.02 0.02 -0.0 0.02 0.02 -0.0
p02.pddl
0.03 0.03 -0.0 0.03 0.04 0.0
p03.pddl
0.05 0.05 0.0 0.06 0.06 -0.0
p04.pddl
0.08 0.08 0.0 0.07 0.07 -0.0
p05.pddl
0.13 0.12 -0.01 0.15 0.16 0.0
p06.pddl
0.21 0.21 -0.0 0.22 0.22 -0.0
p07.pddl
0.41 0.40 -0.01 0.20 0.20 -0.0
p08.pddl
0.33 0.34 0.01 0.28 0.27 -0.0
p09.pddl
0.31 0.33 0.02 0.28 0.28 -0.01
p10.pddl
0.68 0.64 -0.04 0.40 0.40 -0.0
p11.pddl
1.63 1.59 -0.05 0.42 0.42 -0.0
p12.pddl
0.50 0.53 0.03 0.41 0.39 -0.02
p13.pddl
2.25 2.23 -0.02 0.62 0.66 0.04
p14.pddl
0.71 0.75 0.04 0.69 0.72 0.03
p15.pddl
1.08 1.24 0.15 0.86 0.85 -0.01
p16.pddl
1.07 1.10 0.03 0.87 0.89 0.01
p17.pddl
1.68 1.52 -0.16 1.39 1.49 0.1
p18.pddl
2.09 2.35 0.26 1.41 1.52 0.11
p19.pddl
18.55 17.36 -1.2 1.72 1.76 0.05
p20.pddl
2.11 2.54 0.43 1.64 1.83 0.19
probfreecell-2-1.pddl
0.07 0.08 0.0 0.10 0.10 -0.0
probfreecell-2-2.pddl
0.08 0.08 0.0 0.08 0.08 0.0
probfreecell-2-3.pddl
0.08 0.08 -0.0 0.09 0.08 -0.0
probfreecell-2-4.pddl
0.08 0.08 -0.0 0.08 0.08 0.0
probfreecell-2-5.pddl
0.08 0.08 0.0 0.08 0.08 -0.0
probfreecell-3-1.pddl
0.14 0.13 -0.0 0.16 0.16 0.0
probfreecell-3-2.pddl
0.14 0.14 0.0 0.14 0.15 0.0
probfreecell-3-3.pddl
0.14 0.15 0.01 0.14 0.14 -0.0
probfreecell-3-4.pddl
0.15 0.14 -0.0 0.14 0.15 0.0
probfreecell-3-5.pddl
0.14 0.14 0.01 0.15 0.14 -0.0
probfreecell-4-1.pddl
0.24 0.23 -0.01 0.26 0.26 0.0
probfreecell-4-2.pddl
0.22 0.22 0.0 0.20 0.22 0.02
probfreecell-4-3.pddl
0.24 0.21 -0.03 0.22 0.22 -0.0
probfreecell-4-4.pddl
0.23 0.22 -0.0 0.22 0.21 -0.01
probfreecell-4-5.pddl
0.21 0.22 0.01 0.22 0.22 0.0
probfreecell-5-1.pddl
0.33 0.32 -0.01 0.38 0.38 0.0
probfreecell-5-2.pddl
0.31 0.33 0.02 0.31 0.31 0.0
probfreecell-5-3.pddl
0.32 0.34 0.02 0.31 0.31 -0.01
probfreecell-5-4.pddl
0.36 0.31 -0.05 0.39 0.38 -0.01
probfreecell-5-5.pddl
0.32 0.33 0.01 0.38 0.37 -0.01
probfreecell-6-1.pddl
0.45 0.46 0.01 0.42 0.39 -0.04
probfreecell-6-2.pddl
0.42 0.42 -0.0 0.37 0.39 0.01
probfreecell-6-3.pddl
0.42 0.42 -0.0 0.50 0.49 -0.01
probfreecell-6-4.pddl
0.47 0.45 -0.02 0.41 0.41 0.01
probfreecell-6-5.pddl
0.44 0.43 -0.01 0.51 0.50 -0.0
probfreecell-7-1.pddl
0.58 0.64 0.06 0.68 0.63 -0.05
probfreecell-7-2.pddl
0.54 0.54 -0.01 0.76 0.70 -0.06
probfreecell-7-3.pddl
0.59 0.67 0.09 0.64 0.65 0.0
probfreecell-7-4.pddl
0.63 0.63 -0.0 0.66 0.63 -0.03
probfreecell-7-5.pddl
0.55 0.58 0.03 0.75 0.76 0.01
probfreecell-8-1.pddl
0.82 0.85 0.03 0.90 0.87 -0.03
probfreecell-8-2.pddl
0.78 0.76 -0.02 0.66 0.65 -0.0
probfreecell-8-3.pddl
0.78 0.75 -0.04 0.83 0.77 -0.06
probfreecell-8-4.pddl
0.81 0.75 -0.06 0.77 0.83 0.06
probfreecell-8-5.pddl
0.78 0.80 0.01 0.78 0.80 0.03
probfreecell-9-1.pddl
1.07 0.94 -0.13 1.13 1.15 0.02
probfreecell-9-2.pddl
0.91 0.90 -0.01 0.92 0.95 0.03
probfreecell-9-3.pddl
1.06 1.00 -0.07 0.95 0.96 0.0
probfreecell-9-4.pddl
0.91 0.89 -0.02 1.03 0.92 -0.11
probfreecell-9-5.pddl
1.05 0.90 -0.16 0.97 0.93 -0.04
probfreecell-10-1.pddl
2.52 2.53 0.02 1.09 1.14 0.05
probfreecell-10-2.pddl
1.21 1.11 -0.1 0.88 0.91 0.03
probfreecell-10-3.pddl
1.31 1.23 -0.08 1.16 1.27 0.11
probfreecell-10-4.pddl
1.52 1.34 -0.18 1.21 1.21 0.0
probfreecell-10-5.pddl
1.52 1.42 -0.09 1.14 1.20 0.07
probfreecell-11-1.pddl
1.63 1.54 -0.1 1.45 1.49 0.04
probfreecell-11-2.pddl
1.64 1.56 -0.09 1.66 1.66 0.0
probfreecell-11-3.pddl
1.55 1.38 -0.17 1.61 1.56 -0.06
probfreecell-11-4.pddl
1.52 1.41 -0.11 1.64 1.61 -0.02
probfreecell-11-5.pddl
None None - 1.28 1.40 0.12
probfreecell-12-1.pddl
19.97 18.21 -1.76 1.64 1.50 -0.14
probfreecell-12-2.pddl
2.82 2.17 -0.65 1.60 1.64 0.04
probfreecell-12-3.pddl
1.70 1.82 0.12 1.98 2.12 0.14
probfreecell-12-4.pddl
1.81 2.05 0.24 1.39 1.32 -0.07
probfreecell-12-5.pddl
633.45 639.80 6.35 1.74 1.73 -0.02
probfreecell-13-1.pddl
39.11 38.34 -0.76 1.80 1.67 -0.13
probfreecell-13-2.pddl
19.25 21.09 1.84 1.73 1.70 -0.03
probfreecell-13-3.pddl
2.11 2.16 0.04 1.44 1.43 -0.01
probfreecell-13-4.pddl
7.41 6.75 -0.67 1.43 1.51 0.09
probfreecell-13-5.pddl
624.28 645.34 21.06 9.31 9.04 -0.27
Sum of diffs
24.03
0.14
Arithmetic mean of diffs
0.30
0.00
ged-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
d-1-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-1-3.pddl
0.02 0.02 -0.0 0.02 0.02 -0.0
d-1-4.pddl
0.02 0.01 -0.01 0.01 0.01 0.0
d-1-8.pddl
0.02 0.02 0.0 0.03 0.03 0.0
d-2-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-2-3.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
d-2-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-2-8.pddl
0.03 0.03 -0.0 0.05 0.05 0.0
d-3-1.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
d-3-2.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
d-3-4.pddl
0.02 0.02 -0.0 0.03 0.03 0.0
d-4-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
d-4-3.pddl
0.02 0.02 0.0 0.03 0.03 0.0
d-4-8.pddl
0.03 0.03 0.0 0.05 0.04 -0.0
d-7-5.pddl
0.02 0.02 -0.0 0.03 0.03 -0.0
d-7-6.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
d-8-1.pddl
0.02 0.02 0.0 0.03 0.03 0.0
d-8-2.pddl
0.03 0.03 0.0 0.05 0.05 0.0
d-8-4.pddl
0.03 0.03 -0.0 0.05 0.05 0.0
d-8-9.pddl
0.04 0.04 0.0 0.05 0.05 0.0
Sum of diffs
-0.00
0.00
Arithmetic mean of diffs
-0.00
0.00
grid
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.04 0.04 0.0 0.07 0.07 0.0
prob02.pddl
0.07 0.07 -0.0 0.14 0.14 -0.0
prob03.pddl
0.14 0.15 0.01 None None -
prob04.pddl
0.19 0.18 -0.01 0.27 0.26 -0.01
prob05.pddl
0.48 0.55 0.07 7.89 7.83 -0.06
Sum of diffs
0.06
-0.07
Arithmetic mean of diffs
0.01
-0.02
gripper
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob07.pddl
0.01 0.03 0.02 0.01 0.01 0.0
prob08.pddl
0.01 0.02 0.0 0.01 0.01 -0.0
prob09.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
prob10.pddl
0.02 0.02 0.0 0.02 0.02 0.0
prob11.pddl
0.02 0.02 0.0 0.03 0.03 -0.0
prob12.pddl
0.02 0.02 0.0 0.03 0.03 0.0
prob13.pddl
0.02 0.02 0.0 0.04 0.04 0.0
prob14.pddl
0.02 0.02 -0.0 0.05 0.05 -0.0
prob15.pddl
0.03 0.03 0.0 0.05 0.06 0.0
prob16.pddl
0.03 0.03 0.0 0.06 0.07 0.0
prob17.pddl
0.03 0.03 -0.0 0.09 0.08 -0.02
prob18.pddl
0.03 0.03 0.0 0.09 0.09 0.0
prob19.pddl
0.03 0.04 0.0 0.11 0.11 -0.0
prob20.pddl
0.04 0.04 -0.0 0.12 0.13 0.0
Sum of diffs
0.02
-0.01
Arithmetic mean of diffs
0.00
-0.00
hiking-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
ptesting-1-2-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
ptesting-1-2-4.pddl
0.02 0.02 0.0 0.02 0.02 0.0
ptesting-1-2-5.pddl
0.06 0.06 -0.0 0.04 0.04 -0.0
ptesting-1-2-7.pddl
0.27 0.27 0.0 0.18 0.18 0.0
ptesting-1-2-8.pddl
0.53 0.53 -0.0 0.38 0.38 -0.0
ptesting-2-2-3.pddl
0.02 0.02 0.0 0.05 0.05 -0.0
ptesting-2-2-4.pddl
0.12 0.12 -0.0 0.39 0.38 -0.01
ptesting-2-2-5.pddl
0.30 0.29 -0.01 1.00 1.03 0.03
ptesting-2-2-6.pddl
0.57 0.58 0.01 1.38 1.45 0.07
ptesting-2-2-7.pddl
1.36 1.32 -0.05 4.31 4.18 -0.12
ptesting-2-2-8.pddl
1.83 1.82 -0.01 4.79 4.63 -0.16
ptesting-2-3-4.pddl
0.20 0.18 -0.01 0.41 0.41 0.0
ptesting-2-3-5.pddl
0.41 0.42 0.01 1.33 1.41 0.08
ptesting-2-3-6.pddl
0.87 0.86 -0.01 3.92 4.06 0.14
ptesting-2-3-7.pddl
1.95 1.87 -0.08 4.94 4.87 -0.07
ptesting-2-4-3.pddl
0.03 0.03 -0.0 0.12 0.12 0.01
ptesting-2-4-4.pddl
0.22 0.22 -0.01 0.63 0.67 0.04
ptesting-2-4-5.pddl
0.67 0.67 0.0 2.03 2.01 -0.01
ptesting-2-4-6.pddl
1.01 1.04 0.03 4.71 5.18 0.46
ptesting-2-4-7.pddl
2.08 2.09 0.02 12.46 11.96 -0.5
Sum of diffs
-0.11
-0.04
Arithmetic mean of diffs
-0.01
-0.00
logistics00
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
probLOGISTICS-4-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-4-1.pddl
0.02 0.01 -0.01 0.01 0.01 0.0
probLOGISTICS-4-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-5-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-5-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-5-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-6-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-6-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-6-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-6-9.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-7-0.pddl
0.01 0.01 0.0 0.02 0.01 -0.01
probLOGISTICS-7-1.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
probLOGISTICS-8-0.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
probLOGISTICS-8-1.pddl
0.01 0.02 0.0 0.01 0.01 -0.0
probLOGISTICS-9-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
probLOGISTICS-9-1.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
probLOGISTICS-10-0.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
probLOGISTICS-10-1.pddl
0.02 0.02 0.0 0.01 0.01 0.0
probLOGISTICS-11-0.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
probLOGISTICS-11-1.pddl
0.02 0.02 -0.0 0.02 0.02 -0.0
probLOGISTICS-12-0.pddl
0.02 0.02 0.0 0.01 0.02 0.0
probLOGISTICS-12-1.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
probLOGISTICS-13-0.pddl
0.04 0.04 -0.0 0.10 0.10 0.0
probLOGISTICS-13-1.pddl
0.04 0.04 0.0 0.08 0.08 0.0
probLOGISTICS-14-0.pddl
0.03 0.03 0.0 0.10 0.10 0.0
probLOGISTICS-14-1.pddl
0.04 0.04 -0.0 0.14 0.15 0.0
probLOGISTICS-15-0.pddl
0.05 0.05 0.0 0.16 0.15 -0.01
probLOGISTICS-15-1.pddl
0.04 0.04 0.0 0.19 0.19 0.0
Sum of diffs
-0.01
-0.01
Arithmetic mean of diffs
-0.00
-0.00
logistics98
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.01 0.01 0.0 0.05 0.05 0.0
prob02.pddl
0.04 0.03 -0.01 0.73 0.71 -0.02
prob03.pddl
0.06 0.06 0.0 26.41 28.42 2.02
prob04.pddl
0.12 0.12 0.0 None None -
prob05.pddl
0.01 0.01 0.0 0.02 0.02 0.0
prob06.pddl
0.20 0.21 0.0 None None -
prob07.pddl
0.04 0.04 -0.0 4.09 4.16 0.07
prob08.pddl
0.09 0.09 0.0 None None -
prob09.pddl
0.40 0.40 0.0 None None -
prob10.pddl
0.45 0.45 0.0 165.84 172.19 6.35
prob11.pddl
0.03 0.03 -0.0 3.95 4.19 0.24
prob12.pddl
0.21 0.21 -0.01 None None -
prob13.pddl
0.41 0.41 0.01 None None -
prob14.pddl
0.48 0.48 0.0 None None -
prob15.pddl
0.13 0.12 -0.0 6.72 6.78 0.06
prob16.pddl
0.15 0.16 0.01 None None -
prob17.pddl
0.06 0.06 -0.0 None None -
prob18.pddl
3.57 3.36 -0.21 None None -
prob19.pddl
1.38 1.49 0.11 None None -
prob20.pddl
3.21 3.29 0.09 None None -
prob21.pddl
1.10 1.09 -0.01 None None -
prob22.pddl
42.01 41.98 -0.03 None None -
prob23.pddl
0.36 0.36 0.0 143.37 140.00 -3.36
prob24.pddl
0.25 0.26 0.02 None None -
prob25.pddl
8.35 8.54 0.19 None None -
prob26.pddl
7.27 7.27 -0.0 None None -
prob27.pddl
4.49 4.59 0.1 None None -
prob28.pddl
176.18 127.67 -48.52 None None -
prob29.pddl
18.42 18.14 -0.27 None None -
prob30.pddl
5.92 5.98 0.06 None None -
prob31.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
prob32.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob33.pddl
0.01 0.01 0.0 0.02 0.02 0.0
prob34.pddl
0.04 0.04 -0.0 1.24 1.22 -0.02
prob35.pddl
0.02 0.02 -0.0 0.11 0.11 0.0
Sum of diffs
-48.48
5.33
Arithmetic mean of diffs
-1.39
0.38
miconic
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
s1-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s1-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s1-2.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
s1-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s1-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s2-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s2-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s2-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s2-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s2-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s3-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s3-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s3-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s3-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s3-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s4-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s4-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s4-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s4-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s4-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s5-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s5-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s5-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s5-3.pddl
0.01 0.01 0.0 0.01 0.02 0.01
s5-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s6-0.pddl
0.01 0.02 0.01 0.01 0.01 0.0
s6-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s6-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s6-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s6-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s7-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s7-1.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
s7-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s7-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s7-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s8-0.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s8-1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s8-2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s8-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s8-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s9-0.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
s9-1.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
s9-2.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
s9-3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s9-4.pddl
0.01 0.01 0.0 0.01 0.01 0.0
s10-0.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s10-1.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s10-2.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s10-3.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s10-4.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s11-0.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
s11-1.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s11-2.pddl
0.02 0.02 0.0 0.01 0.01 0.0
s11-3.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
s11-4.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
s12-0.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s12-1.pddl
0.02 0.02 0.0 0.01 0.01 0.0
s12-2.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
s12-3.pddl
0.02 0.02 0.0 0.01 0.01 0.0
s12-4.pddl
0.02 0.02 0.0 0.01 0.01 0.0
s13-0.pddl
0.03 0.03 0.0 0.01 0.02 0.0
s13-1.pddl
0.02 0.02 0.0 0.02 0.01 -0.0
s13-2.pddl
0.03 0.03 -0.0 0.02 0.02 -0.0
s13-3.pddl
0.02 0.03 0.0 0.02 0.02 0.0
s13-4.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
s14-0.pddl
0.03 0.03 -0.0 0.02 0.02 0.0
s14-1.pddl
0.03 0.03 0.0 0.02 0.02 0.0
s14-2.pddl
0.03 0.03 -0.0 0.02 0.02 0.0
s14-3.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
s14-4.pddl
0.03 0.03 0.0 0.02 0.02 0.0
s15-0.pddl
0.03 0.03 0.0 0.02 0.02 0.0
s15-1.pddl
0.04 0.04 0.0 0.02 0.02 -0.0
s15-2.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
s15-3.pddl
0.03 0.03 -0.0 0.02 0.02 0.0
s15-4.pddl
0.03 0.05 0.02 0.02 0.02 0.0
s16-0.pddl
0.04 0.04 -0.0 0.02 0.02 -0.0
s16-1.pddl
0.04 0.04 0.0 0.02 0.02 -0.0
s16-2.pddl
0.04 0.04 0.0 0.02 0.02 0.0
s16-3.pddl
0.04 0.04 0.0 0.02 0.02 0.0
s16-4.pddl
0.04 0.04 0.0 0.02 0.02 -0.0
s17-0.pddl
0.04 0.04 0.0 0.02 0.02 -0.0
s17-1.pddl
0.04 0.04 0.0 0.02 0.04 0.01
s17-2.pddl
0.04 0.04 0.0 0.02 0.02 -0.0
s17-3.pddl
0.05 0.05 0.0 0.02 0.02 0.0
s17-4.pddl
0.04 0.04 -0.0 0.02 0.02 -0.0
s18-0.pddl
0.05 0.05 -0.0 0.03 0.03 -0.0
s18-1.pddl
0.05 0.05 -0.0 0.03 0.03 0.0
s18-2.pddl
0.05 0.05 -0.0 0.03 0.03 -0.0
s18-3.pddl
0.05 0.05 0.0 0.03 0.03 -0.0
s18-4.pddl
0.05 0.05 0.0 0.02 0.02 0.0
s19-0.pddl
0.06 0.06 0.0 0.03 0.03 0.0
s19-1.pddl
0.06 0.06 0.0 0.03 0.03 -0.0
s19-2.pddl
0.06 0.06 -0.0 0.03 0.03 -0.0
s19-3.pddl
0.06 0.06 0.0 0.03 0.03 0.0
s19-4.pddl
0.05 0.05 -0.0 0.03 0.03 -0.0
s20-0.pddl
0.06 0.06 0.0 0.03 0.03 -0.0
s20-1.pddl
0.06 0.06 0.0 0.03 0.03 -0.0
s20-2.pddl
0.06 0.06 0.0 0.03 0.03 -0.0
s20-3.pddl
0.06 0.06 -0.0 0.03 0.03 -0.0
s20-4.pddl
0.06 0.06 0.0 0.03 0.03 0.0
s21-0.pddl
0.07 0.07 0.0 0.03 0.03 -0.0
s21-1.pddl
0.07 0.07 -0.0 0.04 0.04 0.0
s21-2.pddl
0.06 0.06 0.0 0.04 0.04 0.0
s21-3.pddl
0.07 0.06 -0.0 0.03 0.03 -0.0
s21-4.pddl
0.06 0.06 0.0 0.04 0.04 0.0
s22-0.pddl
0.08 0.08 0.0 0.04 0.04 0.0
s22-1.pddl
0.08 0.08 0.0 0.04 0.04 -0.0
s22-2.pddl
0.08 0.08 -0.0 0.04 0.04 0.0
s22-3.pddl
0.08 0.08 0.0 0.04 0.04 0.0
s22-4.pddl
0.07 0.08 0.0 0.04 0.04 -0.0
s23-0.pddl
0.09 0.09 0.0 0.04 0.06 0.02
s23-1.pddl
0.08 0.08 0.0 0.04 0.04 0.0
s23-2.pddl
0.08 0.08 -0.0 0.04 0.04 -0.0
s23-3.pddl
0.08 0.08 0.0 0.04 0.04 -0.0
s23-4.pddl
0.08 0.08 0.0 0.04 0.04 0.0
s24-0.pddl
0.09 0.09 -0.0 0.05 0.05 -0.0
s24-1.pddl
0.10 0.09 -0.0 0.05 0.05 -0.0
s24-2.pddl
0.10 0.10 0.0 0.05 0.05 -0.0
s24-3.pddl
0.10 0.09 -0.0 0.05 0.05 0.0
s24-4.pddl
0.09 0.09 -0.0 0.05 0.05 0.0
s25-0.pddl
0.10 0.10 -0.0 0.05 0.05 -0.0
s25-1.pddl
0.12 0.11 -0.0 0.05 0.05 0.0
s25-2.pddl
0.10 0.09 -0.0 0.05 0.05 0.0
s25-3.pddl
0.11 0.11 -0.0 0.05 0.05 0.0
s25-4.pddl
0.11 0.11 0.0 0.07 0.05 -0.02
s26-0.pddl
0.12 0.12 0.0 0.06 0.06 -0.0
s26-1.pddl
0.11 0.11 0.0 0.06 0.06 -0.0
s26-2.pddl
0.13 0.13 0.0 0.06 0.06 0.0
s26-3.pddl
0.12 0.13 0.01 0.06 0.06 -0.0
s26-4.pddl
0.11 0.11 0.0 0.06 0.06 0.0
s27-0.pddl
0.14 0.14 -0.0 0.06 0.06 0.0
s27-1.pddl
0.13 0.13 0.0 0.06 0.06 -0.0
s27-2.pddl
0.14 0.13 -0.01 0.06 0.06 0.0
s27-3.pddl
0.13 0.12 -0.0 0.06 0.06 -0.0
s27-4.pddl
0.13 0.13 0.0 0.06 0.06 -0.01
s28-0.pddl
0.16 0.15 -0.01 0.07 0.07 0.0
s28-1.pddl
0.15 0.15 -0.0 0.07 0.07 0.0
s28-2.pddl
0.16 0.15 -0.0 0.07 0.07 -0.0
s28-3.pddl
0.12 0.14 0.02 0.06 0.06 0.0
s28-4.pddl
0.14 0.15 0.01 0.07 0.07 0.0
s29-0.pddl
0.15 0.15 0.0 0.07 0.07 0.0
s29-1.pddl
0.14 0.14 0.0 0.07 0.07 0.0
s29-2.pddl
0.16 0.16 0.0 0.07 0.07 0.0
s29-3.pddl
0.17 0.17 -0.0 0.07 0.07 -0.0
s29-4.pddl
0.18 0.18 0.0 0.07 0.07 0.0
s30-0.pddl
0.16 0.15 -0.0 0.08 0.08 0.0
s30-1.pddl
0.17 0.17 -0.0 0.08 0.08 -0.0
s30-2.pddl
0.17 0.17 -0.0 0.08 0.08 0.0
s30-3.pddl
0.18 0.19 0.0 0.08 0.08 -0.0
s30-4.pddl
0.17 0.17 -0.0 0.07 0.08 0.0
Sum of diffs
0.06
0.02
Arithmetic mean of diffs
0.00
0.00
movie
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob08.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob12.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob13.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob14.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob15.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob16.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob17.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob18.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob19.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob20.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob21.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob22.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob23.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob24.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob25.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob26.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob27.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob28.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob29.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
Sum of diffs
0.00
0.00
Arithmetic mean of diffs
0.00
0.00
mprime
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.02 0.02 0.0 0.02 0.02 0.0
prob02.pddl
0.06 0.06 -0.0 4.66 4.84 0.18
prob03.pddl
0.04 0.04 0.0 0.36 0.36 -0.0
prob04.pddl
0.02 0.02 0.0 0.03 0.03 0.0
prob05.pddl
0.05 0.05 0.0 5.80 6.09 0.29
prob06.pddl
0.60 0.63 0.04 None None -
prob07.pddl
0.03 0.03 0.0 0.28 0.28 0.0
prob08.pddl
0.12 0.11 -0.01 None None -
prob09.pddl
0.04 0.04 0.0 0.37 0.37 0.0
prob10.pddl
0.62 0.61 -0.0 None None -
prob11.pddl
0.02 0.02 0.0 0.02 0.02 0.0
prob12.pddl
0.03 0.03 -0.0 3.15 3.14 -0.0
prob13.pddl
0.76 0.68 -0.08 None None -
prob14.pddl
0.88 0.99 0.11 None None -
prob15.pddl
0.59 0.60 0.01 None None -
prob16.pddl
0.08 0.08 -0.0 2.96 2.93 -0.03
prob17.pddl
0.28 0.27 -0.01 38.99 39.31 0.33
prob18.pddl
0.51 0.55 0.04 None None -
prob19.pddl
0.21 0.22 0.0 None None -
prob20.pddl
0.50 0.53 0.03 None None -
prob21.pddl
0.30 0.30 -0.0 30.76 32.26 1.5
prob22.pddl
0.77 0.68 -0.09 None None -
prob23.pddl
0.29 0.29 0.0 None None -
prob24.pddl
0.31 0.34 0.03 None None -
prob25.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
prob26.pddl
0.06 0.06 0.0 52.32 48.82 -3.5
prob27.pddl
0.08 0.08 0.0 0.15 0.15 0.0
prob28.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
prob29.pddl
0.05 0.05 0.0 0.21 0.22 0.01
prob30.pddl
0.28 0.28 0.0 None None -
prob31.pddl
0.07 0.07 -0.0 0.20 0.20 -0.0
prob32.pddl
0.03 0.03 0.0 1.25 1.22 -0.03
prob33.pddl
0.32 0.30 -0.02 None None -
prob34.pddl
0.07 0.07 -0.0 0.20 0.20 -0.0
prob35.pddl
0.02 0.02 0.0 0.07 0.07 -0.0
Sum of diffs
0.06
-1.26
Arithmetic mean of diffs
0.00
-0.06
mystery
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
prob01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob02.pddl
0.09 0.09 -0.0 0.43 0.45 0.02
prob03.pddl
0.02 0.02 -0.0 0.04 0.05 0.01
prob04.pddl
136.99 139.28 2.3 108.11 101.98 -6.13
prob05.pddl
None None - None None -
prob06.pddl
5.29 5.34 0.05 None None -
prob07.pddl
0.01 0.01 0.0 None None -
prob08.pddl
None None - None None -
prob09.pddl
172.13 178.48 6.35 0.07 0.07 0.0
prob10.pddl
0.49 0.51 0.02 None None -
prob11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob12.pddl
17.78 17.62 -0.16 6.70 6.78 0.08
prob13.pddl
0.29 0.30 0.01 None None -
prob14.pddl
0.73 0.73 -0.0 None None -
prob15.pddl
0.22 0.25 0.03 17.64 17.29 -0.35
prob16.pddl
None None - None None -
prob17.pddl
0.19 0.19 0.0 0.41 0.43 0.03
prob18.pddl
0.01 0.01 0.0 None None -
prob19.pddl
0.18 0.18 -0.0 2.24 2.25 0.0
prob20.pddl
0.08 0.08 0.0 49.70 52.50 2.8
prob21.pddl
None None - None None -
prob22.pddl
None None - None None -
prob23.pddl
None None - None None -
prob24.pddl
None None - None None -
prob25.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob26.pddl
0.02 0.02 0.0 0.13 0.13 0.0
prob27.pddl
0.02 0.02 -0.0 0.03 0.03 0.0
prob28.pddl
0.01 0.01 0.0 0.01 0.01 0.0
prob29.pddl
0.02 0.02 0.0 0.03 0.03 -0.0
prob30.pddl
0.05 0.05 0.0 0.45 0.44 -0.0
Sum of diffs
8.59
-3.55
Arithmetic mean of diffs
0.37
-0.21
nomystery-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p03.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
p04.pddl
0.03 0.03 0.0 0.70 0.71 0.01
p05.pddl
0.06 0.06 0.0 57.68 58.52 0.84
p06.pddl
0.10 0.10 0.0 None None -
p07.pddl
0.11 0.11 0.0 None None -
p08.pddl
0.13 0.13 -0.0 None None -
p09.pddl
0.16 0.16 0.0 0.16 0.17 0.0
p10.pddl
0.14 0.13 -0.0 None None -
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.05 0.05 0.0 0.05 0.05 0.0
p13.pddl
0.01 0.01 0.0 0.11 0.11 -0.0
p14.pddl
0.16 0.16 0.0 1.15 1.15 0.01
p15.pddl
0.05 0.05 -0.0 1.08 1.06 -0.02
p16.pddl
None None - None None -
p17.pddl
0.16 0.16 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
0.14 0.15 0.0 None None -
p20.pddl
None None - None None -
Sum of diffs
0.02
0.84
Arithmetic mean of diffs
0.00
0.08
openstacks-opt08-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
p09.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p10.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p11.pddl
0.04 0.02 -0.01 0.04 0.02 -0.02
p12.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
p13.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
p14.pddl
0.03 0.03 0.0 0.03 0.03 -0.0
p15.pddl
0.03 0.05 0.02 0.03 0.03 0.0
p16.pddl
0.03 0.03 0.0 0.03 0.03 0.0
p17.pddl
0.04 0.04 0.0 0.04 0.04 0.0
p18.pddl
0.04 0.04 0.0 0.04 0.04 0.0
p19.pddl
0.04 0.04 0.0 0.04 0.04 -0.0
p20.pddl
0.05 0.05 -0.0 0.05 0.05 -0.0
p21.pddl
0.05 0.05 0.0 0.05 0.05 0.0
p22.pddl
0.06 0.06 -0.0 0.06 0.06 0.0
p23.pddl
0.06 0.06 -0.0 0.06 0.06 -0.0
p24.pddl
0.07 0.07 0.0 0.06 0.06 0.0
p25.pddl
0.07 0.07 0.0 0.07 0.07 0.0
p26.pddl
0.08 0.08 0.0 0.07 0.07 0.0
p27.pddl
0.08 0.09 0.0 0.08 0.08 -0.0
p28.pddl
0.09 0.09 0.0 0.09 0.09 -0.0
p29.pddl
0.10 0.10 0.0 0.10 0.09 -0.0
p30.pddl
0.10 0.10 0.0 0.10 0.10 -0.0
Sum of diffs
0.02
-0.02
Arithmetic mean of diffs
0.00
-0.00
openstacks-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p02.pddl
0.01 0.02 0.0 0.01 0.01 -0.0
p03.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
p04.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p05.pddl
0.02 0.02 -0.0 0.02 0.02 -0.0
p06.pddl
0.02 0.02 -0.0 0.02 0.02 -0.0
p07.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p08.pddl
0.03 0.03 0.0 0.02 0.02 0.0
p09.pddl
0.03 0.03 0.0 0.03 0.03 0.0
p10.pddl
0.06 0.06 0.0 0.06 0.06 0.0
p11.pddl
0.03 0.03 0.0 0.03 0.03 -0.0
p12.pddl
0.03 0.03 -0.0 0.03 0.03 -0.0
p13.pddl
0.04 0.04 -0.0 0.04 0.04 -0.0
p14.pddl
0.04 0.04 0.0 0.04 0.04 0.0
p15.pddl
0.05 0.04 -0.0 0.04 0.04 0.0
p16.pddl
0.05 0.05 0.0 0.05 0.05 0.0
p17.pddl
0.05 0.05 -0.0 0.05 0.05 -0.0
p18.pddl
0.06 0.06 -0.0 0.06 0.06 -0.0
p19.pddl
0.07 0.07 0.0 0.06 0.06 -0.0
p20.pddl
0.07 0.07 0.0 0.07 0.07 -0.0
Sum of diffs
0.00
-0.00
Arithmetic mean of diffs
0.00
-0.00
openstacks-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p20_1.pddl
0.03 0.03 0.0 0.03 0.03 -0.0
p20_2.pddl
0.03 0.04 0.0 0.03 0.03 -0.0
p20_3.pddl
0.04 0.04 0.0 0.04 0.04 0.0
p25_1.pddl
0.05 0.05 0.0 0.05 0.05 -0.0
p25_3.pddl
0.06 0.06 0.0 0.06 0.06 -0.0
p30_1.pddl
0.08 0.08 0.0 0.07 0.07 -0.0
p30_2.pddl
0.08 0.08 0.0 0.07 0.07 -0.0
p30_3.pddl
0.08 0.09 0.01 0.09 0.09 0.0
p35_1.pddl
0.11 0.11 0.0 0.11 0.10 -0.0
p35_2.pddl
0.11 0.11 0.0 0.11 0.11 -0.0
p35_3.pddl
0.12 0.12 0.01 0.14 0.14 -0.0
p40_1.pddl
0.14 0.15 0.01 0.14 0.14 -0.0
p40_2.pddl
0.15 0.15 0.0 0.14 0.14 -0.0
p40_3.pddl
0.17 0.17 -0.0 0.19 0.19 -0.0
p45_1.pddl
0.19 0.19 0.0 0.19 0.19 0.0
p45_2.pddl
0.20 0.20 0.0 0.20 0.19 -0.0
p45_3.pddl
0.23 0.24 0.0 0.28 0.27 -0.01
p50_1.pddl
0.26 0.26 -0.0 0.25 0.24 -0.0
p50_2.pddl
0.27 0.26 -0.01 0.27 0.25 -0.02
p50_3.pddl
0.29 0.30 0.01 0.35 0.36 0.01
Sum of diffs
0.04
-0.03
Arithmetic mean of diffs
0.00
-0.00
openstacks-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p07.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p08.pddl
0.11 0.11 0.0 0.07 0.07 0.0
p09.pddl
0.11 0.11 0.0 0.07 0.07 -0.0
p10.pddl
0.12 0.12 -0.0 0.08 0.08 -0.0
p11.pddl
0.12 0.12 0.0 0.09 0.08 -0.01
p12.pddl
0.13 0.13 -0.0 0.09 0.09 0.0
p13.pddl
0.14 0.14 -0.0 0.09 0.10 0.0
p14.pddl
0.14 0.14 0.0 0.09 0.09 0.0
p15.pddl
0.14 0.14 0.0 0.10 0.10 0.0
p16.pddl
0.13 0.13 0.0 0.10 0.10 -0.0
p17.pddl
0.21 0.20 -0.0 0.14 0.14 0.0
p18.pddl
0.61 0.62 0.01 0.36 0.35 -0.01
p19.pddl
0.21 0.21 0.0 0.13 0.13 0.0
p20.pddl
0.35 0.35 0.01 0.21 0.21 0.0
p21.pddl
0.35 0.35 -0.0 0.20 0.21 0.01
p22.pddl
0.35 0.36 0.01 0.23 0.23 -0.0
p23.pddl
0.35 0.36 0.01 0.26 0.25 -0.01
p24.pddl
3.04 3.68 0.64 3.44 3.39 -0.05
p25.pddl
2.96 2.80 -0.15 2.76 2.69 -0.07
p26.pddl
1.70 1.67 -0.03 0.91 0.89 -0.02
p27.pddl
5.51 6.17 0.66 3.02 2.85 -0.17
p28.pddl
46.23 45.01 -1.23 50.41 48.86 -1.54
p29.pddl
37.02 36.62 -0.4 39.18 37.64 -1.54
p30.pddl
14.11 12.32 -1.79 7.60 8.26 0.66
Sum of diffs
-2.26
-2.75
Arithmetic mean of diffs
-0.08
-0.09
organic-synthesis-opt18-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.03 0.03 0.0 0.01 0.01 0.0
p02.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
p03.pddl
0.43 0.42 -0.02 0.29 0.29 0.0
p04.pddl
None None - None None -
p05.pddl
None None - None None -
p06.pddl
None None - None None -
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
None None - None None -
p09.pddl
0.55 0.54 -0.01 0.40 0.40 0.01
p10.pddl
0.60 0.58 -0.01 0.39 0.39 -0.0
p11.pddl
None None - None None -
p12.pddl
None None - None None -
p13.pddl
None None - None None -
p14.pddl
0.50 0.52 0.02 0.22 0.22 0.0
p15.pddl
None None - None None -
p16.pddl
None None - None None -
p17.pddl
None None - None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
Sum of diffs
-0.02
0.01
Arithmetic mean of diffs
-0.00
0.00
organic-synthesis-split-opt18-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.04 0.04 0.0 0.05 0.05 0.0
p02.pddl
0.07 0.07 0.0 0.07 0.07 0.0
p03.pddl
0.99 1.13 0.13 2.66 2.69 0.04
p04.pddl
0.33 0.37 0.04 3.62 3.59 -0.03
p05.pddl
0.83 0.86 0.04 2.75 2.75 0.0
p06.pddl
1.08 0.97 -0.11 64.07 64.73 0.66
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
2.61 2.97 0.36 246.75 247.71 0.96
p09.pddl
0.11 0.11 0.0 0.39 0.39 0.0
p10.pddl
0.11 0.11 0.0 0.57 0.56 -0.01
p11.pddl
1.36 1.31 -0.05 None None -
p12.pddl
1.95 2.03 0.09 None None -
p13.pddl
12.62 13.00 0.38 None None -
p14.pddl
0.22 0.24 0.02 0.20 0.20 0.0
p15.pddl
None None - None None -
p16.pddl
20.44 23.17 2.73 None None -
p17.pddl
62.05 68.96 6.91 None None -
p18.pddl
None None - None None -
p19.pddl
5.56 5.69 0.13 None None -
p20.pddl
393.38 413.10 19.71 None None -
Sum of diffs
30.39
1.62
Arithmetic mean of diffs
1.69
0.15
parcprinter-08-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p05.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p06.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p07.pddl
0.03 0.03 -0.0 0.02 0.03 0.0
p08.pddl
0.03 0.03 0.0 0.03 0.03 0.0
p09.pddl
0.04 0.04 0.0 0.03 0.04 0.0
p10.pddl
0.04 0.04 0.0 0.04 0.04 0.0
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13.pddl
0.01 0.01 -0.0 0.11 0.10 -0.01
p14.pddl
0.02 0.02 0.0 4.99 4.97 -0.03
p15.pddl
0.02 0.03 0.0 None None -
p16.pddl
0.03 0.03 0.0 None None -
p17.pddl
0.04 0.04 0.0 None None -
p18.pddl
0.04 0.04 0.0 None None -
p19.pddl
0.06 0.07 0.0 None None -
p20.pddl
0.07 0.07 0.0 None None -
p21.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p22.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p23.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p24.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p25.pddl
0.02 0.02 0.0 3.40 3.37 -0.02
p26.pddl
0.02 0.04 0.01 0.02 0.02 0.0
p27.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
p28.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
p29.pddl
0.04 0.04 -0.0 None None -
p30.pddl
0.05 0.05 0.0 None None -
Sum of diffs
0.03
-0.05
Arithmetic mean of diffs
0.00
-0.00
parcprinter-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p07.pddl
0.02 0.02 -0.0 0.01 0.02 0.0
p08.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
p09.pddl
0.01 0.01 0.0 0.11 0.11 0.0
p10.pddl
0.02 0.02 0.0 3.29 3.25 -0.04
p11.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p12.pddl
0.02 0.02 0.0 4.92 4.93 0.02
p13.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
p14.pddl
0.03 0.03 0.0 0.03 0.03 -0.0
p15.pddl
0.04 0.04 0.0 0.03 0.03 0.0
p16.pddl
0.04 0.04 0.0 0.04 0.04 -0.0
p17.pddl
0.03 0.03 0.0 None None -
p18.pddl
0.03 0.03 -0.0 None None -
p19.pddl
0.04 0.04 -0.0 None None -
p20.pddl
0.03 0.03 0.0 0.02 0.02 0.0
Sum of diffs
0.01
-0.02
Arithmetic mean of diffs
0.00
-0.00
parking-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
pfile03-011.pddl
0.13 0.13 0.01 None None -
pfile03-012.pddl
0.20 0.20 -0.0 None None -
pfile04-013.pddl
0.35 0.35 0.0 None None -
pfile04-014.pddl
0.40 0.42 0.02 None None -
pfile04-015.pddl
0.30 0.30 -0.0 None None -
pfile04-016.pddl
0.35 0.33 -0.02 None None -
pfile05-017.pddl
0.54 0.48 -0.06 None None -
pfile05-018.pddl
0.50 0.49 -0.01 None None -
pfile05-019.pddl
0.78 0.71 -0.07 None None -
pfile05-020.pddl
0.70 0.67 -0.02 None None -
pfile06-021.pddl
1.05 0.98 -0.07 None None -
pfile06-022.pddl
0.94 1.05 0.11 None None -
pfile06-023.pddl
0.92 0.86 -0.06 None None -
pfile06-024.pddl
1.51 1.62 0.11 None None -
pfile07-025.pddl
2.40 2.40 0.0 None None -
pfile07-026.pddl
1.37 1.46 0.1 None None -
pfile07-027.pddl
1.47 1.50 0.03 None None -
pfile07-028.pddl
2.30 2.40 0.1 None None -
pfile08-029.pddl
3.21 3.17 -0.05 None None -
pfile08-030.pddl
2.36 2.33 -0.03 None None -
Sum of diffs
0.09
None
Arithmetic mean of diffs
0.00
None
parking-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p_12_7-01.pddl
0.17 0.17 -0.0 None None -
p_12_7-02.pddl
0.17 0.16 -0.0 2.73 2.83 0.1
p_12_7-03.pddl
0.20 0.20 0.0 None None -
p_12_7-04.pddl
0.19 0.19 -0.0 None None -
p_14_8-01.pddl
0.29 0.29 -0.0 None None -
p_14_8-02.pddl
0.35 0.36 0.01 None None -
p_14_8-03.pddl
0.45 0.44 -0.02 None None -
p_14_8-04.pddl
0.32 0.35 0.03 None None -
p_16_9-01.pddl
0.59 0.61 0.03 None None -
p_16_9-02.pddl
0.55 0.49 -0.05 None None -
p_16_9-03.pddl
0.48 0.46 -0.02 None None -
p_16_9-04.pddl
0.53 0.53 0.0 None None -
p_18_10-01.pddl
1.33 1.14 -0.19 None None -
p_18_10-02.pddl
0.85 0.84 -0.01 None None -
p_18_10-03.pddl
0.74 0.73 -0.0 None None -
p_18_10-04.pddl
0.74 0.66 -0.08 None None -
p_20_11-01.pddl
2.13 1.86 -0.27 None None -
p_20_11-02.pddl
1.53 1.53 -0.0 None None -
p_20_11-03.pddl
1.73 2.18 0.44 None None -
p_20_11-04.pddl
2.60 2.69 0.09 None None -
Sum of diffs
-0.05
0.10
Arithmetic mean of diffs
-0.00
0.10
pathways-noneg
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.04 0.03 -0.0
p05.pddl
0.01 0.01 0.0 1.15 1.11 -0.04
p06.pddl
0.03 0.03 0.0 27.11 27.17 0.06
p07.pddl
0.03 0.03 0.0 177.77 179.05 1.28
p08.pddl
0.05 0.05 0.0 None None -
p09.pddl
0.04 0.05 0.0 31.87 31.10 -0.77
p10.pddl
None None - None None -
p11.pddl
0.05 0.05 -0.0 113.22 112.60 -0.62
p12.pddl
0.07 0.07 -0.0 None None -
p13.pddl
0.07 0.07 0.0 None None -
p14.pddl
0.08 0.08 -0.0 None None -
p15.pddl
0.07 0.08 0.0 None None -
p16.pddl
None None - None None -
p17.pddl
0.13 0.13 0.0 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
0.26 0.26 -0.0 None None -
p24.pddl
0.29 0.27 -0.02 None None -
p25.pddl
0.31 0.31 -0.0 None None -
p26.pddl
0.32 0.32 0.0 None None -
p27.pddl
0.41 0.40 -0.02 None None -
p28.pddl
0.30 0.30 0.0 None None -
p29.pddl
0.46 0.45 -0.01 None None -
p30.pddl
0.54 0.56 0.01 None None -
Sum of diffs
-0.02
-0.09
Arithmetic mean of diffs
-0.00
-0.01
pegsol-08-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p03.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p09.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10.pddl
0.04 0.04 0.0 0.01 0.01 -0.0
p11.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p12.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p13.pddl
0.01 0.02 0.0 0.07 0.07 0.0
p14.pddl
0.02 0.02 0.0 0.05 0.06 0.0
p15.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p16.pddl
0.02 0.02 -0.0 0.03 0.03 -0.0
p17.pddl
0.26 0.28 0.02 0.13 0.13 -0.0
p18.pddl
0.06 0.06 0.0 0.01 0.01 -0.0
p19.pddl
0.02 0.02 0.0 0.05 0.05 -0.0
p20.pddl
0.03 0.03 0.0 0.01 0.01 0.0
p21.pddl
0.02 0.02 0.0 0.09 0.09 0.0
p22.pddl
0.03 0.03 -0.0 0.05 0.04 -0.02
p23.pddl
0.02 0.03 0.0 0.16 0.16 -0.0
p24.pddl
0.03 0.03 -0.0 0.07 0.08 0.0
p25.pddl
0.03 0.03 -0.0 0.06 0.06 -0.0
p26.pddl
0.02 0.02 0.0 0.16 0.16 0.0
p27.pddl
1.01 0.99 -0.01 0.02 0.02 -0.0
p28.pddl
2.83 2.79 -0.04 4.04 3.94 -0.11
p29.pddl
181.68 177.93 -3.75 0.72 0.73 0.01
p30.pddl
3.00 3.01 0.0 75.29 73.94 -1.35
Sum of diffs
-3.77
-1.46
Arithmetic mean of diffs
-0.13
-0.05
pegsol-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
p02.pddl
0.29 0.28 -0.0 0.13 0.13 0.0
p03.pddl
0.06 0.06 0.0 0.01 0.01 -0.0
p04.pddl
0.02 0.02 0.0 0.05 0.05 -0.0
p05.pddl
0.02 0.02 0.0 0.20 0.20 -0.0
p06.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p07.pddl
0.03 0.03 -0.0 0.01 0.01 0.0
p08.pddl
0.03 0.03 0.0 0.01 0.01 -0.0
p09.pddl
0.06 0.06 -0.0 0.04 0.04 -0.0
p10.pddl
0.02 0.02 0.0 0.09 0.09 -0.0
p11.pddl
0.03 0.03 0.0 0.04 0.04 -0.0
p12.pddl
0.03 0.03 0.0 0.06 0.06 0.0
p13.pddl
0.02 0.02 -0.0 0.16 0.16 -0.0
p14.pddl
0.03 0.04 0.0 0.07 0.08 0.0
p15.pddl
0.03 0.03 -0.0 0.06 0.06 -0.0
p16.pddl
0.02 0.02 0.0 0.16 0.16 0.0
p17.pddl
1.01 1.00 -0.01 0.02 0.02 0.0
p18.pddl
2.88 2.88 -0.01 4.04 3.98 -0.06
p19.pddl
178.87 177.54 -1.33 0.73 0.73 0.01
p20.pddl
3.01 2.96 -0.04 73.92 75.41 1.49
Sum of diffs
-1.39
1.43
Arithmetic mean of diffs
-0.07
0.07
petri-net-alignment-opt18-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.27 0.26 -0.01 0.25 0.25 0.0
p02.pddl
0.63 0.63 0.0 0.56 0.53 -0.03
p03.pddl
1.18 1.12 -0.06 0.81 0.81 0.0
p04.pddl
1.20 1.19 -0.01 0.90 0.92 0.02
p05.pddl
0.56 0.56 0.0 0.54 0.51 -0.03
p06.pddl
1.38 1.25 -0.13 1.00 0.89 -0.11
p07.pddl
1.12 1.01 -0.12 0.75 0.81 0.07
p08.pddl
1.19 1.22 0.03 0.88 0.87 -0.01
p09.pddl
1.59 1.08 -0.51 0.78 0.84 0.07
p10.pddl
2.81 3.73 0.92 1.46 1.61 0.15
p11.pddl
1.72 1.63 -0.1 0.94 1.01 0.08
p12.pddl
5.56 5.81 0.26 2.35 2.30 -0.06
p13.pddl
2.44 3.12 0.68 1.53 1.51 -0.03
p14.pddl
3.90 3.68 -0.22 1.71 1.60 -0.11
p15.pddl
2.44 3.15 0.71 1.40 1.58 0.17
p16.pddl
4.08 4.91 0.83 1.92 1.90 -0.03
p17.pddl
5.21 4.58 -0.62 1.96 2.29 0.33
p18.pddl
5.04 4.76 -0.27 1.86 1.69 -0.17
p19.pddl
5.55 4.47 -1.08 1.81 2.14 0.34
p20.pddl
5.91 6.07 0.16 2.45 2.20 -0.25
Sum of diffs
0.47
0.40
Arithmetic mean of diffs
0.02
0.02
pipesworld-notankage
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02-net1-b6-g4.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p03-net1-b8-g3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04-net1-b8-g5.pddl
0.03 0.03 0.0 0.01 0.01 -0.0
p05-net1-b10-g4.pddl
0.02 0.02 -0.0 0.01 0.01 -0.0
p06-net1-b10-g6.pddl
0.10 0.10 0.0 0.01 0.01 -0.0
p07-net1-b12-g5.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p08-net1-b12-g7.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
p09-net1-b14-g6.pddl
0.03 0.03 -0.0 0.02 0.02 0.0
p10-net1-b14-g8.pddl
0.04 0.04 0.0 0.03 0.03 0.0
p11-net2-b10-g2.pddl
0.53 0.55 0.02 0.05 0.05 0.0
p12-net2-b10-g4.pddl
0.52 0.52 0.0 0.07 0.07 -0.0
p13-net2-b12-g3.pddl
0.03 0.04 0.0 0.17 0.16 -0.0
p14-net2-b12-g5.pddl
0.28 0.28 0.0 0.08 0.08 0.0
p15-net2-b14-g4.pddl
0.09 0.09 0.0 0.16 0.16 -0.0
p16-net2-b14-g6.pddl
1.58 1.59 0.01 2.29 2.19 -0.1
p17-net2-b16-g5.pddl
1.56 1.57 0.01 0.11 0.11 -0.0
p18-net2-b16-g7.pddl
2.60 2.64 0.03 0.14 0.14 0.0
p19-net2-b18-g6.pddl
0.08 0.08 0.0 0.09 0.09 0.0
p20-net2-b18-g8.pddl
4.44 4.37 -0.07 0.29 0.28 -0.0
p21-net3-b12-g2.pddl
0.04 0.04 -0.0 0.05 0.05 0.0
p22-net3-b12-g4.pddl
3.39 3.48 0.1 0.48 0.49 0.01
p23-net3-b14-g3.pddl
0.08 0.08 0.0 0.21 0.21 0.0
p24-net3-b14-g5.pddl
1.92 1.84 -0.08 1.84 1.82 -0.02
p25-net3-b16-g5.pddl
0.12 0.12 -0.0 1.75 1.83 0.09
p26-net3-b16-g7.pddl
4.21 4.54 0.33 0.30 0.28 -0.02
p27-net3-b18-g6.pddl
5.13 4.93 -0.2 33.91 33.46 -0.45
p28-net3-b18-g7.pddl
4.97 5.01 0.04 22.06 20.86 -1.21
p29-net3-b20-g6.pddl
1.20 1.22 0.02 16.67 16.01 -0.66
p30-net3-b20-g8.pddl
5.19 5.27 0.08 1.03 1.09 0.06
p31-net4-b14-g3.pddl
0.08 0.08 -0.0 0.33 0.33 -0.0
p32-net4-b14-g5.pddl
1.36 1.37 0.01 0.22 0.22 -0.0
p33-net4-b16-g5.pddl
0.86 0.85 -0.01 0.54 0.54 -0.0
p34-net4-b16-g6.pddl
4.10 4.15 0.05 1.01 1.02 0.01
p35-net4-b18-g4.pddl
2.62 2.63 0.01 36.36 34.97 -1.4
p36-net4-b18-g6.pddl
0.19 0.19 0.0 123.95 119.55 -4.4
p37-net4-b20-g5.pddl
0.60 0.59 -0.01 None None -
p38-net4-b20-g7.pddl
6.35 6.17 -0.18 27.80 29.15 1.36
p39-net4-b22-g7.pddl
0.27 0.29 0.02 None None -
p40-net4-b22-g8.pddl
1.51 1.46 -0.05 119.47 120.54 1.07
p41-net5-b22-g2.pddl
0.36 0.39 0.03 6.80 6.95 0.15
p42-net5-b22-g4.pddl
None None - None None -
p43-net5-b24-g3.pddl
None None - None None -
p44-net5-b24-g5.pddl
None None - None None -
p45-net5-b26-g4.pddl
None None - None None -
p46-net5-b26-g6.pddl
None None - None None -
p47-net5-b28-g5.pddl
None None - None None -
p48-net5-b28-g7.pddl
None None - None None -
p49-net5-b30-g6.pddl
0.78 0.79 0.0 None None -
p50-net5-b30-g8.pddl
19.26 19.22 -0.04 None None -
Sum of diffs
0.11
-5.53
Arithmetic mean of diffs
0.00
-0.14
pipesworld-tankage
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-net1-b6-g2-t50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02-net1-b6-g4-t50.pddl
0.03 0.03 0.0 0.01 0.01 0.0
p03-net1-b8-g3-t80.pddl
0.03 0.03 -0.0 0.03 0.03 -0.0
p04-net1-b8-g5-t80.pddl
0.04 0.04 0.0 0.03 0.03 -0.0
p05-net1-b10-g4-t50.pddl
0.03 0.03 0.0 0.03 0.03 -0.0
p06-net1-b10-g6-t50.pddl
0.04 0.04 0.0 0.03 0.03 0.0
p07-net1-b12-g5-t80.pddl
0.09 0.09 0.0 0.08 0.08 0.0
p08-net1-b12-g7-t80.pddl
0.10 0.11 0.0 0.09 0.09 -0.0
p09-net1-b14-g6-t50.pddl
2.60 2.60 -0.0 0.51 0.53 0.02
p10-net1-b14-g8-t50.pddl
0.16 0.16 -0.01 0.14 0.14 0.0
p11-net2-b10-g2-t30.pddl
0.08 0.08 -0.0 0.21 0.20 -0.0
p12-net2-b10-g4-t60.pddl
0.11 0.11 -0.0 0.45 0.46 0.01
p13-net2-b12-g3-t70.pddl
0.13 0.12 -0.01 23.20 23.22 0.02
p14-net2-b12-g5-t30.pddl
0.16 0.17 0.0 0.87 0.84 -0.03
p15-net2-b14-g4-t30.pddl
0.26 0.26 -0.0 2.11 2.09 -0.02
p16-net2-b14-g6-t80.pddl
0.83 0.79 -0.04 None None -
p17-net2-b16-g5-t20.pddl
1.02 1.03 0.01 3.47 3.37 -0.1
p18-net2-b16-g7-t60.pddl
2.10 2.05 -0.04 14.70 15.08 0.39
p19-net2-b18-g6-t60.pddl
0.30 0.31 0.01 11.87 12.38 0.5
p20-net2-b18-g8-t90.pddl
2.65 2.98 0.33 None None -
p21-net3-b12-g2-t60.pddl
0.10 0.09 -0.01 0.63 0.64 0.01
p22-net3-b12-g4-t60.pddl
355.43 358.96 3.53 14.40 14.08 -0.33
p23-net3-b14-g3-t60.pddl
2.86 2.74 -0.12 None None -
p24-net3-b14-g5-t60.pddl
0.89 0.94 0.05 None None -
p25-net3-b16-g5-t60.pddl
0.78 0.85 0.07 None None -
p26-net3-b16-g7-t70.pddl
23.66 23.91 0.26 None None -
p27-net3-b18-g6-t70.pddl
0.90 0.81 -0.09 None None -
p28-net3-b18-g7-t70.pddl
879.75 878.49 -1.26 None None -
p29-net3-b20-g6-t70.pddl
2.31 2.28 -0.03 None None -
p30-net3-b20-g8-t70.pddl
8.63 8.06 -0.57 None None -
p31-net4-b14-g3-t20.pddl
34.87 35.36 0.49 0.56 0.57 0.01
p32-net4-b14-g5-t30.pddl
2.69 2.68 -0.01 34.89 34.82 -0.07
p33-net4-b16-g5-t60.pddl
0.68 0.73 0.05 None None -
p34-net4-b16-g6-t60.pddl
1.04 1.17 0.13 None None -
p35-net4-b18-g4-t90.pddl
1.81 2.10 0.29 None None -
p36-net4-b18-g6-t90.pddl
31.69 35.75 4.07 None None -
p37-net4-b20-g5-t60.pddl
1.19 1.21 0.02 None None -
p38-net4-b20-g7-t60.pddl
4.63 4.52 -0.11 None None -
p39-net4-b22-g7-t50.pddl
2.30 2.26 -0.03 None None -
p40-net4-b22-g8-t50.pddl
2.22 2.25 0.03 None None -
p41-net5-b22-g2-t20.pddl
0.49 0.54 0.05 None None -
p42-net5-b22-g4-t50.pddl
None None - None None -
p43-net5-b24-g3-t80.pddl
None None - None None -
p44-net5-b24-g5-t80.pddl
None None - None None -
p45-net5-b26-g4-t50.pddl
None None - None None -
p46-net5-b26-g6-t50.pddl
None None - None None -
p47-net5-b28-g5-t50.pddl
None None - None None -
p48-net5-b28-g7-t50.pddl
None None - None None -
p49-net5-b30-g6-t50.pddl
13.54 16.41 2.87 None None -
p50-net5-b30-g8-t50.pddl
156.38 128.26 -28.12 None None -
Sum of diffs
-18.20
0.40
Arithmetic mean of diffs
-0.42
0.02
psr-small
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-s2-n1-l2-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02-s5-n1-l3-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03-s7-n1-l3-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04-s8-n1-l4-f10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05-s9-n1-l4-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06-s10-n1-l4-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07-s11-n1-l4-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08-s12-n1-l5-f10.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p09-s13-n1-l5-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p10-s17-n2-l2-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p11-s18-n2-l2-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12-s21-n2-l3-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p13-s22-n2-l3-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p14-s23-n2-l3-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p15-s24-n2-l4-f10.pddl
0.02 0.02 0.0 0.07 0.08 0.0
p16-s29-n2-l5-f30.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p17-s30-n2-l5-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p18-s31-n2-l5-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p19-s33-n3-l2-f30.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
p20-s34-n3-l2-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p21-s35-n3-l2-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p22-s37-n3-l3-f30.pddl
0.03 0.03 0.0 0.01 0.01 0.0
p23-s38-n3-l3-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p24-s39-n3-l3-f70.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p25-s40-n3-l4-f10.pddl
0.27 0.26 -0.01 0.66 0.67 0.01
p26-s41-n3-l4-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p27-s42-n3-l4-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p28-s43-n3-l4-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p29-s45-n3-l5-f30.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p30-s46-n3-l5-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p31-s49-n4-l2-f30.pddl
0.02 0.02 0.0 0.21 0.21 -0.0
p32-s50-n4-l2-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p33-s51-n4-l2-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p34-s55-n4-l3-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p35-s57-n5-l2-f30.pddl
0.01 0.01 0.0 0.82 0.82 0.0
p36-s65-n6-l2-f30.pddl
0.02 0.02 0.0 3.56 3.44 -0.11
p37-s67-n6-l2-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p38-s78-n3-l3-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p39-s79-n3-l3-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p40-s80-n3-l4-f10.pddl
0.03 0.03 -0.0 16.37 16.80 0.43
p41-s81-n3-l4-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p42-s82-n3-l4-f50.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p43-s83-n3-l4-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p44-s89-n4-l2-f30.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p45-s94-n4-l3-f50.pddl
0.01 0.01 0.0 0.01 0.02 0.01
p46-s97-n5-l2-f30.pddl
0.01 0.01 0.0 0.22 0.22 0.0
p47-s98-n5-l2-f50.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p48-s101-n5-l3-f30.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
p49-s105-n6-l2-f30.pddl
0.03 0.03 0.0 0.02 0.02 0.0
p50-s107-n6-l2-f70.pddl
0.01 0.01 0.0 0.01 0.01 0.0
Sum of diffs
-0.01
0.34
Arithmetic mean of diffs
-0.00
0.01
rovers
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
p07.pddl
0.01 0.01 0.0 0.02 0.02 0.0
p08.pddl
0.01 0.01 0.0 0.03 0.03 -0.0
p09.pddl
0.01 0.01 0.0 0.24 0.25 0.01
p10.pddl
0.02 0.02 0.0 0.50 0.53 0.02
p11.pddl
0.01 0.02 0.0 0.09 0.09 0.0
p12.pddl
0.01 0.01 0.0 0.03 0.03 0.0
p13.pddl
0.02 0.02 0.0 0.13 0.13 0.0
p14.pddl
0.02 0.02 0.0 0.29 0.28 -0.0
p15.pddl
0.03 0.03 -0.0 0.46 0.46 0.0
p16.pddl
0.02 0.02 0.0 0.37 0.36 -0.01
p17.pddl
0.03 0.03 -0.0 8.87 9.05 0.19
p18.pddl
0.04 0.04 0.0 91.45 88.52 -2.93
p19.pddl
0.08 0.08 0.0 None None -
p20.pddl
0.13 0.12 -0.01 None None -
p21.pddl
0.11 0.11 0.0 None None -
p22.pddl
0.13 0.12 -0.0 78.54 77.43 -1.11
p23.pddl
0.15 0.15 0.0 None None -
p24.pddl
0.23 0.23 0.0 None None -
p25.pddl
0.05 0.05 -0.0 2.06 1.99 -0.07
p26.pddl
0.08 0.08 -0.0 None None -
p27.pddl
0.16 0.16 0.0 None None -
p28.pddl
0.22 0.22 -0.0 None None -
p29.pddl
0.16 0.16 -0.0 None None -
p30.pddl
0.27 0.28 0.01 None None -
p31.pddl
0.41 0.41 -0.0 None None -
p32.pddl
0.84 0.84 0.0 None None -
p33.pddl
1.69 1.66 -0.03 None None -
p34.pddl
0.76 0.78 0.02 None None -
p35.pddl
3.19 3.04 -0.14 None None -
p36.pddl
1.82 1.81 -0.01 None None -
p37.pddl
6.64 6.64 0.01 None None -
p38.pddl
4.53 4.72 0.19 None None -
p39.pddl
3.77 3.72 -0.05 None None -
p40.pddl
7.80 7.32 -0.47 None None -
Sum of diffs
-0.49
-3.90
Arithmetic mean of diffs
-0.01
-0.20
satellite
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-pfile1.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02-pfile2.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03-pfile3.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04-pfile4.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p05-pfile5.pddl
0.01 0.01 0.0 0.09 0.09 0.0
p06-pfile6.pddl
0.01 0.01 0.0 0.10 0.10 0.0
p07-pfile7.pddl
0.01 0.01 0.0 0.34 0.34 -0.0
p08-pfile8.pddl
0.02 0.02 0.0 5.88 5.95 0.07
p09-pfile9.pddl
0.02 0.02 -0.0 5.23 5.21 -0.01
p10-pfile10.pddl
0.03 0.03 -0.0 23.88 22.88 -1.0
p11-pfile11.pddl
0.03 0.03 0.0 6.81 6.74 -0.07
p12-pfile12.pddl
0.05 0.05 0.0 96.64 101.72 5.08
p13-pfile13.pddl
0.12 0.13 0.01 None None -
p14-pfile14.pddl
0.06 0.06 -0.0 52.84 52.29 -0.55
p15-pfile15.pddl
0.11 0.10 -0.0 None None -
p16-pfile16.pddl
0.08 0.08 -0.0 None None -
p17-pfile17.pddl
0.15 0.14 -0.01 None None -
p18-pfile18.pddl
0.05 0.05 0.0 None None -
p19-pfile19.pddl
0.08 0.08 0.0 None None -
p20-pfile20.pddl
0.21 0.21 0.0 None None -
p21-HC-pfile1.pddl
0.15 0.15 0.0 16.14 15.74 -0.39
p22-HC-pfile2.pddl
0.28 0.28 -0.0 None None -
p23-HC-pfile3.pddl
0.54 0.53 -0.02 17.92 18.19 0.27
p24-HC-pfile4.pddl
1.49 1.53 0.04 None None -
p25-HC-pfile5.pddl
2.14 2.22 0.08 None None -
p26-HC-pfile6.pddl
1.43 1.38 -0.05 None None -
p27-HC-pfile7.pddl
1.79 1.68 -0.12 None None -
p28-HC-pfile8.pddl
10.30 9.82 -0.48 None None -
p29-HC-pfile9.pddl
8.05 8.74 0.69 None None -
p30-HC-pfile10.pddl
37.04 38.61 1.57 None None -
p31-HC-pfile11.pddl
37.06 35.94 -1.12 None None -
p32-HC-pfile12.pddl
164.70 161.75 -2.95 None None -
p33-HC-pfile13.pddl
401.27 404.58 3.31 None None -
p34-HC-pfile14.pddl
13.72 14.03 0.31 None None -
p35-HC-pfile15.pddl
64.72 59.41 -5.31 None None -
p36-HC-pfile16.pddl
29.71 28.47 -1.24 None None -
Sum of diffs
-5.28
3.40
Arithmetic mean of diffs
-0.15
0.23
scanalyzer-08-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.03 0.03 0.0 0.03 0.03 0.0
p05.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p06.pddl
0.03 0.03 0.0 0.02 0.02 0.0
p07.pddl
0.07 0.07 0.0 0.07 0.07 -0.0
p08.pddl
0.05 0.06 0.0 0.04 0.04 0.0
p09.pddl
0.06 0.06 0.0 0.04 0.04 -0.0
p10.pddl
0.16 0.18 0.02 0.14 0.15 0.01
p11.pddl
0.12 0.11 -0.0 0.09 0.09 0.0
p12.pddl
0.15 0.14 -0.01 0.09 0.09 -0.0
p13.pddl
0.33 0.34 0.0 0.30 0.28 -0.02
p14.pddl
0.23 0.23 0.0 0.16 0.17 0.0
p15.pddl
0.31 0.32 0.0 0.17 0.16 -0.01
p16.pddl
0.70 0.71 0.01 0.55 0.55 -0.0
p17.pddl
0.47 0.49 0.02 0.30 0.33 0.03
p18.pddl
0.69 0.67 -0.03 0.30 0.33 0.03
p19.pddl
1.31 1.18 -0.13 0.89 0.83 -0.05
p20.pddl
0.95 0.91 -0.04 0.56 0.54 -0.02
p21.pddl
1.53 1.44 -0.1 0.53 0.50 -0.03
p22.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p23.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p24.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p25.pddl
1.28 1.16 -0.12 0.95 0.91 -0.04
p26.pddl
0.97 0.96 -0.01 0.70 0.70 0.0
p27.pddl
0.99 0.90 -0.09 0.62 0.64 0.02
p28.pddl
28.65 22.86 -5.79 13.38 13.24 -0.13
p29.pddl
38.16 34.18 -3.98 8.83 8.66 -0.17
p30.pddl
21.94 19.50 -2.44 8.32 8.46 0.15
Sum of diffs
-12.68
-0.24
Arithmetic mean of diffs
-0.42
-0.01
scanalyzer-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
p02.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.03 0.03 0.0 0.03 0.03 -0.0
p05.pddl
0.08 0.08 0.0 0.07 0.07 0.0
p06.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p07.pddl
1.22 1.21 -0.01 0.90 0.89 -0.01
p08.pddl
0.15 0.17 0.01 0.15 0.15 0.0
p09.pddl
0.34 0.35 0.01 0.29 0.26 -0.02
p10.pddl
0.65 0.65 -0.0 0.52 0.50 -0.01
p11.pddl
1.16 1.22 0.06 0.91 0.94 0.04
p12.pddl
0.03 0.03 0.0 0.02 0.02 -0.0
p13.pddl
0.94 0.97 0.03 0.64 0.61 -0.02
p14.pddl
0.98 0.83 -0.15 0.69 0.69 0.01
p15.pddl
0.05 0.05 -0.0 0.04 0.04 0.0
p16.pddl
0.11 0.12 0.01 0.09 0.09 -0.0
p17.pddl
0.22 0.24 0.02 0.16 0.16 0.0
p18.pddl
0.44 0.47 0.03 0.31 0.32 0.01
p19.pddl
0.98 0.87 -0.11 0.53 0.53 0.0
p20.pddl
27.63 22.50 -5.13 13.58 13.43 -0.16
Sum of diffs
-5.23
-0.17
Arithmetic mean of diffs
-0.26
-0.01
snake-opt18-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.71 0.78 0.07 0.53 0.53 0.01
p02.pddl
2.44 2.29 -0.15 1.89 1.85 -0.04
p03.pddl
24.03 23.45 -0.58 5.83 5.79 -0.04
p04.pddl
0.30 0.31 0.01 0.35 0.35 0.01
p05.pddl
0.38 0.37 -0.01 0.38 0.35 -0.03
p06.pddl
1.63 1.81 0.19 2.81 2.68 -0.12
p07.pddl
1023.34 1057.12 33.78 96.89 93.35 -3.53
p08.pddl
None None - 405.10 385.67 -19.43
p09.pddl
0.62 0.59 -0.03 0.52 0.51 -0.01
p10.pddl
0.86 0.90 0.04 0.66 0.68 0.02
p11.pddl
2.46 2.23 -0.23 5.29 5.41 0.12
p12.pddl
333.65 347.11 13.45 108.71 102.60 -6.12
p13.pddl
57.11 49.32 -7.79 None None -
p14.pddl
None None - None None -
p15.pddl
0.99 1.06 0.07 1.03 0.99 -0.04
p16.pddl
58.59 64.86 6.27 86.90 88.08 1.18
p17.pddl
870.34 1004.14 133.8 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
6.75 5.73 -1.03 2.03 2.14 0.11
Sum of diffs
177.86
-27.92
Arithmetic mean of diffs
11.12
-1.86
sokoban-opt08-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.02 0.02 -0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p04.pddl
0.04 0.04 0.0 0.06 0.08 0.01
p05.pddl
0.04 0.04 0.0 None None -
p06.pddl
0.01 0.01 0.0 0.05 0.05 -0.0
p07.pddl
0.04 0.04 0.0 0.43 0.43 0.0
p08.pddl
1.06 1.04 -0.02 24.91 25.59 0.68
p09.pddl
0.13 0.13 -0.0 5.54 5.84 0.3
p10.pddl
0.30 0.30 -0.0 2.33 2.19 -0.14
p11.pddl
2.62 2.62 0.01 1.46 1.47 0.0
p12.pddl
0.43 0.43 -0.01 37.79 37.88 0.09
p13.pddl
16.40 16.26 -0.14 26.78 27.88 1.1
p14.pddl
0.05 0.05 -0.0 0.27 0.27 -0.0
p15.pddl
4.01 3.96 -0.05 25.28 24.74 -0.54
p16.pddl
1.01 1.04 0.03 1.13 1.14 0.01
p17.pddl
0.14 0.14 -0.0 0.56 0.55 -0.0
p18.pddl
1.95 1.94 -0.02 44.84 45.60 0.76
p19.pddl
3.35 3.34 -0.01 96.98 96.06 -0.92
p20.pddl
0.08 0.08 0.0 0.40 0.39 -0.0
p21.pddl
0.16 0.16 0.0 0.08 0.09 0.0
p22.pddl
2.42 2.39 -0.02 62.31 62.64 0.33
p23.pddl
0.13 0.14 0.0 4.45 4.44 -0.01
p24.pddl
5.52 5.39 -0.13 None None -
p25.pddl
275.30 274.78 -0.52 None None -
p26.pddl
1.81 1.91 0.1 None None -
p27.pddl
0.48 0.49 0.01 0.24 0.25 0.01
p28.pddl
101.48 101.83 0.35 99.33 99.64 0.31
p29.pddl
0.06 0.06 0.0 None None -
p30.pddl
None None - None None -
Sum of diffs
-0.42
2.00
Arithmetic mean of diffs
-0.01
0.08
sokoban-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 -0.0 0.05 0.05 0.0
p02.pddl
0.14 0.14 -0.0 0.57 0.55 -0.01
p03.pddl
0.05 0.05 0.0 0.28 0.28 -0.01
p04.pddl
0.04 0.04 0.0 0.06 0.06 0.0
p05.pddl
1.00 1.01 0.01 1.15 1.13 -0.02
p06.pddl
2.62 2.67 0.06 1.45 1.46 0.01
p07.pddl
0.30 0.30 -0.0 2.32 2.31 -0.01
p08.pddl
0.13 0.13 0.0 5.81 5.85 0.03
p09.pddl
0.04 0.04 -0.0 0.43 0.43 0.0
p10.pddl
0.04 0.04 -0.0 None None -
p11.pddl
15.77 16.55 0.78 28.32 27.93 -0.39
p12.pddl
0.08 0.08 0.0 0.39 0.39 0.0
p13.pddl
1.06 1.05 -0.0 25.16 26.66 1.51
p14.pddl
0.42 0.42 0.01 37.53 37.23 -0.3
p15.pddl
1.95 1.93 -0.03 45.66 45.61 -0.05
p16.pddl
3.98 3.93 -0.04 25.49 25.33 -0.17
p17.pddl
3.20 3.32 0.12 96.45 98.32 1.87
p18.pddl
0.16 0.16 0.0 0.09 0.09 0.0
p19.pddl
2.40 2.40 -0.01 62.43 62.60 0.17
p20.pddl
0.13 0.14 0.0 4.10 4.32 0.22
Sum of diffs
0.91
2.86
Arithmetic mean of diffs
0.05
0.15
spider-opt18-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.39 0.41 0.01 0.63 0.63 -0.01
p02.pddl
1.71 1.78 0.06 0.91 0.82 -0.09
p03.pddl
2.36 2.42 0.06 2.67 2.67 -0.0
p04.pddl
3.62 3.52 -0.1 4.11 4.27 0.15
p05.pddl
17.94 19.10 1.16 7.42 7.47 0.05
p06.pddl
76.31 73.09 -3.22 117.94 118.97 1.03
p07.pddl
0.40 0.38 -0.02 0.38 0.40 0.02
p08.pddl
0.70 0.69 -0.01 0.73 0.75 0.01
p09.pddl
14.71 14.09 -0.62 2.26 2.21 -0.05
p10.pddl
69.72 63.53 -6.19 11.86 12.32 0.46
p11.pddl
10.43 10.54 0.11 7.29 7.30 0.01
p12.pddl
32.34 31.88 -0.47 36.24 36.16 -0.08
p13.pddl
188.57 182.69 -5.88 17.97 17.26 -0.71
p14.pddl
0.33 0.31 -0.02 0.31 0.31 -0.0
p15.pddl
0.62 0.71 0.09 0.71 0.71 -0.0
p16.pddl
1.83 1.68 -0.15 1.89 1.88 -0.01
p17.pddl
2.95 2.97 0.03 2.42 2.54 0.12
p18.pddl
7.38 6.56 -0.82 18.89 17.89 -1.0
p19.pddl
13.63 12.44 -1.19 8.67 8.90 0.23
p20.pddl
22.56 18.37 -4.19 15.98 15.34 -0.64
Sum of diffs
-21.37
-0.50
Arithmetic mean of diffs
-1.07
-0.03
storage
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p08.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p09.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p10.pddl
0.01 0.02 0.0 0.01 0.01 -0.0
p11.pddl
0.08 0.08 0.0 0.04 0.05 0.0
p12.pddl
0.08 0.08 -0.0 0.23 0.25 0.02
p13.pddl
0.19 0.19 -0.0 0.01 0.01 -0.0
p14.pddl
0.49 0.51 0.02 0.04 0.04 0.0
p15.pddl
0.20 0.19 -0.01 0.17 0.17 -0.01
p16.pddl
0.30 0.31 0.01 1.93 1.91 -0.02
p17.pddl
0.47 0.47 0.0 32.45 32.84 0.39
p18.pddl
53.56 54.43 0.87 None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
33.50 36.77 3.27 None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
4.16
0.39
Arithmetic mean of diffs
0.22
0.02
termes-opt18-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.03 0.03 0.0 0.05 0.05 -0.0
p02.pddl
0.20 0.20 -0.0 0.07 0.07 -0.0
p03.pddl
0.30 0.30 0.0 0.42 0.42 0.0
p04.pddl
0.25 0.25 0.0 0.39 0.38 -0.01
p05.pddl
21.46 21.53 0.07 4.77 4.99 0.22
p06.pddl
5.96 5.95 -0.01 10.71 10.40 -0.31
p07.pddl
71.84 71.12 -0.71 102.73 101.02 -1.72
p08.pddl
92.10 91.68 -0.42 24.02 23.37 -0.64
p09.pddl
None None - None None -
p10.pddl
393.72 381.56 -12.15 None None -
p11.pddl
0.04 0.04 -0.0 0.23 0.23 -0.0
p12.pddl
0.07 0.07 -0.0 0.03 0.03 0.0
p13.pddl
0.19 0.18 -0.0 0.35 0.36 0.01
p14.pddl
0.14 0.13 -0.0 0.13 0.13 0.0
p15.pddl
3.26 3.24 -0.02 0.78 0.77 -0.01
p16.pddl
1.66 1.67 0.01 1.39 1.34 -0.05
p17.pddl
0.61 0.64 0.03 0.23 0.23 -0.0
p18.pddl
0.04 0.04 -0.0 0.03 0.03 -0.0
p19.pddl
0.52 0.52 -0.0 0.08 0.08 0.0
p20.pddl
0.70 0.70 -0.0 0.42 0.40 -0.02
Sum of diffs
-13.23
-2.53
Arithmetic mean of diffs
-0.70
-0.14
tetris-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01-6.pddl
1.12 1.15 0.02 0.17 0.17 -0.01
p01-8.pddl
2.09 2.01 -0.08 0.38 0.36 -0.02
p01-10.pddl
242.76 245.83 3.07 1.09 1.09 -0.0
p02-4.pddl
0.08 0.08 -0.0 0.06 0.07 0.0
p02-6.pddl
1.05 1.13 0.08 0.25 0.24 -0.01
p02-8.pddl
1.52 1.49 -0.03 0.38 0.38 -0.0
p02-10.pddl
26.71 26.15 -0.56 0.42 0.42 0.0
p03-4.pddl
0.18 0.18 0.0 0.06 0.07 0.0
p03-6.pddl
0.76 0.75 -0.01 0.13 0.13 -0.0
p03-8.pddl
3.25 3.29 0.04 0.79 0.82 0.03
p03-10.pddl
7.37 7.01 -0.36 1.17 1.27 0.1
p04-6.pddl
1.01 1.02 0.0 0.14 0.14 -0.0
p04-8.pddl
8.65 8.55 -0.11 0.72 0.71 -0.01
p04-10.pddl
11.50 11.38 -0.12 0.91 0.94 0.03
p05-6.pddl
0.38 0.39 0.01 0.14 0.14 0.0
p05-8.pddl
196.44 194.50 -1.94 0.81 0.83 0.02
p05-10.pddl
4.91 5.24 0.33 1.08 1.05 -0.03
Sum of diffs
0.34
0.11
Arithmetic mean of diffs
0.02
0.01
tidybot-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.14 0.13 -0.01 0.08 0.08 0.0
p02.pddl
0.74 0.75 0.01 0.33 0.34 0.01
p03.pddl
0.39 0.33 -0.05 0.27 0.27 -0.0
p04.pddl
0.43 0.49 0.06 0.35 0.35 -0.0
p05.pddl
1.48 1.29 -0.19 0.80 0.79 -0.02
p06.pddl
0.80 0.93 0.13 0.86 0.73 -0.13
p07.pddl
1.04 1.17 0.14 0.61 0.61 0.0
p08.pddl
1579.15 1726.40 147.25 0.80 0.80 0.0
p09.pddl
7.28 7.63 0.35 1.37 1.31 -0.06
p10.pddl
1.48 1.58 0.1 1.07 1.10 0.03
p11.pddl
1.94 2.30 0.36 1.24 1.20 -0.04
p12.pddl
2.02 1.79 -0.22 1.06 1.08 0.03
p13.pddl
6.40 6.82 0.41 1.05 1.11 0.06
p14.pddl
3.02 3.03 0.0 1.54 1.34 -0.2
p15.pddl
None None - 1.62 1.63 0.01
p16.pddl
3.46 2.81 -0.65 1.62 1.62 -0.0
p17.pddl
6.79 7.27 0.47 2.29 2.24 -0.05
p18.pddl
19.39 17.00 -2.39 2.04 2.01 -0.02
p19.pddl
3.07 3.63 0.56 1.78 1.75 -0.03
p20.pddl
4.49 3.93 -0.56 2.47 2.58 0.11
Sum of diffs
145.77
-0.30
Arithmetic mean of diffs
7.67
-0.02
tidybot-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
3.83 3.83 0.0 13.38 13.69 0.31
p02.pddl
4.26 4.07 -0.18 1.54 1.61 0.07
p03.pddl
3.11 2.78 -0.33 1.76 1.59 -0.17
p04.pddl
2.11 2.51 0.41 1.54 1.57 0.03
p05.pddl
5.33 6.19 0.87 2.44 2.46 0.02
p06.pddl
14.30 11.01 -3.29 2.98 2.94 -0.04
p07.pddl
3.42 3.30 -0.12 1.77 1.73 -0.03
p08.pddl
2.91 3.02 0.11 1.59 1.51 -0.08
p09.pddl
4.79 4.06 -0.73 2.35 2.45 0.1
p10.pddl
6.93 5.74 -1.19 2.89 2.92 0.03
p11.pddl
2.33 2.26 -0.07 1.27 1.23 -0.04
p12.pddl
1.72 1.75 0.03 1.09 1.04 -0.04
p13.pddl
6.82 6.21 -0.61 1.08 1.01 -0.07
p14.pddl
2.38 2.63 0.24 1.40 1.47 0.08
p15.pddl
None None - 1.64 1.61 -0.03
p16.pddl
2.54 2.66 0.12 1.57 1.60 0.02
p17.pddl
6.56 9.53 2.97 2.27 2.27 -0.0
p18.pddl
19.67 16.16 -3.51 2.01 2.01 0.0
p19.pddl
3.06 3.31 0.25 1.81 1.83 0.02
p20.pddl
4.32 4.25 -0.06 2.64 2.63 -0.01
Sum of diffs
-5.10
0.17
Arithmetic mean of diffs
-0.27
0.01
tpp
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p06.pddl
0.01 0.01 -0.0 0.02 0.02 0.0
p07.pddl
0.01 0.02 0.0 0.03 0.03 0.0
p08.pddl
0.02 0.02 0.0 0.05 0.05 0.0
p09.pddl
0.02 0.02 0.0 0.08 0.08 -0.0
p10.pddl
0.03 0.03 0.0 0.14 0.14 -0.0
p11.pddl
0.04 0.03 -0.0 0.24 0.23 -0.01
p12.pddl
0.04 0.04 -0.0 0.38 0.39 0.01
p13.pddl
0.05 0.05 0.0 0.23 0.22 -0.01
p14.pddl
0.06 0.07 0.0 0.52 0.51 -0.01
p15.pddl
0.09 0.09 0.0 0.42 0.43 0.01
p16.pddl
0.19 0.19 -0.0 2.71 2.63 -0.08
p17.pddl
0.26 0.26 -0.0 31.83 30.99 -0.85
p18.pddl
0.19 0.19 -0.0 10.21 10.19 -0.02
p19.pddl
0.42 0.42 0.0 23.60 23.69 0.1
p20.pddl
0.55 0.53 -0.01 67.95 68.08 0.13
p21.pddl
0.66 0.64 -0.02 7.00 6.54 -0.46
p22.pddl
0.46 0.46 0.0 7.26 7.12 -0.14
p23.pddl
0.79 0.80 0.01 18.73 17.96 -0.77
p24.pddl
1.62 1.74 0.12 13.41 14.10 0.69
p25.pddl
1.27 1.35 0.07 54.78 55.32 0.54
p26.pddl
2.17 2.24 0.07 59.70 60.24 0.54
p27.pddl
2.78 2.83 0.05 56.50 57.01 0.51
p28.pddl
3.22 3.33 0.1 None None -
p29.pddl
7.00 7.80 0.8 None None -
p30.pddl
6.13 6.14 0.01 None None -
Sum of diffs
1.21
0.18
Arithmetic mean of diffs
0.04
0.01
transport-opt08-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p03.pddl
0.02 0.02 -0.0 0.02 0.02 0.0
p04.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p05.pddl
0.04 0.04 -0.0 0.04 0.04 -0.0
p06.pddl
0.07 0.08 0.0 0.12 0.12 -0.0
p07.pddl
0.11 0.10 -0.01 0.31 0.32 0.01
p08.pddl
0.13 0.14 0.01 0.41 0.41 -0.0
p09.pddl
0.19 0.19 -0.0 0.76 0.73 -0.03
p10.pddl
0.26 0.26 -0.0 1.56 1.59 0.03
p11.pddl
0.01 0.02 0.01 0.01 0.01 0.0
p12.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p13.pddl
0.02 0.02 0.0 0.03 0.03 -0.0
p14.pddl
0.03 0.03 -0.0 0.05 0.05 0.0
p15.pddl
0.07 0.07 0.0 0.08 0.08 -0.0
p16.pddl
0.12 0.12 0.0 0.94 0.98 0.04
p17.pddl
0.24 0.23 -0.01 3.35 3.16 -0.18
p18.pddl
0.33 0.34 0.01 5.40 5.61 0.21
p19.pddl
0.43 0.42 -0.01 12.92 12.72 -0.2
p20.pddl
0.63 0.66 0.03 26.05 26.88 0.82
p21.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p22.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p23.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p24.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p25.pddl
0.04 0.04 -0.0 0.05 0.05 -0.0
p26.pddl
0.07 0.07 0.0 0.12 0.12 0.0
p27.pddl
0.10 0.10 0.0 0.14 0.14 -0.0
p28.pddl
0.19 0.19 0.0 0.97 0.91 -0.05
p29.pddl
0.20 0.19 -0.01 0.74 0.76 0.02
p30.pddl
0.24 0.25 0.02 0.98 0.93 -0.05
Sum of diffs
0.04
0.62
Arithmetic mean of diffs
0.00
0.02
transport-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p02.pddl
0.02 0.02 0.0 0.02 0.02 -0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p04.pddl
0.02 0.02 0.0 0.03 0.03 0.0
p05.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p06.pddl
0.02 0.02 0.0 0.02 0.03 0.0
p07.pddl
0.03 0.03 0.0 0.03 0.03 0.0
p08.pddl
0.04 0.04 0.0 0.09 0.08 -0.0
p09.pddl
0.04 0.04 0.0 0.05 0.05 0.0
p10.pddl
0.06 0.06 -0.0 0.11 0.11 0.0
p11.pddl
0.06 0.06 0.0 0.07 0.07 0.0
p12.pddl
0.07 0.07 0.0 0.21 0.21 -0.0
p13.pddl
0.05 0.05 0.0 0.05 0.05 -0.0
p14.pddl
0.07 0.08 0.0 0.13 0.13 -0.0
p15.pddl
0.06 0.06 0.0 0.06 0.06 -0.0
p16.pddl
0.11 0.11 0.0 0.19 0.18 -0.0
p17.pddl
0.04 0.04 0.0 0.04 0.04 -0.0
p18.pddl
0.03 0.03 -0.0 0.05 0.05 0.0
p19.pddl
0.04 0.04 0.0 0.05 0.05 0.0
p20.pddl
0.07 0.07 -0.0 0.12 0.12 0.0
Sum of diffs
0.01
-0.00
Arithmetic mean of diffs
0.00
-0.00
transport-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p03.pddl
0.02 0.02 0.0 0.03 0.03 -0.0
p04.pddl
0.04 0.04 0.0 0.06 0.06 0.0
p05.pddl
0.06 0.06 0.0 0.26 0.26 0.0
p06.pddl
0.07 0.07 0.0 0.13 0.13 0.0
p07.pddl
0.02 0.02 -0.0 0.03 0.03 0.0
p08.pddl
0.03 0.03 0.0 0.06 0.06 -0.0
p09.pddl
0.05 0.05 0.0 0.10 0.10 -0.0
p10.pddl
0.08 0.08 0.0 1.10 1.10 0.01
p11.pddl
0.15 0.15 -0.0 2.81 2.70 -0.11
p12.pddl
0.18 0.18 -0.0 5.42 5.59 0.18
p13.pddl
0.02 0.02 0.0 0.03 0.03 0.0
p14.pddl
0.04 0.04 0.0 0.06 0.06 -0.0
p15.pddl
0.06 0.06 -0.0 0.10 0.10 -0.0
p16.pddl
0.11 0.11 0.0 1.42 1.40 -0.02
p17.pddl
0.22 0.21 -0.01 2.44 2.55 0.1
p18.pddl
0.22 0.23 0.01 3.59 3.73 0.14
p19.pddl
0.32 0.32 -0.01 1.40 1.35 -0.05
p20.pddl
0.32 0.32 -0.0 1.31 1.34 0.03
Sum of diffs
-0.00
0.28
Arithmetic mean of diffs
-0.00
0.01
trucks-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 -0.0 0.05 0.05 0.0
p03.pddl
0.02 0.02 0.0 1.27 1.28 0.01
p04.pddl
0.12 0.13 0.0 0.02 0.02 -0.0
p05.pddl
0.03 0.03 -0.0 0.03 0.03 -0.0
p06.pddl
0.04 0.04 0.0 0.04 0.04 0.0
p07.pddl
0.10 0.10 -0.0 48.05 46.17 -1.88
p08.pddl
0.05 0.05 0.0 None None -
p09.pddl
0.13 0.12 -0.0 None None -
p10.pddl
4.89 4.88 -0.02 None None -
p11.pddl
1.44 1.37 -0.07 None None -
p12.pddl
20.06 20.52 0.46 None None -
p13.pddl
99.71 101.35 1.64 None None -
p14.pddl
4.44 4.52 0.08 None None -
p15.pddl
75.19 74.08 -1.12 None None -
p16.pddl
362.17 367.60 5.43 None None -
p17.pddl
235.57 240.48 4.91 None None -
p18.pddl
None None - None None -
p19.pddl
None None - None None -
p20.pddl
None None - None None -
p21.pddl
None None - None None -
p22.pddl
None None - None None -
p23.pddl
None None - None None -
p24.pddl
None None - None None -
p25.pddl
None None - None None -
p26.pddl
None None - None None -
p27.pddl
None None - None None -
p28.pddl
None None - None None -
p29.pddl
None None - None None -
p30.pddl
None None - None None -
Sum of diffs
11.32
-1.87
Arithmetic mean of diffs
0.67
-0.27
visitall-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
problem02-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem02-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem03-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem03-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem04-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem04-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem05-full.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem05-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem06-full.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
problem06-half.pddl
0.01 0.01 0.0 0.01 0.01 0.0
problem07-full.pddl
0.02 0.02 0.0 0.01 0.01 -0.0
problem07-half.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
problem08-full.pddl
0.03 0.03 0.0 0.01 0.01 -0.0
problem08-half.pddl
0.02 0.02 0.0 0.01 0.01 0.0
problem09-full.pddl
0.04 0.04 -0.0 0.02 0.02 0.0
problem09-half.pddl
0.03 0.03 0.0 0.01 0.01 0.0
problem10-full.pddl
0.05 0.05 -0.0 0.02 0.02 -0.0
problem10-half.pddl
0.03 0.03 0.0 0.01 0.01 -0.0
problem11-full.pddl
0.08 0.08 0.0 0.03 0.03 -0.0
problem11-half.pddl
0.04 0.04 0.0 0.02 0.02 0.0
Sum of diffs
0.00
-0.00
Arithmetic mean of diffs
0.00
-0.00
visitall-opt14-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p-1-5.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-1-6.pddl
0.01 0.02 0.0 0.01 0.01 0.0
p-1-7.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p-1-8.pddl
0.03 0.03 0.0 0.01 0.02 0.0
p-1-9.pddl
0.04 0.04 0.0 0.02 0.02 0.0
p-1-10.pddl
0.05 0.05 0.0 0.02 0.02 0.0
p-1-11.pddl
0.08 0.08 0.0 0.03 0.03 -0.0
p-1-12.pddl
0.09 0.09 0.0 0.03 0.03 -0.0
p-1-13.pddl
0.14 0.14 0.0 0.04 0.04 -0.0
p-1-14.pddl
0.18 0.18 0.0 0.05 0.05 0.0
p-1-15.pddl
0.23 0.23 -0.0 0.06 0.06 -0.0
p-1-16.pddl
0.30 0.30 0.0 0.07 0.07 0.0
p-1-17.pddl
0.35 0.36 0.01 0.09 0.09 -0.0
p-1-18.pddl
0.45 0.45 -0.0 0.11 0.11 0.0
p-05-5.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-05-6.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-05-7.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p-05-8.pddl
0.02 0.02 -0.0 0.01 0.01 0.0
p-05-9.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p-05-10.pddl
0.03 0.03 -0.0 0.01 0.01 0.0
Sum of diffs
0.02
0.00
Arithmetic mean of diffs
0.00
0.00
woodworking-opt08-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 -0.0 0.01 0.01 0.0
p02.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p03.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p04.pddl
0.03 0.03 0.0 None None -
p05.pddl
0.18 0.18 0.0 0.03 0.03 -0.0
p06.pddl
0.05 0.05 0.0 0.18 0.18 0.0
p07.pddl
0.06 0.06 0.0 0.05 0.05 -0.0
p08.pddl
0.07 0.07 0.0 None None -
p09.pddl
0.48 0.50 0.02 None None -
p10.pddl
0.10 0.10 0.0 1.57 1.54 -0.04
p11.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p12.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p13.pddl
0.03 0.03 0.0 0.02 0.02 0.0
p14.pddl
0.11 0.12 0.0 0.02 0.02 0.0
p15.pddl
0.20 0.20 -0.0 0.03 0.03 -0.0
p16.pddl
0.20 0.20 -0.0 None None -
p17.pddl
0.29 0.29 0.0 0.14 0.14 -0.0
p18.pddl
0.08 0.08 0.0 0.30 0.32 0.02
p19.pddl
0.07 0.07 0.0 0.06 0.06 0.0
p20.pddl
0.48 0.49 0.01 0.92 0.94 0.01
p21.pddl
0.01 0.02 0.01 0.01 0.01 0.0
p22.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
p23.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p24.pddl
0.15 0.15 0.01 185.97 182.71 -3.27
p25.pddl
0.25 0.25 -0.0 0.03 0.03 -0.0
p26.pddl
0.05 0.05 0.0 None None -
p27.pddl
0.26 0.28 0.02 None None -
p28.pddl
0.51 0.46 -0.05 None None -
p29.pddl
0.12 0.12 -0.0 0.07 0.07 -0.0
p30.pddl
0.74 0.76 0.03 11.50 11.15 -0.34
Sum of diffs
0.06
-3.61
Arithmetic mean of diffs
0.00
-0.16
woodworking-opt11-strips
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.02 0.02 0.0 0.01 0.01 0.0
p02.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p03.pddl
0.03 0.03 0.0 0.02 0.02 0.0
p04.pddl
0.02 0.02 0.0 0.02 0.02 0.0
p05.pddl
0.14 0.15 0.01 182.45 180.07 -2.38
p06.pddl
0.03 0.03 -0.0 None None -
p07.pddl
0.12 0.12 0.0 0.02 0.02 -0.0
p08.pddl
0.24 0.25 0.0 0.03 0.03 0.0
p09.pddl
0.18 0.18 -0.0 0.03 0.03 -0.0
p10.pddl
0.20 0.20 0.0 0.03 0.03 0.0
p11.pddl
0.05 0.05 0.0 None None -
p12.pddl
0.20 0.20 -0.0 None None -
p13.pddl
0.05 0.05 0.0 0.18 0.18 0.0
p14.pddl
0.26 0.26 -0.0 None None -
p15.pddl
0.28 0.28 -0.0 0.14 0.14 -0.0
p16.pddl
0.06 0.06 0.0 0.05 0.05 -0.0
p17.pddl
0.51 0.49 -0.02 None None -
p18.pddl
0.08 0.08 -0.0 0.33 0.32 -0.01
p19.pddl
0.07 0.07 -0.0 None None -
p20.pddl
0.12 0.12 0.0 0.07 0.07 -0.0
Sum of diffs
-0.00
-2.38
Arithmetic mean of diffs
-0.00
-0.17
zenotravel
Show table
total_time
issue995-base-lama-first
issue995-v1-lama-first
Diff (lama-first)
issue995-base-lm_zg
issue995-v1-lm_zg
Diff (lm_zg)
p01.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p02.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p03.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p04.pddl
0.01 0.01 0.0 0.01 0.01 0.0
p05.pddl
0.01 0.01 -0.0 0.01 0.01 -0.0
p06.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p07.pddl
0.01 0.01 0.0 0.01 0.01 -0.0
p08.pddl
0.02 0.02 0.0 0.03 0.03 -0.0
p09.pddl
0.02 0.02 -0.0 0.03 0.03 0.0
p10.pddl
0.02 0.02 0.0 0.05 0.05 0.0
p11.pddl
0.02 0.02 -0.0 0.06 0.06 0.0
p12.pddl
0.03 0.03 0.0 0.06 0.06 0.0
p13.pddl
0.05 0.03 -0.01 0.12 0.11 -0.0
p14.pddl
0.10 0.10 -0.0 2.83 2.85 0.02
p15.pddl
0.17 0.18 0.0 1.39 1.42 0.04
p16.pddl
0.21 0.22 0.01 6.03 6.04 0.01
p17.pddl
0.39 0.40 0.0 32.11 32.16 0.05
p18.pddl
0.55 0.51 -0.04 5.16 5.20 0.04
p19.pddl
0.75 0.67 -0.07 7.39 7.41 0.01
p20.pddl
1.31 1.20 -0.11 14.22 13.74 -0.49
Sum of diffs
-0.23
-0.31
Arithmetic mean of diffs
-0.01
-0.02