unexplained-errors

Contents of /infai/seipp/projects/jendrik-downward/experiments/issue213/data/issue213-v8-opt-30min-grid-steps/slurm.err without "memory cg" errors:

slurmstepd: error: Unable to unlink domain socket: No such file or directory
2018-12-13 06:14:21,387 ERROR    There was output to *-grid-steps/slurm.err
2018-12-13 06:15:49,375 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14249".
2018-12-13 06:15:49,376 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05698".
2018-12-13 06:15:49,376 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05954".
2018-12-13 06:15:49,376 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12968".
2018-12-13 06:15:49,376 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14444".
2018-12-13 06:15:49,376 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07169".
2018-12-13 06:15:49,377 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/14000".
2018-12-13 06:15:49,377 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06805".
2018-12-13 06:15:49,377 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13501".
2018-12-13 06:15:49,377 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05635".
2018-12-13 06:15:49,377 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05843".
2018-12-13 06:15:49,377 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13814".
2018-12-13 06:15:49,377 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14541".
2018-12-13 06:15:49,377 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14526".
2018-12-13 06:15:49,378 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06611".
2018-12-13 06:15:49,378 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14379".
2018-12-13 06:15:49,378 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13346".
2018-12-13 06:15:49,378 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14220".
2018-12-13 06:15:49,378 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13929".
2018-12-13 06:15:49,378 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05850".
2018-12-13 06:15:49,378 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13342".
2018-12-13 06:15:49,378 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13837".
2018-12-13 06:15:49,378 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13854".
2018-12-13 06:15:49,379 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05685".
2018-12-13 06:15:49,379 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05485".
2018-12-13 06:15:49,379 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14126".
2018-12-13 06:15:49,379 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06972".
2018-12-13 06:15:49,379 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05525".
2018-12-13 06:15:49,379 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13439".
2018-12-13 06:15:49,379 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05618".
2018-12-13 06:15:49,379 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05739".
2018-12-13 06:15:49,379 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13160".
2018-12-13 06:15:49,380 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13017".
2018-12-13 06:15:49,380 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14150".
2018-12-13 06:15:49,380 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13353".
2018-12-13 06:15:49,380 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13224".
2018-12-13 06:15:49,380 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13010".
2018-12-13 06:15:49,380 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06298".
2018-12-13 06:15:49,380 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06793".
2018-12-13 06:15:49,380 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13273".
2018-12-13 06:15:49,380 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14380".
2018-12-13 06:15:49,380 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06542".
2018-12-13 06:15:49,381 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06920".
2018-12-13 06:15:49,381 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13182".
2018-12-13 06:15:49,381 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06832".
2018-12-13 06:15:49,381 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13419".
2018-12-13 06:15:49,381 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13886".
2018-12-13 06:15:49,381 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05788".
2018-12-13 06:15:49,381 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05662".
2018-12-13 06:15:49,381 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12901".
2018-12-13 06:15:49,381 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13246".
2018-12-13 06:15:49,381 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06573".
2018-12-13 06:15:49,382 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 18:41:34,588 ERROR    planner finished and wrote 6015 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-17301-17400/17383".
2018-12-13 06:15:49,382 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06938".
2018-12-13 06:15:49,382 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06507".
2018-12-13 06:15:49,382 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14062".
2018-12-13 06:15:49,382 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 04:06:23,333 ERROR    planner finished and wrote 1991 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-26401-26500/26461".
2018-12-13 06:15:49,382 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05490".
2018-12-13 06:15:49,382 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13477".
2018-12-13 06:15:49,382 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05778".
2018-12-13 06:15:49,382 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13576".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13390".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13443".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06117".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13742".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06854".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06124".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 23:36:05,591 ERROR    planner finished and wrote 6243 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35653".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14421".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12925".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06272".
2018-12-13 06:15:49,383 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05597".
2018-12-13 06:15:49,384 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13349".
2018-12-13 06:15:49,384 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05926".
2018-12-13 06:15:49,384 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05887".
2018-12-13 06:15:49,384 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05651".
2018-12-13 06:15:49,384 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14505".
2018-12-13 06:15:49,384 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14079".
2018-12-13 06:15:49,384 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06347".
2018-12-13 06:15:49,384 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05989".
2018-12-13 06:15:49,384 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14142".
2018-12-13 06:15:49,384 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13655".
2018-12-13 06:15:49,385 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07158".
2018-12-13 06:15:49,385 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13285".
2018-12-13 06:15:49,385 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06419".
2018-12-13 06:15:49,385 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13411".
2018-12-13 06:15:49,385 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13334".
2018-12-13 06:15:49,385 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06567".
2018-12-13 06:15:49,385 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13210".
2018-12-13 06:15:49,385 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06442".
2018-12-13 06:15:49,385 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14081".
2018-12-13 06:15:49,385 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07125".
2018-12-13 06:15:49,386 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14057".
2018-12-13 06:15:49,386 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14373".
2018-12-13 06:15:49,386 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13521".
2018-12-13 06:15:49,386 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05890".
2018-12-13 06:15:49,386 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05797".
2018-12-13 06:15:49,386 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14490".
2018-12-13 06:15:49,386 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07044".
2018-12-13 06:15:49,386 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06596".
2018-12-13 06:15:49,386 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06597".
2018-12-13 06:15:49,386 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07002".
2018-12-13 06:15:49,387 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13033".
2018-12-13 06:15:49,387 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07271".
2018-12-13 06:15:49,387 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06581".
2018-12-13 06:15:49,387 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13228".
2018-12-13 06:15:49,387 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14488".
2018-12-13 06:15:49,387 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14132".
2018-12-13 06:15:49,387 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13834".
2018-12-13 06:15:49,387 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07289".
2018-12-13 06:15:49,387 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06923".
2018-12-13 06:15:49,387 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13697".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06543".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06388".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06202".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13857".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13021".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06287".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13829".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12933".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06459".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13872".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13550".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13604".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12936".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05745".
2018-12-13 06:15:49,388 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06763".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06212".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13746".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13974".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13251".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06707".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06135".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06789".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05693".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05965".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12828".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05798".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05836".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13027".
2018-12-13 06:15:49,389 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06680".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14038".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 00:09:39,597 ERROR    planner finished and wrote 1875 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02764".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06921".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14384".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05660".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13369".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13037".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06121".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05755".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13062".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06091".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13970".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13851".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06149".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13924".
2018-12-13 06:15:49,390 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13777".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05810".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14386".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06144".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13534".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14562".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06106".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07013".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 01:37:46,147 ERROR    planner finished and wrote 2298 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-17301-17400/17393".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14014".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05512".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06137".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06267".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13700".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06023".
2018-12-13 06:15:49,391 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06628".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07178".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14544".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13141".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06965".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05496".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14600".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12881".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05648".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14284".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14261".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14556".
2018-12-13 06:15:49,392 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05976".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06372".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06701".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06608".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06030".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06547".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'exitcode--15', 'driver.err: 2018-12-12 22:53:14,195 ERROR    planner wrote 10240 KiB (hard limit) to run.log -> abort command\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35652".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13376".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06698".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06646".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13513".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05800".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14501".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06400".
2018-12-13 06:15:49,393 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13158".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14144".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06683".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06300".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06885".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05623".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06732".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05664".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12802".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14169".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07199".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13730".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13490".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13903".
2018-12-13 06:15:49,394 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05654".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14452".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06509".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13707".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12946".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06841".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06398".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13994".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13121".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06113".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06221".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14603".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14029".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13485".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13480".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13516".
2018-12-13 06:15:49,395 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07090".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12900".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13291".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05712".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12917".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06048".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12791".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14321".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13966".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05683".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05612".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07067".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06771".
2018-12-13 06:15:49,396 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13565".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07249".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14002".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12836".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13734".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06942".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05852".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13151".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12918".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13250".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06226".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12889".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05781".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06184".
2018-12-13 06:15:49,397 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05529".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13617".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13758".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05678".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05493".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05747".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06679".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14610".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05586".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06503".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13261".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14069".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14051".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06935".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06027".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14184".
2018-12-13 06:15:49,398 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13830".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14022".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06666".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13965".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14274".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14326".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13405".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06455".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12930".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06837".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13080".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13920".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06150".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13024".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07241".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06265".
2018-12-13 06:15:49,399 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13414".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06761".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13783".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06961".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14410".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06407".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13800".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05970".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13668".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05838".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13050".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06244".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13737".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13687".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06224".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05649".
2018-12-13 06:15:49,400 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05782".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05880".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14197".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13280".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 00:54:01,462 ERROR    planner finished and wrote 8471 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02793".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06361".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13721".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05741".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07145".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12821".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06621".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07164".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14302".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 04:48:34,614 ERROR    planner finished and wrote 1884 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21034".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13046".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14493".
2018-12-13 06:15:49,401 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13326".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14559".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06531".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05929".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06556".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14525".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07264".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07117".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13602".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13171".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06066".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14295".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13099".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12953".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 01:58:16,456 ERROR    planner finished and wrote 2650 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-00901-01000/00971".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14517".
2018-12-13 06:15:49,402 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05589".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14553".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06209".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13605".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06077".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06489".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07121".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12856".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06688".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06867".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06367".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12998".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07303".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05691".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13649".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14108".
2018-12-13 06:15:49,403 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06191".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05754".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07253".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07081".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13434".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13188".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06042".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13506".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06205".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13350".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06940".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06968".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06395".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14516".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07300".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14460".
2018-12-13 06:15:49,404 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12949".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13615".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13724".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06493".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14502".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12935".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14472".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06778".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06831".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06228".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12842".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06454".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07017".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13400".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06353".
2018-12-13 06:15:49,405 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05941".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06451".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06930".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14109".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06393".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13926".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06598".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05818".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06669".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13751".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06602".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12867".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06269".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05587".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14120".
2018-12-13 06:15:49,406 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13383".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06081".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13219".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13231".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14543".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 02:45:14,590 ERROR    planner finished and wrote 2807 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35662".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06435".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13921".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14163".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06010".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05495".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05729".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13861".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13769".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14344".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12947".
2018-12-13 06:15:49,407 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14528".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07183".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14250".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07163".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05617".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13315".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14494".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12835".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06309".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14385".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12848".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06274".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06932".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13910".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13898".
2018-12-13 06:15:49,408 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14519".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13704".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06096".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06516".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06238".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13354".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12862".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05643".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14129".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14034".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06456".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05644".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14390".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13945".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06345".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14077".
2018-12-13 06:15:49,409 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06524".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07022".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06614".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 21:51:56,252 ERROR    planner finished and wrote 2650 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-19201-19300/19241".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06954".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05917".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14308".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06836".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12967".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13420".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14185".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14579".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13593".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05489".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07245".
2018-12-13 06:15:49,410 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06591".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06780".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05974".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06175".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13222".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14280".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13870".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07109".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06708".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13911".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13556".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13117".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06682".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13827".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05731".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13859".
2018-12-13 06:15:49,411 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12961".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06713".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14298".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14574".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14607".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06438".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13319".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14419".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13610".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06801".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13363".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06465".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06564".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14212".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13795".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06379".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 15:10:15,294 ERROR    planner finished and wrote 2804 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-17401-17500/17407".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05530".
2018-12-13 06:15:49,412 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14058".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07283".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06631".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06478".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05526".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06484".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14217".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13408".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13832".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12794".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05793".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12805".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13553".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05896".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13091".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14168".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14173".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14566".
2018-12-13 06:15:49,413 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06807".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06036".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13639".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06323".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06984".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13166".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13496".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13159".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07012".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13561".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13053".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12871".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06989".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06495".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05689".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06217".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06416".
2018-12-13 06:15:49,414 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05953".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06585".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13084".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07293".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13203".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13133".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14312".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13864".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13022".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12910".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14177".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13289".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05995".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12857".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06343".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05621".
2018-12-13 06:15:49,415 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14478".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13124".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14050".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06350".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14074".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06280".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14085".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06028".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13311".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13212".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12988".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06319".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05987".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 15:13:07,443 ERROR    planner finished and wrote 1432 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-22801-22900/22862".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12920".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06485".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07134".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06668".
2018-12-13 06:15:49,416 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13622".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13069".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06031".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07231".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06569".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05711".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06146".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13167".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14316".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 15:17:52,689 ERROR    planner finished and wrote 2650 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-19201-19300/19209".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14561".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05542".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07297".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14131".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14360".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06324".
2018-12-13 06:15:49,417 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13447".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06515".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05520".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07254".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05870".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06862".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13030".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14209".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14223".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05910".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07069".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05500".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13614".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14091".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13584".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06640".
2018-12-13 06:15:49,418 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13430".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07056".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07063".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13849".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13304".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14564".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14440".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13616".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06613".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14043".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07307".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06981".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14102".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06362".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06464".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06559".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07088".
2018-12-13 06:15:49,419 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06975".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06894".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07215".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05573".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13631".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06401".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13368".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13713".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06700".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07131".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07027".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13956".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14555".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06882".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13919".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06374".
2018-12-13 06:15:49,420 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06765".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06663".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12937".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14054".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05807".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06910".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13656".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06533".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13479".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05835".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13135".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12924".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13554".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13517".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05867".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14128".
2018-12-13 06:15:49,421 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05543".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05629".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06166".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14407".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06277".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12887".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14200".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13206".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06702".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14427".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13607".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14235".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05562".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07299".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13262".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13657".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13954".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13237".
2018-12-13 06:15:49,422 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07152".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06903".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05502".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07066".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05626".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07191".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13288".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13824".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14403".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13818".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05903".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06336".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14616".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06945".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14448".
2018-12-13 06:15:49,423 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12919".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07033".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13385".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13249".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06979".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06868".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05628".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05957".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05925".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13305".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13959".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06593".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06610".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06884".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06744".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13709".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13493".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06017".
2018-12-13 06:15:49,424 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06415".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06490".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05608".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06207".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12886".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05753".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13917".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13797".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14088".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06061".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05551".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13960".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06620".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05907".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05972".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14470".
2018-12-13 06:15:49,425 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14082".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06469".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06839".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05546".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06705".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14036".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14532".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14012".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06539".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14283".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13128".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05948".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13109".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13973".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13568".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06426".
2018-12-13 06:15:49,426 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05676".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13235".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05757".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06501".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05830".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12869".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07102".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13451".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12943".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13107".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06002".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06889".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14234".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14158".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07127".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05864".
2018-12-13 06:15:49,427 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07114".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06211".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13012".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13179".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13209".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06678".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14612".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13743".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13993".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06808".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13590".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06709".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14098".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13793".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14339".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12870".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14125".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12798".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05991".
2018-12-13 06:15:49,428 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14170".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14515".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13407".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06375".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14206".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06258".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06565".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13726".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13715".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06714".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06222".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12825".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12876".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06329".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05785".
2018-12-13 06:15:49,429 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06863".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14467".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06187".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06998".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13748".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06130".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07077".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14191".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13703".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13377".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06724".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05915".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07170".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05598".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07247".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05655".
2018-12-13 06:15:49,430 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07140".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06527".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13339".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13532".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13464".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06774".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06171".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14275".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06907".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06279".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14080".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06348".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13041".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05506".
2018-12-13 06:15:49,431 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13470".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07177".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06169".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12995".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05602".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06391".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06928".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13669".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12945".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13035".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06768".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05811".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14474".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13120".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13122".
2018-12-13 06:15:49,432 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13949".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05971".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13194".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13456".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06084".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05593".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14606".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13064".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07016".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06104".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07082".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13270".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13559".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13881".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13256".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07098".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13226".
2018-12-13 06:15:49,433 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13429".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13785".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12928".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13603".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06934".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06952".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13879".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13771".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06118".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13302".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06802".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14341".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14268".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06188".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06273".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06181".
2018-12-13 06:15:49,434 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05772".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14140".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13792".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06341".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13708".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07161".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13193".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13874".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06194".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13555".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14586".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13620".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05557".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07047".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14413".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05517".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14533".
2018-12-13 06:15:49,435 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13144".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 05:17:02,666 ERROR    planner finished and wrote 2108 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21069".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13254".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14193".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14457".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14391".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14030".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05960".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13453".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05812".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05866".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12973".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07209".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06630".
2018-12-13 06:15:49,436 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14576".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14425".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14432".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06609".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13475".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14099".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07034".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14113".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06038".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06784".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13672".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13666".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13173".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05509".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13113".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06133".
2018-12-13 06:15:49,437 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06818".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12811".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07040".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06649".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07007".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14118".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14570".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13322".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14611".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12969".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13039".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14127".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06215".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13248".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07062".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13404".
2018-12-13 06:15:49,438 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14400".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14083".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06245".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06071".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12817".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14420".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13491".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06999".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12894".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13138".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13900".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07198".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06637".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06731".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05936".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07179".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12957".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14214".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13660".
2018-12-13 06:15:49,439 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13366".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07137".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13902".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14067".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06363".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13170".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06145".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06251".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05653".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12994".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05604".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06078".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05802".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13942".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06154".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13164".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05503".
2018-12-13 06:15:49,440 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14007".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13573".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07093".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14282".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06986".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06235".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14442".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06313".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07239".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13457".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14016".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13909".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07302".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05634".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05740".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05821".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06284".
2018-12-13 06:15:49,441 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13541".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06742".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06019".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13634".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13676".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06752".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13752".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14009".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06703".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13214".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14581".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12963".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07187".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06208".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06645".
2018-12-13 06:15:49,442 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14175".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05680".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05893".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05884".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13581".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06525".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12838".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13636".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06213".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05940".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13504".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 20:26:50,693 ERROR    planner finished and wrote 1190 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21045".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06643".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05846".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14039".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05869".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14167".
2018-12-13 06:15:49,443 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12893".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07149".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06068".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14376".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14017".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 20:28:49,701 ERROR    planner finished and wrote 1432 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-04501-04600/04592".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05492".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12853".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13360".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07242".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05684".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12987".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06330".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14292".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06728".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06250".
2018-12-13 06:15:49,444 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06051".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06174".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13309".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06941".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14258".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05900".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14366".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05482".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07266".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13103".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14251".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13401".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13316".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14066".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13078".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05809".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06433".
2018-12-13 06:15:49,445 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05545".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05792".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06685".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06519".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06168".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 20:53:30,946 ERROR    planner finished and wrote 1319 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-19201-19300/19236".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06574".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12885".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06294".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05620".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07025".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12981".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05619".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13176".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07087".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12803".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06824".
2018-12-13 06:15:49,446 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13032".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06749".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06234".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07301".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06365".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06775".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14222".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13741".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14216".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06403".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05923".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06412".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07112".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14304".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06231".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07291".
2018-12-13 06:15:49,447 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13230".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05853".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07075".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13397".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14372".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14342".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05951".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14428".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06429".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12797".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06792".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06974".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06988".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06183".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06758".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06423".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13139".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05913".
2018-12-13 06:15:49,448 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13070".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13720".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13578".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05633".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06481".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05827".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06475".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07278".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07305".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13848".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13082".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14534".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13767".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05504".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13928".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07032".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05977".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13243".
2018-12-13 06:15:49,449 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14327".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13155".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12913".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05937".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12954".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 18:43:55,272 ERROR    planner finished and wrote 1318 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-00901-01000/00966".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14015".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13498".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13711".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05605".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06786".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05844".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06088".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06850".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14106".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05832".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14592".
2018-12-13 06:15:49,450 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05794".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13147".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06745".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06004".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13380".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13925".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05760".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06074".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12878".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14389".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13528".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13040".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07175".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14348".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14291".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06576".
2018-12-13 06:15:49,451 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05921".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13892".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13988".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05707".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06139".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07194".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05945".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06916".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14279".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13991".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12808".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14398".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13199".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06289".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05519".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06129".
2018-12-13 06:15:49,452 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06053".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13034".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14395".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13937".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07004".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13673".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13011".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'exitcode--15', 'driver.err: 2018-12-12 20:09:29,695 ERROR    planner wrote 10240 KiB (hard limit) to run.log -> abort command\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-17301-17400/17382".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13308".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06966".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13839".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06522".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07272".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06126".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06472".
2018-12-13 06:15:49,453 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14614".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13204".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07228".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06200".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07138".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07018".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13999".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12959".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14143".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14174".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14266".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05631".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12809".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14399".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13799".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06877".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06218".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14469".
2018-12-13 06:15:49,454 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05646".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06466".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14447".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07116".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06964".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06143".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06791".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13067".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06823".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14353".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05595".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05858".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06364".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14068".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06366".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13386".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13508".
2018-12-13 06:15:49,455 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13233".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05882".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06696".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05803".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06093".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06955".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12899".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13198".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06498".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05820".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07295".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06286".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14231".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05737".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13312".
2018-12-13 06:15:49,456 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13140".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05668".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06406".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 22:09:40,736 ERROR    planner finished and wrote 2157 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02799".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06513".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14245".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14095".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06009".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05694".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06811".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06800".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13598".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05988".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14430".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05978".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14486".
2018-12-13 06:15:49,457 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06925".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06901".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06570".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06157".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14237".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13268".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13331".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13841".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13031".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 17:02:30,620 ERROR    planner finished and wrote 1319 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-19201-19300/19208".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07099".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05871".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05703".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06424".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06001".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06034".
2018-12-13 06:15:49,458 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07294".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05510".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13813".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06101".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13618".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06116".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14008".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14539".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13252".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07167".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05521".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07071".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14183".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12966".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06173".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13298".
2018-12-13 06:15:49,459 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07286".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06239".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07009".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14554".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06949".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 21:08:40,963 ERROR    planner finished and wrote 2807 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35677".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14260".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14019".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05912".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13473".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14148".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06025".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05624".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14037".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14585".
2018-12-13 06:15:49,460 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06639".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14437".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13781".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14504".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05955".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14181".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06820".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14046".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12827".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05507".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07019".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13412".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06243".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12931".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06526".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06142".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06108".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07280".
2018-12-13 06:15:49,461 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07216".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13702".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07213".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14414".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13940".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14309".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06058".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05553".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13373".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13983".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05550".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06186".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14084".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07260".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14301".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13095".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06844".
2018-12-13 06:15:49,462 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14229".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12829".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05891".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13005".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07206".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13351".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05934".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14507".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12896".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06335".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06922".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07258".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05606".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05579".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06080".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14387".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12847".
2018-12-13 06:15:49,463 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13539".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13766".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14201".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06803".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06163".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14320".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06829".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07030".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13585".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12999".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06773".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14166".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13191".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14227".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07185".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14434".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05776".
2018-12-13 06:15:49,464 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13658".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14003".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14352".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13106".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13624".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05716".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13880".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05943".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07051".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06588".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13865".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05679".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13509".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06913".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06103".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14583".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05609".
2018-12-13 06:15:49,465 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06359".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13004".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06506".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14071".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14569".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13535".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05583".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07036".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07202".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06897".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05733".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14405".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13365".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13281".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13632".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14001".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06022".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13538".
2018-12-13 06:15:49,466 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13977".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07181".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05630".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13234".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13257".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06795".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06603".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14272".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06558".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13142".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05534".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06909".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13654".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14070".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14589".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07204".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13163".
2018-12-13 06:15:49,467 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07238".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13807".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12831".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06198".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07005".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06276".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13463".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13336".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06131".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 17:27:08,155 ERROR    planner finished and wrote 7619 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35679".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06710".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14332".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06536".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14481".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06627".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05622".
2018-12-13 06:15:49,468 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05584".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06301".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06266".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14179".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05484".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13893".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06746".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07060".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05681".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05538".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14529".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14253".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13768".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13061".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05966".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13318".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13739".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06886".
2018-12-13 06:15:49,469 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14101".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05518".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13183".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13939".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 18:30:20,025 ERROR    planner finished and wrote 6243 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35685".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14546".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14497".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05719".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13728".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13282".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12916".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13101".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14180".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06948".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06047".
2018-12-13 06:15:49,470 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13888".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13108".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14383".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14382".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05815".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06170".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06083".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12903".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13635".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 02:10:42,713 ERROR    planner finished and wrote 1763 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-08101-08200/08191".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14190".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13735".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13696".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06993".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07248".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13566".
2018-12-13 06:15:49,471 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13551".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06595".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14417".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13790".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 02:28:38,319 ERROR    planner finished and wrote 1193 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02775".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12832".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13683".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05670".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14594".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06357".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12890".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14035".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14028".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13105".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13450".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13100".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13058".
2018-12-13 06:15:49,472 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07128".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13642".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06197".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13284".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12830".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13406".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13271".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13260".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06634".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06445".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05877".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13545".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14458".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12826".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13856".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06735".
2018-12-13 06:15:49,473 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12977".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06623".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07276".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14451".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13948".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13522".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13416".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06112".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13934".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06236".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06247".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13530".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05857".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13442".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06737".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14161".
2018-12-13 06:15:49,474 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14599".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12906".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06658".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06261".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07304".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14551".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07192".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14455".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12927".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07143".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13253".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06833".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13592".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06253".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12993".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13181".
2018-12-13 06:15:49,475 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13196".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13325".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13239".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13486".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12983".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14119".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06782".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06748".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13152".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14247".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06919".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 04:04:31,777 ERROR    planner finished and wrote 2269 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-26401-26500/26460".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05939".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14289".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07282".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13803".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07111".
2018-12-13 06:15:49,476 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14459".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13458".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06340".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13389".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13018".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06152".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13731".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13927".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07226".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06405".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06422".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13557".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05541".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07011".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13873".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06754".
2018-12-13 06:15:49,477 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13901".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05795".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06468".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13882".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14351".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06140".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07008".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13625".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13356".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14509".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13510".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07080".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05487".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14424".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14278".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06580".
2018-12-13 06:15:49,478 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14123".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13145".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05640".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06967".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06230".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05688".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05499".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05559".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13111".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06687".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14333".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13695".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14270".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13448".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13436".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13086".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06295".
2018-12-13 06:15:49,479 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05576".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07257".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06331".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14572".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13858".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13779".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13520".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14052".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07064".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14164".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13664".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14518".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07023".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14138".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06530".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05744".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07244".
2018-12-13 06:15:49,480 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13402".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14256".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14006".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13085".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06766".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13765".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06870".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06201".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06316".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12951".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05777".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12942".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05738".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13016".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07026".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06987".
2018-12-13 06:15:49,481 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14149".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13361".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06534".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13955".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06809".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06772".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06155".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14107".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05894".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14020".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14040".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14598".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14159".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05834".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06653".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06762".
2018-12-13 06:15:49,482 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06827".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12962".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07285".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07154".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06310".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13205".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06606".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14605".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13744".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06063".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06655".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14354".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14397".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12905".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12801".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12974".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05641".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05566".
2018-12-13 06:15:49,483 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06819".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12860".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13073".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13957".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06327".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07156".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14203".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14045".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06453".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13074".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06193".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06151".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07020".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13762".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06983".
2018-12-13 06:15:49,484 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12865".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13116".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13503".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06899".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14462".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13594".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13571".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13544".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13964".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06799".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14186".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 05:37:41,773 ERROR    planner finished and wrote 1432 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-04601-04700/04620".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13371".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06054".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06356".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13097".
2018-12-13 06:15:49,485 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14104".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06447".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14523".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07091".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05947".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14429".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14056".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06924".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06881".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06387".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12923".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13307".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13381".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05873".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07217".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13295".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 05:06:36,746 ERROR    planner finished and wrote 6064 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-17401-17500/17415".
2018-12-13 06:15:49,486 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12849".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06450".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12875".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05677".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05650".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05801".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06125".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05735".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05690".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06414".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06035".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13946".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05616".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13820".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14156".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14446".
2018-12-13 06:15:49,487 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12979".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06182".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06115".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13701".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14346".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05666".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07129".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05990".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06097".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06092".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06511".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05721".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13863".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13569".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14338".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07074".
2018-12-13 06:15:49,488 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06241".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07101".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06568".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07225".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13395".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05560".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14147".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07203".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13341".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06308".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13558".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07155".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06024".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06690".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06673".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12909".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06326".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14232".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05610".
2018-12-13 06:15:49,489 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13757".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06545".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14162".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07222".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13047".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13951".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12932".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06006".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13933".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14225".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13784".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06826".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13985".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13952".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06592".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07055".
2018-12-13 06:15:49,490 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13297".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13908".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05639".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13809".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13869".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13056".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07246".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13997".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13461".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14092".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14299".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06977".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13332".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05714".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14063".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06843".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06769".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07045".
2018-12-13 06:15:49,491 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06060".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13208".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/07000".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06268".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14604".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13125".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05532".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05750".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13778".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14011".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12823".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14042".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14545".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05527".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13969".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13653".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06351".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14075".
2018-12-13 06:15:49,492 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07265".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06482".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14204".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13409".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07237".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06075".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14438".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05601".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05979".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06409".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13241".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06015".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06618".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13344".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14314".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06866".
2018-12-13 06:15:49,493 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13042".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06667".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12892".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13714".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13466".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07159".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14005".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06600".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13519".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06263".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14276".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06095".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13560".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12850".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13613".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07042".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05547".
2018-12-13 06:15:49,494 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13110".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14567".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13072".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12984".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05999".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13760".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13267".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05763".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06739".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05851".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13245".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14208".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06057".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06153".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14415".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07221".
2018-12-13 06:15:49,495 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13670".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06160".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14269".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06662".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05813".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06875".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07100".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14263".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06915".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13525".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13343".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06561".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07085".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13161".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14591".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13806".
2018-12-13 06:15:49,496 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13446".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06087".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12833".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14512".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05931".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12819".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12880".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05985".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 19:38:37,063 ERROR    planner finished and wrote 2108 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21037".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07153".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14049".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13338".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05961".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13025".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06571".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13905".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06463".
2018-12-13 06:15:49,497 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05817".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06439".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13104".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06443".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05935".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14371".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06122".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14527".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12863".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06904".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05607".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13630".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05708".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06206".
2018-12-13 06:15:49,498 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14218".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06788".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06933".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06812".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14558".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07269".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12795".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13836".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14471".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06537".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13705".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13738".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06240".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14573".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13079".
2018-12-13 06:15:49,499 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07096".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06990".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14195".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12866".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12907".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13755".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06305".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06523".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14552".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13264".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06368".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13996".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13494".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13335".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06449".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14273".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13300".
2018-12-13 06:15:49,500 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05861".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12902".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06953".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06659".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12872".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05780".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07092".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05702".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13935".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05497".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06396".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06943".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06271".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13667".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07076".
2018-12-13 06:15:49,501 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06352".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06582".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06283".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13595".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14453".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12822".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12873".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14408".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/06000".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06114".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13052".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13190".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13547".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06992".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14608".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13221".
2018-12-13 06:15:49,502 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05855".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06518".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13975".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14464".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05544".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13961".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07122".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05824".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14489".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07208".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06624".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06067".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05567".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14374".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05491".
2018-12-13 06:15:49,503 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06037".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13722".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13531".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06306".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05652".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06797".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13276".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13816".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13878".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06858".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12986".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14568".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06794".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12921".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05728".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13862".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13422".
2018-12-13 06:15:49,504 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13976".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06337".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06890".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13981".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13003".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05799".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14549".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06969".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14319".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06671".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06767".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13773".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13162".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07104".
2018-12-13 06:15:49,505 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06548".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13699".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07021".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06248".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12864".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06452".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13426".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06636".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05580".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13374".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05769".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06577".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13093".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14136".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13220".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06134".
2018-12-13 06:15:49,506 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13982".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14241".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06147".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07024".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13727".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14026".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05787".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13930".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12944".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05914".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05924".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07236".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05585".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05898".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13157".
2018-12-13 06:15:49,507 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06806".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06532".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06029".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05558".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14100".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06755".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06299".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13877".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14445".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07279".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06474".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07186".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05486".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13850".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13984".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05700".
2018-12-13 06:15:49,508 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13944".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05908".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13495".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05831".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13717".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14602".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05588".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07182".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13423".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14510".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14388".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05706".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13808".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06622".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05699".
2018-12-13 06:15:49,509 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13413".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07174".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07048".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14306".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14294".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05964".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05829".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06560".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13129".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06020".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14097".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14194".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06431".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06270".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06810".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05889".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13478".
2018-12-13 06:15:49,510 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13825".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05958".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06070".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05603".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13066".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14188".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13648".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14402".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13247".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06617".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06148".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14110".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13303".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06848".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12985".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14450".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05796".
2018-12-13 06:15:49,511 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13811".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14362".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14213".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06111".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06681".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06195".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13500".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12960".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05667".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06512".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14053".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13543".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06225".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12854".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06192".
2018-12-13 06:15:49,512 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13698".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06960".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06985".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13847".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13127".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07240".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12971".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06085".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13853".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13001".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14207".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14215".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13293".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06692".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13137".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14224".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06349".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06132".
2018-12-13 06:15:49,513 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14500".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14073".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06816".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05822".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14506".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06736".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06956".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13153".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05675".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14286".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06127".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06500".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06604".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06976".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07068".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05758".
2018-12-13 06:15:49,514 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14146".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06777".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12982".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14521".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13537".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07157".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07041".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06893".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13189".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14087".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06190".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13481".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06065".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06625".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06715".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05895".
2018-12-13 06:15:49,515 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05743".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14461".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13890".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06939".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13398".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06632".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14171".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05927".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14601".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06090".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06626".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07057".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14157".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07214".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14152".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12938".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07296".
2018-12-13 06:15:49,516 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06425".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06052".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06219".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05872".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 00:25:42,344 ERROR    planner finished and wrote 4823 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21068".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13348".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13418".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13871".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14111".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14105".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05842".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05909".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06314".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13723".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14117".
2018-12-13 06:15:49,517 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06817".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13904".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06529".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13313".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12964".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13244".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07141".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14522".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14524".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06846".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13421".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05590".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13323".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12879".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06462".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14219".
2018-12-13 06:15:49,518 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06354".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05828".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13468".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13588".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05766".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06838".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06764".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13347".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14331".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14010".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07094".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07113".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05673".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13562".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06178".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07233".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05881".
2018-12-13 06:15:49,519 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05980".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05751".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06891".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06971".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13036".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13236".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12965".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14230".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12793".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06344".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14137".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06579".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07275".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13359".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13716".
2018-12-13 06:15:49,520 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05816".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06911".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14130".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14041".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13958".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06436".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13995".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07255".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14378".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06760".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06123".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13492".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12855".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13753".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13749".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13936".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05950".
2018-12-13 06:15:49,521 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14343".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06544".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05575".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06012".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13330".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06815".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13586".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05483".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07031".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14296".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07150".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 04:25:32,069 ERROR    planner finished and wrote 2157 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02767".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06872".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12877".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06584".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14024".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05658".
2018-12-13 06:15:49,522 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05555".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13118".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14210".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05528".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13355".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06079".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06233".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13410".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06346".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12997".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07106".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14078".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13650".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14165".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06719".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14287".
2018-12-13 06:15:49,523 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13287".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05592".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13798".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14578".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13662".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06722".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06257".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06982".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14072".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06729".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14297".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13787".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14325".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12858".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13469".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12859".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14377".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13609".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05511".
2018-12-13 06:15:49,524 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06551".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13296".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06318".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06599".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06716".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13454".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13038".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06557".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13819".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 18:40:44,067 ERROR    planner finished and wrote 2650 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-00901-01000/00939".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05599".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06227".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14271".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13774".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05897".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13651".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13227".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07273".
2018-12-13 06:15:49,525 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13431".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06203".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13923".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05638".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14483".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13474".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06787".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06929".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06619".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06136".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06394".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05968".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06616".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05779".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06936".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07035".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05505".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12799".
2018-12-13 06:15:49,526 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14443".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'exitcode--15', 'driver.err: 2018-12-13 03:33:54,045 ERROR    planner wrote 10240 KiB (hard limit) to run.log -> abort command\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-17401-17500/17414".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14466".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07073".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13665".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12874".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13087".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13132".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05661".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14115".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06615".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13290".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06852".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06328".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05647".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13967".
2018-12-13 06:15:49,527 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05996".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14547".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14254".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06099".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13299".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07015".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05901".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14485".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13215".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06790".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05533".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06055".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06730".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12816".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06725".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06032".
2018-12-13 06:15:49,528 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06199".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14047".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13986".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14531".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13433".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14393".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13115".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06165".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14252".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14315".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06650".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13306".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13507".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13317".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14090".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05548".
2018-12-13 06:15:49,529 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05732".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14431".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13134".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13823".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06902".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14411".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06486".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06590".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13057".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07172".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05986".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13831".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13277".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14236".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06546".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12844".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06738".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13292".
2018-12-13 06:15:49,530 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14238".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13916".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06572".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05723".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06553".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06879".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14580".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13098".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06652".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06428".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06045".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05522".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13449".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13643".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05883".
2018-12-13 06:15:49,531 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13077".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06963".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06888".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06743".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13899".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06661".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13489".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13275".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14233".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06446".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06550".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06458".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 17:42:03,291 ERROR    planner finished and wrote 2270 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35678".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07010".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07146".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13523".
2018-12-13 06:15:49,532 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13417".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07235".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06076".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13150".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13008".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05911".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14482".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14244".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06018".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13932".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05906".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 01:04:08,189 ERROR    planner finished and wrote 1318 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-00901-01000/00938".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06100".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07130".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06177".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06651".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13340".
2018-12-13 06:15:49,533 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13599".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13172".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14328".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14492".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13564".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13646".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13333".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07162".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13661".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14259".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06041".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14495".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07219".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06958".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06315".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14557".
2018-12-13 06:15:49,534 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07196".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06333".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06991".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13747".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13844".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05916".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 19:58:26,813 ERROR    planner finished and wrote 2298 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-17401-17500/17408".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05879".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06695".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07298".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13217".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05963".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06587".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 19:34:34,123 ERROR    planner finished and wrote 8470 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02765".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13444".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05636".
2018-12-13 06:15:49,535 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07259".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13866".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12922".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13732".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13211".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06931".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13885".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05997".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05892".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13962".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06404".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06757".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06995".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06563".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14141".
2018-12-13 06:15:49,536 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13883".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06296".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05697".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13223".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06397".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06720".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13675".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13812".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13638".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06859".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07229".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13425".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07176".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13484".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13294".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13096".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06672".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06223".
2018-12-13 06:15:49,537 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12800".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14290".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14033".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07097".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14202".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06861".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13081".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06040".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05771".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07103".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13314".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13372".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13437".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14096".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06214".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06822".
2018-12-13 06:15:49,538 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13644".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06246".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05540".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 19:46:12,131 ERROR    planner finished and wrote 1190 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21059".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06853".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13764".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13045".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13780".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06840".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06699".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13088".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14565".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07119".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07126".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14441".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13391".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06676".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14364".
2018-12-13 06:15:49,539 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05749".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06479".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13527".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13352".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14267".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05663".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05992".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14094".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06508".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06644".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06796".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07195".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13533".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06665".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06229".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06566".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12956".
2018-12-13 06:15:49,540 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14154".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06656".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06005".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13378".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 21:47:55,873 ERROR    planner finished and wrote 8361 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21035".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13192".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13013".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14311".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06210".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07001".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05975".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06905".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07078".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05840".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14192".
2018-12-13 06:15:49,541 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05764".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06712".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06747".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05656".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13979".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06167".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05759".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13548".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12841".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13229".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14496".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06159".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06896".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06759".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06304".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13860".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05730".
2018-12-13 06:15:49,542 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12948".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13846".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06776".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14221".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06059".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06670".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06098".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13580".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05982".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13265".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13896".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14114".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14511".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07250".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13059".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12939".
2018-12-13 06:15:49,543 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13943".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06871".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14423".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06973".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05672".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13852".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12812".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06497".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14392".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13136".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13710".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12843".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05642".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05865".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13274".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06855".
2018-12-13 06:15:49,544 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14093".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12837".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06694".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14324".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05899".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06303".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14436".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06049".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05726".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13482".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14367".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13633".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07052".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05696".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13587".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13947".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06589".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06392".
2018-12-13 06:15:49,545 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13868".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07308".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06927".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13645".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12888".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13608".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06043".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13733".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06880".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06312".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13269".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13931".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06540".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13375".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14281".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06291".
2018-12-13 06:15:49,546 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12980".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07230".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07267".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06647".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06492".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05805".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05888".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06504".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06342".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06232".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06457".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13950".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05825".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05568".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13015".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14025".
2018-12-13 06:15:49,547 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05720".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07058".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13611".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14536".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14613".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14239".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14456".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07029".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05878".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13596".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06430".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06756".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14262".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13238".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06779".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06254".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06014".
2018-12-13 06:15:49,548 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14477".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12815".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06408".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07108".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06583".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13912".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05789".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14211".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07089".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06638".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06946".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06821".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13840".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06883".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13884".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05956".
2018-12-13 06:15:49,549 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06689".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06480".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06997".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14044".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13006".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14277".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14575".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13460".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13283".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13148".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14023".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14468".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14064".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06440".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06842".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06249".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06753".
2018-12-13 06:15:49,550 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13185".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06307".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06317".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13671".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13914".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13445".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06185".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06734".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07223".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06073".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05746".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06260".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13462".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06322".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06718".
2018-12-13 06:15:49,551 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05531".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05761".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12884".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05868".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06410".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13980".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06386".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13990".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05967".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06158".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06750".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13201".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07232".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06502".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13131".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14155".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14475".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06845".
2018-12-13 06:15:49,552 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07256".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14394".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12845".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13626".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14514".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06491".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06959".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14329".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13907".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13415".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05494".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13242".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13895".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13759".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07262".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13913".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07053".
2018-12-13 06:15:49,553 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13659".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12989".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06105".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13629".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13177".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13887".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14255".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06320".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05591".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05756".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05848".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14439".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06033".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13090".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07028".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06878".
2018-12-13 06:15:49,554 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07144".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14363".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06555".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13526".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05632".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06521".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05808".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14590".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13195".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13358".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06642".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12810".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06021".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14596".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12824".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14300".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13826".
2018-12-13 06:15:49,555 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13505".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07188".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14121".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13754".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05847".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13143".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13213".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13601".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12929".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06594".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06069".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05516".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13020".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06460".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13641".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14588".
2018-12-13 06:15:49,556 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05513".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14359".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14396".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06657".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14584".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06008".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06161".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07277".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13802".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07274".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14330".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06119".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13978".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06693".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13941".
2018-12-13 06:15:49,557 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05833".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06109".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06813".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12972".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06520".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05709".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14032".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12950".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13963".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05928".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07200".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06549".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14563".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07243".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07054".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05875".
2018-12-13 06:15:49,558 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14288".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06554".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06360".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13123".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05860".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14426".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14322".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06706".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13102".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06740".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06741".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06675".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13279".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07306".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14365".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12882".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12820".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07171".
2018-12-13 06:15:49,559 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14018".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06962".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06072".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05725".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06798".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06355".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05501".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14476".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06120".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06013".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13465".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13175".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06399".
2018-12-13 06:15:49,560 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13577".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06538".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13619".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14484".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13789".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13918".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13471".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06332".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13051".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12911".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12955".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06413".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13329".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07072".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13515".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05742".
2018-12-13 06:15:49,561 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07224".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13438".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06488".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06552".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05791".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07268".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14246".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 22:57:41,557 ERROR    planner finished and wrote 1432 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-22801-22900/22890".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06470".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12898".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13989".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05572".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14345".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06873".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13597".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14176".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06237".
2018-12-13 06:15:49,562 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14465".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05515".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12861".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06612".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14199".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13694".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13063".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07292".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13712".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06216".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14369".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13567".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13589".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06162".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14124".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05944".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05715".
2018-12-13 06:15:49,563 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06951".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14356".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05998".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14307".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06869".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13379".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06290".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05614".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13821".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06003".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05564".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06629".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13345".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14205".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13801".
2018-12-13 06:15:49,564 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13002".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07135".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13906".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13396".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12895".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05727".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14587".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13745".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06471".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06255".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05637".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07037".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13833".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14116".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07003".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13060".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14265".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07165".
2018-12-13 06:15:49,565 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06726".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12958".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05570".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13065".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13202".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13467".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06477".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14577".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13788".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13876".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13029".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07290".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 05:03:57,664 ERROR    planner finished and wrote 4823 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21036".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05819".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13894".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13184".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14406".
2018-12-13 06:15:49,566 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06654".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14597".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13071".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05969".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07281".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06908".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06783".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13640".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13776".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13337".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05627".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14404".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13048".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05786".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06321".
2018-12-13 06:15:49,567 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06535".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 00:18:25,121 ERROR    planner finished and wrote 1193 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02789".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13023".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05571".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06461".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14240".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13384".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07197".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13156".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14571".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13518".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06302".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05535".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14021".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05885".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14479".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14061".
2018-12-13 06:15:49,568 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05549".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06473".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14508".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07227".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05863".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06275".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14031".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13440".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13218".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05762".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12852".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14340".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06605".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13327".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14370".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05701".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14059".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07120".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06914".
2018-12-13 06:15:49,569 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05919".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07210".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'exitcode--15', 'driver.err: 2018-12-12 20:19:29,691 ERROR    planner wrote 10240 KiB (hard limit) to run.log -> abort command\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35684".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05736".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05876".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12990".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13054".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14086".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05765".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06138".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06864".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05669".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12915".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05949".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06514".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06607".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13623".
2018-12-13 06:15:49,570 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14313".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13278".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 04:08:21,017 ERROR    planner finished and wrote 8361 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21063".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13263".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13582".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07083".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13301".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05823".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06860".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06417".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05722".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06204".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14182".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14538".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14076".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06994".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06674".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14293".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06898".
2018-12-13 06:15:49,571 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06156".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06834".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07166".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13130".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06189".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13364".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14491".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06432".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14473".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07070".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06633".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06781".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14027".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13652".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07038".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05994".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06420".
2018-12-13 06:15:49,572 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12891".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13187".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13647".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05556".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07110".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05942".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12839".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06339".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07147".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07046".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06402".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13761".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13922".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05804".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06723".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13310".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07133".
2018-12-13 06:15:49,573 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13258".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13019".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13428".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13583".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13612".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13546".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06016".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14499".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05692".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13146".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14243".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12807".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14401".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14454".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13600".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05856".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06293".
2018-12-13 06:15:49,574 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14310".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13987".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05959".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13370".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06082".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06487".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05508".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13674".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12818".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13524".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05561".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07201".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05718".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05918".
2018-12-13 06:15:49,575 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14409".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13232".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07190".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06717".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13049".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05713".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07136".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13459".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07148".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06252".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13845".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14048".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07270".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05734".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06278".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05826".
2018-12-13 06:15:49,576 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14449".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13971".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14349".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13897".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14535".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06094".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05574".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06297".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05682".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06892".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13512".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13889".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05704".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14242".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06691".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12992".
2018-12-13 06:15:49,577 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06179".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06727".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13536".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06751".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05774".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13796".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12904".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13497".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06874".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12840".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13083".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14004".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13483".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07180".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06635".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14368".
2018-12-13 06:15:49,578 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05886".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06944".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06785".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13154".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05498".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13682".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05783".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13178".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13822".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13875".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14418".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06172".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13320".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13570".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13574".
2018-12-13 06:15:49,579 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07039".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06849".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12991".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06262".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06950".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14593".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06517".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05596".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05775".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13502".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05695".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07168".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05837".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14257".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13804".
2018-12-13 06:15:49,580 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13452".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06586".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06441".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06814".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06851".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06804".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07049".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13770".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14160".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13549".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12952".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05768".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14178".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12790".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13786".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14358".
2018-12-13 06:15:49,581 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06947".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05581".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13775".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07118".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13432".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13367".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06046".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06895".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07059".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05563".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 21:34:55,849 ERROR    planner finished and wrote 7606 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-17401-17500/17409".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05657".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13750".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14133".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12868".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07212".
2018-12-13 06:15:49,582 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14487".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 19:02:17,140 ERROR    planner finished and wrote 1884 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21060".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06528".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12926".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13736".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14122".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06285".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07139".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13075".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14336".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05724".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14189".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12792".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13094".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06704".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05814".
2018-12-13 06:15:49,583 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14303".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06562".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05784".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13007".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13725".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14228".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06110".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14435".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07207".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05537".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 23:12:09,070 ERROR    planner finished and wrote 1992 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-08101-08200/08190".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13628".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13953".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05552".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14615".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13043".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05920".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14463".
2018-12-13 06:15:49,584 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07142".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07107".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05930".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06980".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06677".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13855".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05577".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13579".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06847".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13663".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14520".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13719".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06256".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05613".
2018-12-13 06:15:49,585 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06026".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13627".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06196".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13499".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06039".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13112".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05845".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13092".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06444".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07084".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14317".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 18:28:44,412 ERROR    planner finished and wrote 1875 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02790".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06770".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06721".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06389".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13729".
2018-12-13 06:15:49,586 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06141".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07006".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06926".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05806".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06086".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13575".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13207".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12941".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13387".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13842".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13791".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14055".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13324".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06505".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12897".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14248".
2018-12-13 06:15:49,587 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13169".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14361".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13200".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12796".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14334".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06917".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06102".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06292".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07050".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14285".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13756".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14513".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07252".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05674".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06857".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13240".
2018-12-13 06:15:49,588 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06499".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13540".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06421".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 17:55:37,347 ERROR    planner finished and wrote 7606 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-17301-17400/17381".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05582".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06865".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13114".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14135".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13817".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/13000".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05938".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07184".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06164".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13472".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13838".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05488".
2018-12-13 06:15:49,589 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13968".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06660".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05539".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14172".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12914".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06288".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14337".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14198".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05773".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06062".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05854".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12834".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06448".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14264".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05671".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13441".
2018-12-13 06:15:49,590 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06259".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13321".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06483".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05645".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06220".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05859".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14537".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06825".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06641".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12970".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14416".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13794".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14542".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05984".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05705".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06648".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13399".
2018-12-13 06:15:49,591 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07065".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14498".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06887".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14503".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12883".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13009".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05600".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14134".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06281".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13476".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13197".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): ['driver.err: 2018-12-12 20:08:28,829 ERROR    planner finished and wrote 2270 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35663".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13992".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05536".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 05:47:20,916 ERROR    planner finished and wrote 2805 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-17301-17400/17392".
2018-12-13 06:15:49,592 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06697".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14540".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12940".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07115".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13225".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12976".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13180".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14357".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05905".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06050".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06434".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07095".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14335".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13089".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06912".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06575".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06541".
2018-12-13 06:15:49,593 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13805".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13186".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05523".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07205".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13563".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13552".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14548".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06828".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13740".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07061".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13362".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14582".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14375".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06711".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12975".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06733".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13216".
2018-12-13 06:15:49,594 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13706".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05790".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13168".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14355".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13763".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 03:19:23,850 ERROR    planner finished and wrote 4869 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02798".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05752".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14196".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05849".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14013".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13255".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13998".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06906".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06970".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05659".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13126".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13815".
2018-12-13 06:15:49,595 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05687".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05904".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14318".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06601".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07124".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13488".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06900".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13427".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05981".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05565".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07151".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06334".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06494".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12851".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05993".
2018-12-13 06:15:49,596 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13435".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06996".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14480".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06835".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13680".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05594".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05973".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06830".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06856".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07014".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06107".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13259".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05770".
2018-12-13 06:15:49,597 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13572".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14609".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05952".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13915".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13119".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13891".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13044".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13028".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13328".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13076".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12978".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13621".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12804".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13068".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05748".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14347".
2018-12-13 06:15:49,598 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14145".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14065".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07263".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13772".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07261".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13514".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06128".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06437".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13424".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05717".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05578".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05983".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06338".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13174".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13542".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14112".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13394".
2018-12-13 06:15:49,599 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13591".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14153".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06176".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13165".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06089".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14139".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07160".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06011".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12912".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06411".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13392".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07079".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05839".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13272".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06282".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13718".
2018-12-13 06:15:49,600 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12814".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07288".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14151".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07132".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14187".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06937".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12996".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06325".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05611".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14560".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13938".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05841".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06180".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14433".
2018-12-13 06:15:49,601 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06007".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14226".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07123".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06918".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13867".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05902".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06064".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14381".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13529".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13403".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14412".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13455".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07251".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13357".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05767".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06686".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07173".
2018-12-13 06:15:49,602 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13810".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06684".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14103".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06390".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07193".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 01:49:55,172 ERROR    planner finished and wrote 7619 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35651".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06978".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05946".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13972".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13055".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13835".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13828".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07218".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12934".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14089".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14350".
2018-12-13 06:15:49,603 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05933".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13382".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07234".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13487".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12813".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06578".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05514".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13511".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06264".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07086".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13782".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13286".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07211".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13026".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05686".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06664".
2018-12-13 06:15:49,604 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05625".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06311".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06496".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05862".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06358".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06044".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05569".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14422".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05874".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07105".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05665".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06427".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06476".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06510".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14060".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12806".
2018-12-13 06:15:49,605 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06876".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05524".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14305".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06467".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13393".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14530".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05554".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05922".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07043".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14595".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07189".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05962".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05615".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13266".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07287".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14550".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12908".
2018-12-13 06:15:49,606 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05932".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12846".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07220".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13637".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): ['driver.err: 2018-12-13 05:48:02,847 ERROR    planner finished and wrote 4869 KiB to run.log (soft limit: 1024 KiB)\n', 'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02766".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13388".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06242".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13606".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06056".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06418".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07284".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05710".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06957".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13014".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13149".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13843".
2018-12-13 06:15:49,607 ERROR    Unexplained error(s): [u'segfault', 'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14323".
2018-12-13 06:15:59,962 ERROR    There were 3684 runs with unexplained errors.
2018-12-13 06:16:27,193 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13784".
2018-12-13 06:16:27,193 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05860".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05593".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06336".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07219".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14265".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13237".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06875".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12992".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07103".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05797".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14314".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05942".
2018-12-13 06:16:27,194 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13942".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07205".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07279".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14313".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13219".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12937".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05989".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06199".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07224".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06327".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12838".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13646".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12976".
2018-12-13 06:16:27,195 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05996".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06025".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06439".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13723".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07074".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05939".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06602".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05666".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13382".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06355".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14434".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14289".
2018-12-13 06:16:27,196 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06846".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13062".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12989".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07190".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07054".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05507".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07195".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14524".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07162".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06474".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14421".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14502".
2018-12-13 06:16:27,197 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13952".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13711".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05857".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14061".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06443".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12814".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06779".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07039".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06319".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06701".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06151".
2018-12-13 06:16:27,198 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05853".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05755".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06810".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14304".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12818".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06349".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12841".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14065".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14417".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05949".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12816".
2018-12-13 06:16:27,199 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14216".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05981".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05584".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05628".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14198".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13025".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14372".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13161".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06055".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14256".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05697".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06650".
2018-12-13 06:16:27,200 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13579".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14007".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06657".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07169".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13585".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13847".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05800".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12815".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06168".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07127".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06344".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06839".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12981".
2018-12-13 06:16:27,201 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05743".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14449".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06423".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06323".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06712".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06149".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13734".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07110".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12921".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05890".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06224".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13115".
2018-12-13 06:16:27,202 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12942".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05567".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13694".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14083".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13268".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13987".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05916".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13157".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07160".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06928".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06452".
2018-12-13 06:16:27,203 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07199".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06795".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14109".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05859".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05739".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'driver.err: 2018-12-13 05:48:02,847 ERROR    planner finished and wrote 4869 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02766".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13544".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07106".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14231".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14242".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05744".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14071".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14247".
2018-12-13 06:16:27,204 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05927".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06869".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06041".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14161".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12999".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06764".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13450".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06375".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14262".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06322".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13493".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07122".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06947".
2018-12-13 06:16:27,205 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06568".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06163".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06725".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06204".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14142".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13573".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07248".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07035".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13583".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12975".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12865".
2018-12-13 06:16:27,206 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13225".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14006".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07280".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14166".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14541".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13870".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06558".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06903".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06247".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14333".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13051".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06075".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13477".
2018-12-13 06:16:27,207 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13539".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06081".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06460".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14005".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13442".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14530".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14088".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05563".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05780".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13588".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06526".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06289".
2018-12-13 06:16:27,208 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06833".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12909".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07051".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14207".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06058".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05820".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07137".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06615".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13748".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07107".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06644".
2018-12-13 06:16:27,209 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13944".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06230".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06549".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12857".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06397".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06595".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13814".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07235".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06132".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06273".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06272".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13195".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07139".
2018-12-13 06:16:27,210 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07082".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06208".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05854".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14080".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05515".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07308".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06311".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07099".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06921".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06309".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13901".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14035".
2018-12-13 06:16:27,211 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06816".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13476".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06345".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13576".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13094".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07252".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06428".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12877".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06596".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14419".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14531".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06489".
2018-12-13 06:16:27,212 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05559".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13816".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14053".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06748".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05533".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06772".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14476".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06288".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14018".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06037".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06407".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14257".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06512".
2018-12-13 06:16:27,213 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13192".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06464".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14519".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'driver.err: 2018-12-12 19:34:34,123 ERROR    planner finished and wrote 8470 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02765".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06844".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12979".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06667".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14475".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07183".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06214".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07017".
2018-12-13 06:16:27,214 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13600".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'driver.err: 2018-12-13 05:03:57,664 ERROR    planner finished and wrote 4823 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21036".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14220".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05585".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13606".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06508".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13276".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06393".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07036".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06507".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06704".
2018-12-13 06:16:27,215 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06009".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06161".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12860".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14481".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06016".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06091".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14595".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14159".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13762".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05999".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05958".
2018-12-13 06:16:27,216 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06190".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07274".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06566".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12978".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06516".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06843".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14131".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06088".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06693".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12888".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07050".
2018-12-13 06:16:27,217 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13474".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'driver.err: 2018-12-13 00:25:42,344 ERROR    planner finished and wrote 4823 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21068".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14238".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13473".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06989".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14373".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06183".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13078".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06359".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14276".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07071".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07007".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14136".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13295".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13741".
2018-12-13 06:16:27,218 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05955".
2018-12-13 06:16:27,219 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14360".
2018-12-13 06:16:27,219 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14446".
2018-12-13 06:16:27,219 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13804".
2018-12-13 06:16:27,219 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13365".
2018-12-13 06:16:27,219 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06730".
2018-12-13 06:16:27,219 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07031".
2018-12-13 06:16:27,219 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06007".
2018-12-13 06:16:27,219 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13986".
2018-12-13 06:16:27,219 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05532".
2018-12-13 06:16:27,219 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14086".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13853".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06502".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06749".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'driver.err: 2018-12-12 20:26:50,693 ERROR    planner finished and wrote 1190 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21045".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14492".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14042".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06152".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13121".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12891".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07130".
2018-12-13 06:16:27,220 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13346".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07044".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13119".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05707".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06201".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05790".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13439".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06852".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06677".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05864".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06892".
2018-12-13 06:16:27,221 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13670".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06015".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06406".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14241".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05740".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06935".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05733".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05965".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12933".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13619".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13878".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13924".
2018-12-13 06:16:27,222 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06687".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12872".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13143".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13105".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13949".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06167".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13269".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14148".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07263".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14055".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13196".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12919".
2018-12-13 06:16:27,223 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06468".
2018-12-13 06:16:27,224 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05543".
2018-12-13 06:16:27,224 ERROR    Unexplained error(s): [u'driver.err: 2018-12-13 02:10:42,713 ERROR    planner finished and wrote 1763 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-08101-08200/08191".
2018-12-13 06:16:27,224 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14278".
2018-12-13 06:16:27,224 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12923".
2018-12-13 06:16:27,224 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06112".
2018-12-13 06:16:27,224 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06518".
2018-12-13 06:16:27,224 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14196".
2018-12-13 06:16:27,224 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14506".
2018-12-13 06:16:27,224 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13003".
2018-12-13 06:16:27,224 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06622".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14078".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06028".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13706".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06915".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14450".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06853".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07227".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14340".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12887".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14567".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06978".
2018-12-13 06:16:27,225 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06612".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06296".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07271".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06634".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06079".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13378".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14091".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13452".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13525".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06603".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13941".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13833".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13561".
2018-12-13 06:16:27,226 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05725".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05792".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14560".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05542".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13393".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14440".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14190".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13839".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06784".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06242".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06800".
2018-12-13 06:16:27,227 ERROR    Unexplained error(s): [u'driver.err: 2018-12-12 15:17:52,689 ERROR    planner finished and wrote 2650 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-19201-19300/19209".
2018-12-13 06:16:27,228 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06905".
2018-12-13 06:16:27,228 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07304".
2018-12-13 06:16:27,228 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14448".
2018-12-13 06:16:27,228 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13980".
2018-12-13 06:16:27,228 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06353".
2018-12-13 06:16:27,228 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05638".
2018-12-13 06:16:27,228 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06302".
2018-12-13 06:16:27,228 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13447".
2018-12-13 06:16:27,230 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07191".
2018-12-13 06:16:27,230 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12837".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06579".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05839".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05962".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06324".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13626".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14019".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13931".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06662".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06196".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13879".
2018-12-13 06:16:27,231 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06823".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06535".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14354".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13575".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05516".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06600".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13530".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06987".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07259".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13747".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14213".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12804".
2018-12-13 06:16:27,232 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14409".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05618".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13281".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06790".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05777".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07300".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13249".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14526".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14402".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13460".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06188".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05833".
2018-12-13 06:16:27,233 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13665".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13658".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13014".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13958".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06996".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05656".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12973".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13357".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14342".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05487".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12988".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13811".
2018-12-13 06:16:27,234 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06830".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13410".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07077".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07126".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06054".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07269".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14084".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13507".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13117".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05844".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14553".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14396".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06876".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13085".
2018-12-13 06:16:27,235 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06538".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06265".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13468".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06035".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06045".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14494".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13518".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06999".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06099".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14596".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07142".
2018-12-13 06:16:27,236 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13934".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14318".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06268".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13260".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06215".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05920".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07091".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06292".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14024".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07001".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13757".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07058".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05722".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06871".
2018-12-13 06:16:27,237 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13141".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13773".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06285".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13369".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05948".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13040".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05552".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12807".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13209".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13059".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14306".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07250".
2018-12-13 06:16:27,238 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13075".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07080".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14156".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06339".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13483".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14174".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13032".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12927".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14453".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13008".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14346".
2018-12-13 06:16:27,239 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14335".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05882".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06259".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13505".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07124".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13596".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06949".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06659".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05807".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14457".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06993".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07045".
2018-12-13 06:16:27,240 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05674".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05491".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14045".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13770".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13341".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06330".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12913".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13234".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13807".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13523".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13649".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'driver.err: 2018-12-12 20:08:28,829 ERROR    planner finished and wrote 2270 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35663".
2018-12-13 06:16:27,241 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06979".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13571".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13050".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14075".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/07000".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06594".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13372".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06759".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05808".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06854".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12908".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13310".
2018-12-13 06:16:27,242 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05804".
2018-12-13 06:16:27,243 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06472".
2018-12-13 06:16:27,243 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06200".
2018-12-13 06:16:27,243 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06510".
2018-12-13 06:16:27,243 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05703".
2018-12-13 06:16:27,243 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12808".
2018-12-13 06:16:27,243 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06991".
2018-12-13 06:16:27,243 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14518".
2018-12-13 06:16:27,243 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05625".
2018-12-13 06:16:27,243 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14296".
2018-12-13 06:16:27,243 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06165".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05933".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07159".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06221".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05599".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'driver.err: 2018-12-13 01:49:55,172 ERROR    planner finished and wrote 7619 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35651".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07147".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13323".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13792".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12827".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13554".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13250".
2018-12-13 06:16:27,244 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06241".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14430".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13459".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13407".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06100".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05995".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13108".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06809".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06173".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14322".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06672".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06798".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14287".
2018-12-13 06:16:27,245 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06614".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06900".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13624".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05834".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05745".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14138".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13244".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05956".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13803".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06435".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06912".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05641".
2018-12-13 06:16:27,246 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05587".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13066".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13993".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13465".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05976".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05982".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14320".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13167".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05713".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05705".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12830".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06686".
2018-12-13 06:16:27,247 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05967".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06986".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06363".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05779".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13892".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14504".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05827".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13080".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06227".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14237".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05676".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05987".
2018-12-13 06:16:27,248 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13521".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13718".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06914".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14411".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13634".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14566".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13830".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'exitcode--15', u'driver.err: 2018-12-13 03:33:54,045 ERROR    planner wrote 10240 KiB (hard limit) to run.log -> abort command\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-17401-17500/17414".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14096".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14317".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07241".
2018-12-13 06:16:27,249 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13230".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06787".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07268".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07168".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07030".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06307".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07223".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13202".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06556".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06123".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13124".
2018-12-13 06:16:27,250 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14074".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14137".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13324".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06983".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05805".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13107".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14141".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14425".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07176".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07104".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14501".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05661".
2018-12-13 06:16:27,251 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07067".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'driver.err: 2018-12-13 02:28:38,319 ERROR    planner finished and wrote 1193 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02775".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05831".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05580".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05848".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13652".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13877".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13698".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14036".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14130".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07172".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05880".
2018-12-13 06:16:27,252 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13622".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07068".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13907".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06771".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06676".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06334".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06770".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12983".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13259".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06174".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13306".
2018-12-13 06:16:27,253 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06206".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14608".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06969".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07181".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14392".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05504".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12905".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12900".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06401".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13503".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06036".
2018-12-13 06:16:27,254 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06783".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07215".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14413".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14125".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14281".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05597".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06129".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14270".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06271".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05932".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13214".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06162".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13659".
2018-12-13 06:16:27,255 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13936".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06542".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13825".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13243".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05883".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05855".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13764".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14020".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13404".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13625".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05826".
2018-12-13 06:16:27,256 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05645".
2018-12-13 06:16:27,257 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13206".
2018-12-13 06:16:27,257 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06835".
2018-12-13 06:16:27,257 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13977".
2018-12-13 06:16:27,257 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06632".
2018-12-13 06:16:27,257 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13174".
2018-12-13 06:16:27,257 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05784".
2018-12-13 06:16:27,257 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07128".
2018-12-13 06:16:27,257 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05867".
2018-12-13 06:16:27,257 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13150".
2018-12-13 06:16:27,257 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13367".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13504".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13843".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14063".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14367".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/06000".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14263".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05647".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05633".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06567".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07276".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13616".
2018-12-13 06:16:27,258 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12938".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06796".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06585".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05832".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06249".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06975".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14226".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13836".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14590".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13221".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14114".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05510".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13390".
2018-12-13 06:16:27,259 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06696".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14051".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14465".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13828".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06747".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14261".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'driver.err: 2018-12-12 18:28:44,412 ERROR    planner finished and wrote 1875 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02790".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07125".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06546".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06057".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06817".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13526".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06956".
2018-12-13 06:16:27,260 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07167".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07084".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13627".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06938".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13809".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14204".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13061".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13999".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07294".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06862".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13292".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05547".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14576".
2018-12-13 06:16:27,261 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12829".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13782".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13023".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14488".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14355".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06609".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14085".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06179".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06467".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06023".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14164".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14034".
2018-12-13 06:16:27,262 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14077".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07112".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06160".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12832".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06499".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06605".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13880".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13227".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13074".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14561".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12915".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06638".
2018-12-13 06:16:27,263 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05738".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13009".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05726".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14059".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06788".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05536".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06402".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06962".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06416".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13035".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06666".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06295".
2018-12-13 06:16:27,264 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14422".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13613".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05701".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14103".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06694".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14218".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12868".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13962".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06136".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14371".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13805".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05925".
2018-12-13 06:16:27,265 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13363".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06372".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06225".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14043".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12994".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13771".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14236".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13697".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06119".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07291".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14468".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13484".
2018-12-13 06:16:27,266 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05566".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13789".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05737".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06945".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14512".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06705".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13041".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07065".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07040".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07236".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14305".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14027".
2018-12-13 06:16:27,267 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06825".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13027".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05845".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06126".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06060".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05801".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07258".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14570".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13918".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13403".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14380".
2018-12-13 06:16:27,268 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12849".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05973".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13128".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05693".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06306".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14291".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14540".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13492".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13758".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14538".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12911".
2018-12-13 06:16:27,269 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13861".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06805".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12851".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05978".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07105".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13394".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13271".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06387".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13071".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14390".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06532".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12825".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14013".
2018-12-13 06:16:27,270 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06210".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07290".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05501".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13516".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05940".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14155".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06493".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13906".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07201".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06438".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14240".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05506".
2018-12-13 06:16:27,271 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06913".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07296".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07064".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05906".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07132".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06127".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12902".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13313".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05885".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14616".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05659".
2018-12-13 06:16:27,272 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14311".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05836".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13438".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06264".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13028".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13030".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14245".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13730".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13290".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06212".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13820".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13938".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05917".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06627".
2018-12-13 06:16:27,273 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06591".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06562".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13719".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13802".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14048".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05494".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13769".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12946".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06395".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07221".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14144".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06797".
2018-12-13 06:16:27,274 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06121".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05728".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13992".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13171".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14294".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14359".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14459".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06729".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06413".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13707".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07092".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06422".
2018-12-13 06:16:27,275 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05953".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05498".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06144".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07076".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06412".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13168".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06305".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06484".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14600".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13321".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13927".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13089".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14243".
2018-12-13 06:16:27,276 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13603".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05557".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06103".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07170".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14606".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13827".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06674".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13515".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13097".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14562".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06300".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07233".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06534".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05488".
2018-12-13 06:16:27,277 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06723".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13287".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07289".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06485".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05941".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06002".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06297".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07072".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13780".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06731".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13489".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12866".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13970".
2018-12-13 06:16:27,278 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06269".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13964".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12820".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05644".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13527".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05802".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13308".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06257".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05616".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05689".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13462".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13266".
2018-12-13 06:16:27,279 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07182".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07016".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06907".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13824".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14381".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12863".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12930".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13760".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13246".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06290".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06801".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14548".
2018-12-13 06:16:27,280 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13079".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07011".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13490".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14028".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06410".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13754".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14205".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06347".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14418".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06360".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06802".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14105".
2018-12-13 06:16:27,281 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12798".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'driver.err: 2018-12-13 05:47:20,916 ERROR    planner finished and wrote 2805 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-17301-17400/17392".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06331".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06826".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12998".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14189".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06838".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13495".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14273".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14288".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14377".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05861".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13509".
2018-12-13 06:16:27,282 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06652".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14438".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13926".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06069".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14135".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07298".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06728".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07204".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13965".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12803".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14581".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05574".
2018-12-13 06:16:27,283 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07247".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07089".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06351".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06880".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13160".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07014".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14119".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06572".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13278".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12826".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13630".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14208".
2018-12-13 06:16:27,284 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13073".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06187".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13457".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14522".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05624".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05677".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07210".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14415".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06191".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13923".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14266".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07226".
2018-12-13 06:16:27,285 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13397".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05723".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14451".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06130".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06841".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05742".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06092".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05653".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13702".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06678".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07146".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13418".
2018-12-13 06:16:27,286 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13469".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12928".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13057".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13922".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06392".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13263".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05603".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05635".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13445".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14591".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13589".
2018-12-13 06:16:27,287 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13409".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13036".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07151".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13645".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14272".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13664".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12836".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13004".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05561".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06143".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05537".
2018-12-13 06:16:27,288 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05586".
2018-12-13 06:16:27,289 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06509".
2018-12-13 06:16:27,289 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13963".
2018-12-13 06:16:27,289 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07225".
2018-12-13 06:16:27,289 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13111".
2018-12-13 06:16:27,289 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07217".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05964".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14474".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12991".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13333".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07087".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05993".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12856".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14431".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13618".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06984".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06053".
2018-12-13 06:16:27,290 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14233".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13481".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06619".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14206".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13587".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13577".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14162".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05525".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07140".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05529".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05643".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06451".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13126".
2018-12-13 06:16:27,291 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14044".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06752".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13203".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05614".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06279".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'driver.err: 2018-12-12 21:08:40,963 ERROR    planner finished and wrote 2807 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-35601-35700/35677".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07059".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06425".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'driver.err: 2018-12-12 20:53:30,946 ERROR    planner finished and wrote 1319 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-19201-19300/19236".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12941".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13991".
2018-12-13 06:16:27,292 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06611".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06148".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13715".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06404".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06780".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05773".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06352".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13644".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12701-12800/12791".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12821".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05579".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13609".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14133".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05763".
2018-12-13 06:16:27,293 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14285".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06104".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13045".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05655".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13309".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12858".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06616".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14546".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13144".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07117".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13705".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14610".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13650".
2018-12-13 06:16:27,294 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14583".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06767".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12953".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13893".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07281".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05776".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12958".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06125".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07062".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13767".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06773".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14604".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05799".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14458".
2018-12-13 06:16:27,295 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14528".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13297".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14529".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13248".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14254".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13534".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14069".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06171".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06172".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06457".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07152".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05974".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05922".
2018-12-13 06:16:27,296 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07121".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14199".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13725".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07185".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06702".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13580".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13311".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06038".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07093".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13883".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05514".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06970".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13090".
2018-12-13 06:16:27,297 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12806".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07047".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05910".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05497".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06792".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05596".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05663".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14280".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06424".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06570".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13904".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05904".
2018-12-13 06:16:27,298 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13359".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05704".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13026".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05681".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13971".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06606".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07243".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14160".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13236".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06703".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13815".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14277".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05629".
2018-12-13 06:16:27,299 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05530".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06743".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13617".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05658".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06465".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06490".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06110".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12834".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13674".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06238".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06255".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06669".
2018-12-13 06:16:27,300 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06427".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05813".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06226".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06320".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'driver.err: 2018-12-13 03:19:23,850 ERROR    planner finished and wrote 4869 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02798".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06456".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14235".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13392".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13479".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13712".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13335".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06059".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14029".
2018-12-13 06:16:27,301 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06019".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06575".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05874".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14073".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13532".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05607".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14509".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14185".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14251".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12931".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13541".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07249".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06367".
2018-12-13 06:16:27,302 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13055".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05519".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14153".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14364".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06899".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14321".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06806".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12935".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06940".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13863".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13180".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05401-05500/05489".
2018-12-13 06:16:27,303 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06434".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12904".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06504".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13568".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13340".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07134".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06916".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14244".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06917".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05817".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13307".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06569".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13496".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13044".
2018-12-13 06:16:27,304 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13136".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06870".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13774".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06593".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13491".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13812".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'driver.err: 2018-12-12 22:57:41,557 ERROR    planner finished and wrote 1432 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-22801-22900/22890".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13592".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05850".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13662".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14327".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07018".
2018-12-13 06:16:27,305 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06881".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'driver.err: 2018-12-12 17:02:30,620 ERROR    planner finished and wrote 1319 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-19201-19300/19208".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14499".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05523".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07028".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13785".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13329".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05816".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05899".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13177".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13288".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13488".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06643".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12880".
2018-12-13 06:16:27,306 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06147".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05828".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06237".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13593".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07301-07400/07306".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06189".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13087".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07088".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06682".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13569".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06218".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13201".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05589".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06757".
2018-12-13 06:16:27,307 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12828".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14493".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13232".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05764".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13467".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13759".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06001".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13412".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06525".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05671".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06571".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05694".
2018-12-13 06:16:27,308 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13451".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13740".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06588".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06006".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05843".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13423".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13885".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06166".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06180".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07012".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14192".
2018-12-13 06:16:27,309 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06114".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13597".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13787".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06299".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07041".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06582".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07083".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07265".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05571".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13318".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14369".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06565".
2018-12-13 06:16:27,310 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05702".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13159".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05877".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06118".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05602".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13286".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14520".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05664".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'driver.err: 2018-12-12 19:02:17,140 ERROR    planner finished and wrote 1884 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-21001-21100/21060".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05539".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13700".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14047".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05938".
2018-12-13 06:16:27,311 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14279".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06673".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07049".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13437".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07094".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13919".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14439".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06082".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06925".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06317".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05719".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13424".
2018-12-13 06:16:27,312 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06968".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07004".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06364".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14487".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14221".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12819".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13361".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06095".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06755".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06654".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13133".
2018-12-13 06:16:27,313 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06084".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12924".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06560".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05672".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07008".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14126".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13415".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07178".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14227".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13194".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06701-06800/06711".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06951".
2018-12-13 06:16:27,314 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13261".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13779".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06895".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06078".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13683".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14176".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14484".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06931".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13932".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06831".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13135".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07163".
2018-12-13 06:16:27,315 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13988".
2018-12-13 06:16:27,316 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13388".
2018-12-13 06:16:27,316 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05601-05700/05692".
2018-12-13 06:16:27,316 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14248".
2018-12-13 06:16:27,316 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06926".
2018-12-13 06:16:27,316 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06531".
2018-12-13 06:16:27,316 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14496".
2018-12-13 06:16:27,316 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13063".
2018-12-13 06:16:27,316 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13601-13700/13666".
2018-12-13 06:16:27,316 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06936".
2018-12-13 06:16:27,316 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14363".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14444".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14603".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06478".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14271".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13339".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13006".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06169".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06086".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14406".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'driver.err: 2018-12-13 00:54:01,462 ERROR    planner finished and wrote 8471 KiB to run.log (soft limit: 1024 KiB)\n', u'output-to-slurm.err']. Please inspect output and error logs under "runs-02701-02800/02793".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06997".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13501-13600/13533".
2018-12-13 06:16:27,317 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05721".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13201-13300/13204".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07173".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14485".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14401-14500/14443".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14169".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07013".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13352".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07201-07300/07216".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13001-13100/13053".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13183".
2018-12-13 06:16:27,318 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13876".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05908".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06801-06900/06868".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06101-06200/06175".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14147".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14295".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06618".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14316".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06051".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07101-07200/07175".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12811".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06501-06600/06574".
2018-12-13 06:16:27,319 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-07001-07100/07048".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05501-05600/05502".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13901-14000/13912".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13301-13400/13370".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14356".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06901-07000/06946".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05971".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12901-13000/12963".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14301-14400/14337".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14201-14300/14234".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05762".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14601-14700/14607".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13801-13900/13872".
2018-12-13 06:16:27,320 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06052".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06201-06300/06211".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14187".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05801-05900/05856".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13123".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14001-14100/14066".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-12801-12900/12881".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14589".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06001-06100/06010".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13701-13800/13763".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05901-06000/05914".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14501-14600/14580".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06301-06400/06400".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06601-06700/06633".
2018-12-13 06:16:27,321 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13163".
2018-12-13 06:16:27,322 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-05701-05800/05724".
2018-12-13 06:16:27,322 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-06401-06500/06497".
2018-12-13 06:16:27,322 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13112".
2018-12-13 06:16:27,322 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-14101-14200/14108".
2018-12-13 06:16:27,322 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13101-13200/13118".
2018-12-13 06:16:27,322 ERROR    Unexplained error(s): [u'segfault', u'output-to-slurm.err']. Please inspect output and error logs under "runs-13401-13500/13500".
2018-12-13 06:16:27,322 ERROR    Unexplained error(s): [u