Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-805

monitord does not handle aborted jobs well

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: master, 4.4.1
    • Fix Version/s: master, 4.5.0, 4.4.1
    • Component/s: Monitord
    • Labels:
      None

      Description

      For workflows, where user abort running workflows, there can be cases where jobs kickstart output files are empty. In that case, the associated inv.end events don't have the timestamp values set.

      From duncan:
      Hi Karan,

      I tried re-running pegasus-monitord for Sam’s workflow, but now it’s even more incorrect:

      <http://sugar-dev3.phy.syr.edu/pegasus/%7Esamantha.usman/root/52/workflow?wf_uuid=85ec134f-d117-4b34-b9d0-b06ac5c77fc8>

      Any idea what is wrong? Full monitor output is below.

      Cheers,
      Duncan.

      [samantha.usman@sugar-dev3 ~]$ cd /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/.
      [samantha.usman@sugar-dev3 H1L1-ihope_ssipe-965779215-604800.tI2nTq]$
      [samantha.usman@sugar-dev3 H1L1-ihope_ssipe-965779215-604800.tI2nTq]$ pegasus-monitord --replay ihope_ssipe-0.dag.dagman.out

      2014-12-03T14:56:07-0500 - pegasus-monitord starting - pid 5224 ----------------

      1417636567 - 2014-12-03T14:56:07-0500 - MONITORD_STARTED - 85ec134f-d117-4b34-b9d0-b06ac5c77fc8 - ihope_ssipe-0
      1417636568 - 2014-12-03T14:56:08-0500 - MONITORD_STARTED - 398f8aab-2520-41a2-8652-f77dfddc4c12 - inspiral_hipe_datafind-0
      1417636572 - 2014-12-03T14:56:12-0500 - MONITORD_STARTED - 12d8414b-be0d-49ff-a920-680f073e4e17 - inspiral_hipe_nsbh4lininj.NSBH4LININJ-0
      1417636579 - 2014-12-03T14:56:19-0500 - MONITORD_STARTED - 7e828a4f-0105-4e5f-be32-ee0574495e81 - inspiral_hipe_nsbh3lininj.NSBH3LININJ-0
      1417636586 - 2014-12-03T14:56:26-0500 - MONITORD_STARTED - ef334725-cc11-4a15-8f59-a610fb868d37 - inspiral_hipe_bbh4lininj.BBH4LININJ-0
      1417636593 - 2014-12-03T14:56:33-0500 - MONITORD_STARTED - d179ca68-3d61-42db-9479-0e9fd3485a2c - inspiral_hipe_bbh6lininj.BBH6LININJ-0
      1417636599 - 2014-12-03T14:56:39-0500 - MONITORD_STARTED - 48251f9f-445e-48ac-94b1-1290d4a3a86c - inspiral_hipe_full_data.FULL_DATA-0
      1417636606 - 2014-12-03T14:56:46-0500 - MONITORD_STARTED - f33a0d93-7f5b-443c-a08b-82a88268fc32 - inspiral_hipe_bbh3lininj.BBH3LININJ-0
      1417636615 - 2014-12-03T14:56:55-0500 - MONITORD_STARTED - 618f7d3f-f917-4e75-8138-2632701835af - inspiral_hipe_nsbh2lininj.NSBH2LININJ-0
      1417636626 - 2014-12-03T14:57:06-0500 - MONITORD_STARTED - f41d27ba-5cc5-4fed-b259-487589bbea40 - inspiral_hipe_bns6lininj.BNS6LININJ-0
      1417636639 - 2014-12-03T14:57:19-0500 - MONITORD_STARTED - 229743f2-5697-4814-af70-3239b2382db9 - inspiral_hipe_bbh2lininj.BBH2LININJ-0
      1417636650 - 2014-12-03T14:57:30-0500 - MONITORD_STARTED - 005c0549-e26d-4b64-bd4c-8ea4de4edb6e - inspiral_hipe_nsbh6lininj.NSBH6LININJ-0
      1417636659 - 2014-12-03T14:57:39-0500 - MONITORD_STARTED - ab7f9d8b-38b8-427e-b07f-5a22882fc513 - inspiral_hipe_bbhlininj.BBHLININJ-0
      1417636667 - 2014-12-03T14:57:47-0500 - MONITORD_STARTED - 5e21e34b-c042-47cc-a7d9-dbffb6f20bba - inspiral_hipe_bns5lininj.BNS5LININJ-0
      1417636676 - 2014-12-03T14:57:56-0500 - MONITORD_STARTED - a5e173aa-ac0c-40d9-91c0-118b0581a004 - inspiral_hipe_nsbh5lininj.NSBH5LININJ-0
      1417636685 - 2014-12-03T14:58:05-0500 - MONITORD_STARTED - cdf6058f-1b2c-4211-99b4-d9e31569e236 - inspiral_hipe_nsbhlininj.NSBHLININJ-0
      1417636694 - 2014-12-03T14:58:14-0500 - MONITORD_STARTED - 1d347d50-ecae-4722-be02-1757e71c628b - inspiral_hipe_bnslininj.BNSLININJ-0
      1417636704 - 2014-12-03T14:58:24-0500 - MONITORD_STARTED - 2d2c3308-d72a-4d51-98d4-1300ef4f8cc3 - inspiral_hipe_playground.PLAYGROUND-0
      1417636708 - 2014-12-03T14:58:28-0500 - MONITORD_STARTED - d8816321-e426-489a-ae21-ee428390b23a - inspiral_hipe_bns2lininj.BNS2LININJ-0
      1417636717 - 2014-12-03T14:58:37-0500 - MONITORD_STARTED - 5c8bc23f-540e-45f3-a0dc-a0b6f518ee30 - inspiral_hipe_bns3lininj.BNS3LININJ-0
      1417636726 - 2014-12-03T14:58:46-0500 - MONITORD_STARTED - da35c852-587a-4133-9774-fe7cbc2c4e1c - inspiral_hipe_bns4lininj.BNS4LININJ-0
      1417636735 - 2014-12-03T14:58:55-0500 - MONITORD_STARTED - cf00e0ac-82f7-467d-b3d1-f76d87e8e39b - inspiral_hipe_bbh5lininj.BBH5LININJ-0
      1417636939 - 2014-12-03T15:02:19-0500 - MONITORD_STARTED - 99a9d77c-e65b-455c-8812-c8f3fb4f9c77 - inspiral_hipe_playground_cat2_veto.PLAYGROUND_CAT_2_VETO-0
      1417636942 - 2014-12-03T15:02:22-0500 - MONITORD_STARTED - e4bd77ad-8b6b-4df2-b5a7-436fe5820b0d - inspiral_hipe_playground_cat4_veto.PLAYGROUND_CAT_4_VETO-0
      1417636944 - 2014-12-03T15:02:24-0500 - MONITORD_STARTED - 8e23d86a-1992-4b01-8c72-4b6434e043e5 - inspiral_hipe_playground_cat3_veto.PLAYGROUND_CAT_3_VETO-0
      2014-12-03 15:02:27,618:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 2d2c3308-d72a-4d51-98d4-1300ef4f8cc3 - inspiral_hipe_playground.PLAYGROUND-0
      2014-12-03 15:02:27,618:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '2d2c3308-d72a-4d51-98d4-1300ef4f8cc3', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 230, 'start_time': 1416911582, 'job__id': 'ligolw_sstinca_ID000512', 'ts': None, 'argv': ' -n ligo-thincajob::ligolw_sstinca:1.0 -N ID000512 -R local -L inspiral_hipe_playground.PLAYGROUND -T 2014-11-24T19:52:49-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/playground/../executables/ligolw_sstinca --magic-number 6.0 --depop-sngl-inspiral --drop-veto-info --make-expr-tables --e-thinca-parameter 0.5 --vetoes-name VETO_CAT1_CUMULATIVE --coinc-end-time-segment : --weighted-snr newsnr H1L1-LLWADD_0_PLAYGROUND-966325357-3968.xml.gz ', 'task__id': 'ID000512', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-thincajob::ligolw_sstinca:1.0', 'exitcode': '1'}
      2014-12-03 15:02:27,619:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:03:49,864:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> f41d27ba-5cc5-4fed-b259-487589bbea40 - inspiral_hipe_bns6lininj.BNS6LININJ-0
      2014-12-03 15:03:49,865:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'f41d27ba-5cc5-4fed-b259-487589bbea40', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 142, 'start_time': 1416898709, 'job__id': 'lalapps_inspiral_ID000108', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000108 -R local -L inspiral_hipe_bns6lininj.BNS6LININJ -T 2014-11-24T19:54:00-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bns6lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file H1-TMPLTBANK-966016546-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BNS6LININJ --gps-end-time 966018594 --calibrated-data real_8 --channel-name H1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966016546 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_1006_BNS6LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache H-H1_LDAS_C02_L2_CACHE-965997338-25927.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000108', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:03:49,865:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637038 - 2014-12-03T15:03:58-0500 - MONITORD_STARTED - b30fbe10-8149-46ce-83bd-15e282f6db8d - inspiral_hipe_nsbh4lininj_cat3_veto.NSBH4LININJ_CAT_3_VETO-0
      1417637050 - 2014-12-03T15:04:10-0500 - MONITORD_STARTED - b04e54f7-5253-42ea-ac02-5308de0d172d - inspiral_hipe_nsbh4lininj_cat4_veto.NSBH4LININJ_CAT_4_VETO-0
      1417637052 - 2014-12-03T15:04:12-0500 - MONITORD_STARTED - 1a8d7aaf-9c2f-4591-b911-ec99555b7e76 - inspiral_hipe_nsbh4lininj_cat2_veto.NSBH4LININJ_CAT_2_VETO-0
      1417637054 - 2014-12-03T15:04:14-0500 - MONITORD_STARTED - b5762c8c-9b5b-4534-83bd-3789da95a098 - inspiral_hipe_nsbh3lininj_cat4_veto.NSBH3LININJ_CAT_4_VETO-0
      1417637055 - 2014-12-03T15:04:15-0500 - MONITORD_STARTED - eb6163e6-90f4-4180-a2de-21cd8ed37606 - inspiral_hipe_nsbh3lininj_cat2_veto.NSBH3LININJ_CAT_2_VETO-0
      1417637068 - 2014-12-03T15:04:28-0500 - MONITORD_STARTED - f25bb66b-8221-40b4-b27a-5887e756580a - inspiral_hipe_nsbh3lininj_cat3_veto.NSBH3LININJ_CAT_3_VETO-0
      1417637070 - 2014-12-03T15:04:30-0500 - MONITORD_STARTED - 3f51b8b4-e55b-45a9-8a73-c2b77e3b001d - inspiral_hipe_bbh4lininj_cat4_veto.BBH4LININJ_CAT_4_VETO-0
      1417637071 - 2014-12-03T15:04:31-0500 - MONITORD_STARTED - 09e747ec-0f10-496f-bdc4-23aa94f44d9d - inspiral_hipe_bbh4lininj_cat2_veto.BBH4LININJ_CAT_2_VETO-0
      1417637072 - 2014-12-03T15:04:32-0500 - MONITORD_STARTED - 2757ea9c-501c-4955-b22b-574553a080fa - inspiral_hipe_bbh4lininj_cat3_veto.BBH4LININJ_CAT_3_VETO-0
      1417637074 - 2014-12-03T15:04:34-0500 - MONITORD_STARTED - e07f0ecf-3b2d-45e7-8768-dda13694f997 - inspiral_hipe_bbhlininj_cat3_veto.BBHLININJ_CAT_3_VETO-0
      1417637091 - 2014-12-03T15:04:51-0500 - MONITORD_STARTED - fe062799-0dab-4e2e-bfbf-1a149f65180f - inspiral_hipe_bbhlininj_cat2_veto.BBHLININJ_CAT_2_VETO-0
      1417637092 - 2014-12-03T15:04:52-0500 - MONITORD_STARTED - fe4c5af6-b141-4ee8-8237-3ffda9435763 - inspiral_hipe_bbhlininj_cat4_veto.BBHLININJ_CAT_4_VETO-0
      1417637093 - 2014-12-03T15:04:53-0500 - MONITORD_STARTED - 4e68bf65-85df-47f3-8df4-82d23902ee2e - inspiral_hipe_nsbh2lininj_cat3_veto.NSBH2LININJ_CAT_3_VETO-0
      1417637095 - 2014-12-03T15:04:55-0500 - MONITORD_STARTED - 608b49c7-f961-4166-910f-7cd2135d5bf9 - inspiral_hipe_nsbh2lininj_cat4_veto.NSBH2LININJ_CAT_4_VETO-0
      1417637096 - 2014-12-03T15:04:56-0500 - MONITORD_STARTED - 7f27c8b5-83a1-44e3-9c07-6e4a7a9adb11 - inspiral_hipe_nsbh2lininj_cat2_veto.NSBH2LININJ_CAT_2_VETO-0
      1417637115 - 2014-12-03T15:05:15-0500 - MONITORD_STARTED - 446f852e-1a8c-4da5-a2f1-706de484e1c6 - inspiral_hipe_bns6lininj_cat4_veto.BNS6LININJ_CAT_4_VETO-0
      1417637116 - 2014-12-03T15:05:16-0500 - MONITORD_STARTED - bae2ace5-0693-44d9-bba2-fde6f95f0907 - inspiral_hipe_bns6lininj_cat2_veto.BNS6LININJ_CAT_2_VETO-0
      1417637117 - 2014-12-03T15:05:17-0500 - MONITORD_STARTED - df8d9852-34aa-4aba-bdba-03ead06c025b - inspiral_hipe_bns6lininj_cat3_veto.BNS6LININJ_CAT_3_VETO-0
      1417637118 - 2014-12-03T15:05:18-0500 - MONITORD_STARTED - 2ef2a675-520a-45c5-9723-8f69f92a5b45 - inspiral_hipe_bns5lininj_cat2_veto.BNS5LININJ_CAT_2_VETO-0
      1417637119 - 2014-12-03T15:05:19-0500 - MONITORD_STARTED - 04834078-379b-4c6f-a0c1-2b087827891b - inspiral_hipe_bns5lininj_cat4_veto.BNS5LININJ_CAT_4_VETO-0
      1417637120 - 2014-12-03T15:05:20-0500 - MONITORD_STARTED - b238f7de-d460-466b-a9d5-fa4c341be04d - inspiral_hipe_bns5lininj_cat3_veto.BNS5LININJ_CAT_3_VETO-0
      1417637140 - 2014-12-03T15:05:40-0500 - MONITORD_STARTED - a47e4331-5401-4733-b7b8-c2fa9092279a - inspiral_hipe_bbh3lininj_cat2_veto.BBH3LININJ_CAT_2_VETO-0
      1417637142 - 2014-12-03T15:05:42-0500 - MONITORD_STARTED - 4887effe-cc0c-4faf-8fa2-ae7ca7c715c4 - inspiral_hipe_bbh3lininj_cat3_veto.BBH3LININJ_CAT_3_VETO-0
      1417637143 - 2014-12-03T15:05:43-0500 - MONITORD_STARTED - 172c1d58-d9be-4f4e-90dc-2e6d5be9c180 - inspiral_hipe_bbh3lininj_cat4_veto.BBH3LININJ_CAT_4_VETO-0
      1417637144 - 2014-12-03T15:05:44-0500 - MONITORD_STARTED - 26e23ad5-373a-4bff-b517-0d938f1203f8 - inspiral_hipe_bns2lininj_cat2_veto.BNS2LININJ_CAT_2_VETO-0
      1417637146 - 2014-12-03T15:05:46-0500 - MONITORD_STARTED - 89787a33-d0d9-41a5-b47c-b1d76c2421f5 - inspiral_hipe_bns2lininj_cat4_veto.BNS2LININJ_CAT_4_VETO-0
      1417637147 - 2014-12-03T15:05:47-0500 - MONITORD_STARTED - 9cb96e13-5e45-422f-8ad5-8a587c4e9096 - inspiral_hipe_bns2lininj_cat3_veto.BNS2LININJ_CAT_3_VETO-0
      1417637148 - 2014-12-03T15:05:48-0500 - MONITORD_STARTED - f2784e6d-13b1-48d4-87ce-8722720b096b - inspiral_hipe_bns3lininj_cat3_veto.BNS3LININJ_CAT_3_VETO-0
      1417637150 - 2014-12-03T15:05:50-0500 - MONITORD_STARTED - 4554307b-779d-454c-97e6-a7cd2c3cd5da - inspiral_hipe_bns3lininj_cat2_veto.BNS3LININJ_CAT_2_VETO-0
      1417637182 - 2014-12-03T15:06:22-0500 - MONITORD_STARTED - bae1526a-bcde-4486-a54d-bd490b4d5042 - inspiral_hipe_bns3lininj_cat4_veto.BNS3LININJ_CAT_4_VETO-0
      1417637185 - 2014-12-03T15:06:25-0500 - MONITORD_STARTED - d6719d20-2dd4-44c9-a0c8-2060b8e606ca - inspiral_hipe_bbh6lininj_cat3_veto.BBH6LININJ_CAT_3_VETO-0
      1417637186 - 2014-12-03T15:06:26-0500 - MONITORD_STARTED - 3a8e171e-c7e5-40a7-b982-f8d0683e21dc - inspiral_hipe_bbh6lininj_cat2_veto.BBH6LININJ_CAT_2_VETO-0
      1417637187 - 2014-12-03T15:06:27-0500 - MONITORD_STARTED - be0342bc-c7d0-457e-a0e4-0c654765f8a6 - inspiral_hipe_bbh6lininj_cat4_veto.BBH6LININJ_CAT_4_VETO-0
      1417637189 - 2014-12-03T15:06:29-0500 - MONITORD_STARTED - cd606e39-06ef-4f7b-997e-10c6e7d88611 - inspiral_hipe_nsbh6lininj_cat3_veto.NSBH6LININJ_CAT_3_VETO-0
      2014-12-03 15:06:41,489:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> cf00e0ac-82f7-467d-b3d1-f76d87e8e39b - inspiral_hipe_bbh5lininj.BBH5LININJ-0
      2014-12-03 15:06:41,489:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'cf00e0ac-82f7-467d-b3d1-f76d87e8e39b', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 117, 'start_time': 1416907913, 'job__id': 'lalapps_inspiral_ID000230', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000230 -R local -L inspiral_hipe_bbh5lininj.BBH5LININJ -T 2014-11-24T19:53:19-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bbh5lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file H1-TMPLTBANK-966342637-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BBH5LININJ --gps-end-time 966344685 --calibrated-data real_8 --channel-name H1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966342637 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_3005_BBH5LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache H-H1_LDAS_C02_L2_CACHE-966311909-53180.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000230', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:06:41,490:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637221 - 2014-12-03T15:07:01-0500 - MONITORD_STARTED - b717b0ca-66f7-483a-a52d-355a69fe48c0 - inspiral_hipe_nsbh6lininj_cat2_veto.NSBH6LININJ_CAT_2_VETO-0
      1417637223 - 2014-12-03T15:07:03-0500 - MONITORD_STARTED - d0f96aec-74af-40a2-abd7-65295ccde9e4 - inspiral_hipe_nsbh6lininj_cat4_veto.NSBH6LININJ_CAT_4_VETO-0
      1417637224 - 2014-12-03T15:07:04-0500 - MONITORD_STARTED - 87d8ab6c-f6d1-4932-bffa-e83c46ef13e3 - inspiral_hipe_nsbh5lininj_cat2_veto.NSBH5LININJ_CAT_2_VETO-0
      1417637226 - 2014-12-03T15:07:06-0500 - MONITORD_STARTED - 45c75aae-7895-415a-a284-0f9e77c2b084 - inspiral_hipe_nsbh5lininj_cat4_veto.NSBH5LININJ_CAT_4_VETO-0
      1417637227 - 2014-12-03T15:07:07-0500 - MONITORD_STARTED - 7b2efa26-1f92-4034-be58-85ab81bb3ec2 - inspiral_hipe_nsbh5lininj_cat3_veto.NSBH5LININJ_CAT_3_VETO-0
      1417637229 - 2014-12-03T15:07:09-0500 - MONITORD_STARTED - 8c64a12d-dd7c-44ec-a7f2-05e61890de5d - inspiral_hipe_nsbhlininj_cat3_veto.NSBHLININJ_CAT_3_VETO-0
      1417637230 - 2014-12-03T15:07:10-0500 - MONITORD_STARTED - 0d6d2662-c2a8-4e59-b5ac-632d36a99bb8 - inspiral_hipe_nsbhlininj_cat2_veto.NSBHLININJ_CAT_2_VETO-0
      1417637231 - 2014-12-03T15:07:11-0500 - MONITORD_STARTED - b48abba9-4e83-465f-a000-448a0029c561 - inspiral_hipe_nsbhlininj_cat4_veto.NSBHLININJ_CAT_4_VETO-0
      1417637295 - 2014-12-03T15:08:15-0500 - MONITORD_STARTED - 3c125a55-0568-433b-8b1b-148b8c259648 - inspiral_hipe_full_data_cat3_veto.FULL_DATA_CAT_3_VETO-0
      1417637297 - 2014-12-03T15:08:17-0500 - MONITORD_STARTED - ad35ae1b-ce67-4b32-a42c-8b498a88f1ae - inspiral_hipe_full_data_cat4_veto.FULL_DATA_CAT_4_VETO-0
      1417637298 - 2014-12-03T15:08:18-0500 - MONITORD_STARTED - 501d2c3e-78b3-4f2d-8555-778d7654a6bb - inspiral_hipe_full_data_cat2_veto.FULL_DATA_CAT_2_VETO-0
      1417637300 - 2014-12-03T15:08:20-0500 - MONITORD_STARTED - d2492120-cb5f-4626-822f-4db42ad813cb - inspiral_hipe_bns4lininj_cat3_veto.BNS4LININJ_CAT_3_VETO-0
      2014-12-03 15:08:22,754:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> ef334725-cc11-4a15-8f59-a610fb868d37 - inspiral_hipe_bbh4lininj.BBH4LININJ-0
      2014-12-03 15:08:22,754:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'ef334725-cc11-4a15-8f59-a610fb868d37', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 422, 'start_time': 1416919307, 'job__id': 'lalapps_inspiral_ID000604', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000604 -R local -L inspiral_hipe_bbh4lininj.BBH4LININJ -T 2014-11-24T19:54:15-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bbh4lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-966038588-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BBH4LININJ --gps-end-time 966040636 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966038588 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_3004_BBH4LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-966036660-9099.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000604', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:08:22,755:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:08:23,410:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 618f7d3f-f917-4e75-8138-2632701835af - inspiral_hipe_nsbh2lininj.NSBH2LININJ-0
      2014-12-03 15:08:23,410:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '618f7d3f-f917-4e75-8138-2632701835af', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 283, 'start_time': 1416911623, 'job__id': 'lalapps_inspiral_ID000563', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000563 -R local -L inspiral_hipe_nsbh2lininj.NSBH2LININJ -T 2014-11-24T19:53:04-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/nsbh2lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-965946643-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag NSBH2LININJ --gps-end-time 965948691 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 965948585 --enable-high-pass 30.0 --gps-start-time 965946643 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_2002_NSBH2LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-965923553-25146.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000563', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:08:23,411:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637344 - 2014-12-03T15:09:04-0500 - MONITORD_STARTED - e43059bd-9217-49b1-9f7f-8b3eb5b288be - inspiral_hipe_bns4lininj_cat4_veto.BNS4LININJ_CAT_4_VETO-0
      1417637346 - 2014-12-03T15:09:06-0500 - MONITORD_STARTED - 84b943f8-a765-414c-bebe-78a1dc3f63e0 - inspiral_hipe_bns4lininj_cat2_veto.BNS4LININJ_CAT_2_VETO-0
      1417637347 - 2014-12-03T15:09:07-0500 - MONITORD_STARTED - 46cf740f-d5e6-43ca-bbdd-415ce92c0fc9 - inspiral_hipe_bbh2lininj_cat3_veto.BBH2LININJ_CAT_3_VETO-0
      1417637348 - 2014-12-03T15:09:08-0500 - MONITORD_STARTED - 33d5c534-9869-4ba7-a438-8a284afb81f1 - inspiral_hipe_bbh2lininj_cat4_veto.BBH2LININJ_CAT_4_VETO-0
      1417637349 - 2014-12-03T15:09:09-0500 - MONITORD_STARTED - 07f9761f-3ed9-4331-9792-e3e27ce65010 - inspiral_hipe_bbh2lininj_cat2_veto.BBH2LININJ_CAT_2_VETO-0
      2014-12-03 15:09:11,254:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> d179ca68-3d61-42db-9479-0e9fd3485a2c - inspiral_hipe_bbh6lininj.BBH6LININJ-0
      2014-12-03 15:09:11,255:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'd179ca68-3d61-42db-9479-0e9fd3485a2c', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 406, 'start_time': 1416913529, 'job__id': 'lalapps_inspiral_ID000134', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000134 -R local -L inspiral_hipe_bbh6lininj.BBH6LININJ -T 2014-11-24T19:53:14-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bbh6lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file H1-TMPLTBANK-966124999-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BBH6LININJ --gps-end-time 966127047 --calibrated-data real_8 --channel-name H1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966124999 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_3006_BBH6LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache H-H1_LDAS_C02_L2_CACHE-966119231-16977.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000134', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:09:11,255:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:09:11,426:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> f33a0d93-7f5b-443c-a08b-82a88268fc32 - inspiral_hipe_bbh3lininj.BBH3LININJ-0
      2014-12-03 15:09:11,426:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'f33a0d93-7f5b-443c-a08b-82a88268fc32', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 300, 'start_time': 1416911625, 'job__id': 'lalapps_inspiral_ID000669', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000669 -R local -L inspiral_hipe_bbh3lininj.BBH3LININJ -T 2014-11-24T19:53:39-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bbh3lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-966188170-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BBH3LININJ --gps-end-time 966190218 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966188170 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_3003_BBH3LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-966176642-30488.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000669', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:09:11,426:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:09:18,795:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> b30fbe10-8149-46ce-83bd-15e282f6db8d - inspiral_hipe_nsbh4lininj_cat3_veto.NSBH4LININJ_CAT_3_VETO-0
      2014-12-03 15:09:18,795:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'b30fbe10-8149-46ce-83bd-15e282f6db8d', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 24, 'start_time': 1417185596, 'job__id': 'ligolw_add_ID000091', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000091 -R local -L inspiral_hipe_nsbh4lininj_cat3_veto.NSBH4LININJ_CAT_3_VETO -T 2014-11-24T19:56:01-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/nsbh4lininj/../executables/ligolw_add --output H1L1-LLWADD_0_NSBH4LININJ_CAT_3_VETO-966267128-7958.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_3-965779215-604800.xml H1-INSPIRAL_FIRST_NSBH4LININJ-966267128-2048.xml.gz H1-INSPIRAL_FIRST_NSBH4LININJ-966269048-2048.xml.gz H1-INSPIRAL_FIRST_NSBH4LININJ-966270968-2048.xml.gz H1-INSPIRAL_FIRST_NSBH4LININJ-966272888-2048.xml.gz L1-INSPIRAL_FIRST_NSBH4LININJ-966267278-2048.xml.gz L1-INSPIRAL_FIRST_NSBH4LININJ-966269198-2048.xml.gz L1-INSPIRAL_FIRST_NSBH4LININJ-966271118-2048.xml.gz L1-INSPIRAL_FIRST_NSBH4LININJ-966273038-2048.xml.gz ', 'task__id': 'ID000091', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:09:18,796:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637384 - 2014-12-03T15:09:44-0500 - MONITORD_STARTED - 77bd3ac6-c8c8-4286-b2e3-13b54fe5b05d - inspiral_hipe_bnslininj_cat3_veto.BNSLININJ_CAT_3_VETO-0
      1417637386 - 2014-12-03T15:09:46-0500 - MONITORD_STARTED - 6244a0f4-ae0a-405b-b75a-8a28d4215bf3 - inspiral_hipe_bnslininj_cat4_veto.BNSLININJ_CAT_4_VETO-0
      1417637388 - 2014-12-03T15:09:48-0500 - MONITORD_STARTED - 9fa0e941-5e81-497d-acaf-a8fecf78f88d - inspiral_hipe_bnslininj_cat2_veto.BNSLININJ_CAT_2_VETO-0
      1417637390 - 2014-12-03T15:09:50-0500 - MONITORD_STARTED - 42cd703f-87aa-43df-99e5-5607477cbea0 - inspiral_hipe_bbh5lininj_cat4_veto.BBH5LININJ_CAT_4_VETO-0
      1417637391 - 2014-12-03T15:09:51-0500 - MONITORD_STARTED - 83f55692-8433-4d18-a47d-7ab11d6f1eef - inspiral_hipe_bbh5lininj_cat3_veto.BBH5LININJ_CAT_3_VETO-0
      2014-12-03 15:09:54,231:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 005c0549-e26d-4b64-bd4c-8ea4de4edb6e - inspiral_hipe_nsbh6lininj.NSBH6LININJ-0
      2014-12-03 15:09:54,232:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '005c0549-e26d-4b64-bd4c-8ea4de4edb6e', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 320, 'start_time': 1416913669, 'job__id': 'lalapps_inspiral_ID000677', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000677 -R local -L inspiral_hipe_nsbh6lininj.NSBH6LININJ -T 2014-11-24T19:54:10-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/nsbh6lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-966203530-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag NSBH6LININJ --gps-end-time 966205578 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966203530 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_2006_NSBH6LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-966176642-30488.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000677', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:09:54,232:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:09:54,854:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 5e21e34b-c042-47cc-a7d9-dbffb6f20bba - inspiral_hipe_bns5lininj.BNS5LININJ-0
      2014-12-03 15:09:54,855:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '5e21e34b-c042-47cc-a7d9-dbffb6f20bba', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 244, 'start_time': 1416911626, 'job__id': 'lalapps_inspiral_ID000692', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000692 -R local -L inspiral_hipe_bns5lininj.BNS5LININJ -T 2014-11-24T19:54:20-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bns5lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-966236276-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BNS5LININJ --gps-end-time 966238324 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966236276 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_1005_BNS5LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-966220908-34090.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000692', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:09:54,855:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637442 - 2014-12-03T15:10:42-0500 - MONITORD_STARTED - dcfd7fbc-2379-4077-8508-e449e630db6b - inspiral_hipe_bbh5lininj_cat2_veto.BBH5LININJ_CAT_2_VETO-0
      2014-12-03 15:10:50,997:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 5c8bc23f-540e-45f3-a0dc-a0b6f518ee30 - inspiral_hipe_bns3lininj.BNS3LININJ-0
      2014-12-03 15:10:50,997:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '5c8bc23f-540e-45f3-a0dc-a0b6f518ee30', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 345, 'start_time': 1416923025, 'job__id': 'lalapps_inspiral_ID000592', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000592 -R local -L inspiral_hipe_bns3lininj.BNS3LININJ -T 2014-11-24T19:53:24-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bns3lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-966009943-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BNS3LININJ --gps-end-time 966011991 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966009943 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_1003_BNS3LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-966002255-15929.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000592', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:10:50,998:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:10:56,221:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> e07f0ecf-3b2d-45e7-8768-dda13694f997 - inspiral_hipe_bbhlininj_cat3_veto.BBHLININJ_CAT_3_VETO-0
      2014-12-03 15:10:56,222:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'e07f0ecf-3b2d-45e7-8768-dda13694f997', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 33, 'start_time': 1417193586, 'job__id': 'ligolw_add_ID000031', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000031 -R local -L inspiral_hipe_bbhlininj_cat3_veto.BBHLININJ_CAT_3_VETO -T 2014-11-24T19:55:57-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bbhlininj/../executables/ligolw_add --output H1L1-LLWADD_0_BBHLININJ_CAT_3_VETO-965923171-9728.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_3-965779215-604800.xml H1-INSPIRAL_FIRST_BBHLININJ-965923171-2048.xml.gz H1-INSPIRAL_FIRST_BBHLININJ-965925091-2048.xml.gz H1-INSPIRAL_FIRST_BBHLININJ-965927011-2048.xml.gz H1-INSPIRAL_FIRST_BBHLININJ-965928931-2048.xml.gz H1-INSPIRAL_FIRST_BBHLININJ-965930851-2048.xml.gz L1-INSPIRAL_FIRST_BBHLININJ-965923561-2048.xml.gz L1-INSPIRAL_FIRST_BBHLININJ-965925481-2048.xml.gz L1-INSPIRAL_FIRST_BBHLININJ-965927401-2048.xml.gz L1-INSPIRAL_FIRST_BBHLININJ-965929321-2048.xml.gz ', 'task__id': 'ID000031', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:10:56,222:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:11:34,195:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 7e828a4f-0105-4e5f-be32-ee0574495e81 - inspiral_hipe_nsbh3lininj.NSBH3LININJ-0
      2014-12-03 15:11:34,196:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '7e828a4f-0105-4e5f-be32-ee0574495e81', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 486, 'start_time': 1416921182, 'job__id': 'lalapps_inspiral_ID000182', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000182 -R local -L inspiral_hipe_nsbh3lininj.NSBH3LININJ -T 2014-11-24T19:53:29-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/nsbh3lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file H1-TMPLTBANK-966230648-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag NSBH3LININJ --gps-end-time 966232696 --calibrated-data real_8 --channel-name H1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966230648 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_2003_NSBH3LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache H-H1_LDAS_C02_L2_CACHE-966217200-69661.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000182', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:11:34,197:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:11:35,527:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 229743f2-5697-4814-af70-3239b2382db9 - inspiral_hipe_bbh2lininj.BBH2LININJ-0
      2014-12-03 15:11:35,527:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '229743f2-5697-4814-af70-3239b2382db9', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 357, 'start_time': 1416913648, 'job__id': 'lalapps_inspiral_ID000616', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000616 -R local -L inspiral_hipe_bbh2lininj.BBH2LININJ -T 2014-11-24T19:53:09-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bbh2lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-966064822-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BBH2LININJ --gps-end-time 966066870 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966064822 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_3002_BBH2LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-966055214-25789.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000616', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:11:35,528:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:11:35,947:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> ab7f9d8b-38b8-427e-b07f-5a22882fc513 - inspiral_hipe_bbhlininj.BBHLININJ-0
      2014-12-03 15:11:35,948:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'ab7f9d8b-38b8-427e-b07f-5a22882fc513', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 330, 'start_time': 1416919335, 'job__id': 'lalapps_inspiral_ID000574', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000574 -R local -L inspiral_hipe_bbhlininj.BBHLININJ -T 2014-11-24T19:53:55-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bbhlininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-965967792-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BBHLININJ --gps-end-time 965969840 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 965968122 --enable-high-pass 30.0 --gps-start-time 965967792 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_3001_BBHLININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-965948850-20998.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000574', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:11:35,948:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:11:41,099:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> fe062799-0dab-4e2e-bfbf-1a149f65180f - inspiral_hipe_bbhlininj_cat2_veto.BBHLININJ_CAT_2_VETO-0
      2014-12-03 15:11:41,099:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'fe062799-0dab-4e2e-bfbf-1a149f65180f', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 14, 'start_time': 1417193590, 'job__id': 'ligolw_add_ID000021', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000021 -R local -L inspiral_hipe_bbhlininj_cat2_veto.BBHLININJ_CAT_2_VETO -T 2014-11-24T19:54:57-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bbhlininj/../executables/ligolw_add --output H1L1-LLWADD_0_BBHLININJ_CAT_2_VETO-965875765-9728.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_2-965779215-604800.xml H1-INSPIRAL_FIRST_BBHLININJ-965876817-2048.xml.gz H1-INSPIRAL_FIRST_BBHLININJ-965878737-2048.xml.gz H1-INSPIRAL_FIRST_BBHLININJ-965880657-2048.xml.gz H1-INSPIRAL_FIRST_BBHLININJ-965882577-2048.xml.gz L1-INSPIRAL_FIRST_BBHLININJ-965875765-2048.xml.gz L1-INSPIRAL_FIRST_BBHLININJ-965877685-2048.xml.gz L1-INSPIRAL_FIRST_BBHLININJ-965879605-2048.xml.gz L1-INSPIRAL_FIRST_BBHLININJ-965881525-2048.xml.gz L1-INSPIRAL_FIRST_BBHLININJ-965883445-2048.xml.gz ', 'task__id': 'ID000021', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:11:41,099:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:11:44,796:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 446f852e-1a8c-4da5-a2f1-706de484e1c6 - inspiral_hipe_bns6lininj_cat4_veto.BNS6LININJ_CAT_4_VETO-0
      2014-12-03 15:11:44,796:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '446f852e-1a8c-4da5-a2f1-706de484e1c6', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 54, 'start_time': 1417200166, 'job__id': 'ligolw_add_ID000105', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000105 -R local -L inspiral_hipe_bns6lininj_cat4_veto.BNS6LININJ_CAT_4_VETO -T 2014-11-24T19:56:44-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bns6lininj/../executables/ligolw_add --output H1L1-LLWADD_0_BNS6LININJ_CAT_4_VETO-966344557-3968.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_4-965779215-604800.xml H1-INSPIRAL_FIRST_BNS6LININJ-966344557-2048.xml.gz H1-INSPIRAL_FIRST_BNS6LININJ-966346477-2048.xml.gz L1-INSPIRAL_FIRST_BNS6LININJ-966344921-2048.xml.gz L1-INSPIRAL_FIRST_BNS6LININJ-966345981-2048.xml.gz ', 'task__id': 'ID000105', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:11:44,797:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:12:14,496:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 12d8414b-be0d-49ff-a920-680f073e4e17 - inspiral_hipe_nsbh4lininj.NSBH4LININJ-0
      2014-12-03 15:12:14,496:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '12d8414b-be0d-49ff-a920-680f073e4e17', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 510, 'start_time': 1416915430, 'job__id': 'lalapps_inspiral_ID000611', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000611 -R local -L inspiral_hipe_nsbh4lininj.NSBH4LININJ -T 2014-11-24T19:54:05-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/nsbh4lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-966055222-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag NSBH4LININJ --gps-end-time 966057270 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966055222 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_2004_NSBH4LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-966055214-25789.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000611', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:12:14,497:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:12:17,731:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> da35c852-587a-4133-9774-fe7cbc2c4e1c - inspiral_hipe_bns4lininj.BNS4LININJ-0
      2014-12-03 15:12:17,731:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'da35c852-587a-4133-9774-fe7cbc2c4e1c', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 267, 'start_time': 1416917388, 'job__id': 'lalapps_inspiral_ID000584', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000584 -R local -L inspiral_hipe_bns4lininj.BNS4LININJ -T 2014-11-24T19:53:50-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bns4lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-965989230-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BNS4LININJ --gps-end-time 965991278 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 965989230 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_1004_BNS4LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-965971942-23684.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000584', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:12:17,731:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:12:19,541:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 2ef2a675-520a-45c5-9723-8f69f92a5b45 - inspiral_hipe_bns5lininj_cat2_veto.BNS5LININJ_CAT_2_VETO-0
      2014-12-03 15:12:19,542:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '2ef2a675-520a-45c5-9723-8f69f92a5b45', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 14, 'start_time': 1417201825, 'job__id': 'ligolw_add_ID000021', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000021 -R local -L inspiral_hipe_bns5lininj_cat2_veto.BNS5LININJ_CAT_2_VETO -T 2014-11-24T19:55:23-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bns5lininj/../executables/ligolw_add --output H1L1-LLWADD_0_BNS5LININJ_CAT_2_VETO-965875765-9728.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_2-965779215-604800.xml H1-INSPIRAL_FIRST_BNS5LININJ-965876817-2048.xml.gz H1-INSPIRAL_FIRST_BNS5LININJ-965878737-2048.xml.gz H1-INSPIRAL_FIRST_BNS5LININJ-965880657-2048.xml.gz H1-INSPIRAL_FIRST_BNS5LININJ-965882577-2048.xml.gz L1-INSPIRAL_FIRST_BNS5LININJ-965875765-2048.xml.gz L1-INSPIRAL_FIRST_BNS5LININJ-965877685-2048.xml.gz L1-INSPIRAL_FIRST_BNS5LININJ-965879605-2048.xml.gz L1-INSPIRAL_FIRST_BNS5LININJ-965881525-2048.xml.gz L1-INSPIRAL_FIRST_BNS5LININJ-965883445-2048.xml.gz ', 'task__id': 'ID000021', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:12:19,542:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:13:08,452:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> cdf6058f-1b2c-4211-99b4-d9e31569e236 - inspiral_hipe_nsbhlininj.NSBHLININJ-0
      2014-12-03 15:13:08,453:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'cdf6058f-1b2c-4211-99b4-d9e31569e236', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 347, 'start_time': 1416923044, 'job__id': 'lalapps_inspiral_ID000551', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000551 -R local -L inspiral_hipe_nsbhlininj.NSBHLININJ -T 2014-11-24T19:54:25-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/nsbhlininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-965925481-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag NSBHLININJ --gps-end-time 965927529 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 965925481 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_2001_NSBHLININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-965923553-25146.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000551', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:13:08,453:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:13:10,355:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> d8816321-e426-489a-ae21-ee428390b23a - inspiral_hipe_bns2lininj.BNS2LININJ-0
      2014-12-03 15:13:10,355:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'd8816321-e426-489a-ae21-ee428390b23a', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 355, 'start_time': 1416924837, 'job__id': 'lalapps_inspiral_ID000615', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000615 -R local -L inspiral_hipe_bns2lininj.BNS2LININJ -T 2014-11-24T19:53:45-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bns2lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-966062902-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BNS2LININJ --gps-end-time 966064950 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966062902 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_1002_BNS2LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-966055214-25789.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000615', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:13:10,356:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637590 - 2014-12-03T15:13:10-0500 - MONITORD_FINISHED - b30fbe10-8149-46ce-83bd-15e282f6db8d - inspiral_hipe_nsbh4lininj_cat3_veto.NSBH4LININJ_CAT_3_VETO-0
      1417637607 - 2014-12-03T15:13:27-0500 - MONITORD_FINISHED - 398f8aab-2520-41a2-8652-f77dfddc4c12 - inspiral_hipe_datafind-0
      1417637611 - 2014-12-03T15:13:31-0500 - MONITORD_FINISHED - b04e54f7-5253-42ea-ac02-5308de0d172d - inspiral_hipe_nsbh4lininj_cat4_veto.NSBH4LININJ_CAT_4_VETO-0
      1417637611 - 2014-12-03T15:13:31-0500 - MONITORD_FINISHED - 1a8d7aaf-9c2f-4591-b911-ec99555b7e76 - inspiral_hipe_nsbh4lininj_cat2_veto.NSBH4LININJ_CAT_2_VETO-0
      1417637611 - 2014-12-03T15:13:31-0500 - MONITORD_FINISHED - b5762c8c-9b5b-4534-83bd-3789da95a098 - inspiral_hipe_nsbh3lininj_cat4_veto.NSBH3LININJ_CAT_4_VETO-0
      1417637611 - 2014-12-03T15:13:31-0500 - MONITORD_FINISHED - eb6163e6-90f4-4180-a2de-21cd8ed37606 - inspiral_hipe_nsbh3lininj_cat2_veto.NSBH3LININJ_CAT_2_VETO-0
      2014-12-03 15:13:32,315:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 8c64a12d-dd7c-44ec-a7f2-05e61890de5d - inspiral_hipe_nsbhlininj_cat3_veto.NSBHLININJ_CAT_3_VETO-0
      2014-12-03 15:13:32,316:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '8c64a12d-dd7c-44ec-a7f2-05e61890de5d', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 19, 'start_time': 1417213075, 'job__id': 'ligolw_add_ID000065', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000065 -R local -L inspiral_hipe_nsbhlininj_cat3_veto.NSBHLININJ_CAT_3_VETO -T 2014-11-24T19:56:10-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/nsbhlininj/../executables/ligolw_add --output H1L1-LLWADD_0_NSBHLININJ_CAT_3_VETO-966142634-11648.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_3-965779215-604800.xml H1-INSPIRAL_FIRST_NSBHLININJ-966143942-2048.xml.gz H1-INSPIRAL_FIRST_NSBHLININJ-966145862-2048.xml.gz H1-INSPIRAL_FIRST_NSBHLININJ-966147782-2048.xml.gz H1-INSPIRAL_FIRST_NSBHLININJ-966149702-2048.xml.gz H1-INSPIRAL_FIRST_NSBHLININJ-966151622-2048.xml.gz L1-INSPIRAL_FIRST_NSBHLININJ-966142634-2048.xml.gz L1-INSPIRAL_FIRST_NSBHLININJ-966144554-2048.xml.gz L1-INSPIRAL_FIRST_NSBHLININJ-966146474-2048.xml.gz L1-INSPIRAL_FIRST_NSBHLININJ-966148394-2048.xml.gz L1-INSPIRAL_FIRST_NSBHLININJ-966150314-2048.xml.gz L1-INSPIRAL_FIRST_NSBHLININJ-966152234-2048.xml.gz ', 'task__id': 'ID000065', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:13:32,316:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:13:47,210:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> a5e173aa-ac0c-40d9-91c0-118b0581a004 - inspiral_hipe_nsbh5lininj.NSBH5LININJ-0
      2014-12-03 15:13:47,210:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'a5e173aa-ac0c-40d9-91c0-118b0581a004', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 348, 'start_time': 1416922966, 'job__id': 'lalapps_inspiral_ID000511', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000511 -R local -L inspiral_hipe_nsbh5lininj.NSBH5LININJ -T 2014-11-24T19:53:34-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/nsbh5lininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-965835159-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag NSBH5LININJ --gps-end-time 965837207 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 965835159 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_2005_NSBH5LININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-965829391-33387.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000511', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:13:47,211:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637628 - 2014-12-03T15:13:48-0500 - MONITORD_FINISHED - f25bb66b-8221-40b4-b27a-5887e756580a - inspiral_hipe_nsbh3lininj_cat3_veto.NSBH3LININJ_CAT_3_VETO-0
      1417637628 - 2014-12-03T15:13:48-0500 - MONITORD_FINISHED - 3f51b8b4-e55b-45a9-8a73-c2b77e3b001d - inspiral_hipe_bbh4lininj_cat4_veto.BBH4LININJ_CAT_4_VETO-0
      1417637628 - 2014-12-03T15:13:48-0500 - MONITORD_FINISHED - 09e747ec-0f10-496f-bdc4-23aa94f44d9d - inspiral_hipe_bbh4lininj_cat2_veto.BBH4LININJ_CAT_2_VETO-0
      1417637628 - 2014-12-03T15:13:48-0500 - MONITORD_FINISHED - 2757ea9c-501c-4955-b22b-574553a080fa - inspiral_hipe_bbh4lininj_cat3_veto.BBH4LININJ_CAT_3_VETO-0
      1417637640 - 2014-12-03T15:14:00-0500 - MONITORD_FINISHED - 85ec134f-d117-4b34-b9d0-b06ac5c77fc8 - ihope_ssipe-0
      1417637643 - 2014-12-03T15:14:03-0500 - MONITORD_FINISHED - 99a9d77c-e65b-455c-8812-c8f3fb4f9c77 - inspiral_hipe_playground_cat2_veto.PLAYGROUND_CAT_2_VETO-0
      1417637643 - 2014-12-03T15:14:03-0500 - MONITORD_FINISHED - e4bd77ad-8b6b-4df2-b5a7-436fe5820b0d - inspiral_hipe_playground_cat4_veto.PLAYGROUND_CAT_4_VETO-0
      1417637643 - 2014-12-03T15:14:03-0500 - MONITORD_FINISHED - 8e23d86a-1992-4b01-8c72-4b6434e043e5 - inspiral_hipe_playground_cat3_veto.PLAYGROUND_CAT_3_VETO-0
      1417637643 - 2014-12-03T15:14:03-0500 - MONITORD_FINISHED - e07f0ecf-3b2d-45e7-8768-dda13694f997 - inspiral_hipe_bbhlininj_cat3_veto.BBHLININJ_CAT_3_VETO-0
      1417637643 - 2014-12-03T15:14:03-0500 - MONITORD_FINISHED - fe4c5af6-b141-4ee8-8237-3ffda9435763 - inspiral_hipe_bbhlininj_cat4_veto.BBHLININJ_CAT_4_VETO-0
      1417637643 - 2014-12-03T15:14:03-0500 - MONITORD_FINISHED - 4e68bf65-85df-47f3-8df4-82d23902ee2e - inspiral_hipe_nsbh2lininj_cat3_veto.NSBH2LININJ_CAT_3_VETO-0
      1417637643 - 2014-12-03T15:14:03-0500 - MONITORD_FINISHED - 608b49c7-f961-4166-910f-7cd2135d5bf9 - inspiral_hipe_nsbh2lininj_cat4_veto.NSBH2LININJ_CAT_4_VETO-0
      1417637643 - 2014-12-03T15:14:03-0500 - MONITORD_FINISHED - 7f27c8b5-83a1-44e3-9c07-6e4a7a9adb11 - inspiral_hipe_nsbh2lininj_cat2_veto.NSBH2LININJ_CAT_2_VETO-0
      1417637643 - 2014-12-03T15:14:03-0500 - MONITORD_FINISHED - 04834078-379b-4c6f-a0c1-2b087827891b - inspiral_hipe_bns5lininj_cat4_veto.BNS5LININJ_CAT_4_VETO-0
      2014-12-03 15:14:03,653:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/nsbhlininj/inspiral_hipe_nsbhlininj_cat3_veto.NSBHLININJ_CAT_3_VETO_ID000061.000
      2014-12-03 15:14:05,516:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> d2492120-cb5f-4626-822f-4db42ad813cb - inspiral_hipe_bns4lininj_cat3_veto.BNS4LININJ_CAT_3_VETO-0
      2014-12-03 15:14:05,516:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'd2492120-cb5f-4626-822f-4db42ad813cb', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 12, 'start_time': 1417215385, 'job__id': 'ligolw_add_ID000011', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000011 -R local -L inspiral_hipe_bns4lininj_cat3_veto.BNS4LININJ_CAT_3_VETO -T 2014-11-24T19:55:55-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bns4lininj/../executables/ligolw_add --output H1L1-LLWADD_0_BNS4LININJ_CAT_3_VETO-965828879-10248.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_3-965779215-604800.xml H1-INSPIRAL_FIRST_BNS4LININJ-965828879-2048.xml.gz H1-INSPIRAL_FIRST_BNS4LININJ-965832608-2048.xml.gz H1-INSPIRAL_FIRST_BNS4LININJ-965833195-2048.xml.gz H1-INSPIRAL_FIRST_BNS4LININJ-965836836-2048.xml.gz L1-INSPIRAL_FIRST_BNS4LININJ-965829399-2048.xml.gz L1-INSPIRAL_FIRST_BNS4LININJ-965831319-2048.xml.gz L1-INSPIRAL_FIRST_BNS4LININJ-965833239-2048.xml.gz L1-INSPIRAL_FIRST_BNS4LININJ-965835159-2048.xml.gz L1-INSPIRAL_FIRST_BNS4LININJ-965837079-2048.xml.gz ', 'task__id': 'ID000011', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:14:05,517:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637657 - 2014-12-03T15:14:17-0500 - MONITORD_FINISHED - fe062799-0dab-4e2e-bfbf-1a149f65180f - inspiral_hipe_bbhlininj_cat2_veto.BBHLININJ_CAT_2_VETO-0
      1417637657 - 2014-12-03T15:14:17-0500 - MONITORD_FINISHED - 446f852e-1a8c-4da5-a2f1-706de484e1c6 - inspiral_hipe_bns6lininj_cat4_veto.BNS6LININJ_CAT_4_VETO-0
      1417637657 - 2014-12-03T15:14:17-0500 - MONITORD_FINISHED - bae2ace5-0693-44d9-bba2-fde6f95f0907 - inspiral_hipe_bns6lininj_cat2_veto.BNS6LININJ_CAT_2_VETO-0
      1417637657 - 2014-12-03T15:14:17-0500 - MONITORD_FINISHED - df8d9852-34aa-4aba-bdba-03ead06c025b - inspiral_hipe_bns6lininj_cat3_veto.BNS6LININJ_CAT_3_VETO-0
      1417637657 - 2014-12-03T15:14:17-0500 - MONITORD_FINISHED - 2ef2a675-520a-45c5-9723-8f69f92a5b45 - inspiral_hipe_bns5lininj_cat2_veto.BNS5LININJ_CAT_2_VETO-0
      1417637657 - 2014-12-03T15:14:17-0500 - MONITORD_FINISHED - b238f7de-d460-466b-a9d5-fa4c341be04d - inspiral_hipe_bns5lininj_cat3_veto.BNS5LININJ_CAT_3_VETO-0
      2014-12-03 15:14:22,441:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 77bd3ac6-c8c8-4286-b2e3-13b54fe5b05d - inspiral_hipe_bnslininj_cat3_veto.BNSLININJ_CAT_3_VETO-0
      2014-12-03 15:14:22,442:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '77bd3ac6-c8c8-4286-b2e3-13b54fe5b05d', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 26, 'start_time': 1417219618, 'job__id': 'ligolw_add_ID000095', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000095 -R local -L inspiral_hipe_bnslininj_cat3_veto.BNSLININJ_CAT_3_VETO -T 2014-11-24T19:55:33-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bnslininj/../executables/ligolw_add --output H1L1-LLWADD_0_BNSLININJ_CAT_3_VETO-966280568-7802.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_3-965779215-604800.xml H1-INSPIRAL_FIRST_BNSLININJ-966280568-2048.xml.gz H1-INSPIRAL_FIRST_BNSLININJ-966282488-2048.xml.gz H1-INSPIRAL_FIRST_BNSLININJ-966284408-2048.xml.gz H1-INSPIRAL_FIRST_BNSLININJ-966284805-2048.xml.gz L1-INSPIRAL_FIRST_BNSLININJ-966284402-2048.xml.gz L1-INSPIRAL_FIRST_BNSLININJ-966286322-2048.xml.gz ', 'task__id': 'ID000095', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:14:22,442:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:14:29,426:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 48251f9f-445e-48ac-94b1-1290d4a3a86c - inspiral_hipe_full_data.FULL_DATA-0
      2014-12-03 15:14:29,427:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '48251f9f-445e-48ac-94b1-1290d4a3a86c', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 305, 'start_time': 1416911619, 'job__id': 'lalapps_inspiral_ID000673', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000673 -R local -L inspiral_hipe_full_data.FULL_DATA -T 2014-11-24T19:52:54-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/full_data/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-966197770-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag FULL_DATA --gps-end-time 966199818 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 966197770 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-966176642-30488.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000673', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:14:29,427:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637671 - 2014-12-03T15:14:31-0500 - MONITORD_FINISHED - a47e4331-5401-4733-b7b8-c2fa9092279a - inspiral_hipe_bbh3lininj_cat2_veto.BBH3LININJ_CAT_2_VETO-0
      1417637671 - 2014-12-03T15:14:31-0500 - MONITORD_FINISHED - 4887effe-cc0c-4faf-8fa2-ae7ca7c715c4 - inspiral_hipe_bbh3lininj_cat3_veto.BBH3LININJ_CAT_3_VETO-0
      1417637671 - 2014-12-03T15:14:31-0500 - MONITORD_FINISHED - 172c1d58-d9be-4f4e-90dc-2e6d5be9c180 - inspiral_hipe_bbh3lininj_cat4_veto.BBH3LININJ_CAT_4_VETO-0
      1417637671 - 2014-12-03T15:14:31-0500 - MONITORD_FINISHED - 26e23ad5-373a-4bff-b517-0d938f1203f8 - inspiral_hipe_bns2lininj_cat2_veto.BNS2LININJ_CAT_2_VETO-0
      1417637671 - 2014-12-03T15:14:31-0500 - MONITORD_FINISHED - 89787a33-d0d9-41a5-b47c-b1d76c2421f5 - inspiral_hipe_bns2lininj_cat4_veto.BNS2LININJ_CAT_4_VETO-0
      1417637671 - 2014-12-03T15:14:31-0500 - MONITORD_FINISHED - 9cb96e13-5e45-422f-8ad5-8a587c4e9096 - inspiral_hipe_bns2lininj_cat3_veto.BNS2LININJ_CAT_3_VETO-0
      1417637671 - 2014-12-03T15:14:31-0500 - MONITORD_FINISHED - f2784e6d-13b1-48d4-87ce-8722720b096b - inspiral_hipe_bns3lininj_cat3_veto.BNS3LININJ_CAT_3_VETO-0
      1417637671 - 2014-12-03T15:14:31-0500 - MONITORD_FINISHED - 4554307b-779d-454c-97e6-a7cd2c3cd5da - inspiral_hipe_bns3lininj_cat2_veto.BNS3LININJ_CAT_2_VETO-0
      2014-12-03 15:14:33,666:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 42cd703f-87aa-43df-99e5-5607477cbea0 - inspiral_hipe_bbh5lininj_cat4_veto.BBH5LININJ_CAT_4_VETO-0
      2014-12-03 15:14:33,666:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '42cd703f-87aa-43df-99e5-5607477cbea0', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 18, 'start_time': 1417220211, 'job__id': 'ligolw_add_ID000027', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000027 -R local -L inspiral_hipe_bbh5lininj_cat4_veto.BBH5LININJ_CAT_4_VETO -T 2014-11-24T19:56:26-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bbh5lininj/../executables/ligolw_add --output H1L1-LLWADD_0_BBH5LININJ_CAT_4_VETO-965898805-11324.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_4-965779215-604800.xml H1-INSPIRAL_FIRST_BBH5LININJ-965899857-2048.xml.gz H1-INSPIRAL_FIRST_BBH5LININJ-965901777-2048.xml.gz H1-INSPIRAL_FIRST_BBH5LININJ-965903697-2048.xml.gz H1-INSPIRAL_FIRST_BBH5LININJ-965905617-2048.xml.gz H1-INSPIRAL_FIRST_BBH5LININJ-965907537-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-965898805-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-965900725-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-965901811-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-965906161-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-965908081-2048.xml.gz ', 'task__id': 'ID000027', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:14:33,666:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:14:33,882:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 83f55692-8433-4d18-a47d-7ab11d6f1eef - inspiral_hipe_bbh5lininj_cat3_veto.BBH5LININJ_CAT_3_VETO-0
      2014-12-03 15:14:33,883:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '83f55692-8433-4d18-a47d-7ab11d6f1eef', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 22, 'start_time': 1417220207, 'job__id': 'ligolw_add_ID000061', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000061 -R local -L inspiral_hipe_bbh5lininj_cat3_veto.BBH5LININJ_CAT_3_VETO -T 2014-11-24T19:55:42-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bbh5lininj/../executables/ligolw_add --output H1L1-LLWADD_0_BBH5LININJ_CAT_3_VETO-966124999-12003.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_3-965779215-604800.xml H1-INSPIRAL_FIRST_BBH5LININJ-966124999-2048.xml.gz H1-INSPIRAL_FIRST_BBH5LININJ-966126919-2048.xml.gz H1-INSPIRAL_FIRST_BBH5LININJ-966128839-2048.xml.gz H1-INSPIRAL_FIRST_BBH5LININJ-966130759-2048.xml.gz H1-INSPIRAL_FIRST_BBH5LININJ-966132679-2048.xml.gz H1-INSPIRAL_FIRST_BBH5LININJ-966134152-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-966125130-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-966127050-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-966128139-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-966131114-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-966133034-2048.xml.gz L1-INSPIRAL_FIRST_BBH5LININJ-966134954-2048.xml.gz ', 'task__id': 'ID000061', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:14:33,883:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637679 - 2014-12-03T15:14:39-0500 - MONITORD_FINISHED - bae1526a-bcde-4486-a54d-bd490b4d5042 - inspiral_hipe_bns3lininj_cat4_veto.BNS3LININJ_CAT_4_VETO-0
      1417637679 - 2014-12-03T15:14:39-0500 - MONITORD_FINISHED - d6719d20-2dd4-44c9-a0c8-2060b8e606ca - inspiral_hipe_bbh6lininj_cat3_veto.BBH6LININJ_CAT_3_VETO-0
      1417637679 - 2014-12-03T15:14:39-0500 - MONITORD_FINISHED - 3a8e171e-c7e5-40a7-b982-f8d0683e21dc - inspiral_hipe_bbh6lininj_cat2_veto.BBH6LININJ_CAT_2_VETO-0
      1417637679 - 2014-12-03T15:14:39-0500 - MONITORD_FINISHED - be0342bc-c7d0-457e-a0e4-0c654765f8a6 - inspiral_hipe_bbh6lininj_cat4_veto.BBH6LININJ_CAT_4_VETO-0
      1417637679 - 2014-12-03T15:14:39-0500 - MONITORD_FINISHED - cd606e39-06ef-4f7b-997e-10c6e7d88611 - inspiral_hipe_nsbh6lininj_cat3_veto.NSBH6LININJ_CAT_3_VETO-0
      1417637686 - 2014-12-03T15:14:46-0500 - MONITORD_FINISHED - 2d2c3308-d72a-4d51-98d4-1300ef4f8cc3 - inspiral_hipe_playground.PLAYGROUND-0
      1417637686 - 2014-12-03T15:14:46-0500 - MONITORD_FINISHED - b717b0ca-66f7-483a-a52d-355a69fe48c0 - inspiral_hipe_nsbh6lininj_cat2_veto.NSBH6LININJ_CAT_2_VETO-0
      1417637686 - 2014-12-03T15:14:46-0500 - MONITORD_FINISHED - d0f96aec-74af-40a2-abd7-65295ccde9e4 - inspiral_hipe_nsbh6lininj_cat4_veto.NSBH6LININJ_CAT_4_VETO-0
      1417637686 - 2014-12-03T15:14:46-0500 - MONITORD_FINISHED - 87d8ab6c-f6d1-4932-bffa-e83c46ef13e3 - inspiral_hipe_nsbh5lininj_cat2_veto.NSBH5LININJ_CAT_2_VETO-0
      1417637686 - 2014-12-03T15:14:46-0500 - MONITORD_FINISHED - 45c75aae-7895-415a-a284-0f9e77c2b084 - inspiral_hipe_nsbh5lininj_cat4_veto.NSBH5LININJ_CAT_4_VETO-0
      1417637686 - 2014-12-03T15:14:46-0500 - MONITORD_FINISHED - 7b2efa26-1f92-4034-be58-85ab81bb3ec2 - inspiral_hipe_nsbh5lininj_cat3_veto.NSBH5LININJ_CAT_3_VETO-0
      1417637686 - 2014-12-03T15:14:46-0500 - MONITORD_FINISHED - 0d6d2662-c2a8-4e59-b5ac-632d36a99bb8 - inspiral_hipe_nsbhlininj_cat2_veto.NSBHLININJ_CAT_2_VETO-0
      1417637686 - 2014-12-03T15:14:46-0500 - MONITORD_FINISHED - b48abba9-4e83-465f-a000-448a0029c561 - inspiral_hipe_nsbhlininj_cat4_veto.NSBHLININJ_CAT_4_VETO-0
      1417637701 - 2014-12-03T15:15:01-0500 - MONITORD_FINISHED - 8c64a12d-dd7c-44ec-a7f2-05e61890de5d - inspiral_hipe_nsbhlininj_cat3_veto.NSBHLININJ_CAT_3_VETO-0
      1417637702 - 2014-12-03T15:15:02-0500 - MONITORD_FINISHED - e43059bd-9217-49b1-9f7f-8b3eb5b288be - inspiral_hipe_bns4lininj_cat4_veto.BNS4LININJ_CAT_4_VETO-0
      1417637702 - 2014-12-03T15:15:02-0500 - MONITORD_FINISHED - 84b943f8-a765-414c-bebe-78a1dc3f63e0 - inspiral_hipe_bns4lininj_cat2_veto.BNS4LININJ_CAT_2_VETO-0
      1417637702 - 2014-12-03T15:15:02-0500 - MONITORD_FINISHED - 46cf740f-d5e6-43ca-bbdd-415ce92c0fc9 - inspiral_hipe_bbh2lininj_cat3_veto.BBH2LININJ_CAT_3_VETO-0
      1417637702 - 2014-12-03T15:15:02-0500 - MONITORD_FINISHED - 33d5c534-9869-4ba7-a438-8a284afb81f1 - inspiral_hipe_bbh2lininj_cat4_veto.BBH2LININJ_CAT_4_VETO-0
      1417637702 - 2014-12-03T15:15:02-0500 - MONITORD_FINISHED - 07f9761f-3ed9-4331-9792-e3e27ce65010 - inspiral_hipe_bbh2lininj_cat2_veto.BBH2LININJ_CAT_2_VETO-0
      1417637707 - 2014-12-03T15:15:07-0500 - MONITORD_FINISHED - 6244a0f4-ae0a-405b-b75a-8a28d4215bf3 - inspiral_hipe_bnslininj_cat4_veto.BNSLININJ_CAT_4_VETO-0
      1417637707 - 2014-12-03T15:15:07-0500 - MONITORD_FINISHED - 9fa0e941-5e81-497d-acaf-a8fecf78f88d - inspiral_hipe_bnslininj_cat2_veto.BNSLININJ_CAT_2_VETO-0
      1417637707 - 2014-12-03T15:15:07-0500 - MONITORD_FINISHED - 42cd703f-87aa-43df-99e5-5607477cbea0 - inspiral_hipe_bbh5lininj_cat4_veto.BBH5LININJ_CAT_4_VETO-0
      1417637707 - 2014-12-03T15:15:07-0500 - MONITORD_FINISHED - 83f55692-8433-4d18-a47d-7ab11d6f1eef - inspiral_hipe_bbh5lininj_cat3_veto.BBH5LININJ_CAT_3_VETO-0
      1417637711 - 2014-12-03T15:15:11-0500 - MONITORD_FINISHED - 77bd3ac6-c8c8-4286-b2e3-13b54fe5b05d - inspiral_hipe_bnslininj_cat3_veto.BNSLININJ_CAT_3_VETO-0
      1417637711 - 2014-12-03T15:15:11-0500 - MONITORD_FINISHED - dcfd7fbc-2379-4077-8508-e449e630db6b - inspiral_hipe_bbh5lininj_cat2_veto.BBH5LININJ_CAT_2_VETO-0
      1417637715 - 2014-12-03T15:15:15-0500 - MONITORD_FINISHED - d2492120-cb5f-4626-822f-4db42ad813cb - inspiral_hipe_bns4lininj_cat3_veto.BNS4LININJ_CAT_3_VETO-0
      2014-12-03 15:15:19,630:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 3c125a55-0568-433b-8b1b-148b8c259648 - inspiral_hipe_full_data_cat3_veto.FULL_DATA_CAT_3_VETO-0
      2014-12-03 15:15:19,631:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '3c125a55-0568-433b-8b1b-148b8c259648', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 194, 'start_time': 1417213979, 'job__id': 'ligolw_sstinca_ID000202', 'ts': None, 'argv': ' -n ligo-thincajob::ligolw_sstinca:1.0 -N ID000202 -R local -L inspiral_hipe_full_data_cat3_veto.FULL_DATA_CAT_3_VETO -T 2014-11-24T19:55:31-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/full_data/../executables/ligolw_sstinca --magic-number 6.0 --depop-sngl-inspiral --drop-veto-info --make-expr-tables --e-thinca-parameter 0.5 --vetoes-name VETO_CAT3_CUMULATIVE --coinc-end-time-segment 966258901.375:966268724.25 --weighted-snr newsnr H1L1-LLWADD_1_FULL_DATA_CAT_3_VETO-966257528-11798.xml.gz ', 'task__id': 'ID000202', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-thincajob::ligolw_sstinca:1.0', 'exitcode': '1'}
      2014-12-03 15:15:19,631:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:15:26,002:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> ad35ae1b-ce67-4b32-a42c-8b498a88f1ae - inspiral_hipe_full_data_cat4_veto.FULL_DATA_CAT_4_VETO-0
      2014-12-03 15:15:26,002:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': 'ad35ae1b-ce67-4b32-a42c-8b498a88f1ae', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 90, 'start_time': 1417213900, 'job__id': 'ligolw_add_ID000035', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000035 -R local -L inspiral_hipe_full_data_cat4_veto.FULL_DATA_CAT_4_VETO -T 2014-11-24T19:56:15-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/full_data/../executables/ligolw_add --output H1L1-LLWADD_0_FULL_DATA_CAT_4_VETO-965937001-9728.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_4-965779215-604800.xml H1-INSPIRAL_FIRST_FULL_DATA-965938531-2048.xml.gz H1-INSPIRAL_FIRST_FULL_DATA-965940451-2048.xml.gz H1-INSPIRAL_FIRST_FULL_DATA-965942371-2048.xml.gz H1-INSPIRAL_FIRST_FULL_DATA-965942699-2048.xml.gz L1-INSPIRAL_FIRST_FULL_DATA-965937001-2048.xml.gz L1-INSPIRAL_FIRST_FULL_DATA-965938921-2048.xml.gz L1-INSPIRAL_FIRST_FULL_DATA-965940841-2048.xml.gz L1-INSPIRAL_FIRST_FULL_DATA-965942761-2048.xml.gz L1-INSPIRAL_FIRST_FULL_DATA-965944681-2048.xml.gz ', 'task__id': 'ID000035', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:15:26,003:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      2014-12-03 15:15:35,431:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 501d2c3e-78b3-4f2d-8555-778d7654a6bb - inspiral_hipe_full_data_cat2_veto.FULL_DATA_CAT_2_VETO-0
      2014-12-03 15:15:35,431:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '501d2c3e-78b3-4f2d-8555-778d7654a6bb', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 13, 'start_time': 1417213893, 'job__id': 'ligolw_add_ID000011', 'ts': None, 'argv': ' -n ligo-ligolwaddjob::ligolw_add:1.0 -N ID000011 -R local -L inspiral_hipe_full_data_cat2_veto.FULL_DATA_CAT_2_VETO -T 2014-11-24T19:54:31-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/full_data/../executables/ligolw_add --output H1L1-LLWADD_0_FULL_DATA_CAT_2_VETO-965828879-10248.xml.gz TISI_ZEROLAG.xml.gz H1L1-VETOTIME_CAT_2-965779215-604800.xml H1-INSPIRAL_FIRST_FULL_DATA-965828879-2048.xml.gz H1-INSPIRAL_FIRST_FULL_DATA-965832608-2048.xml.gz H1-INSPIRAL_FIRST_FULL_DATA-965833195-2048.xml.gz H1-INSPIRAL_FIRST_FULL_DATA-965836836-2048.xml.gz L1-INSPIRAL_FIRST_FULL_DATA-965829399-2048.xml.gz L1-INSPIRAL_FIRST_FULL_DATA-965831319-2048.xml.gz L1-INSPIRAL_FIRST_FULL_DATA-965833239-2048.xml.gz L1-INSPIRAL_FIRST_FULL_DATA-965835159-2048.xml.gz L1-INSPIRAL_FIRST_FULL_DATA-965837079-2048.xml.gz ', 'task__id': 'ID000011', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-ligolwaddjob::ligolw_add:1.0', 'exitcode': '1'}
      2014-12-03 15:15:35,432:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637743 - 2014-12-03T15:15:43-0500 - MONITORD_FINISHED - 3c125a55-0568-433b-8b1b-148b8c259648 - inspiral_hipe_full_data_cat3_veto.FULL_DATA_CAT_3_VETO-0
      1417637746 - 2014-12-03T15:15:46-0500 - MONITORD_FINISHED - ad35ae1b-ce67-4b32-a42c-8b498a88f1ae - inspiral_hipe_full_data_cat4_veto.FULL_DATA_CAT_4_VETO-0
      2014-12-03 15:15:48,979:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/full_data/inspiral_hipe_full_data_cat2_veto.FULL_DATA_CAT_2_VETO_ID000023.000
      2014-12-03 15:15:51,745:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/nsbh4lininj/inspiral_hipe_nsbh4lininj.NSBH4LININJ_ID000017.000
      2014-12-03 15:15:54,935:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/nsbh3lininj/inspiral_hipe_nsbh3lininj.NSBH3LININJ_ID000010.000
      1417637757 - 2014-12-03T15:15:57-0500 - MONITORD_FINISHED - 501d2c3e-78b3-4f2d-8555-778d7654a6bb - inspiral_hipe_full_data_cat2_veto.FULL_DATA_CAT_2_VETO-0
      2014-12-03 15:16:01,348:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bbh4lininj/inspiral_hipe_bbh4lininj.BBH4LININJ_ID000019.000
      1417637766 - 2014-12-03T15:16:06-0500 - MONITORD_FINISHED - 12d8414b-be0d-49ff-a920-680f073e4e17 - inspiral_hipe_nsbh4lininj.NSBH4LININJ-0
      1417637767 - 2014-12-03T15:16:07-0500 - MONITORD_FINISHED - 7e828a4f-0105-4e5f-be32-ee0574495e81 - inspiral_hipe_nsbh3lininj.NSBH3LININJ-0
      2014-12-03 15:16:09,716:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bbh6lininj/inspiral_hipe_bbh6lininj.BBH6LININJ_ID000007.000
      1417637773 - 2014-12-03T15:16:13-0500 - MONITORD_FINISHED - ef334725-cc11-4a15-8f59-a610fb868d37 - inspiral_hipe_bbh4lininj.BBH4LININJ-0
      2014-12-03 15:16:26,732:workflow.py:output_to_db:104: WARNING: NL-LOAD-ERROR --> 1d347d50-ecae-4722-be02-1757e71c628b - inspiral_hipe_bnslininj.BNSLININJ-0
      2014-12-03 15:16:26,732:workflow.py:output_to_db:105: WARNING: error sending event: inv.end --> {'xwf__id': '1d347d50-ecae-4722-be02-1757e71c628b', 'executable': '/usr/bin/../bin/pegasus-kickstart', 'job_inst__id': 445, 'start_time': 1417026144, 'job__id': 'lalapps_inspiral_ID000502', 'ts': None, 'argv': ' -n ligo-inspiraljob::lalapps_inspiral:1.0 -N ID000502 -R local -L inspiral_hipe_bnslininj.BNSLININJ -T 2014-11-24T19:52:59-05:00 /home/samantha.usman/bns/ahope-comparison-paper/s6-threepointfive/965779215-966384015/bnslininj/../executables/lalapps_inspiral --do-rsq-veto --trig-end-time 0 --cluster-method template --dynamic-range-exponent 69.0 --autochisq-stride 2 --bank-file L1-TMPLTBANK-965812420-2048.xml.gz --high-pass-order 8 --strain-high-pass-order 8 --ifo-tag FIRST --user-tag BNSLININJ --gps-end-time 965814468 --calibrated-data real_8 --channel-name L1:LDAS-STRAIN --snr-threshold 5.5 --enable-rsq-veto --number-of-segments 15 --trig-start-time 0 --enable-high-pass 30.0 --gps-start-time 965812420 --enable-filter-inj-only --autochisq-two-sided --high-pass-attenuation 0.1 --chisq-bins 16 --inverse-spec-length 16 --rsq-veto-threshold 15.0 --segment-length 1048576 --low-frequency-cutoff 40.0 --pad-data 8 --maximization-interval 30 --sample-rate 4096 --chisq-threshold 10.0 --rsq-veto-max-snr 12.0 --resample-filter ldas --strain-high-pass-atten 0.1 --strain-high-pass-freq 30 --bank-veto-time-freq --injection-file HL-INJECTIONS_1001_BNSLININJ-965779215-604800.xml --segment-overlap 524288 --frame-cache L-L1_LDAS_C02_L2_CACHE-965812412-10556.lcf --chisq-delta 0.2 --bank-veto-subbank-size 20 --approximant FindChirpSP --rsq-veto-time-thresh 0.0002 --write-compress --autochisq-length 100 --enable-output --rsq-veto-window 6.0 --order threePointFivePN --spectrum-type median', 'task__id': 'ID000502', 'inv__id': 1, 'level': 'Error', 'transformation': 'ligo-inspiraljob::lalapps_inspiral:1.0', 'exitcode': '1'}
      2014-12-03 15:16:26,733:workflow.py:output_to_db:106: WARNING: Traceback (most recent call last):
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/workflow.py", line 99, in output_to_db
         self._sink.send(event, kwargs)
       File "/usr/lib64/python2.6/site-packages/Pegasus/monitoring/event_output.py", line 215, in send
         self._db.notify(d)
       File "/usr/lib64/python2.6/site-packages/Pegasus/netlogger/analysis/modules/_base.py", line 257, in notify
         raise ProcessException(str(err))
      ProcessException: invalid literal for float(): None

      1417637786 - 2014-12-03T15:16:26-0500 - MONITORD_FINISHED - d179ca68-3d61-42db-9479-0e9fd3485a2c - inspiral_hipe_bbh6lininj.BBH6LININJ-0
      2014-12-03 15:16:32,605:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bbh3lininj/inspiral_hipe_bbh3lininj.BBH3LININJ_ID000012.000
      2014-12-03 15:16:37,633:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/nsbh2lininj/inspiral_hipe_nsbh2lininj.NSBH2LININJ_ID000005.000
      2014-12-03 15:16:39,564:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bns6lininj/inspiral_hipe_bns6lininj.BNS6LININJ_ID000016.000
      1417637808 - 2014-12-03T15:16:48-0500 - MONITORD_FINISHED - f33a0d93-7f5b-443c-a08b-82a88268fc32 - inspiral_hipe_bbh3lininj.BBH3LININJ-0
      2014-12-03 15:16:53,360:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bbh2lininj/inspiral_hipe_bbh2lininj.BBH2LININJ_ID000006.000
      1417637814 - 2014-12-03T15:16:54-0500 - MONITORD_FINISHED - 618f7d3f-f917-4e75-8138-2632701835af - inspiral_hipe_nsbh2lininj.NSBH2LININJ-0
      1417637819 - 2014-12-03T15:16:59-0500 - MONITORD_FINISHED - f41d27ba-5cc5-4fed-b259-487589bbea40 - inspiral_hipe_bns6lininj.BNS6LININJ-0
      2014-12-03 15:17:13,538:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/nsbh6lininj/inspiral_hipe_nsbh6lininj.NSBH6LININJ_ID000018.000
      1417637837 - 2014-12-03T15:17:17-0500 - MONITORD_FINISHED - 229743f2-5697-4814-af70-3239b2382db9 - inspiral_hipe_bbh2lininj.BBH2LININJ-0
      2014-12-03 15:17:17,907:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bbhlininj/inspiral_hipe_bbhlininj.BBHLININJ_ID000015.000
      2014-12-03 15:17:29,350:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bns5lininj/inspiral_hipe_bns5lininj.BNS5LININJ_ID000020.000
      2014-12-03 15:17:30,802:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/full_data/inspiral_hipe_full_data.FULL_DATA_ID000003.000
      1417637852 - 2014-12-03T15:17:32-0500 - MONITORD_FINISHED - 005c0549-e26d-4b64-bd4c-8ea4de4edb6e - inspiral_hipe_nsbh6lininj.NSBH6LININJ-0
      2014-12-03 15:17:36,843:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/nsbhlininj/inspiral_hipe_nsbhlininj.NSBHLININJ_ID000021.000
      1417637858 - 2014-12-03T15:17:38-0500 - MONITORD_FINISHED - ab7f9d8b-38b8-427e-b07f-5a22882fc513 - inspiral_hipe_bbhlininj.BBHLININJ-0
      2014-12-03 15:17:39,597:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bns2lininj/inspiral_hipe_bns2lininj.BNS2LININJ_ID000013.000
      2014-12-03 15:17:44,120:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/nsbh5lininj/inspiral_hipe_nsbh5lininj.NSBH5LININJ_ID000011.000
      1417637869 - 2014-12-03T15:17:49-0500 - MONITORD_FINISHED - 5e21e34b-c042-47cc-a7d9-dbffb6f20bba - inspiral_hipe_bns5lininj.BNS5LININJ-0
      2014-12-03 15:17:49,841:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bnslininj/inspiral_hipe_bnslininj.BNSLININJ_ID000004.000
      2014-12-03 15:17:52,807:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bns3lininj/inspiral_hipe_bns3lininj.BNS3LININJ_ID000009.000
      1417637874 - 2014-12-03T15:17:54-0500 - MONITORD_FINISHED - 48251f9f-445e-48ac-94b1-1290d4a3a86c - inspiral_hipe_full_data.FULL_DATA-0
      1417637877 - 2014-12-03T15:17:57-0500 - MONITORD_FINISHED - cdf6058f-1b2c-4211-99b4-d9e31569e236 - inspiral_hipe_nsbhlininj.NSBHLININJ-0
      2014-12-03 15:18:00,083:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bns4lininj/inspiral_hipe_bns4lininj.BNS4LININJ_ID000014.000
      1417637882 - 2014-12-03T15:18:02-0500 - MONITORD_FINISHED - a5e173aa-ac0c-40d9-91c0-118b0581a004 - inspiral_hipe_nsbh5lininj.NSBH5LININJ-0
      1417637883 - 2014-12-03T15:18:03-0500 - MONITORD_FINISHED - d8816321-e426-489a-ae21-ee428390b23a - inspiral_hipe_bns2lininj.BNS2LININJ-0
      1417637884 - 2014-12-03T15:18:04-0500 - MONITORD_FINISHED - 1d347d50-ecae-4722-be02-1757e71c628b - inspiral_hipe_bnslininj.BNSLININJ-0
      1417637884 - 2014-12-03T15:18:04-0500 - MONITORD_FINISHED - 5c8bc23f-540e-45f3-a0dc-a0b6f518ee30 - inspiral_hipe_bns3lininj.BNS3LININJ-0
      2014-12-03 15:18:08,923:pegasus-monitord:process_dagman_out:852: WARNING: DAGMan was aborted for workflow running in directory /usr1/samantha.usman/log/H1L1-ihope_ssipe-965779215-604800.tI2nTq/bbh5lininj/inspiral_hipe_bbh5lininj.BBH5LININJ_ID000008.000
      1417637889 - 2014-12-03T15:18:09-0500 - MONITORD_FINISHED - da35c852-587a-4133-9774-fe7cbc2c4e1c - inspiral_hipe_bns4lininj.BNS4LININJ-0
      1417637893 - 2014-12-03T15:18:13-0500 - MONITORD_FINISHED - cf00e0ac-82f7-467d-b3d1-f76d87e8e39b - inspiral_hipe_bbh5lininj.BBH5LININJ-0

      2014-12-03T15:18:13-0500 - pegasus-monitord ending - pid 5224 ------------------

      2014-12-03T15:18:13-0500 - pegasus-monitord - DB flushing beginning ------------
      2014-12-03T15:18:13-0500 - pegasus-monitord - DB flushing ended ----------------
      2014-12-03T15:18:13-0500 - pegasus-monitord - DB flushing beginning ------------
      2014-12-03T15:18:14-0500 - pegasus-monitord - DB flushing ended ----------------

        Attachments

          Activity

            People

            • Assignee:
              vahi Karan Vahi
              Reporter:
              dbrown Duncan Brown
            • Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: