pegasus-rc-client error in register_local_0_0 job for workflow producing 1k output files

This issue belongs to an archived project. You can view it, but you can't modify it. Learn more

XMLWordPrintable

    • Type: Bug
    • Resolution: Fixed
    • Priority: Major
    • master, 5.0.0
    • Affects Version/s: master, 5.0.0
    • Component/s: pegasus-rc-client
    • None

      The following error is observed when running this workflow (see attached submit directory) during the register_local_0_0 job.

      ------
      168 data: |
      169 java.sql.SQLException: Expression tree is too large (maximum depth 1000)
      170 at org.sqlite.core.NativeDB.throwex(NativeDB.java:397)
      171 at org.sqlite.core.NativeDB._exec(Native Method)
      172 at org.sqlite.jdbc3.JDBC3Statement.executeUpdate(JDBC3Statement.java:116)
      173 at edu.isi.pegasus.planner.catalog.replica.impl.JDBCRC.insert(JDBCRC.java:1306)
      174 at edu.isi.pegasus.planner.client.RCClient.work(RCClient.java:563)
      175 at edu.isi.pegasus.planner.client.RCClient.parse(RCClient.java:886)
      176 at edu.isi.pegasus.planner.client.RCClient.main(RCClient.java:1126)
      177 #Successfully worked on : 0 lines.
      178 #Worked on total number of : 500 lines.

      It looks like a delete command is failing:

      2021-03-04 17:10:53.357 ERROR [root] Unable to tell database DELETE FROM rc_pfn WHERE (lfn_id=2 AND pfn='file:/ ///nas/home/tanaka/workflows/wf-output/10545.txt.out' AND site='local')

      The workflow produces 1001 output files.

            Assignee:
            Rafael Ferreira Da Silva [X] (Inactive)
            Reporter:
            Ryan Tanaka [X] (Inactive)
            Archiver:
            Rajiv Mayani

              Created:
              Updated:
              Resolved:
              Archived: