Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1463

improve insert performance of pegasus-rc-client

    XMLWordPrintable

    Details

      Description

      I recently used pegasus-rc-client to insert sets of 1.5 million entries each, using the following syntax:

      pegasus-rc-client -i <file.rls>

      Each invocation took over 12 hours to insert the 1.5 million entries (they were run serially). Another run as part of the regular CyberShake workflow took 5 hours to insert 437,400 entries, so that's around 25 entries per second.

      The current speed is workable with some patience, but just wanted to check if there was any low hanging fruit to speed it up a bit.

        Attachments

          Activity

            People

            • Assignee:
              rafsilva Rafael Ferreira Da Silva
              Reporter:
              scottcal Scott Callaghan
            • Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: