Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1463

improve insert performance of pegasus-rc-client

    XMLWordPrintable

Details

    Description

      I recently used pegasus-rc-client to insert sets of 1.5 million entries each, using the following syntax:

      pegasus-rc-client -i <file.rls>

      Each invocation took over 12 hours to insert the 1.5 million entries (they were run serially). Another run as part of the regular CyberShake workflow took 5 hours to insert 437,400 entries, so that's around 25 entries per second.

      The current speed is workable with some patience, but just wanted to check if there was any low hanging fruit to speed it up a bit.

      Attachments

        Activity

          People

            rafsilva Rafael Ferreira Da Silva
            scottcal Scott Callaghan
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: