Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1463

improve insert performance of pegasus-rc-client

    XMLWordPrintable

    Details

      Description

      I recently used pegasus-rc-client to insert sets of 1.5 million entries each, using the following syntax:

      pegasus-rc-client -i <file.rls>

      Each invocation took over 12 hours to insert the 1.5 million entries (they were run serially). Another run as part of the regular CyberShake workflow took 5 hours to insert 437,400 entries, so that's around 25 entries per second.

      The current speed is workable with some patience, but just wanted to check if there was any low hanging fruit to speed it up a bit.

        Attachments

          Activity

            People

            Assignee:
            rafsilva Rafael Ferreira Da Silva
            Reporter:
            scottcal Scott Callaghan
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: