Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-374

pegasus-transfer fails on scp if the destination host is not known

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: master, 3.0.2
    • Fix Version/s: master
    • Labels:
      None

      Description

      I set up a workflow to use SCP for stage-in and stage-out on Amazon, but the job fails with "Host key verification fails" because the destination host is not in my known_hosts.

      I made it work two ways:

      1. Adding "-o StrictHostKeyChecking=no" to the command line generated by pegasus-transfer
      2. Adding the following lines to my ~/.ssh/config:
      Host *.compute-1.amazonaws.com
        StrictHostKeyChecking no
        UserKnownHostsFile=/dev/null

      I'm not really sure what the best solution is to this. I tend to think its #2. I'm not sure this is really a bug in pegasus-transfer, but I think its worth discussing the issue.

      Here's what pegasus-transfer spits out:

      2011-05-03 13:46:16,329 INFO: Reading URL pairs from stdin
      2011-05-03 13:46:16,330 INFO: PATH=/usr/local/globus/default/bin:/usr/local/pegasus/default/bin:/usr/bin:/bin
      2011-05-03 13:46:16,330 INFO: LD_LIBRARY_PATH=/usr/local/globus/default/lib:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd64
      2011-05-03 13:46:16,330 INFO: Executing scp commands
      Host key verification failed.
      lost connection
      2011-05-03 13:46:17,049 CRITICAL: Command '/usr/bin/scp /lfs1/submit/diamond/f.a condor@ec2-50-17-106-165.compute-1.amazonaws.com:/mnt/gideon/pegasus/diamond/run0003/f.a' failed with error code 1

        Attachments

          Activity

            People

            • Assignee:
              rynge-page Mats Rynge [X] (Inactive)
              Reporter:
              gideon Gideon Juve (Inactive)
            • Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: