Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-374

pegasus-transfer fails on scp if the destination host is not known

XMLWordPrintable

    • Type: Icon: Bug Bug
    • Resolution: Fixed
    • Priority: Icon: Major Major
    • master
    • Affects Version/s: master, 3.0.2
    • None

      I set up a workflow to use SCP for stage-in and stage-out on Amazon, but the job fails with "Host key verification fails" because the destination host is not in my known_hosts.

      I made it work two ways:

      1. Adding "-o StrictHostKeyChecking=no" to the command line generated by pegasus-transfer
      2. Adding the following lines to my ~/.ssh/config:
      Host *.compute-1.amazonaws.com
      StrictHostKeyChecking no
      UserKnownHostsFile=/dev/null

      I'm not really sure what the best solution is to this. I tend to think its #2. I'm not sure this is really a bug in pegasus-transfer, but I think its worth discussing the issue.

      Here's what pegasus-transfer spits out:

      2011-05-03 13:46:16,329 INFO: Reading URL pairs from stdin
      2011-05-03 13:46:16,330 INFO: PATH=/usr/local/globus/default/bin:/usr/local/pegasus/default/bin:/usr/bin:/bin
      2011-05-03 13:46:16,330 INFO: LD_LIBRARY_PATH=/usr/local/globus/default/lib:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd64
      2011-05-03 13:46:16,330 INFO: Executing scp commands
      Host key verification failed.
      lost connection
      2011-05-03 13:46:17,049 CRITICAL: Command '/usr/bin/scp /lfs1/submit/diamond/f.a condor@ec2-50-17-106-165.compute-1.amazonaws.com:/mnt/gideon/pegasus/diamond/run0003/f.a' failed with error code 1

            Assignee:
            rynge-page Mats Rynge [X] (Inactive)
            Reporter:
            gideon Gideon Juve (Inactive)
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: