For 4.4 pegasus-transfer has threading support to do the transfers across transfer sets. After talking about this today, we decided to have the following default configuration values in pegasus-transfer

• by default the number of threads will be 2
• we will expose a way via properties to increase the number if users want to have better bandwidth
• in case of any failures, pegasus-transfer will revert back on a single thread