I am wanting to transfer TBs of data from S3 to an EC2 Windows Server then back again which will take a couple of hours when making use of a basic AWS CLI Copy command. To help speed things up I am wanting to make use of AWS Data Pipeline and the graphic in the AWS Data Pipeline documentation seems to suggest that data can at least flow from EC2 to S3:
Yet I am finding it hard to gain an understanding on how that can be done. The closest example I have seen is the concept of staging data by making use of the ShellCommandActivity which transfers data from an S3 DataNode to an EC2 before copying it back to S3.
Instead I am wanting to copy data from S3 on an already running Windows instance and then at a later point copy further data back into S3.