In this post, we use the linux shell to generate a bunch of files, add some text to each file, push all the files to S3, then read the files using AWS s3 CLI
The AWS docs mention that 1000 objects are retrieved at a time by the AWS CLI.
By default, the AWS CLI uses a page size of 1000 and retrieves all available items. For example, if you run
aws s3api list-objectson an Amazon S3 bucket that contains 3,500 objects, the AWS CLI automatically makes four calls to Amazon S3, handling the service-specific pagination logic for you in the background and…