So, I have a DynamoDB table `Users` and I want to return all the contents of this table. Or maybe even some. 

I tried

    aws dynamodb query --table-name Users 

and it says I have to specify `key-condition` or `key-condition-expression`, so I added the following:

    aws dynamodb query --table-name Users --key-condition-expression Username = &quot;test&quot;

and it returns an error message `&quot; Unknown options: test &quot;`.


how to return items in a dynamodb on aws-cli

I am attempting to utilize the AWS CLI along with a `for` loop in bash to iteratively purge multiple SQS message queues.  The bash script works almost as intended, the problem I am having is with the return value each time the AWS CLI sends a request.  When the request is successful, it returns an empty value and opens up an interactive pager in the command line.  I then have to manually type `q` to exit the interactive screen and allow the `for` loop to continue to the next iteration.  This becomes very tedious and time consuming when attempting to purge a large number of queues.

Is there a way to configure AWS CLI to disable this interactive pager from popping up for every return value?  Or a way to pipe the return values into a separate file instead of being displayed?

I have played around with configuring different return value types (text, yaml, JSON) but haven&#39;t had any luck.  Also the `--no-pagination` parameter doesn&#39;t change the behavior.

Here&#39;s an example of the bash script I&#39;m trying to run:
```
for x in 1 2 3; do 
  aws sqs purge-queue --queue-url https://sqs.&lt;aws-region&gt;.amazonaws.com/&lt;id&gt;/&lt;env&gt;-$x-&lt;queueName&gt;.fifo; 
done
```

How to turn off the pager for AWS CLI return value?

`aws s3 sync --delete` removed some new files.

For example: 

There is a file in the bucket - `S3://my-bucket/images/1.jpg`

Then, I uploaded a file to the server: `2.jpg`

There are 2 files in the server: `1.jpg` and `2.jpg`

Start running the sync cronjob:

    aws s3 sync s3://my-bucket/ ./ --delete
    aws s3 sync  ./ s3://my-bucket/ --delete


----- 

Why do we add `--delete` - we want to delete the files in s3 and sync it to the server.

We will upload files to the server and remove the files in s3.

Is there any way to fix it?

AWS S3 sync --delete, removed new files in local

is there ANY way to execute aws-cli inside AWS Lambda?
It doesn&#39;t seem to be pre-installed.
(I&#39;ve checked with &quot;which aws&quot; via Node.js child-process, and it didn&#39;t exist.）

Call aws-cli from AWS Lambda

When I give the command `aws config list`, I get the following output for the default profile:

          Name                    Value             Type    Location
          ----                    -----             ----    --------
       profile                &lt;not set&gt;             None    None

However, when I give the command for a named profile, I get a profile name

    $ aws configure list --profile MyProfile
          Name                    Value             Type    Location
          ----                    -----             ----    --------
       profile                MyProfile           manual    --profile

I have tried `aws configure set profile Default` to name the default profile as `Default` by reading the &#39;[set][1]&#39; CLI command, I also tried `aws configure set StoreAs Default` because I thought that&#39;s what&#39;s the variable is named after I read [this page][2]. I want to do this because I want have two profiles and I want to switch between profiles using the `AWS_DEFAULT_PROFILE` environment variable.


  [1]: https://docs.aws.amazon.com/cli/latest/reference/configure/set.html
  [2]: https://docs.aws.amazon.com/powershell/latest/userguide/specifying-your-aws-credentials.html

How do I set the name of the default profile in AWS CLI?

I want to list the public IP addresses of my EC2 instances using Bash, separated by a delimiter (space or a new-line).

I tried to pipe the output to [jq][1] with `aws ec2 describe-instances | jq`, but can&#39;t seem to isolate just the IP addresses.


  [1]: https://stedolan.github.io/jq/

Can this be done by `aws` alone, specifying arguments to `jq`, or something else entirely?

List public IP addresses of EC2 instances

Is there any way to force CloudFormation to delete a non-empty S3 Bucket?

Can I force CloudFormation to delete non-empty S3 Bucket?

Interactively, I can use &quot;aws configure&quot; to change or see the default region. Is there a &quot;pwd&quot; like function, documented or not that allows me to determine or confirm the current region mid-script ? Even if AWS_DEFAULT_REGION is not defined ? I want a script to run under a number of profiles. I can scrape from aws configure list, but is there something neater ?

Using aws cli, what is best way to determine the current region

I am having trouble downloading multiple files from AWS S3 buckets to my local machine. 

I have all the filenames that I want to download and I do not want others. How can I do that ? Is there any kind of loop in aws-cli I can do some iteration ?

There are couple hundreds files I need to download so that it seems not possible to use one single command that takes all filenames as arguments. 

Copy multiple files from s3 bucket

I have an S3 bucket that is 100% empty.  Versioning was never enabled on the bucket.  However, I still cannot remove the bucket.  I have tried via the Console and the CLI tool.  On the console it just says &quot;Error&quot; with no error message.  From the cli and api it tells me: &quot;An error occurred (BucketNotEmpty) when calling the DeleteBucket operation: The bucket you tried to delete is not empty&quot;.  I have tried all of the following:

`aws s3 rb s3://&lt;bucket_name&gt; --force` -&gt; BucketNotEmpty

`aws s3 rm s3://&lt;bucket_name&gt; --recursive` -&gt; No output (because it&#39;s already empty)

`aws s3api list-object-versions --bucket &lt;bucket_name&gt;` -&gt; No output (because versioning was never enabled)

`aws s3api list-multipart-uploads --bucket &lt;bucket_name&gt;` -&gt; No outputs

`aws s3api list-objects --delimiter=/ --prefix= --bucket &lt;bucket_name&gt;` -&gt; No Output (because it&#39;s empty)

* It has no dependencies (it&#39;s not used by cloudfront or anything else that I&#39;m aware of).
* The bucket has been empty for approximately 5 days.
* I was able to delete another very similar bucket with the same IAM user.  Additionally my IAM user has Admin access.

Can&#39;t Delete Empty S3 Bucket

I am thinking about redeploying my static website to Amazon S3. I need to automate the deployment so I was looking for an API for such tasks. I&#39;m a bit confused over the different options.

**Question**: What is the difference between s3cmd, the Python library boto and AWS CLI?

Difference between s3cmd, boto and AWS CLI

Is there a command/subcommand that can be passed to the `aws` utility that can 1) verify that the credentials in the `~/.aws/credentials` file are valid, and 2) give some indication which user the credentials belong to? I&#39;m looking for something generic that doesn&#39;t make any assumptions about the user having permissions to IAM or any specific service.

The use case for this is a deploy-time sanity check to make sure that the credentials are good. Ideally there would be some way to check the return value and abort the deploy if there are invalid credentials.

How to test credentials for AWS Command Line Tools

I noticed that there does not seem to be an option to download an entire `s3` bucket from the AWS Management Console.

Is there an easy way to grab everything in one of my buckets? I was thinking about making the root folder public, using `wget` to grab it all, and then making it private again but I don&#39;t know if there&#39;s an easier way.

Downloading an entire S3 bucket?

I&#39;m having trouble using `*` in the AWS CLI to select a subset of files from a certain bucket.

Adding `*` to the path like this does not seem to work

`aws s3 cp s3://data/2016-08* .`


How can I use wildcards to `cp` a group of files with the AWS CLI

I&#39;ve got two different apps that I am hosting (well the second one is about to go up) on Amazon EC2.

How can I work with both accounts at the command line (Mac OS X) but keep the EC2 keys &amp; certificates separate?  Do I need to change my environment variables before each ec2-* command? 

Would using an alias and having it to the setting of the environment in-line work?  Something like:

    alias ec2-describe-instances1 = export EC2_PRIVATE_KEY=/path; ec2-describe-instances


How to use multiple AWS accounts from the command line?

I recently noticed that I am running an old version of AWS CLI that is lacking some functionality I need:

    $aws --version
    aws-cli/1.2.9 Python/3.4.3 Linux/3.13.0-85-generic

How can I upgrade to the latest version of the AWS CLI (1.10.24)?

Edit:

Running the following command fails to update AWS CLI:

    $ pip install --upgrade awscli
    Requirement already up-to-date: awscli in /usr/local/lib/python2.7/dist-packages
    Cleaning up...

Checking the version:

    $ aws --version
    aws-cli/1.2.9 Python/3.4.3 Linux/3.13.0-85-generic



How to upgrade AWS CLI to the latest version?

Using AWS Cognito, I want to create dummy users for testing purposes.

I then use the _AWS Console_ to create such user, but the user has its _status_ set to `FORCE_CHANGE_PASSWORD`. With that value, this user cannot be authenticated.

Is there a way to change this status?

UPDATE
Same behavior when creating user from CLI


How to change User Status FORCE_CHANGE_PASSWORD?

Im trying to deploy a `docker` container image to `AWS` using `ECS`, but the EC2 instance is not being created. I have scoured the internet looking for an explanation as to why I&#39;m receiving the following error: 

&gt;&quot;A client error (InvalidParameterException) occurred when calling the RunTask operation: No Container Instances were found in your cluster.&quot;

**Here are my steps:** 

1\. Pushed a docker image FROM Ubuntu to my Amazon ECS repo.
   
2\. Registered an ECS Task Definition:

    aws ecs register-task-definition --cli-input-json file://path/to/my-task.json 

3\. Ran the task: 

    aws ecs run-task --task-definition my-task

Yet, it fails.

**Here is my task:**

    {
      &quot;family&quot;: &quot;my-task&quot;,
      &quot;containerDefinitions&quot;: [
        {
            &quot;environment&quot;: [],
            &quot;name&quot;: &quot;my-container&quot;,
            &quot;image&quot;: &quot;my-namespace/my-image&quot;,
            &quot;cpu&quot;: 10,
            &quot;memory&quot;: 500,
            &quot;portMappings&quot;: [
                {
                    &quot;containerPort&quot;: 8080,
                    &quot;hostPort&quot;: 80
                }
            ],
            &quot;entryPoint&quot;: [
                &quot;java&quot;,
                &quot;-jar&quot;,
                &quot;my-jar.jar&quot;
            ],
            &quot;essential&quot;: true
        }
      ]
    }

I have also tried using the management console to configure a cluster and services, yet I get the same error. 
How do I configure the cluster to have ec2 instances, and what kind of container instances do I need to use? *I thought this whole process was to create the EC2 instances to begin with!!*





    

AWS ECS Error when running task: No Container Instances were found in your cluster

Looking for a quick way to pull my account number, I had originally thought of using `aws iam get-account-authorization-details --max-items 1` but there are several issues with doing it this way. Is there a way to do this that might not cross account origins?

Quick way to get AWS Account number from the AWS CLI tools?

I `cd` into the directory where all the pem/key files are and run the following:

    aws iam upload-server-certificate 
        --server-certificate-name certificate_name 
        --certificate-body file://webservercertificate.pem  
        --private-key file://server.key   
        --certificate-chain file://certificate_chain_file.pem 

I get the following error: 



&gt; A client error (InvalidClientTokenId) occurred when calling the
&gt; UploadServerCertificate operation: The security token included in the
&gt; request is invalid.


I have 1 &#39;user&#39; in &#39;users&#39;. That user has been assigned the following permissions:

    IAMFullAccess IAMReadOnlyAccess IAMUserSSHKeys


I&#39;ve downloaded the credentials for this user and put them into my user variables

    AWS_ACCESS_KEY ****
    AWS_SECRET_KEY ****

I have 1 role on my elastic beanstalk  `aws-elasticbeanstalk-ec2-role`

How can I resolve the error &quot;The security token included in the request is invalid&quot; when running aws iam upload-server-certificate?

I am following the [AWS CLI Setup guide][1]. I have managed to successfully install the tool on my Mac OS X terminal with the following output:

    Running cmd: /usr/bin/python virtualenv.py --python /usr/bin/python /Users/fr/.local/lib/aws
    Running cmd: /Users/fr/.local/lib/aws/bin/pip install --no-index --find-links file:///Users/fr/Downloads/awscli-bundle/packages awscli-1.5.3.tar.gz
    You can now run: /Users/fr/.local/lib/aws/bin/aws --version

My issue is that I have to type the full path **/Users/fr/.local/lib/aws/bin/aws** to execute any **aws** command. As per the guide&#39;s final step, I should be able to execute aws command directly without typing the absolute path for it to execute.

When I try using just **aws**, I get the following output:

    aws --version                                                                                         ⏎
    command not found: aws

I followed the instructions to make sure that **~/bin** is in my **PATH** environment and I could see there was no output, hence, I executed the export **PATH=~/bin:$PATH** command to add **~/bin to $PATH**. But this has made no difference. The **aws** command does not work directly.

Could someone please advise what could be going wrong?

  [1]: http://docs.aws.amazon.com/cli/latest/userguide/installing.html#install-bundle-other-os

AWS CLI $PATH Settings

I&#39;m starting a bash script which will take a path in S3 (as specified to the [ls][1] command) and dump the contents of all of the file objects to `stdout`. Essentially I&#39;d like to replicate `cat /path/to/files/*` except for S3, e.g. `s3cat &#39;/bucket/path/to/files/*&#39;`. My first inclination looking at the options is to use the `cp` command to a temporary file and then `cat` that.

Has anyone tried this or similar or is there already a command I&#39;m not finding which does it?

  [1]: http://docs.aws.amazon.com/cli/latest/reference/s3/ls.html

How to use AWS S3 CLI to dump files to stdout in BASH?

I am trying to use aws container service as per the documentation in http://docs.aws.amazon.com/AmazonECS/latest/developerguide/ECS_GetStarted.html

The below error is thrown when running the command: 
     
    aws ecs list-container-instances --cluster default

    You must specify a region. You can also configure your region by running &quot;aws configure&quot;.

The documentation does not mention anything about specifying a default region. How do we do it in a console?


Error &quot;You must specify a region&quot; when running any aws CLI command

Every time I want to config something with AWS I get the following error : 

    &quot;The config profile (myname) could not be found&quot;

like : aws configure

I&#39;m using Python 3.4 and I want to use AWS CLI Keyring to encrypt my credentials.. 

AWS : The config profile (MyName) could not be found

I am going to create a new distribution at **CloudFront**. Already I have uploaded my SSL certificate at AWS IAM using AWS CLI. That certificate appears in the Custom SSL Certificate dropdown on new distribution page but it is **DISABLED**.

Can someone tell me why is it so ? How to select my custom SSL certificate for this distribution ?

Unable to select Custom SSL Certificate (stored in AWS IAM)

I have tried both `s3cmd`:

    $ s3cmd -r -f -v del s3://my-versioned-bucket/

And the AWS CLI:

    $ aws s3 rm s3://my-versioned-bucket/ --recursive

But both of these commands simply add `DELETE` markers to S3. The command for removing a bucket also doesn&#39;t work (from the AWS CLI):

    $ aws s3 rb s3://my-versioned-bucket/ --force
    Cleaning up. Please wait...
    Completed 1 part(s) with ... file(s) remaining
    remove_bucket failed: s3://my-versioned-bucket/ A client error (BucketNotEmpty) occurred when calling the DeleteBucket operation: The bucket you tried to delete is not empty. You must delete all versions in the bucket.

Ok... how? There&#39;s no information in [their documentation][1] for this. S3Cmd says it&#39;s a &#39;fully-featured&#39; S3 command-line tool, but it makes [no reference to versions][2] other than its own. Is there any way to do this without using the web interface, which will take forever and requires me to keep my laptop on?


  [1]: http://docs.aws.amazon.com/cli/latest/reference/s3/index.html
  [2]: http://s3tools.org/usage

How do I delete a versioned bucket in AWS S3 using the CLI?

I&#39;m trying to setup a Amazon Linux AMI(ami-f0091d91) and have a script that runs a copy command to copy from a S3 bucket.

     aws --debug s3 cp s3://aws-codedeploy-us-west-2/latest/codedeploy-agent.noarch.rpm .

 This script works perfectly on my local machine but fails with the following error on the Amazon Image:

    2016-03-22 01:07:47,110 - MainThread - botocore.auth - DEBUG - StringToSign:
    HEAD
    
    
    Tue, 22 Mar 2016 01:07:47 GMT
    x-amz-security-token:AQoDYXdzEPr//////////wEa4ANtcDKVDItVq8Z5OKms8wpQ3MS4dxLtxVq6Om1aWDhLmZhL2zdqiasNBV4nQtVqwyPsRVyxl1Urq1BBCnZzDdl4blSklm6dvu+3efjwjhudk7AKaCEHWlTd/VR3cksSNMFTcI9aIUUwzGW8lD9y8MVpKzDkpxzNB7ZJbr9HQNu8uF/st0f45+ABLm8X4FsBPCl2I3wKqvwV/s2VioP/tJf7RGQK3FC079oxw3mOid5sEi28o0Qp4h/Vy9xEHQ28YQNHXOBafHi0vt7vZpOtOfCJBzXvKbk4zRXbLMamnWVe3V0dArncbNEgL1aAi1ooSQ8+Xps8ufFnqDp7HsquAj50p459XnPedv90uFFd6YnwiVkng9nNTAF+2Jo73+eKTt955Us25Chxvk72nAQsAZlt6NpfR+fF/Qs7jjMGSF6ucjkKbm0x5aCqCw6YknsoE1Rtn8Qz9tFxTmUzyCTNd7uRaxbswm7oHOdsM/Q69otjzqSIztlwgUh2M53LzgChQYx5RjYlrjcyAolRguJjpSq3LwZ5NEacm/W17bDOdaZL3y1977rSJrCxb7lmnHCOER5W0tsF9+XUGW1LMX69EWgFYdn5QNqFk6mcJsZWrR9dkehaQwjLPcv/29QcM+b5u/0goazCtwU=
    /aws-codedeploy-us-west-2/latest/codedeploy-agent.noarch.rpm
    2016-03-22 01:07:47,111 - MainThread - botocore.endpoint - DEBUG - Sending http request: &lt;PreparedRequest [HEAD]&gt;
    2016-03-22 01:07:47,111 - MainThread - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (1): aws-codedeploy-us-west-2.s3.amazonaws.com
    2016-03-22 01:07:47,151 - MainThread - botocore.vendored.requests.packages.urllib3.connectionpool - DEBUG - &quot;HEAD /latest/codedeploy-agent.noarch.rpm HTTP/1.1&quot; 403 0
    2016-03-22 01:07:47,151 - MainThread - botocore.parsers - DEBUG - Response headers: {&#39;x-amz-id-2&#39;: &#39;0mRvGge9ugu+KKyDmROm4jcTa1hAnA5Ax8vUlkKZXoJ//HVJAKxbpFHvOGaqiECa4sgon2F1kXw=&#39;, &#39;server&#39;: &#39;AmazonS3&#39;, &#39;transfer-encoding&#39;: &#39;chunked&#39;, &#39;x-amz-request-id&#39;: &#39;6204CD88E880E5DD&#39;, &#39;date&#39;: &#39;Tue, 22 Mar 2016 01:07:46 GMT&#39;, &#39;content-type&#39;: &#39;application/xml&#39;}
    2016-03-22 01:07:47,152 - MainThread - botocore.parsers - DEBUG - Response body:
    
    2016-03-22 01:07:47,152 - MainThread - botocore.hooks - DEBUG - Event needs-retry.s3.HeadObject: calling handler &lt;botocore.retryhandler.RetryHandler object at 0x7f421075bcd0&gt;
    2016-03-22 01:07:47,152 - MainThread - botocore.retryhandler - DEBUG - No retry needed.
    2016-03-22 01:07:47,152 - MainThread - botocore.hooks - DEBUG - Event after-call.s3.HeadObject: calling handler &lt;function enhance_error_msg at 0x7f4211085758&gt;
    2016-03-22 01:07:47,152 - MainThread - botocore.hooks - DEBUG - Event after-call.s3.HeadObject: calling handler &lt;awscli.errorhandler.ErrorHandler object at 0x7f421100cc90&gt;
    2016-03-22 01:07:47,152 - MainThread - awscli.errorhandler - DEBUG - HTTP Response Code: 403
    2016-03-22 01:07:47,152 - MainThread - awscli.customizations.s3.s3handler - DEBUG - Exception caught during task execution: A client error (403) occurred when calling the HeadObject operation: Forbidden
    Traceback (most recent call last):
      File &quot;/usr/local/lib/python2.7/site-packages/awscli/customizations/s3/s3handler.py&quot;, line 100, in call
        total_files, total_parts = self._enqueue_tasks(files)
      File &quot;/usr/local/lib/python2.7/site-packages/awscli/customizations/s3/s3handler.py&quot;, line 178, in _enqueue_tasks
        for filename in files:
      File &quot;/usr/local/lib/python2.7/site-packages/awscli/customizations/s3/fileinfobuilder.py&quot;, line 31, in call
        for file_base in files:
      File &quot;/usr/local/lib/python2.7/site-packages/awscli/customizations/s3/filegenerator.py&quot;, line 142, in call
        for src_path, extra_information in file_iterator:
      File &quot;/usr/local/lib/python2.7/site-packages/awscli/customizations/s3/filegenerator.py&quot;, line 314, in list_objects
        yield self._list_single_object(s3_path)
      File &quot;/usr/local/lib/python2.7/site-packages/awscli/customizations/s3/filegenerator.py&quot;, line 343, in _list_single_object
        response = self._client.head_object(**params)
      File &quot;/usr/local/lib/python2.7/site-packages/botocore/client.py&quot;, line 228, in _api_call
        return self._make_api_call(operation_name, kwargs)
      File &quot;/usr/local/lib/python2.7/site-packages/botocore/client.py&quot;, line 488, in _make_api_call
        model=operation_model, context=request_context
      File &quot;/usr/local/lib/python2.7/site-packages/botocore/hooks.py&quot;, line 226, in emit
        return self._emit(event_name, kwargs)
      File &quot;/usr/local/lib/python2.7/site-packages/botocore/hooks.py&quot;, line 209, in _emit
        response = handler(**kwargs)
      File &quot;/usr/local/lib/python2.7/site-packages/awscli/errorhandler.py&quot;, line 70, in __call__
        http_status_code=http_response.status_code)
    ClientError: A client error (403) occurred when calling the HeadObject operation: Forbidden
    2016-03-22 01:07:47,153 - Thread-1 - awscli.customizations.s3.executor - DEBUG - Received print task: PrintTask(message=&#39;A client error (403) occurred when calling the HeadObject operation: Forbidden&#39;, error=True, total_parts=None, warning=None)
    A client error (403) occurred when calling the HeadObject operation: Forbidden

However, when I run it with the `--no-sign-request` option, it works perfectly:

     aws --debug --no-sign-request s3 cp s3://aws-codedeploy-us-west-2/latest/codedeploy-agent.noarch.rpm .

 Can someone please explain what is going on?

AWS CLI S3 A client error (403) occurred when calling the HeadObject operation: Forbidden

I created a new Access Key and configured that in the AWS CLI with `aws configure`. It created the `.ini` file in `~/.aws/config`. When I run `aws s3 ls` it gives:

&gt; A client error (InvalidAccessKeyId) occurred when calling the ListBuckets operation: The AWS Access Key Id you provided does not exist in our records.

`AmazonS3FullAccess` policy is also attached to the user. How to fix this? 
 

The AWS Access Key Id does not exist in our records

I am using the aws cli to list the files in an s3 bucket using the following command ([documentation][1]):

    aws s3 ls s3://mybucket --recursive --human-readable --summarize

This command gives me the following output:

    2013-09-02 21:37:53   10 Bytes a.txt
    2013-09-02 21:37:53  2.9 MiB foo.zip
    2013-09-02 21:32:57   23 Bytes foo/bar/.baz/a
    2013-09-02 21:32:58   41 Bytes foo/bar/.baz/b
    2013-09-02 21:32:57  281 Bytes foo/bar/.baz/c
    2013-09-02 21:32:57   73 Bytes foo/bar/.baz/d
    2013-09-02 21:32:57  452 Bytes foo/bar/.baz/e
    2013-09-02 21:32:57  896 Bytes foo/bar/.baz/hooks/bar
    2013-09-02 21:32:57  189 Bytes foo/bar/.baz/hooks/foo
    2013-09-02 21:32:57  398 Bytes z.txt
    
    Total Objects: 10
       Total Size: 2.9 MiB

However, this is my desired output:

    a.txt
    foo.zip
    foo/bar/.baz/a
    foo/bar/.baz/b
    foo/bar/.baz/c
    foo/bar/.baz/d
    foo/bar/.baz/e
    foo/bar/.baz/hooks/bar
    foo/bar/.baz/hooks/foo
    z.txt

 

How can I omit the date, time and file size in order to show only the file list?

  [1]: http://docs.aws.amazon.com/cli/latest/reference/s3/ls.html

How to display only files from aws s3 ls command?

I can view the log using the following command.

    aws logs get-log-events --log-group-name groupName --log-stream-name streamName --limit 100

what is the command to get feature like `tail -f` so that i can see the log real time


how to view aws log real time (like tail -f)

Is it possible to get the ARN of an S3 bucket via the AWS command line?

I have looked through the documentation for `aws s3api ...` and `aws s3 ...` and have not found a way to do this. 

Get ARN of S3 Bucket with aws cli

I have deleted the [AWS credentials](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-files.html) in `sudo nano ~/.aws/config`. But, the credentials are still in [`aws configure`](https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-configure.html). Is there a way to reset `aws configure` with clear state?

How Do I Clear The Credentials In AWS Configure?

For AWS CLI configuration and credentials files how do you comment out lines in these files - I checked the documentation here http://docs.aws.amazon.com/cli/latest/userguide/cli-chap-getting-started.html#cli-config-files but found nothing.

e.g.

~/.aws/credentials

    [default]
    aws_access_key_id = XXXXXXXXX
    aws_secret_access_key = YYYYYYYY
    
    [qa]
    aws_access_key_id = AAAAAAAAA
    aws_secret_access_key = BBBBBB


~/.aws/config

    [default]
    region = us-east-1
    
    [profile qa]
    region = us-west-2
    
    [profile staging]
    region = us-east-2



How do you comment out lines in AWS CLI config and credentials files?

Most of the time it happens that we load files in a common S3 bucket due to which it becomes hard to figure out data in it.

How can I view objects uploaded on a particular date?

How list Amazon S3 bucket contents by modified date?

I&#39;ve tried to follow AWS instructions on setting ECR authorization to my user by giving the `AmazonEC2ContainerRegistryFullAccess` policy to my user.

However when I try to run on my PC the `aws ecr get-login` I get an error that I don&#39;t have permission.

    An error occurred (AccessDeniedException) when calling the GetAuthorizationToken operation: User: arn:aws:iam::ACCOUNT_NUMBER:user/MY_USER is not authorized to perform: ecr:GetAuthorizationToken on resource: *

What have I done wrong ?

AWS ECR GetAuthorizationToken

I am using the below to get the [stack information][1] I want via AWS Cli:

    aws cloudformation --region ap-southeast-2 describe-stacks --stack-name mystack

It&#39;s returning result OK:

    {
        &quot;Stacks&quot;: [
            {
                &quot;StackId&quot;: &quot;arn:aws:mystackid&quot;, 
                &quot;LastUpdatedTime&quot;: &quot;2017-01-13T04:59:17.472Z&quot;, 
                &quot;Tags&quot;: [], 
                &quot;Outputs&quot;: [
                    {
                        &quot;OutputKey&quot;: &quot;Ec2Sg&quot;, 
                        &quot;OutputValue&quot;: &quot;sg-97e13dff&quot;
                    }, 
                    {
                        &quot;OutputKey&quot;: &quot;DbUrl&quot;, 
                        &quot;OutputValue&quot;: &quot;myUrl&quot;
                    }
                ], 
                &quot;CreationTime&quot;: &quot;2017-01-13T03:27:18.893Z&quot;, 
                &quot;StackName&quot;: &quot;mystack&quot;, 
                &quot;NotificationARNs&quot;: [], 
                &quot;StackStatus&quot;: &quot;UPDATE_ROLLBACK_COMPLETE&quot;, 
                &quot;DisableRollback&quot;: false
            }
        ]
    }

But I do not know how to return only the value of OutputValue which is myUrl

As I do not need the rest, just myUrl.

Is that possible via aws cloudformation describe-stacks?

**Edit**

I just realize I can use --[query][2]:

    --query &quot;Stacks[0].Outputs[1].OutputValue&quot;

will get exactly what I want but I would like to use DbUrl else if the number of Outputs changes, my result will be unexpected.


  [1]: http://docs.aws.amazon.com/cli/latest/reference/cloudformation/describe-stacks.html
  [2]: http://docs.aws.amazon.com/cli/latest/userguide/controlling-output.html

Getting Outputs from aws cloudformation describe-stacks

I&#39;m trying to push a docker image to the AWS ECR repository using the aws-cli.

 - I just run the `get-login` command
 - execute the output (which returns `login succeeded`) 
 - then try to push a docker image then I get the
   message:  
`denied: Your Authorization Token has expired. Please run
   &#39;aws ecr get-login&#39; to fetch a new one.`

I don&#39;t know whats going wrong,  I&#39;m pushing to the right repo, the time on my mac is correct. 
This was working before, but since I reinstalled my mac and upgraded to macOS Sierra it&#39;s not working anymore, so probably related to that.

My `aws --version` output:

`aws-cli/1.11.34 Python/2.7.10 Darwin/16.3.0 botocore/1.4.91`

The complete output of the commands I run:

    $ aws ecr get-login --region eu-west-1
    docker login -u AWS -p AQECAHh....b6Wk -e none https://1234567890.dkr.ecr.eu-west-1.amazonaws.com
    $ docker login -u AWS -p AQECAHh....b6Wk -e none https://1234567890.dkr.ecr.eu-west-1.amazonaws.com
    Flag --email has been deprecated, will be removed in 1.13.
    Login Succeeded
    $ docker push 1234567890.dkr.ecr.eu-west-1.amazonaws.com/service-web:latest
    The push refers to a repository [1234567890.dkr.ecr.eu-west-1.amazonaws.com/service-web]
    c1f87971dfa9: Preparing 
    2eb644aea3de: Preparing 
    9c8843ffe48e: Preparing 
    39bb58d049d4: Preparing 
    f053bc969599: Preparing 
    7169084246b8: Waiting 
    bb134a1936fd: Waiting 
    184e76848a1c: Waiting 
    75c8fcf65748: Waiting 
    eb9b9ee1ea58: Waiting 
    f4bf35723edd: Waiting 
    ddffe1a64b3c: Waiting 
    fd1a1154db16: Waiting 
    b542e946067a: Waiting 
    d49ed2a5e1ed: Waiting 
    bb39b980367a: Waiting 
    25b8358d062f: Waiting 
    997eee521fc7: Waiting 
    50b5447183a8: Waiting 
    4339b5cb0e1d: Waiting 
    3dbd4a53b21b: Waiting 
    2bec16216500: Waiting 
    b9fd8e264df6: Waiting 
    b6ca02dfe5e6: Waiting 
    denied: Your Authorization Token has expired. Please run &#39;aws ecr get-login&#39; to fetch a new one.



`Authorization Token has expired` issue AWS-CLI on MacOS Sierra

I am trying out a simple example suggested by AWS documentation to create a role using a policy json file
http://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_create_for-service.html
And I get the error

    A client error (MalformedPolicyDocument) occurred when calling the CreateRole operation: Has prohibited field Resource

Here&#39;s the command,

    &gt;&gt; aws iam create-role --role-name test-service-role --assume-role-policy-document file:///home/ec2-user/policy.json
    A client error (MalformedPolicyDocument) occurred when calling the CreateRole operation: Has prohibited field Resource

The policy is the exact same as the one mentioned in the example

    &gt;&gt; cat policy.json 
    {
      &quot;Version&quot;: &quot;2012-10-17&quot;,
      &quot;Statement&quot;: {
        &quot;Effect&quot;: &quot;Allow&quot;,
        &quot;Action&quot;: &quot;s3:ListBucket&quot;,
        &quot;Resource&quot;: &quot;arn:aws:s3:::example_bucket&quot;
      }
    }

My version seems to be up to date

    &gt;&gt; aws --version
    aws-cli/1.9.9 Python/2.7.10 Linux/4.1.10-17.31.amzn1.x86_64 botocore/1.3.9

AWS create role - Has prohibited field

I tried to follow this [tutorial][1]. 

This is what I did in the console:

    pip3 install --user --upgrade awscli

after that, when I write: 

    pip3 --version

I&#39;m getting:

    pip 9.0.1 from /Users/user/Library/Python/3.4/lib/python/site-packages (python 3.4)

then I wrote:

    pip3 install --user --upgrade awscli

this command downloaded `awscli` and automatically added this:

    # Setting PATH for Python 3.4
    # The orginal version is saved in .profile.pysave
    PATH=&quot;/Library/Frameworks/Python.framework/Versions/3.4/bin:${PATH}&quot;
    export PATH

to my `.profile`

Later on, just to be sure, I wrote:

    source ~/.profile

and then when I type:

    user$ aws
    -bash: aws: command not found

I restarted the terminal with no luck also. 

What&#39;s the problem here?


  [1]: http://docs.aws.amazon.com/cli/latest/userguide/cli-install-macos.html

I cannot install aws cli on mac os with pip - awscli: command not found

I am trying to embed access and secret key along with aws cli. e.g.

    aws ec2 describe-instances --aws-access-key &lt;access_key&gt; --aws-secret-key &lt;secret_key&gt;

Also tried with -o and -w options for access and secret key respectively. It says : Unknown option aws-access-key and aws-secret-key

passing access and secret key aws cli

I am trying to install awscli using pip3 on Linux Mint 17.2 Rafaela.

I am getting the error:

    Traceback (most recent call last):
      File &quot;/home/jonathan/.local/bin/aws&quot;, line 19, in &lt;module&gt;
        import awscli.clidriver
    ImportError: No module named &#39;awscli&#39;

These are the steps I am taking, following the aws installation guide:

    sudo pip install awscli --upgrade --user

everything seems to install fine.

adding to my .bashrc

    export PATH=~/.local/bin:$PATH

then

    source ~/.bashrc

then i try the command

    aws --version

and i get

    Traceback (most recent call last):
      File &quot;/home/jonathan/.local/bin/aws&quot;, line 19, in &lt;module&gt;
        import awscli.clidriver
    ImportError: No module named &#39;awscli&#39;


Can anyone help with this?

EDIT: For anyone visiting this question. There is no way I can test any of these answers because I have since removed this OS and installed Ubuntu. Also I have no need for awscli anymore.

awscli fails to work: No module named &#39;awscli&#39;

Updated answer (7/10/2021): For AWS CLI v1, do this:

```bash
export AWS_DEFAULT_PROFILE=user2
```

For AWS CLI v2, the following will work:

```bash
export AWS_PROFILE=user2
```

The full question is below for context:

----------

(1.) After successfully configuring a second profile for the AWS CLI, I unsuccessfully tried to set the profile to user2 in my bash session with the following command:

    export AWS_PROFILE=user2

... per the advice here: https://docs.aws.amazon.com/cli/latest/userguide/cli-multiple-profiles.html

(2.) The following command works: 

```bash
aws s3 ls --profile user2
```

So I know that the AWS CLI and the user2 profile are both working on my computer.

(3.) However, when I subsequently (that is, after entering &quot;export AWS_PROFILE=user2&quot;) try something like:

```bash
aws s3 ls
```

... AWS&#39;s response assumes that I want to query it as the default user (NOT user2)

(4.) So the only way I can use the user2 profile from the command line is by continuing to append &quot;--profile user2&quot; to every single command, which is tedious.


(5.)

```bash
echo $AWS_PROFILE
```

yields:

```bash
&gt;&gt; user2
```

, as expected.


Any idea what&#39;s going on here? I&#39;m sure I&#39;m making some dumb mistake somewhere.

How to temporarily switch profiles for AWS CLI?

I&#39;m installing aws-cli on a docker swarm manager node running alpine (Linux 0317632a4ad9 4.9.59-moby #1 SMP Thu Mar 1 20:54:00 UTC 2018 x86_64 Linux).  The aws-cli package for Alpine is currently listed in the community repo on the edge branch (1.18.55.r0).  I modified `/etc/apk/repositories` to target this repo.

The install blew up looking for py3-urllib3, but I got around that and finally got a clean install with no errors, as below:

      ~ $ sudo apk add aws-cli@edge-comm
        fetch http://dl-cdn.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz
        ERROR: unsatisfiable constraints:
          py3-urllib3-1.25.9-r0:
            masked in: @edge
            satisfies: py3-botocore-1.16.12-r0[py3-urllib3&lt;1.26]
    
        ~ $ sudo apk add py3-urllib3@edge aws-cli@edge-comm Installing aws-cli@edge-comm (1.18.55-r0)
        Executing busybox-1.26.2-r11.trigger
        OK: 576 MiB in 81 packages
   
The binary is created at /usr/bin/aws, but crashes looking for an awscli module:

    ~ $ aws
    Traceback (most recent call last):
      File &quot;/usr/bin/aws&quot;, line 19, in &lt;module&gt;
        import awscli.clidriver
    ModuleNotFoundError: No module named &#39;awscli&#39;

Thanks!


All Aws Cli Solutions on Gang of Coders

Total of 43 Aws Cli Solutions