The [boto][1] package is the hand-coded Python library that has been around since 2006.  It is very popular and is fully supported by AWS but because it is hand-coded and there are so many services available (with more appearing all the time) it is difficult to maintain.

So, [boto3][2] is a new version of the boto library based on [botocore][3].  All of the low-level interfaces to AWS are driven from JSON service descriptions that are generated automatically from the canonical descriptions of the services.  So, the interfaces are always correct and always up to date.  There is a resource layer on top of the client-layer that provides a nicer, more Pythonic interface.

The boto3 library is being actively developed by AWS and is the one I would recommend people use if they are starting new development.


  [1]: https://github.com/boto/boto
  [2]: https://github.com/boto/boto3
  [3]: https://github.com/boto/botocore

Boto is the Amazon Web Services (AWS) SDK for Python. It enables Python developers to create, configure, and manage AWS services, such as EC2 and S3.
while
Boto3 generates the client from a JSON service definition file. The client’s methods support every single type of interaction with the target AWS service. Resources, on the other hand, are generated from JSON resource definition files. Boto3 generates the client and the resource from different definitions

In my application, I have to set a large icon for a notification.
LargeIcon must be a Bitmap, and my drawables are vector images (the new feature in Android, see [this link][1])
The problem is when I try to decode a resource that is a vector image, I get a null returned.

Here is the sample of code :

    if (BitmapFactory.decodeResource(arg0.getResources(), R.drawable.vector_menu_objectifs) == null)
			Log.d(&quot;ISNULL&quot;, &quot;NULL&quot;);
		else
			Log.d(&quot;ISNULL&quot;, &quot;NOT NULL&quot;);
In this sample, when I replace R.drawable.vector_menu_objectifs with a &quot;normal&quot; image, a png for exemple, the result is not null (I get the correct bitmap)
Is there something I&#39;m missing?


  [1]: http://developer.android.com/training/material/drawables.html#VectorDrawables

Getting Bitmap from vector drawable


What do you recommend guys for this error when I type in console `ipython notebook` and got 

&gt; ImportError: No module named notebook.notebookapp 

?

I installed ipython notebook with pip and really I don&#39;t know what is going on. 

ImportError: No module named notebook.notebookapp

I&#39;m new to AWS using Python and I&#39;m trying to learn the boto API however I noticed that there are two major versions/packages for Python.  That would be boto and boto3.

What is the difference between the AWS boto and boto3 libraries?

What is the difference between the AWS boto and boto3

<p>I'm new to AWS using Python and I'm trying to learn the boto API however I noticed that there are two major versions/packages for Python.  That would be boto and boto3.</p>
<p>What is the difference between the AWS boto and boto3 libraries?</p>


I have loaded a data file into a Python pandas dataframe. I has a datetime column of the format `2015-07-18 13:53:33.280`. 

What I need to do is create a new column that rounds this out to its nearest quarter hour. So, the date above will be rounded to `2015-07-18 13:45:00.000`.

How do I do this in pandas? I tried using the solution from [here][1], but get an `&#39;Series&#39; object has no attribute &#39;year&#39;` error. 


  [1]: https://stackoverflow.com/questions/24831018/python-how-can-i-round-a-datetime-object-to-the-most-recent-previous-quarter-h

How do I round datetime column to nearest quarter hour

I would like to include image in a jupyter notebook.

If I did the following, it works :

    from IPython.display import Image
    Image(&quot;img/picture.png&quot;)

But I would like to include the images in a markdown cell and the following code gives a 404 error :

    ![title](&quot;img/picture.png&quot;)

I also tried

    ![texte](&quot;http://localhost:8888/img/picture.png&quot;)

But I still get the same error :

    404 GET /notebooks/%22/home/user/folder/img/picture.png%22 (127.0.0.1) 2.74ms referer=http://localhost:8888/notebooks/notebook.ipynb
    

How to embed image or picture in jupyter notebook, either from a local machine or from a web resource?

I&#39;ve read loads of SO answers but can&#39;t find a clear solution.

I have this data in a df called `day1` which represents hours:

    1    10:53
    2    12:17
    3    14:46
    4    16:36
    5    18:39
    6    20:31
    7    22:28
    Name: time, dtype: object&gt;

I want to convert it into a time format. But when I do this:

`day1.time = pd.to_datetime(day1.time, format=&#39;H%:M%&#39;)`

The result includes today&#39;s date:

    1   2015-09-03 10:53:00
    2   2015-09-03 12:17:00
    3   2015-09-03 14:46:00
    4   2015-09-03 16:36:00
    5   2015-09-03 18:39:00
    6   2015-09-03 20:31:00
    7   2015-09-03 22:28:00
    Name: time, dtype: datetime64[ns]&gt;

It seems the `format` argument isn&#39;t working - how do I get the time as shown here without the date?

--------------

**Update**

The following formats the time correctly, but somehow the column is still an object type. Why doesn&#39;t it convert to `datetime64`?

`day1[&#39;time&#39;] = pd.to_datetime(day1[&#39;time&#39;], format=&#39;%H:%M&#39;).dt.time`

    1    10:53:00
    2    12:17:00
    3    14:46:00
    4    16:36:00
    5    18:39:00
    6    20:31:00
    7    22:28:00
    Name: time, dtype: object&gt;

Pandas - convert strings to time without date

When I run `pip freeze &gt; requirements.txt` it seems to include all installed packages. This **appears** to be the documented behavior.

I have, however, done something wrong as this now includes things like Django in projects that have no business with Django.

How do I get requirements for just this project? or in the future how do I install a package with `pip` to be used for this project. I think I missed something about a `virtualenv`.

Pip freeze for only project requirements

I&#39;m trying to read a csv-file from given URL, using Python 3.x: 

    import pandas as pd
    import requests
    
    url = &quot;https://github.com/cs109/2014_data/blob/master/countries.csv&quot;
    s = requests.get(url).content
    c = pd.read_csv(s)

I have the following error

&gt;&quot;Expected file path name or file-like object, got &lt;class &#39;bytes&#39;&gt; type&quot;

How can I fix this? I&#39;m using Python 3.4

Pandas read_csv from url

How to exclude multiple folders while using aws s3 syn ?

I tried :

```
    # aws s3 sync s3://inksedge-app-file-storage-bucket-prod-env \ 
                  s3://inksedge-app-file-storage-bucket-test-env \
                  --exclude &#39;reportTemplate/* orders/* customers/*&#39;
```

But still it&#39;s doing sync for folder &quot;customer&quot;

Output :

```
    copy: s3://inksedge-app-file-storage-bucket-prod-env/customers/116/miniimages/IMG_4800.jpg
       to s3://inksedge-app-file-storage-bucket-test-env/customers/116/miniimages/IMG_4800.jpg

    copy: s3://inksedge-app-file-storage-bucket-prod-env/customers/116/miniimages/DSC_0358.JPG
       to s3://inksedge-app-file-storage-bucket-test-env/customers/116/miniimages/DSC_0358.JPG
```


Exclude multiple folders using AWS S3 sync

I&#39;m trying to rename a file in my s3 bucket using python boto3, I couldn&#39;t clearly understand the arguments. can someone help me here?

What I&#39;m planing is to copy object to a new object, and then delete the actual object.

I found similar questions here, but I need a solution using boto3.

Boto3/S3: Renaming an object using copy_object

I am trying to create a table to store invoice line items in DynamoDB. Let&#39;s say the item is defined by `CompanyCode`, `InvoiceNumber` and `LineItemId`, amount and other line item details. 

A unique item is defined by the combination of the first 3 attributes. Any 2 of those attributes can be same for the different items. What should I select as the Hash Attribute and the Range Attribute? 

3 fields composite primary key (unique item) in Dynamodb

Is it better to have multiple s3 buckets per category of uploads or one bucket with sub folders OR a linked s3 bucket? I know for sure there will be more user-images than there will be profille-pics and that there is a 5TB limit per bucket and 100 buckets per account. I&#39;m doing this using aws boto library and https://github.com/amol-/depot

Which is the  structure my folders in which of the following manner?


	/app_bucket
	    /profile-pic-folder
	    /user-images-folder

	OR

	profile-pic-bucket
	user-images-bucket


    OR
 

    /app_bucket_1
    /app_bucket_2


The last one implies that its really a 10TB bucket where a new bucket is created when the files within bucket_1 exceeds 5TB. But all uploads will be read as if in one bucket. Or is there a better way of doing what I&#39;m trying to do? Many thanks!

I&#39;m not sure if this is correct... 100 buckets per account? 

https://www.reddit.com/r/aws/comments/28vbjs/requesting_increase_in_number_of_s3_buckets/

Is it better to have multiple s3 buckets or one bucket with sub folders?

I&#39;m using **AWS Lambda** to scan data from a **DynamoDB** table. This is what I get in return:

    {
      &quot;videos&quot;: [
        {
          &quot;file&quot;: {
            &quot;S&quot;: &quot;file1.mp4&quot;
          },
          &quot;id&quot;: {
            &quot;S&quot;: &quot;1&quot;
          },
          &quot;canvas&quot;: {
            &quot;S&quot;: &quot;This is Canvas1&quot;
          }
        },
        {
          &quot;file&quot;: {
            &quot;S&quot;: &quot;main.mp4&quot;
          },
          &quot;id&quot;: {
            &quot;S&quot;: &quot;0&quot;
          },
          &quot;canvas&quot;: {
            &quot;S&quot;: &quot;this is a canvas&quot;
          }
        }
      ]
    }

My front-end application is using **Ember Data Rest Adapter** which does not accepts such response. Is there any way I can get normal JSON format? There is this NPM module called `dynamodb-marshaler` to convert DynamoDB data to normal JSON. I&#39;m looking for a **native solution** if possible. 


Formatting DynamoDB data to normal JSON in AWS Lambda

I am trying to figure how to do proper error handling with boto3.

I am trying to create an IAM user:

    def create_user(username, iam_conn):
        try:
            user = iam_conn.create_user(UserName=username)
            return user
        except Exception as e:
            return e

When the call to create_user succeeds, I get a neat object that contains the http status code of the API call and the data of the newly created user.

Example:

    {&#39;ResponseMetadata&#39;: 
          {&#39;HTTPStatusCode&#39;: 200, 
           &#39;RequestId&#39;: &#39;omitted&#39;
          },
     u&#39;User&#39;: {u&#39;Arn&#39;: &#39;arn:aws:iam::omitted:user/omitted&#39;,
               u&#39;CreateDate&#39;: datetime.datetime(2015, 10, 11, 17, 13, 5, 882000, tzinfo=tzutc()),
               u&#39;Path&#39;: &#39;/&#39;,
               u&#39;UserId&#39;: &#39;omitted&#39;,
               u&#39;UserName&#39;: &#39;omitted&#39;
              }
    }

 This works great. But when this fails (like if the user already exists), I just get an object of type botocore.exceptions.ClientError with only text to tell me what went wrong.

Example:
ClientError(&#39;An error occurred (EntityAlreadyExists) when calling the CreateUser operation: User with name omitted already exists.&#39;,)

This (AFAIK) makes error handling very hard because I can&#39;t just switch on the resulting http status code (409 for user already exists according to the AWS API docs for IAM). This makes me think that I must be doing something the wrong way. The optimal way would be for boto3 to never throw exceptions, but juts always return an object that reflects how the API call went.

Can anyone enlighten me on this issue or point me in the right direction?

How to handle errors with boto3?

When I simply run the following code, I always gets this error.

   

    s3 = boto3.resource(&#39;s3&#39;)
    bucket_name = &quot;python-sdk-sample-%s&quot; % uuid.uuid4()
    print(&quot;Creating new bucket with name:&quot;, bucket_name)
    s3.create_bucket(Bucket=bucket_name)


I have saved my credential file in 

 `C:\Users\myname\.aws\credentials`, from where Boto should read my credentials.

Is my setting wrong?

Here is the output from `boto3.set_stream_logger(&#39;botocore&#39;, level=&#39;DEBUG&#39;)`.


    2015-10-24 14:22:28,761 botocore.credentials [DEBUG] Skipping environment variable credential check because profile name was explicitly set.
    2015-10-24 14:22:28,761 botocore.credentials [DEBUG] Looking for credentials via: env
    2015-10-24 14:22:28,773 botocore.credentials [DEBUG] Looking for credentials via: shared-credentials-file
    2015-10-24 14:22:28,774 botocore.credentials [DEBUG] Looking for credentials via: config-file
    2015-10-24 14:22:28,774 botocore.credentials [DEBUG] Looking for credentials via: ec2-credentials-file
    2015-10-24 14:22:28,774 botocore.credentials [DEBUG] Looking for credentials via: boto-config
    2015-10-24 14:22:28,774 botocore.credentials [DEBUG] Looking for credentials via: iam-role

Boto3 Error: botocore.exceptions.NoCredentialsError: Unable to locate credentials

I&#39;m getting the error &quot;The role defined for the function cannot be assumed by Lambda&quot; when I&#39;m trying to create a lambda function with create-function command.

&gt;    aws lambda create-function  
&gt; --region us-west-2  
&gt; --function-name HelloPython  
&gt; --zip-file fileb://hello_python.zip  
&gt; --role arn:aws:iam::my-acc-account-id:role/default   
&gt; --handler hello_python.my_handler  
&gt; --runtime python2.7  
&gt; --timeout 15  
&gt; --memory-size 512

The role defined for the function cannot be assumed by Lambda

How can I upload a file to [Google Cloud Storage](https://cloud.google.com/storage/) from Python 3? Eventually Python 2, if it&#39;s infeasible from Python 3.

I&#39;ve looked and looked, but haven&#39;t found a solution that actually works. I tried [boto](https://github.com/boto/boto), but when I try to generate the necessary .boto file through `gsutil config -e`, it keeps saying that I need to configure authentication through `gcloud auth login`. However, I have done the latter a number of times, without it helping.


How to upload a file to Google Cloud Storage on Python 3?

I need to get the [account-id][1] of the &#39;current user&#39; in a [`boto3`][2] script. Up to now my best solution is to parse the current user [arn][3]:

    &gt;&gt;&gt; import boto3
    &gt;&gt;&gt; account_id = boto3.resource(&#39;iam&#39;).CurrentUser().arn.split(&#39;:&#39;)[4]

but I was wondering if there is a more &#39;lightweight&#39; approach. In fact

    &gt;&gt;&gt; timeit.timeit(&quot;boto3.resource(&#39;iam&#39;).CurrentUser().arn&quot;,
    ... &#39;import boto3&#39;, number=10)
    4.8895583080002325

and I actually do not need the [`CurrentUser`][4] resource in my script.


  [1]: http://docs.aws.amazon.com/general/latest/gr/acct-identifiers.html
  [2]: http://boto3.readthedocs.org/en/latest/index.html
  [3]: http://docs.aws.amazon.com/general/latest/gr/aws-arns-and-namespaces.html#genref-arns
  [4]: https://boto3.readthedocs.org/en/latest/reference/services/iam.html#currentuser

getting the current user account-id in boto3

I am using the Boto 3 python library, and want to connect to AWS CloudFront.
I need to specify the correct AWS Profile (AWS Credentials), but looking at the official documentation, I see no way to specify it.

I am initializing the client using the code:
`client = boto3.client(&#39;cloudfront&#39;)`

However, this results in it using the default profile to connect.
I couldn&#39;t find a method where I can specify which profile to use.


Content Type	Original Author	Original Content on Stackoverflow
Question	Matt	View Question on Stackoverflow
Solution 1 - Python	garnaat	View Answer on Stackoverflow
Solution 2 - Python	Peters Monday	View Answer on Stackoverflow

What is the difference between the AWS boto and boto3

Python Problem Overview

Python Solutions

Solution 1 - Python

Solution 2 - Python

ImportError: No module named notebook.notebookapp

Getting Bitmap from vector drawable

Attributions