TypeError: the JSON object must be str, not 'bytes'

PythonJson

Python Problem Overview


I have the following, very basic code that throws; TypeError: the JSON object must be str, not 'bytes'

import requests
import json

url = 'my url'
user = 'my user'
pwd = 'my password'

response = requests.get(url, auth=(user, pwd))

if(myResponse.ok):
    Data = json.loads(myResponse.content)

I try to set decode to the Data variable, as follows but it throws the same error; jData = json.loads(myResponse.content).decode('utf-8')

Any suggestions?

Python Solutions


Solution 1 - Python

json.loads(myResponse.content.decode('utf-8'))

You just put it in the wrong order, innocent mistake.


(In-depth answer). As courteously pointed out by wim, in some rare cases, they could opt for UTF-16 or UTF-32. These cases will be less common as the developers, in that scenario would be consciously deciding to throw away valuable bandwidth. So, if you run into encoding issues, you can change utf-8 to 16, 32, etc.

There are a couple of solutions for this. You could use request's built-in .json() function:

myResponse.json()

Or, you could opt for character detection via chardet. Chardet is a library developed based on a study. The library has one function: detect. Detect can detect most common encodings and then use them to encode your string with.

import chardet
json.loads(myResponse.content.decode(chardet.detect(myResponse.content)["encoding"]))

Solution 2 - Python

Let requests decode it for you:

data = response.json()

This will check headers (Content-Type) and response encoding, auto-detecting how to decode the content correctly.

Solution 3 - Python

python3.6+ does this automatically.so your code shouldn't return error in python3.6+

what's new in python3.6

Attributions

All content for this solution is sourced from the original question on Stackoverflow.

The content on this page is licensed under the Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license.

Content TypeOriginal AuthorOriginal Content on Stackoverflow
QuestionFunnyChefView Question on Stackoverflow
Solution 1 - PythonNeilView Answer on Stackoverflow
Solution 2 - PythonwimView Answer on Stackoverflow
Solution 3 - PythonSuraj ShresthaView Answer on Stackoverflow