Any thoughts on why this isn&#39;t working?  I really thought &#39;ignore&#39; would do the right thing.

    &gt;&gt;&gt; &#39;add \x93Monitoring\x93 to list &#39;.encode(&#39;latin-1&#39;,&#39;ignore&#39;)
    Traceback (most recent call last):
      File &quot;&lt;interactive input&gt;&quot;, line 1, in ?
    UnicodeDecodeError: &#39;ascii&#39; codec can&#39;t decode byte 0x93 in position 4: ordinal not in range(128)

Python UnicodeDecodeError - Am I misunderstanding encode?

How to write a Base64-encoded image to file?

I have encoded an image to a string using Base64.
First, I read the file, then convert it to a byte array and then apply Base64 encoding to convert the image to a string.

Now my problem is how to decode it.

    byte dearr[] = Base64.decodeBase64(crntImage);
    File outF = new File(&quot;c:/decode/abc.bmp&quot;);
    BufferedImage img02 = ImageIO.write(img02, &quot;bmp&quot;, outF); 

The variable `crntImage` contains the string representation of the image.


Write Base64-encoded image to file

I have a big amount of files and parser. What I Have to do is strip all non utf-8 symbols and put data in mongodb. 
Currently I have code like this. 

    with open(fname, &quot;r&quot;) as fp:
        for line in fp:
            line = line.strip()
            line = line.decode(&#39;utf-8&#39;, &#39;ignore&#39;)
            line = line.encode(&#39;utf-8&#39;, &#39;ignore&#39;)

somehow I still get an error

    bson.errors.InvalidStringData: strings in documents must be valid UTF-8: 
    1/b62010montecassianomcir\xe2\x86\x90ta0\xe2\x86\x90008923304320733/290066010401040101506055soccorin

 
I don&#39;t get it. Is there some simple way to do it? 


**UPD**: seems like Python and Mongo don&#39;t agree about definition of Utf-8 Valid string.

Delete every non utf-8 symbols from string

I want to encode objects in JSON. But, I can not figure out how to make the output without the string escaping.

    import json
    
    class Abc:
    	def __init__(self):
    		self.name=&quot;abc name&quot;
    	def toJSON(self):
    		return json.dumps(self.__dict__, cls=ComplexEncoder)
    
    class Doc:
    	def __init__(self):
    		self.abc=Abc()
    	def toJSON(self):
    		return json.dumps(self.__dict__, cls=ComplexEncoder)
    
    class ComplexEncoder(json.JSONEncoder):
    	def default(self, obj):
    		if isinstance(obj, Abc) or isinstance(obj, Doc):
    			return obj.toJSON()
    		else:
    			return json.JSONEncoder.default(self, obj)
    
    doc=Doc()
    print doc.toJSON()

 
The result is (the dumps returns a string representation, that&#39;s why the &quot; are escaped)

    {&quot;abc&quot;: &quot;{\&quot;name\&quot;: \&quot;abc name\&quot;}&quot;}

I want something a little bit different. The expected result is

    {&quot;abc&quot;: {&quot;name&quot;: &quot;abc name&quot;}&quot;}

But I don&#39;t see how to...
Any hint ?

thanks in advance.



Encoding nested python object in JSON

I&#39;m trying to encode a string that&#39;s pretty complex, so that I can include it in a mailto:

Component:

    &lt;a href=&quot;mailto:test@example.com?subject=&#39;Hello&#39;&amp;{{body}}&quot;&gt;


TS: 

    import { HttpParameterCodec } from &quot;@angular/common/http&quot;;
    
    let body = encodeValue(&#39;This is the example body\nIt has line breaks and bullets\n\u2022bullet one\n\u2022bullet two\n\u2022bullet three&#39;)

When I try to use encodeValue, I get &quot;cannot find name encodeValue.

How would be best to url-encode body?



Encode string for URL (angular)

I&#39;ve heard people talking about &quot;base 64 encoding&quot; here and there.  What is it used for?



What is base 64 encoding used for?

How do you create integers 0..9 and math operators + - * / in to  binary strings.
For example:

     0 = 0000,
     1 = 0001, 
     ...
     9 = 1001

Is there a way to do this with Ruby 1.8.6 without using a library?

How to convert a string or integer to binary in Ruby?

The inbuilt Base64 library in Ruby is adding some &#39;\n&#39;s. I&#39;m unable to find out the reason. For this special example:

    irb(main):001:0&gt; require &#39;rubygems&#39;
    =&gt; true
    irb(main):002:0&gt; require &#39;base64&#39;
    =&gt; true
    irb(main):003:0&gt; str =  &quot;1110--ad6ca0b06e1fbeb7e6518a0418a73a6e04a67054&quot;
    =&gt; &quot;1110--ad6ca0b06e1fbeb7e6518a0418a73a6e04a67054&quot;
    irb(main):004:0&gt; Base64.encode64(str)
    =&gt; &quot;MTExMC0tYWQ2Y2EwYjA2ZTFmYmViN2U2NTE4YTA0MThhNzNhNmUwNGE2NzA1\nNA==\n&quot;

The \n&#39;s are at the last and 6th position from end. The decoder (Base64.decode64) returns back the old string perfectly. Strange thing is, these \n&#39;s don&#39;t add any value to the encoded string. When I remove the newlines from the output string, the decoder decodes it again perfectly.

    irb(main):005:0&gt; Base64.decode64(Base64.encode64(str).gsub(&quot;\n&quot;, &#39;&#39;)) == str
    =&gt; true

More of this, I used an another JS library to produce the base64 encoded output of the same input string, the output comes without the \n&#39;s.

Is this a bug or anything else? Has anybody faced this issue before?

FYI,

    $ ruby -v
    ruby 1.8.7 (2008-08-11 patchlevel 72) [i486-linux]



Strange \n in base64 encoded string in Ruby

I am writing a Python (Python 3.3) program to send some data to a webpage using POST method.  Mostly for debugging process I am getting the page result and displaying it on the screen using `print()` function.

The code is like this:

    conn.request(&quot;POST&quot;, resource, params, headers)
    response = conn.getresponse()
    print(response.status, response.reason)
    data = response.read()
    print(data.decode(&#39;utf-8&#39;));

the `HTTPResponse` `.read()` method returns a `bytes` element encoding the page (which is a well formated UTF-8 document)  It seemed okay until I stopped using IDLE GUI for Windows and used the Windows console instead.  The returned page has a U+2014 character (em-dash) which the print function translates well in the Windows GUI (I presume Code Page 1252) but does not in the Windows Console (Code Page 850).  Given the `strict` default behavior I get the following error:

    UnicodeEncodeError: &#39;charmap&#39; codec can&#39;t encode character &#39;\u2014&#39; in position 10248: character maps to &lt;undefined&gt;

I could fix it using this quite ugly code:

    print(data.decode(&#39;utf-8&#39;).encode(&#39;cp850&#39;,&#39;replace&#39;).decode(&#39;cp850&#39;))

Now it replace the offending character &quot;—&quot; with a `?`.  Not the ideal case (a hyphen should be a better replacement) but good enough for my purpose.

There are several things I do not like from my solution.

 1. The code is ugly with all that decoding, encoding, and decoding.
 2. It solves the problem for just this case.  If I port the program for a system using some other encoding (latin-1, cp437, back to cp1252, etc.) it should recognize the target encoding.  It does not.  (for instance, when using again the IDLE GUI, the emdash is also lost, which didn&#39;t happen before)
 3. It would be nicer if the emdash translated to a hyphen instead of a interrogation bang.

The problem is not the emdash (I can think of several ways to solve that particularly problem) but I need to write robust code.  I am feeding the page with data from a database and that data can come back.  I can anticipate many other conflicting cases: an &#39;&#193;&#39; U+00c1 (which is possible in my database) could translate into CP-850 (DOS/Windows Console encodign for Western European Languages) but not into CP-437 (encoding for US English, which is default in many Windows instalations).

So, the question:

Is there a nicer solution that makes my code agnostic from the output interface encoding?

UnicodeEncodeError: &#39;charmap&#39; codec can&#39;t encode - character maps to &lt;undefined&gt;, print function

I want to encode a string into `base64` and transfer it through a socket and decode it back. 

But after decoding it gives different answer. 

Following is my code and result is &quot;77+9x6s=&quot;


    import javax.xml.bind.DatatypeConverter;
    
        public class f{
        
           public static void main(String a[]){
           
              String str = new String(DatatypeConverter.parseBase64Binary(&quot;user:123&quot;));
              String res = DatatypeConverter.printBase64Binary(str.getBytes());
              System.out.println(res);
           }
        }

Any idea about how to implement this?

Base64 Java encode and decode a string

I&#39;m working on making a URL shortener for my site, and my current plan (I&#39;m open to suggestions) is to use a node ID to generate the shortened URL. So, in theory, node 26 might be `short.com/z`, node 1 might be `short.com/a`, node 52 might be `short.com/Z`, and node 104 might be `short.com/ZZ`. When a user goes to that URL, I need to reverse the process (obviously).

I can think of some kludgy ways to go about this, but I&#39;m guessing there are better ones. Any suggestions?

Convert int to ASCII and back in Python

&gt; **Possible Duplicate:**  
&gt; [Pretty-Printing JSON with PHP](https://stackoverflow.com/questions/6054033/pretty-printing-json-with-php)  

&lt;!-- End of automatically inserted text --&gt;

I&#39;m working on a script that creates a JSON file. Right now I&#39;m just using `json_encode` (PHP 5.2.x) to encode an array into JSON output. Then I print the returned value to a file and save it. Problem is that the client wants to be able to open these JSON files for readability, so I&#39;d like to add line breaks in and &quot;pretty print&quot; the JSON output. Any ideas on how to do this? My only other alternative that I can see is to not use `json_encode` at all and just write the file contents manually and add in my own line breaks for each line.

Here&#39;s what I get:

    {&quot;product_name&quot;:&quot;prod1&quot;,&quot;val1&quot;:1,&quot;val2&quot;:8}

Here&#39;s what I want:

    {
      &quot;product_name&quot;:&quot;prod1&quot;,
      &quot;val1&quot;:1,
      &quot;val2&quot;:8
    }

I suppose I could also just replace every comma with a command followed by a \n, and same for the brackets... Thoughts?


PHP &quot;pretty print&quot; json_encode

How do you safely encode a URL using JavaScript such that it can be put into a GET string?

    var myUrl = &quot;http://example.com/index.html?param=1&amp;anotherParam=2&quot;;
    var myOtherUrl = &quot;http://example.com/index.html?url=&quot; + myUrl;

I assume that you need to encode the `myUrl` variable on that second line?


Encode URL in JavaScript?

I want to base64 encode data to put it in a URL and then decode it within my HttpHandler.

I have found that [Base64 Encoding](http://en.wikipedia.org/wiki/Base64) allows for a &#39;/&#39; character which will mess up my UriTemplate matching.  Then I found that there is a concept of a &quot;modified Base64 for URL&quot; from wikipedia:

A modified Base64 for URL variant exists, where no padding &#39;=&#39; will be used, and the &#39;+&#39; and &#39;/&#39; characters of standard Base64 are respectively replaced by &#39;-&#39; and &#39;_&#39;, so that using URL encoders/decoders is no longer necessary and has no impact on the length of the encoded value, leaving the same encoded form intact for use in relational databases, web forms, and object identifiers in general.

Using .NET I want to modify my current code from doing basic base64 encoding and decoding to using the &quot;modified base64 for URL&quot; method.  Has anyone done this?

To decode, I know it starts out with something like:

    string base64EncodedText = base64UrlEncodedText.Replace(&#39;-&#39;, &#39;+&#39;).Replace(&#39;_&#39;, &#39;/&#39;);

    // Append &#39;=&#39; char(s) if necessary - how best to do this?

    // My normal base64 decoding now uses encodedText

But, I need to potentially add one or two &#39;=&#39; chars to the end which looks a little more complex.

My encoding logic should be a little simpler:

    // Perform normal base64 encoding
    byte[] encodedBytes = Encoding.UTF8.GetBytes(unencodedText);
    string base64EncodedText = Convert.ToBase64String(encodedBytes);

    // Apply URL variant
    string base64UrlEncodedText = base64EncodedText.Replace(&quot;=&quot;, String.Empty).Replace(&#39;+&#39;, &#39;-&#39;).Replace(&#39;/&#39;, &#39;_&#39;);
    
I have seen the [Guid to Base64 for URL](https://stackoverflow.com/questions/1032376/guid-to-base64-for-url) StackOverflow entry, but that has a known length and therefore they can hardcode the number of equal signs needed at the end.

Code for decoding/encoding a modified base64 URL (in ASP.NET Framework)

I&#39;m reading and parsing an Amazon XML file and while the XML file shows a &#39; , when I try to print it I get the following error:

    &#39;ascii&#39; codec can&#39;t encode character u&#39;\u2019&#39; in position 16: ordinal not in range(128) 

From what I&#39;ve read online thus far, the error is coming from the fact that the XML file is in UTF-8, but Python wants to handle it as an ASCII encoded character. Is there a simple way to make the error go away and have my program print the XML as it reads?

Python Unicode Encode Error

I&#39;m POSTing the contents of a form field via AJAX to a PHP script and using JavaScript to `escape(field_contents)`.  The problem is that any plus signs are being stripped out and replaced by spaces.  How can I safely &#39;encode&#39; the plus sign and then appropriately &#39;decode&#39; it on the PHP side?

AJAX POST and Plus Sign ( + ) -- How to Encode?

Hi I&#39;d like to do the following:

    ??? unicode = U+1F60A
    String emoji = getEmojiByUnicode(unicode)
    String text = &quot;So happy &quot;
    textview.setText(text + emoji);
to get this in my textview:

&gt; So happy &#128522;

How can I implement `getEmojiByUnicode(unicode)`?

What type should the `unicode` variable be? (String, char, int?)

Please note that I do NOT want to use Drawables!





How to set emoji by unicode in a textview?

I have an untrusted string that I want to show as text in an HTML page. I need to escape the chars &#39;`&lt;`&#39; and &#39;`&amp;`&#39; as HTML entities.  The less fuss the better.

I&#39;m using UTF8 and don&#39;t need other entities for accented letters.

Is there a built-in function in Ruby or Rails, or should I roll my own?


How to HTML encode/escape a string? Is there a built-in?

Apparently jQuery has the ability to decode a given object or string into a JSON object. However, I have a JS object that I need to POST back to the server and I find no utility in jQuery that wraps the JSON.stringify() function. That function is found in Chrome, Safari 4, FF3.6, and IE8 but is not found in earlier browsers. I can use it natively in the browsers that support it, but otherwise am forced to fall back to using Crockford&#39;s JSON scripts.

Is there some built-in with jQuery that handles JSON encoding and decoding that takes the place of the Crockford scripts?

JSON stringify missing from jQuery 1.4.1?

I need to encode some data in the Base64 encoding in Java. How do I do that? What is the name of the class that provides a Base64 encoder?

---

I tried to use the `sun.misc.BASE64Encoder` class, without success. I have the following line of Java 7 code:

    wr.write(new sun.misc.BASE64Encoder().encode(buf));

I&#39;m using Eclipse. Eclipse marks this line as an error. I imported the required libraries:

    import sun.misc.BASE64Encoder;
    import sun.misc.BASE64Decoder;

But again, both of them are shown as errors. I found [a similar post here][1].

I used Apache Commons as the solution suggested by including:

    import org.apache.commons.*;

and importing the JAR files downloaded from: http://commons.apache.org/codec/

But the problem still exists. Eclipse still shows the errors previously mentioned. What should I do?

  [1]: https://stackoverflow.com/questions/5549464/import-sun-misc-base64encoder-got-error-in-eclipse



Encoding as Base64 in Java

I am trying to convert a Base64String to an image which needs to be saved locally.

At the moment, my code is able to save the image but when I open the saved image, it says &quot;Invalid Image&quot;.

![enter image description here][1]


  [1]: http://i.stack.imgur.com/s6aIa.png

Code:

    try
    {
        using (var imageFile = new StreamWriter(filePath))
        {
            imageFile.Write(resizeImage.Content);
            imageFile.Close();
        }
    }

The `Content` is a `string` object which contains the Base64 String.

C# Base64 String to JPEG Image

I&#39;m trying to upload an image to PingFM. Their [documentation][1] says:

    media – base64 encoded media data.

I can access this image via the URL. I tried (practically guessed) this:


    ActiveSupport::Base64.encode64(open(&quot;http://image.com/img.jpg&quot;))


But I get this error:

&lt;!-- language: lang-none --&gt;

    TypeError: can&#39;t convert Tempfile into String
    	from /usr/lib/ruby/1.8/base64.rb:97:in `pack&#39;
    	from /usr/lib/ruby/1.8/base64.rb:97:in `encode64&#39;
    	from (irb):19
    	from :0


  [1]: https://code.google.com/p/pyngfm/

All Encode Solutions on Gang of Coders

Total of 22 Encode Solutions