Looks like `google.searchGoogle(param)` already returns `unicode`:

    &gt;&gt;&gt; unicode(u&#39;foo&#39;, &#39;utf-8&#39;)

    Traceback (most recent call last):
      File &quot;&lt;pyshell#1&gt;&quot;, line 1, in &lt;module&gt;
        unicode(u&#39;foo&#39;, &#39;utf-8&#39;)
    TypeError: decoding Unicode is not supported

So what you want is:

    result = google.searchGoogle(param).encode(&quot;utf-8&quot;)

As a side note, your code expects it to return a `utf-8` encoded string so what was the point in decoding it (using `unicode()`) and encoding back (using `.encode()`) using the same encoding?

I would like to check if bluetooth is enabled on any Android device periodically. Is there any intents that I could catch using BroadcastReceiver to do so, or is there other ways to do it?

How to check if bluetooth is enabled programmatically?

I have an EditText. I want that after typing some text, when user presses the `Done` key of the softkeyboard, it should directly perform some search operation which I have also implemented in a button click event.

android: Softkeyboard perform action when Done key is pressed

I am having a problem with my encoding in Python. I have tried different methods but I can&#39;t seem to find the best way to encode my output to UTF-8.

This is what I am trying to do:

    result = unicode(google.searchGoogle(param), &quot;utf-8&quot;).encode(&quot;utf-8&quot;)

`searchGoogle` returns the first Google result for `param`.

This is the error I get:

    exceptions.TypeError: decoding Unicode is not supported

Does anyone know how I can make Python encode my output in UTF-8 to avoid this error?

Python decoding Unicode is not supported

I am having a problem with my encoding in Python. I have tried different methods but I can't seem to find the best way to encode my output to UTF-8.
This is what I am trying to do:
<pre><code class="hljs language-ini">result = unicode(google.searchGoogle(param), "utf-8").encode("utf-8")
</code></pre>
<code>searchGoogle</code> returns the first Google result for <code>param</code>.
This is the error I get:
<pre><code class="hljs language-vbnet">exceptions.TypeError: decoding Unicode is not supported
</code></pre>
Does anyone know how I can make Python encode my output in UTF-8 to avoid this error?

It is pretty easy to implement `__len__(self)` method in Python so that it handles `len(inst)` calls like this one:

    class A(object):

      def __len__(self):
        return 7

    a = A()
    len(a) # gives us 7

And there are plenty of alike methods you can define (`__eq__`, `__str__`, `__repr__` etc.).
I know that Python classes are objects as well. 

My question: can I somehow define, for example, `__len__` so that the following works:

    len(A) # makes sense and gives some predictable result




Is there a way to implement methods like __len__ or __eq__ as classmethods?

How do I check whether data in a query exists?

For example:

    users_query = User.query.filter_by(email=&#39;x@x.com&#39;)

How I can check whether users with that email exist?

I can check this with 

    users_query.count()

but how to check it with **exists**?

sqlalchemy exists for query

I have a class that I&#39;m testing which has as a dependency another class (an instance of which gets passed to the CUT&#39;s init method).  I want to mock out this class using the Python Mock library.

What I have is something like:

    mockobj = Mock(spec=MyDependencyClass)
    mockobj.methodfromdepclass.return_value = &quot;the value I want the mock to return&quot;
    assertTrue(mockobj.methodfromdepclass(42), &quot;the value I want the mock to return&quot;)

    cutobj = ClassUnderTest(mockobj)

Which is fine, but &quot;methodfromdepclass&quot; is a parameterized method, and as such I want to create a single mock object where depending on what arguments are passed to methodfromdepclass it returns different values.  

The reason I want this parameterized behaviour is I want to create multiple instances of ClassUnderTest that contain different values (the values of which are produced by what gets returned from the mockobj).

Kinda what I&#39;m thinking (this of course does not work):

    mockobj = Mock(spec=MyDependencyClass)
    mockobj.methodfromdepclass.ifcalledwith(42).return_value = &quot;you called me with arg 42&quot;
    mockobj.methodfromdepclass.ifcalledwith(99).return_value = &quot;you called me with arg 99&quot;

    assertTrue(mockobj.methodfromdepclass(42), &quot;you called me with arg 42&quot;)
    assertTrue(mockobj.methodfromdepclass(99), &quot;you called me with arg 99&quot;)

    cutinst1 = ClassUnderTest(mockobj, 42)
    cutinst2 = ClassUnderTest(mockobj, 99)

    # now cutinst1 &amp; cutinst2 contain different values

How do I achieve this &quot;ifcalledwith&quot; kind of semantics?

Python Mock object with method called multiple times

I have a function with a decorator that I&#39;m trying test with the help of the Python [Mock][1] library. I&#39;d like to use `mock.patch` to replace the real decorator with a mock &#39;bypass&#39; decorator which just calls the function.

What I can&#39;t figure out is how to apply the patch before the real decorator wraps the function. I&#39;ve tried a few different variations on the patch target and reordering the patch and import statements, but without success. Any ideas?

  [1]: http://www.voidspace.org.uk/python/mock/

Can I patch a Python decorator before it wraps a function?

I&#39;m debugging a python script, and I want to watch a variable for a change (much like you can watch a memory adress in gdb).  Is there a way to do this?

How do you watch a variable in pdb

 - How can I send and receive messages on the server side using WebSocket, as per the protocol?

 - Why do I get seemingly random bytes at the server when I send data from the browser to the server? It the data encoded somehow?

 - How does the framing work in both the server &amp;rarr; client and client &amp;rarr; server directions?


How can I send and receive WebSocket messages on the server side?

I recently posted about issues with encrypting large data with RSA, I am finally done with that and now I am moving on to implementing signing with a user&#39;s private key and verifying with the corresponding public key. However, whenever I compare the signed data and the original message I basically just get false returned. I am hoping some of your could see what I am doing wrong.

Here is the code:

    public static string SignData(string message, RSAParameters privateKey)
        {
            //// The array to store the signed message in bytes
            byte[] signedBytes;
            using (var rsa = new RSACryptoServiceProvider())
            {
                //// Write the message to a byte array using UTF8 as the encoding.
                var encoder = new UTF8Encoding();
                byte[] originalData = encoder.GetBytes(message);
                
                try
                {
                    //// Import the private key used for signing the message
                    rsa.ImportParameters(privateKey);

                    //// Sign the data, using SHA512 as the hashing algorithm 
                    signedBytes = rsa.SignData(originalData, CryptoConfig.MapNameToOID(&quot;SHA512&quot;));
                }
                catch (CryptographicException e)
                {
                    Console.WriteLine(e.Message);
                    return null;
                }
                finally
                {
                    //// Set the keycontainer to be cleared when rsa is garbage collected.
                    rsa.PersistKeyInCsp = false;
                }
            }
            //// Convert the a base64 string before returning
            return Convert.ToBase64String(signedBytes);
        }

So that is the first step, to sign the data, next I move on to verifying the data:

    public static bool VerifyData(string originalMessage, string signedMessage, RSAParameters publicKey)
        {
            bool success = false;
            using (var rsa = new RSACryptoServiceProvider())
            {
                byte[] bytesToVerify = Convert.FromBase64String(originalMessage);
                byte[] signedBytes = Convert.FromBase64String(signedMessage);
                try
                {
                    rsa.ImportParameters(publicKey);

                    SHA512Managed Hash = new SHA512Managed();

                    byte[] hashedData = Hash.ComputeHash(signedBytes);

                    success = rsa.VerifyData(bytesToVerify, CryptoConfig.MapNameToOID(&quot;SHA512&quot;), signedBytes);
                }
                catch (CryptographicException e)
                {
                    Console.WriteLine(e.Message);
                }
                finally
                {
                    rsa.PersistKeyInCsp = false;
                }
            }
            return success;
        }

And here is the test client:

    public static void Main(string[] args)
        {
            PublicKeyInfrastructure pki = new PublicKeyInfrastructure();
            Cryptograph crypto = new Cryptograph();
            RSAParameters privateKey = crypto.GenerateKeys(&quot;email@email.com&quot;);

            const string PlainText = &quot;This is really sent by me, really!&quot;;
 
            RSAParameters publicKey = crypto.GetPublicKey(&quot;email@email.com&quot;);

            string encryptedText = Cryptograph.Encrypt(PlainText, publicKey);

            Console.WriteLine(&quot;This is the encrypted Text:&quot; + &quot;\n &quot; + encryptedText);

            string decryptedText = Cryptograph.Decrypt(encryptedText, privateKey);

            Console.WriteLine(&quot;This is the decrypted text: &quot; + decryptedText);

            string messageToSign = encryptedText;

            string signedMessage = Cryptograph.SignData(messageToSign, privateKey);

            //// Is this message really, really, REALLY sent by me?
            bool success = Cryptograph.VerifyData(messageToSign, signedMessage, publicKey);

            Console.WriteLine(&quot;Is this message really, really, REALLY sent by me? &quot; + success);
            
        }

Am I missing a step here? According to the Cryptography API and the examples there, I shouldn&#39;t manually compute any hashes, since I supply the algorithm within the method call itself.

Any help will be greatly appreciated.



Signing and verifying signatures with RSA C#

Since AVD tools 16 I&#39;m getting this warning:

    Replace &quot;...&quot; with ellipsis character (..., &amp;#8230;) ?

in my strings.xml

at this line
   
     &lt;string name=&quot;searching&quot;&gt;Searching...&lt;/string&gt;

How do I replace `...`? Is it just literally `&amp;#8230;`?

Could someone explain this encoding?

Android Replace &quot;...&quot; with ellipsis character

I use `curl` to get some URL response, it&#39;s JSON response and it contains unicode-escaped national characters like **`\u0144 (ń)`** and **`\u00f3 (&#243;)`**. 

How can I convert them to **UTF-8** or any other encoding to save into file?

How to convert \uXXXX unicode to UTF-8 using console tools in *nix

I have a webpage that posts multiple form tags. It&#39;s an inline edit page, where I can either post one row at a time or multiple rows. Last night, without making any changes to the code or data, I started getting `The URL-encoded form data is not valid` error on multiple posts, although single row posts work fine.

URL-encoded form data is not valid

I have an application that deals with clients from all over the world, and, naturally, I want everything going into my databases to be UTF-8 encoded.

The main problem for me is that I don&#39;t know what encoding the source of any string is going to be - it could be from a text box (using `&lt;form accept-charset=&quot;utf-8&quot;&gt;` is only useful if the user is actually submitted the form), or it could be from an uploaded text file, so I really have no control over the input.

What I need is a function or class that makes sure the stuff going into my database is, as far as is possible, UTF-8 encoded. I&#39;ve tried `iconv(mb_detect_encoding($text), &quot;UTF-8&quot;, $text);`
but that has problems (if the input is &#39;fianc&#233;e&#39; it returns &#39;fianc&#39;). I&#39;ve tried a lot of things =/

For file uploads, I like the idea of asking the end user to specify the encoding they use, and show them previews of what the output will look like, but this doesn&#39;t help against nasty hackers (in fact, it could make their life a little easier).

I&#39;ve read the other Stack Overflow questions on the subject, but they seem to all have subtle differences like &quot;I need to parse [RSS][1] feeds&quot; or &quot;I scrape data from websites&quot; (or, indeed, &quot;You can&#39;t&quot;).

But there must be something that at least has a good *try*!

  [1]: https://en.wikipedia.org/wiki/RSS


PHP: Convert any string to UTF-8 without knowing the original character set, or at least try

I&#39;m trying to parse some HTML using DOMDocument, but when I do, I suddenly lose my encoding (at least that is how it appears to me).

    $profile = &quot;&lt;div&gt;&lt;p&gt;various japanese characters&lt;/p&gt;&lt;/div&gt;&quot;;
    $dom = new DOMDocument();
    $dom-&gt;loadHTML($profile); 

    $divs = $dom-&gt;getElementsByTagName(&#39;div&#39;);

    foreach ($divs as $div) {
        echo $dom-&gt;saveHTML($div);
    }

The result of this code is that I get a bunch of characters that are not Japanese.  However, if I do:

    echo $profile;

it displays correctly.  I&#39;ve tried saveHTML and saveXML, and neither display correctly. I am using PHP 5.3.

What I see:

    &#227;&#164;&#227;&#170;&#227;&#227;&#164;&#229;&#183;&#227;&#183;&#227;&#171;&#227;&#180;&#227;&#171;&#227;&#166;&#227;&#227;&#162;&#227;&#164;&#227;&#171;&#227;&#169;&#227;&#179;&#227;&#231;&#179;&#187;&#227;&#174;&#229;&#174;&#182;&#229;&#186;&#173;&#227;&#171;&#227;9&#228;&#186;&#186;&#229;&#229;&#188;&#227;&#174;5&#231;&#170;&#231;&#174;&#227;&#168;&#227;&#227;&#166;&#231;&#227;&#190;&#227;&#227;&#227;&#229;&#189;&#188;&#227;&#229;&#171;&#227;&#227;&#166;4&#228;&#186;&#186;&#227;&#228;&#191;&#179;&#229;&#170;&#227;&#171;&#227;&#170;&#227;&#163;&#227;&#227;&#231;&#182;&#232;&#166;&#170;&#227;&#175;&#230;&#168;&#230;&#227;&#174;&#227;&#187;&#227;&#188;&#227;&#171;&#227;&#185;&#227;&#227;&#179;&#227;&#167;&#227;&#230;&#175;&#232;&#166;&#170;&#227;&#175;&#233;&#181;&#228;&#190;&#191;&#229;&#177;&#227;&#174;&#229;&#174;&#162;&#229;&#174;&#164;&#228;&#191;&#227; &#227;&#163;&#227;&#227;&#233;&#171;&#230; &#161;&#230;&#228;&#187;&#163;&#227;&#175;&#227;&#173;&#227;&#163;&#227;&#227;&#163;&#227;&#174;&#227;&#162;&#227;&#171;&#227;&#227;&#164;&#227;&#227;&#171;&#229;&#164;&#227;&#227;&#191;&#227;&#230;&#232;&#178;&#232;&#179;&#233;&#227;&#229;&#227;&#227;&#170;&#227;&#227;&#227;&#171;&#227;&#227;&#170;&#227;&#227;&#175;&#231;&#179;&#187;&#227;&#174;&#233;&#171;&#230; &#161;&#227;&#184;&#233;&#178;&#229;&#173;&#166;&#227;

What should be shown:

    イリノイ州シカゴにて、アイルランド系の家庭に、9人兄弟の5番目として生まれる。彼を含めて4人が俳優になった。父親は木材のセールスマンで、母親は郵便局の客室係だった。高校時代はキャディのアルバイトに勤しみ、教育資金を受けながらカトリック系の高校へ進学

EDIT: I&#39;ve simplified the code down to five lines so you can test it yourself.

    $profile = &quot;&lt;div lang=ja&gt;&lt;p&gt;イリノイ州シカゴにて、アイルランド系の家庭に、&lt;/p&gt;&lt;/div&gt;&quot;;
    $dom = new DOMDocument();
    $dom-&gt;loadHTML($profile);
    echo $dom-&gt;saveHTML();
    echo $profile;

Here is the html that is returned:

    &lt;div lang=&quot;ja&quot;&gt;&lt;p&gt;&#227;‚&#164;&#227;ƒ&#170;&#227;ƒŽ&#227;‚&#164;&#229;&#183;ž&#227;‚&#183;&#227;‚&#171;&#227;‚&#180;&#227;&#171;&#227;&#166;&#227;€&#227;‚&#162;&#227;‚&#164;&#227;ƒ&#171;&#227;ƒ&#169;&#227;ƒ&#179;&#227;ƒ‰&#231;&#179;&#187;&#227;&#174;&#229;&#174;&#182;&#229;&#186;&#173;&#227;&#171;&#227;€&lt;/p&gt;&lt;/div&gt;
    &lt;div lang=&quot;ja&quot;&gt;&lt;p&gt;イリノイ州シカゴにて、アイルランド系の家庭に、&lt;/p&gt;&lt;/div&gt;

PHP DOMDocument loadHTML not encoding UTF-8 correctly

I&#39;m having trouble getting tmux to display lines for borders.  They are being created with x and q.  It&#39;s a debian squeeze server and the locale is set to en_US UTF8. I also tried adding 
    
    # instructs tmux to expect UTF-8 sequences
    setw -g utf8 on
    set -g status-utf8 on

 lines to .tmux.conf.  Nothing seems to work.  I&#39;m not sure if it&#39;s a locale issue or not.  It displays correctly on other servers, but not the debian.  I appreciate any tips you could offer!  Thanks...

Tmux borders displayed as x q instead of lines?

Let&#39;s suppose I have just used a `BufferedInputStream` to read the bytes of a UTF-8 encoded text file into a byte array. I know that I can use the following routine to convert the bytes to a string, but is there a more efficient/smarter way of doing this than just iterating through the bytes and converting each one? 

    public String openFileToString(byte[] _bytes)
    {
		String file_string = &quot;&quot;;
		
		for(int i = 0; i &lt; _bytes.length; i++)
		{
			file_string += (char)_bytes[i];
		}
		
		return file_string;    
    }

UTF-8 byte[] to String

Two questions here. I have a set of files which are usually UTF-8 with BOM. I&#39;d like to convert them (ideally in place) to UTF-8 with no BOM. It seems like `codecs.StreamRecoder(stream, encode, decode, Reader, Writer, errors)` would handle this. But I don&#39;t really see any good examples on usage. Would this be the best way to handle this?  

    source files:
    Tue Jan 17$ file brh-m-157.json 
    brh-m-157.json: UTF-8 Unicode (with BOM) text

Also, it would be ideal if we could handle different input encoding wihtout explicitly knowing (seen ASCII and UTF-16). It seems like this should all be feasible. Is there a solution that can take any known Python encoding and output as UTF-8 without BOM?

**edit 1**  proposed sol&#39;n from below (thanks!)

    fp = open(&#39;brh-m-157.json&#39;,&#39;rw&#39;)
    s = fp.read()
    u = s.decode(&#39;utf-8-sig&#39;)
    s = u.encode(&#39;utf-8&#39;)
    print fp.encoding  
    fp.write(s)


This gives me the following error:  

    IOError: [Errno 9] Bad file descriptor

###Newsflash
I&#39;m being told in comments that the mistake is I open the file with mode &#39;rw&#39; instead of &#39;r+&#39;/&#39;r+b&#39;, so I should eventually re-edit my question and remove the solved part.

Convert UTF-8 with BOM to UTF-8 with no BOM in Python

I&#39;m looking to prevent a line break after a hyphen `-` on a case-by-case basis that is compatible with all browsers.

Example:

I have this text:  `3-3/8&quot;` which in HTML is this:  `3-3/8&amp;rdquo;`

The problem is that near the end of a line, because of the hyphen, it breaks and wraps to the next line instead of treating it like a full word...

    3-
    3/8&quot;

I&#39;ve tried inserting the &quot;zero width no break character&quot;, `&amp;#65279;` with no luck...

    3-&amp;#65279;3/8&amp;rdquo;

I&#39;m seeing this in Safari and thinking it will be the same in all browsers.

The following is my `doctype` and character encoding...

    &lt;!DOCTYPE html PUBLIC &quot;-//W3C//DTD XHTML 1.0 Transitional//EN&quot;
       &quot;http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd&quot;&gt;
       
    &lt;html xmlns=&quot;http://www.w3.org/1999/xhtml&quot;&gt;
        &lt;meta http-equiv=&quot;Content-Type&quot; content=&quot;text/html;charset=utf-8&quot; /&gt;

Is there any way I can prevent these from line-breaking after the hyphen?  I do not need any solution that applies to the whole page... just something I can insert as needed, like a &quot;zero width no break character&quot;, except one that works.

Here is a Demo.  Simply make the frame narrower until the line breaks at the hyphen.

[http://jsfiddle.net/RagKH/][1]


  [1]: http://jsfiddle.net/RagKH/

No line-break after a hyphen

What&#39;s the difference between `iconv()` and `mb_convert_encoding()` in PHP?  Does one perform better, faster, etc. ( eg. with specific encodings )? In what situations would one be preferred over the other?

Here&#39;s what I think I know already:

**iconv()**

1. included with most installs of PHP.
2. when characters that can&#39;t be mapped to the new character set are found, you can specify if they are converted to a &#39;similar&#39; character, or ignored.

**mb_convert_encoding()**

1. usually requires installing the php-mbstring extension.
2. is able to handle `HTML-ENTITIES`, converting to and from web hex codes.

Are there other differences?

What is the difference between iconv() and mb_convert_encoding() in PHP?

I am compiling a package using maven and it says build failure with following compilation error:

SpanishTest.java[31, 81] unmappable character for encoding UTF8

I searched online and for many people, changing source encoding from UTF-8 to ISO-8859-1 seems to work but I am still getting same compilation error. I am using 32-bit Ubuntu. Here is how that tag looks in my pom.xml

    &lt;project.build.sourceEncoding&gt;ISO-8859-1&lt;/project.build.sourceEncoding&gt;

Even if I change `&lt;project.build.outputEncoding&gt;` tag to ISO-8859-1, I still get the error.Could it be because of java version? I have both-sun java and openjdk installed on my system.

Can anyone please let me know what to do.

Thanks  

Content Type	Original Author	Original Content on Stackoverflow
Question	simonbs	View Question on Stackoverflow
Solution 1 - Python	yak	View Answer on Stackoverflow

Python decoding Unicode is not supported

Python Problem Overview

Python Solutions

Solution 1 - Python

android: Softkeyboard perform action when Done key is pressed

How to check if bluetooth is enabled programmatically?

Attributions