Just get the [string representation][1]:

    html_content = str(listing)

This is a non-prettified version. 

If you want a prettified one, use [`prettify()`][2] method:

    html_content = listing.prettify()


  [1]: http://www.crummy.com/software/BeautifulSoup/bs4/doc/#non-pretty-printing
  [2]: http://www.crummy.com/software/BeautifulSoup/bs4/doc/#pretty-printing

The &lt;a href=&quot;http://www.cplusplus.com/reference/memory/shared_ptr/&quot;&gt;cplusplus.com `shared_ptr` page&lt;/a&gt; calls out a distinction between an _empty_ `std::shared_ptr` and a _null_ `shared_ptr`. The &lt;a href=&quot;http://en.cppreference.com/w/cpp/memory/shared_ptr&quot;&gt;cppreference.com page&lt;/a&gt; doesn&#39;t explicitly call out the distinction, but uses both &quot;empty&quot; and comparison to `nullptr` in its description of `std::shared_ptr` behavior.

Is there a difference between an empty and a null `shared_ptr`? Is there any use case for such mixed-behavior pointers? Does a non-empty null `shared_ptr` even make sense? Would there ever be a case in normal usage (i.e. if you didn&#39;t explicitly construct one) where you could end up with an empty-but-non-null `shared_ptr`?

And do any of these answers change if you&#39;re using the Boost version instead of the C++11 version?

What is the difference between an empty and a null std::shared_ptr in C++?

I&#39;ve written some code to render repeating elements in ReactJS, but I hate how ugly it is.

    render: function(){
      var titles = this.props.titles.map(function(title) {
        return &lt;th&gt;{title}&lt;/th&gt;;
      });
      var rows = this.props.rows.map(function(row) {
        var cells = [];
        for (var i in row) {
          cells.push(&lt;td&gt;{row[i]}&lt;/td&gt;);
        }
        return &lt;tr&gt;{cells}&lt;/tr&gt;;
      });
      return (
        &lt;table className=&quot;MyClassName&quot;&gt;
          &lt;thead&gt;
            &lt;tr&gt;{titles}&lt;/tr&gt;
          &lt;/thead&gt;
          &lt;tbody&gt;{rows}&lt;/tbody&gt;
        &lt;/table&gt;
      );
    } 

Is there a better way to achieve this?

(I would like to embed `for` loops within the template code, or some similar approach.)

How can I render repeating React elements?

I have the following bs4 object listing:


    &gt;&gt;&gt; listing
    &lt;div class=&quot;listingHeader&quot;&gt;
    &lt;h2&gt;
    ....


    &gt;&gt;&gt; type(listing)
    &lt;class &#39;bs4.element.Tag&#39;&gt;

I want to extract the raw html as a string. I&#39;ve tried:

    &gt;&gt;&gt; a = listing.contents
    &gt;&gt;&gt; type(a)
    &lt;type &#39;list&#39;&gt;

So this does not work. How can I do this?

How to get HTML from a beautiful soup object

I have the following bs4 object listing:
<pre><code class="hljs language-python">>>> listing
&#x3C;div class="listingHeader">
&#x3C;h2>
....


>>> type(listing)
&#x3C;class 'bs4.element.Tag'>
</code></pre>
I want to extract the raw html as a string. I've tried:
<pre><code class="hljs language-python">>>> a = listing.contents
>>> type(a)
&#x3C;type 'list'>
</code></pre>
So this does not work. How can I do this?

I have access to NumPy and SciPy and want to create a simple FFT of a data set. I have two lists, one that is `y` values and the other is timestamps for those `y` values. 

What is the simplest way to feed these lists into a SciPy or NumPy method and plot the resulting FFT?

I have looked up examples, but they all rely on creating a set of fake data with some certain number of data points, and frequency, etc. and don&#39;t really show how to do it with just a set of data and the corresponding timestamps.

I have tried the following example:

    from scipy.fftpack import fft

    # Number of samplepoints
    N = 600

    # Sample spacing
    T = 1.0 / 800.0
    x = np.linspace(0.0, N*T, N)
    y = np.sin(50.0 * 2.0*np.pi*x) + 0.5*np.sin(80.0 * 2.0*np.pi*x)
    yf = fft(y)
    xf = np.linspace(0.0, 1.0/(2.0*T), N/2)
    import matplotlib.pyplot as plt
    plt.plot(xf, 2.0/N * np.abs(yf[0:N/2]))
    plt.grid()
    plt.show()

But when I change the argument of `fft` to my data set and plot it, I get extremely odd results, and it appears the scaling for the frequency may be off. I am unsure.

Here is a pastebin of the data I am attempting to FFT

http://pastebin.com/0WhjjMkb
http://pastebin.com/ksM4FvZS

When I use `fft()` on the whole thing it just has a huge spike at zero and nothing else.

Here is my code:

    ## Perform FFT with SciPy
    signalFFT = fft(yInterp)
    
    ## Get power spectral density
    signalPSD = np.abs(signalFFT) ** 2
    
    ## Get frequencies corresponding to signal PSD
    fftFreq = fftfreq(len(signalPSD), spacing)
    
    ## Get positive half of frequencies
    i = fftfreq&gt;0
    
    ##
    plt.figurefigsize = (8, 4)
    plt.plot(fftFreq[i], 10*np.log10(signalPSD[i]));
    #plt.xlim(0, 100);
    plt.xlabel(&#39;Frequency [Hz]&#39;);
    plt.ylabel(&#39;PSD [dB]&#39;)

Spacing is just equal to `xInterp[1]-xInterp[0]`.


Plotting a fast Fourier transform in Python

I am run into trouble .My code below.But I do not know why there is a char &#39;b&#39; before output string &quot;Hello Python&quot;.

    &gt;&gt;&gt; import redis
    &gt;&gt;&gt; redisClient = redis.StrictRedis(host=&#39;192.168.3.88&#39;,port=6379)
    &gt;&gt;&gt; redisClient.set(&#39;test_redis&#39;, &#39;Hello Python&#39;)
    True
    &gt;&gt;&gt; value = redisClient.get(&#39;test_redis&#39;)
    &gt;&gt;&gt; print(value)
    b&#39;Hello Python&#39; //why char &#39;b&#39; output?



About char b prefix in Python3.4.1 client connect to redis

I have the following DataFrame:

    In [1]:
    df = pd.DataFrame({&#39;a&#39;: [1, 2, 3],
                       &#39;b&#39;: [2, 3, 4],
                       &#39;c&#39;: [&#39;dd&#39;, &#39;ee&#39;, &#39;ff&#39;],
                       &#39;d&#39;: [5, 9, 1]})

    df
    Out [1]:
       a  b   c  d
    0  1  2  dd  5
    1  2  3  ee  9
    2  3  4  ff  1



I would like to add a column `&#39;e&#39;` which is the sum of columns `&#39;a&#39;`, `&#39;b&#39;` and `&#39;d&#39;`.

Going across forums, I thought something like this would work:

    df[&#39;e&#39;] = df[[&#39;a&#39;, &#39;b&#39;, &#39;d&#39;]].map(sum)

But it didn&#39;t.

I would like to know the appropriate operation with the list of columns `[&#39;a&#39;, &#39;b&#39;, &#39;d&#39;]` and `df` as inputs.

Pandas: sum DataFrame rows for given columns

I have a local version of Python 3.4.1 and I can run `python -m pip install`, but I&#39;m unable to find the pip binary to run `pip install`. What&#39;s the difference between these two?

What&#39;s the difference between &quot;pip install&quot; and &quot;python -m pip install&quot;?

I am required to extract the time of the day from the [datetime.datetime][1] object returned by the *[created_at][2]* attribute, but how can I do that?

This is my code for getting the datetime.datetime object.

    from datetime import *
    import tweepy

    consumer_key = &#39;&#39;
    consumer_secret = &#39;&#39;
    access_token = &#39;&#39;
    access_secret = &#39;&#39;
    auth = tweepy.OAuthHandler(consumer_key, consumer_secret)
    auth.set_access_token(access_token, access_secret)
    api = tweepy.API(auth)
    tweets = tweepy.Cursor(api.home_timeline).items(limit = 2)
    t1 = datetime.strptime(&#39;Wed Jun 01 12:53:42 +0000 2011&#39;, &#39;%a %b %d %H:%M:%S +0000 %Y&#39;)
    for tweet in tweets:
       print (tweet.created_at - t1)
       t1 = tweet.created_at

I need to only extract the hour and minutes from `t1`.


  [1]: https://docs.python.org/3.3/library/datetime.html#datetime-objects
  [2]: https://developer.twitter.com/en/docs/twitter-api/v1/data-dictionary/object-model/tweet

How can I extract hours and minutes from a datetime.datetime object?

I have a modal in my page. When I try to call it when the windows load, it prints an error to the console that says : 

    $(...).modal is not a function

This is my Modal HTML :

    &lt;div class=&quot;modal fade&quot; id=&quot;prizePopup&quot; tabindex=&quot;-1&quot; role=&quot;dialog&quot; aria-labelledby=&quot;myModalLabel&quot; aria-hidden=&quot;true&quot;&gt;
    &lt;div class=&quot;modal-dialog&quot;&gt;
        &lt;div class=&quot;modal-content&quot;&gt;
            &lt;div class=&quot;modal-header&quot;&gt;
                &lt;button type=&quot;button&quot; class=&quot;close&quot; data-dismiss=&quot;modal&quot; aria-hidden=&quot;true&quot;&gt;
                    &amp;times;
                &lt;/button&gt;
                &lt;h4 class=&quot;modal-title&quot; id=&quot;myModalLabel&quot;&gt;
                    This Modal title
                &lt;/h4&gt;
            &lt;/div&gt;
            &lt;div class=&quot;modal-body&quot;&gt;
                Add some text here
            &lt;/div&gt;
            &lt;div class=&quot;modal-footer&quot;&gt;
                &lt;button type=&quot;button&quot; class=&quot;btn btn-default&quot; data-dismiss=&quot;modal&quot;&gt;Close&lt;/button&gt;
                &lt;button type=&quot;button&quot; class=&quot;btn btn-primary&quot;&gt;
                    Submit changes
                &lt;/button&gt;
            &lt;/div&gt;
        &lt;/div&gt;
    &lt;/div&gt;
&lt;/div&gt;

    &lt;script type=&quot;text/javascript&quot; src=&quot;js/bootstrap.js&quot;&gt;&lt;/script&gt;
    &lt;script src=&quot;//code.jquery.com/jquery-1.11.0.min.js&quot;&gt;&lt;/script&gt;

And this is my JavaScript to run it with when a window is loaded :

    &lt;script type=&quot;text/javascript&quot;&gt;
    $(window).load(function() {
        $(&#39;#prizePopup&#39;).modal(&#39;show&#39;);
    });
    &lt;/script&gt;

How can I fix this problem?

Bootstrap modal: is not a function

I tried to use the [YouTube player demo][1] to generate the code necessary for my video to autoplay and loop itself.
But only the autoplay works, it doesn&#39;t loop, and the demo-video doesn&#39;t work either. Here is the code I&#39;ve used.

    &lt;iframe class=&quot;embed-responsive-item&quot; id=&quot;ytplayer&quot; type=&quot;text/html&quot; width=&quot;640&quot; height=&quot;360&quot; src=&quot;https://www.youtube.com/embed/M7lc1UVf-VE?&amp;autoplay=1&amp;loop=1&amp;rel=0&amp;showinfo=0&amp;color=white&amp;iv_load_policy=3&quot; frameborder=&quot;0&quot; allowfullscreen&gt;
    &lt;/iframe&gt;





  [1]: https://developers.google.com/youtube/youtube_player_demo?hl=zh-tw

Youtube iframe &quot;loop&quot; doesn&#39;t work

Brand new to JS.    	
I am trying to check if the file input element is empty when submitting the form with jQuery/JavaScript.
I have gone through a bunch of solutions and nothing is working for me.  I am trying to avoid the `/c/fakepath` (unless there is no other option)

    &lt;input type=&quot;file&quot; name=&quot;videoFile&quot; id=&quot;videoUploadFile&quot; /&gt;

This does not work:

    var vidFile = $(&quot;#videoUploadFile&quot;).value;

The only way I can get the filename is if I use the following:

    var vidFile = document.getElementById(&quot;videoUploadFile&quot;).files[0].name;

If there is no file available the code throws an error: 
&gt;cannot read property name of undefined

which makes sense because the array is not set. but I cannot figure out how to do any error handling with this.

How do I properly grab the file input element `videoUploadFile`, check if it&#39;s empty, throw an error message if it&#39;s empty?

How to check if input file is empty in jQuery

I am revising some **XHTML** files authored by another party. As part of this effort, I am doing some bulk editing via **Linq to XML**.

I&#39;ve just noticed that some of the original source XHTML files contain the [`&amp;quot;` HTML entity][1] in text nodes within those files. For instance:

&lt;!-- language: lang-html --&gt;

    &lt;p&gt;Greeting: &amp;quot;Hello, World!&amp;quot;&lt;/p&gt;

And that when recovering the XHTML text via [XElement.ToString()][2], the **`&amp;quot;`** entities are being replaced by **plain double-quotes**:

&lt;!-- language: lang-html --&gt;

    &lt;p&gt;Greeting: &quot;Hello, World!&quot;&lt;/p&gt;

**Question:** Can anyone tell me what the motivation might have been for the original author to use the `&amp;quot;` entities instead of plain double-quotes? Did those entities serve a purpose which I don&#39;t fully appreciate? Or, were they truly unnecessary as I suspect?

I do understand that **`&amp;quot;`** would be necessary in certain contexts, such as when there is a need to place a double-quote within an HTML attribute. For instance:

&lt;!-- language: lang-html --&gt;

    &lt;a href=&quot;/images/hello_world.jpg&quot; alt=&quot;Greeting: &amp;quot;Hello, World!&amp;quot;&quot;&gt;
      Greeting&lt;/a&gt;

  [1]: http://www.fileformat.info/info/unicode/char/22/index.htm
  [2]: http://msdn.microsoft.com/en-us/library/bb341005%28v=vs.110%29.aspx


Uses for the &#39;&amp;quot;&#39; entity in HTML

I am trying to style my buttons in a way that the hover makes the button a lighter shade instead of a darker shade. I tried bootstrap customization page(http://getbootstrap.com/customize/) and it doesn&#39;t give me an option to change the button hover color. I tried doing this manually by inspecting the CSS but it is unclear how the buttons are getting the hover color. I tried another bootstrap customization website

http://pikock.github.io/bootstrap-magic/app/#!/editor


I wanted the main color to be #0495c9 and the hover color to be #00b3db but I am only able to specify the button bg color and not it&#39;s hover color.

Any help will be appreciated

Change hover color on a button with Bootstrap customization

I&#39;m trying to scrape a website, but it gives me an error.

I&#39;m using the following code:

    import urllib.request
    from bs4 import BeautifulSoup
    
    get = urllib.request.urlopen(&quot;https://www.website.com/&quot;)
    html = get.read()
    
    soup = BeautifulSoup(html)
    
    print(soup)

And I&#39;m getting the following error:

    File &quot;C:\Python34\lib\encodings\cp1252.py&quot;, line 19, in encode
        return codecs.charmap_encode(input,self.errors,encoding_table)[0]
    UnicodeEncodeError: &#39;charmap&#39; codec can&#39;t encode characters in position 70924-70950: character maps to &lt;undefined&gt;

What can I do to fix this?

UnicodeEncodeError: &#39;charmap&#39; codec can&#39;t encode characters

My python (ver 2.7) script is running well to get some company name from local html files but when it comes to some specific country name, it gives this error &quot;UnicodeEncodeError: &#39;ascii&#39; codec can&#39;t encode character&quot;

Specially getting error when this company name comes

Company Name: **K&#252;hlfix K&#228;lteanlagen Ing.Gerhard Doczekal &amp; Co. KG**

The link cannot be processed

    Traceback (most recent call last): 
      File &quot;C:\Python27\Process2.py&quot;, line 261, in &lt;module&gt;
        flog.write(&quot;\nCompany Name: &quot;+str(pCompanyName))
    UnicodeEncodeError: &#39;ascii&#39; codec can&#39;t encode character u&#39;\xfc&#39; in position 9: ordinal not in range(128)

**Error gives in this line of code:** 

    if companyAlreadyKnown == 0:
       for hit in soup2.findAll(&quot;h1&quot;):
           print &quot;Company Name: &quot;+hit.text
           pCompanyName = hit.text
           flog.write(&quot;\nCompany Name: &quot;+str(pCompanyName))
           companyObj.setCompanyName(pCompanyName)


UnicodeEncodeError: &#39;ascii&#39; codec can&#39;t encode character at special name

Observe the following problem:

    import re
    from bs4 import BeautifulSoup as BS
    
    soup = BS(&quot;&quot;&quot;
    &lt;a href=&quot;/customer-menu/1/accounts/1/update&quot;&gt;
        Edit
    &lt;/a&gt;
    &quot;&quot;&quot;)
    
    # This returns the &lt;a&gt; element
    soup.find(
        &#39;a&#39;,
        href=&quot;/customer-menu/1/accounts/1/update&quot;,
        text=re.compile(&quot;.*Edit.*&quot;)
    )
    
    soup = BS(&quot;&quot;&quot;
    &lt;a href=&quot;/customer-menu/1/accounts/1/update&quot;&gt;
        &lt;i class=&quot;fa fa-edit&quot;&gt;&lt;/i&gt; Edit
    &lt;/a&gt;
    &quot;&quot;&quot;)
    
    # This returns None
    soup.find(
        &#39;a&#39;,
        href=&quot;/customer-menu/1/accounts/1/update&quot;,
        text=re.compile(&quot;.*Edit.*&quot;)
    )

For some reason, BeautifulSoup will not match the text, when the `&lt;i&gt;` tag is there as well. Finding the tag and showing its text produces

    &gt;&gt;&gt; a2 = soup.find(
            &#39;a&#39;,
            href=&quot;/customer-menu/1/accounts/1/update&quot;
        )
    &gt;&gt;&gt; print(repr(a2.text))
    &#39;\n Edit\n&#39;

Right. According to the [Docs](http://www.crummy.com/software/BeautifulSoup/bs4/doc/#a-regular-expression), soup uses the match function of the regular expression, not the search function. So I need to provide the DOTALL flag:

    pattern = re.compile(&#39;.*Edit.*&#39;)
    pattern.match(&#39;\n Edit\n&#39;)  # Returns None
    
    pattern = re.compile(&#39;.*Edit.*&#39;, flags=re.DOTALL)
    pattern.match(&#39;\n Edit\n&#39;)  # Returns MatchObject

Alright. Looks good. Let&#39;s try it with soup

    soup = BS(&quot;&quot;&quot;
    &lt;a href=&quot;/customer-menu/1/accounts/1/update&quot;&gt;
        &lt;i class=&quot;fa fa-edit&quot;&gt;&lt;/i&gt; Edit
    &lt;/a&gt;
    &quot;&quot;&quot;)
    
    soup.find(
        &#39;a&#39;,
        href=&quot;/customer-menu/1/accounts/1/update&quot;,
        text=re.compile(&quot;.*Edit.*&quot;, flags=re.DOTALL)
    )  # Still return None... Why?!


### **Edit**

My solution based on geckons answer: I implemented these helpers:

    import re
    
    MATCH_ALL = r&#39;.*&#39;
    
    
    def like(string):
        &quot;&quot;&quot;
        Return a compiled regular expression that matches the given
        string with any prefix and postfix, e.g. if string = &quot;hello&quot;,
        the returned regex matches r&quot;.*hello.*&quot;
        &quot;&quot;&quot;
        string_ = string
        if not isinstance(string_, str):
            string_ = str(string_)
        regex = MATCH_ALL + re.escape(string_) + MATCH_ALL
        return re.compile(regex, flags=re.DOTALL)
    
    
    def find_by_text(soup, text, tag, **kwargs):
        &quot;&quot;&quot;
        Find the tag in soup that matches all provided kwargs, and contains the
        text.
        
        If no match is found, return None.
        If more than one match is found, raise ValueError.
        &quot;&quot;&quot;
        elements = soup.find_all(tag, **kwargs)
        matches = []
        for element in elements:
            if element.find(text=like(text)):
                matches.append(element)
        if len(matches) &gt; 1:
            raise ValueError(&quot;Too many matches:\n&quot; + &quot;\n&quot;.join(matches))
        elif len(matches) == 0:
            return None
        else:
            return matches[0]

Now, when I want to find the element above, I just run `find_by_text(soup, &#39;Edit&#39;, &#39;a&#39;, href=&#39;/customer-menu/1/accounts/1/update&#39;)`

BeautifulSoup - search by text inside a tag

After I installed BeautifulSoup, Whenever I run my Python in cmd, this warning comes out.

    D:\Application\python\lib\site-packages\beautifulsoup4-4.4.1-py3.4.egg\bs4\__init__.py:166:
    UserWarning: No parser was explicitly specified, so I&#39;m using the best
    available HTML parser for this system (&quot;html.parser&quot;). This usually isn&#39;t a
    problem, but if you run this code on another system, or in a different
    virtual environment, it may use a different parser and behave differently.

    To get rid of this warning, change this:

     BeautifulSoup([your markup])

    to this:

     BeautifulSoup([your markup], &quot;html.parser&quot;)

I have no ideal why it comes out and how to solve it.


How to get rid of BeautifulSoup user warning?

&gt;TypeError: a bytes-like object is required, not &#39;str&#39; 

getting above error while Executing below python code to save the HTML table data in Csv file. don&#39;t know how to get rideup.pls help me.

    import csv
    import requests
    from bs4 import BeautifulSoup
    
    url=&#39;http://www.mapsofindia.com/districts-india/&#39;
    response=requests.get(url)
    html=response.content
    
    soup=BeautifulSoup(html,&#39;html.parser&#39;)
    table=soup.find(&#39;table&#39;, attrs={&#39;class&#39;:&#39;tableizer-table&#39;})
    list_of_rows=[]
    for row in table.findAll(&#39;tr&#39;)[1:]:
        list_of_cells=[]
        for cell in row.findAll(&#39;td&#39;):
            list_of_cells.append(cell.text)
        list_of_rows.append(list_of_cells)
    outfile=open(&#39;./immates.csv&#39;,&#39;wb&#39;)
    writer=csv.writer(outfile)
    writer.writerow([&quot;SNo&quot;, &quot;States&quot;, &quot;Dist&quot;, &quot;Population&quot;])
    writer.writerows(list_of_rows)

on above the last line.

Content Type	Original Author	Original Content on Stackoverflow
Question	user1592380	View Question on Stackoverflow
Solution 1 - Python	alecxe	View Answer on Stackoverflow

How to get HTML from a beautiful soup object

Python Problem Overview

Python Solutions

Solution 1 - Python

How can I render repeating React elements?

What is the difference between an empty and a null std::shared_ptr in C++?

Attributions