&gt; **Possible Duplicate:**  
&gt; [How to parse and process HTML with PHP?](https://stackoverflow.com/questions/3577641/how-to-parse-and-process-html-with-php)  

&lt;!-- End of automatically inserted text --&gt;

&gt; **Suggestion for a reference question**. Stack Overflow has dozens of &quot;How  to parse HTML&quot; questions coming in every day. However, it is very difficult to close as a duplicate because most questions deal with the specific scenario presented by the asker. This question is an attempt to build a generic &quot;reference question&quot; that covers all aspects of the issue. 

&gt; This is an experiment. If such a reference question already exists, let me know and I&#39;ll happily remove this one.

&gt; My ideal vision is that each of the three questions gets answered separately, and the best answers to each bubble up to the top.

&gt; I will be awarding a **200 bounty** to the best answer in each of the three categories two weeks from now,  **pending [discussion of this question][1] on Meta**.  

&gt; Each of these questions have already been answered brilliantly elsewhere, so copy+pasting your own answer to a different question is fine with me. 

**How do I parse HTML with PHP?**

 1. What libraries are there? Which ones use PHP&#39;s native DOM, which ones come with their own parsing engine? (Hint: SimpleHTMLDOM)

 1a. I need to find a specific element, but I find it hard to get used to the XPath syntax. Are there any DOM-based libraries that make parsing HTML easier? Please consider making generic real world examples.  

 2. Is there a PHP library that enables me to query the DOM using CSS[2/3] selectors, like jQuery does? (Hint: phpQuery) Please consider making generic real world examples.  

 3. Bonus question: Why shouldn&#39;t I use regular expressions? Please provide a very short answer in layman&#39;s terms.


  [1]: https://meta.stackexchange.com/questions/63762/do-reference-questions-make-sense

How to parse HTML with PHP?

What is the current state of libraries for scraping websites with Haskell?

I&#39;m trying to make myself do more of my quick oneoff tasks in Haskell, in order to help increase my comfort level with the language. 

In Python, I tend to use the excellent [PyQuery][1] library for this.  Is there something similarly simple and easy in Haskell?  I&#39;ve looked into Tag Soup, and while the parser itself seems nice, actually traversing pages doesn&#39;t seem as nice as it is in other languages.

Is there a better option out there?


  [1]: https://pypi.python.org/pypi/pyquery

Web Scraping With Haskell

How can I strip the HTML from a string in JavaScript?

How to strip HTML tags from string in JavaScript?

It seems like every question on stackoverflow where the asker is using regex to grab some information from HTML will inevitably have an &quot;answer&quot; that says not to use regex to parse HTML.

Why not? I&#39;m aware that there are quote-unquote &quot;real&quot; HTML parsers out there like [Beautiful Soup][1], and I&#39;m sure they&#39;re powerful and useful, but if you&#39;re just doing something simple, quick, or dirty, then why bother using something so complicated when a few regex statements will work just fine?

Moreover, is there just something fundamental that I don&#39;t understand about regex that makes them a bad choice for parsing in general?


  [1]: http://www.crummy.com/software/BeautifulSoup/

Using regular expressions to parse HTML: why not?

I&#39;m looking for an HTML Parser module for Python that can help me get the tags in the form of Python lists/dictionaries/objects.

If I have a document of the form:

    &lt;html&gt;
    &lt;head&gt;Heading&lt;/head&gt;
    &lt;body attr1=&#39;val1&#39;&gt;
        &lt;div class=&#39;container&#39;&gt;
            &lt;div id=&#39;class&#39;&gt;Something here&lt;/div&gt;
            &lt;div&gt;Something else&lt;/div&gt;
        &lt;/div&gt;
    &lt;/body&gt;
    &lt;/html&gt;

then it should give me a way to access the nested tags via the name or id of the HTML tag so that I can basically ask it to get me the content/text in the `div` tag with `class=&#39;container&#39;` contained within the `body` tag, or something similar.

If you&#39;ve used Firefox&#39;s &quot;Inspect element&quot; feature (view HTML) you would know that it gives you all the tags in a nice nested manner like a tree.

I&#39;d prefer a built-in module but that might be asking a little too much.

---

I went through a lot of questions on Stack Overflow and a few blogs on the internet and most of them suggest BeautifulSoup or lxml or HTMLParser but few of these detail the functionality and simply end as a debate over which one is faster/more efficent.


Parsing HTML using Python

I do a lot of HTML parsing in my line of work. Up until now, I was using the HtmlUnit headless browser for parsing and browser automation.

Now, I want to separate both the tasks.

I want to use a light HTML parser because it takes much time in HtmlUnit to first load a page, then get the source and then parse it.

I want to know which HTML parser can parse HTML efficiently. I need

1. Speed
2. Ease to locate any HtmlElement by its &quot;id&quot; or &quot;name&quot; or &quot;tag type&quot;.

It would be ok for me if it doesn&#39;t clean the dirty HTML code. I don&#39;t need to clean any HTML source. I just need an easiest way to move across HtmlElements and harvest data from them.

How can I efficiently parse HTML with Java?

What is the best way to select all the text between 2 tags - ex: the text between all the  &#39;`&lt;pre&gt;`&#39; tags on the page.

Regex select all text between tags

I would like to create a page where all images which reside on my website are listed with title and alternative representation.

I already wrote me a little program to find and load all HTML files, but now I am stuck at how to extract `src`, `title` and `alt` from this HTML:

&lt;pre&gt;&lt;code&gt;&amp;lt;img &lt;b&gt;src&lt;/b&gt;=&quot;/image/fluffybunny.jpg&quot; &lt;b&gt;title&lt;/b&gt;=&quot;Harvey the bunny&quot; &lt;b&gt;alt&lt;/b&gt;=&quot;a cute little fluffy bunny&quot; /&gt;&lt;/code&gt;&lt;/pre&gt;

I guess this should be done with some regex, but since the order of the tags may vary, and I need all of them, I don&#39;t really know how to parse this in an elegant way (I could do it the hard char by char way, but that&#39;s painful).


How to extract img src, title and alt from html using php?

Are there any robust and mature HTML parsers available for PHP? A quick skimming of PEAR didn&#39;t turn anything up (lots of classes for generating HTML, not so much for consuming), and Google taught me a lot of people have started and then abandoned a variety of parser projects.

Not interested in XML parsers (unless then can consume non-well formed HTML) or hacking it on my own with regular expressions.

&lt;strong&gt;Clarification of Intent: &lt;/strong&gt; I&#39;m not interested in filtering of HTML content, I&#39;m interesting in extracting information from HTML documents.

Robust and Mature HTML Parser for PHP

How can one parse HTML/XML and extract information from it?

How do you parse and process HTML/XML in PHP?

I have a file that looks something like this:

``` xml
    &lt;table name=&quot;content_analyzer&quot; primary-key=&quot;id&quot;&gt;
      &lt;type=&quot;global&quot; /&gt;
    &lt;/table&gt;
    &lt;table name=&quot;content_analyzer2&quot; primary-key=&quot;id&quot;&gt;
      &lt;type=&quot;global&quot; /&gt;
    &lt;/table&gt;
    &lt;table name=&quot;content_analyzer_items&quot; primary-key=&quot;id&quot;&gt;
      &lt;type=&quot;global&quot; /&gt;
    &lt;/table&gt;
```

I need to extract anything within the quotes that follow `name=`, i.e., `content_analyzer`, `content_analyzer2` and `content_analyzer_items`.

I am doing this on a Linux box, so a solution using sed, perl, grep or bash is fine.

How to extract string following a pattern with grep, regex or perl

I need to parse (server side) big amounts of HTML pages.  
We all agree that regexp is not the way to go here.  
It seems to me that javascript is the native way of parsing a HTML page, but that assumption relies on the server side code having all the DOM ability javascript has inside a browser.


Does Node.js have that ability built in?  
Is there a better approach to this problem, parsing HTML on the server side?

How do I parse a HTML page with Node.js

I see questions every day asking how to parse or extract something from some HTML string and the first answer/comment is always &quot;Don&#39;t use RegEx to parse HTML, lest you feel the wrath!&quot; (that last part is sometimes omitted).

This is rather confusing for me, I always thought that in general, the best way to parse any complicated string is to use a regular expression.  So how does a HTML parser work?  Doesn&#39;t it use regular expressions to parse.

One particular argument for using a regular expression is that there&#39;s not always a parsing alternative (such as JavaScript, where DOMDocument isn&#39;t a universally available option).  jQuery, for instance, seems to manage just fine using a regex to convert a HTML string to DOM nodes.

Not sure whether or not to CW this, it&#39;s a genuine question that I want to be answered and not really intended to be a discussion thread.

How do HTML parses work if they&#39;re not using regexp?

Tags can have multiple attributes. The order in which attributes appear in the code does not matter. For example:
 
    &lt;a href=&quot;#&quot; title=&quot;#&quot;&gt;
    &lt;a title=&quot;#&quot; href=&quot;#&quot;&gt;


How can I &quot;normalize&quot; the HTML in Javascript, so the order of the attributes is always the same? I don&#39;t care which order is chosen, as long as it is always the same. 

**UPDATE**: my original goal was to make it easier to diff (in JavaScript)  2 HTML pages with slight differences. Because users could use different software to edit the code, the order of the attributes could change. This make the diff too verbose.

**ANSWER**: Well, first thanks for all the answers. And YES, it is possible. Here is how I&#39;ve managed to do it. This is a proof of concept, it can certainly be optimized:


    function sort_attributes(a, b) {
      if( a.name == b.name) {
        return 0;
      }

      return (a.name &lt; b.name) ? -1 : 1;
    }

    $(&quot;#original&quot;).find(&#39;*&#39;).each(function() {
      if (this.attributes.length &gt; 1) {
        var attributes = this.attributes;
        var list = [];
        
        for(var i =0; i &lt; attributes.length; i++) {
          list.push(attributes[i]);
        }
    
        list.sort(sort_attributes);
     
        for(var i = 0; i &lt; list.length; i++) {
          this.removeAttribute(list[i].name, list[i].value);
        }

        for(var i = 0; i &lt; list.length; i++) {
          this.setAttribute(list[i].name, list[i].value);
        }
      }
    });

Same thing for the second element of the diff, `$(&#39;#different&#39;)`. Now `$(&#39;#original&#39;).html()` and `$(&#39;#different&#39;).html()` show HTML code with attributes in the same order.

How to normalize HTML in JavaScript or jQuery?

I have the following bs4 object listing:


    &gt;&gt;&gt; listing
    &lt;div class=&quot;listingHeader&quot;&gt;
    &lt;h2&gt;
    ....


    &gt;&gt;&gt; type(listing)
    &lt;class &#39;bs4.element.Tag&#39;&gt;

I want to extract the raw html as a string. I&#39;ve tried:

    &gt;&gt;&gt; a = listing.contents
    &gt;&gt;&gt; type(a)
    &lt;type &#39;list&#39;&gt;

So this does not work. How can I do this?

How to get HTML from a beautiful soup object

I would like to **extract a specific type of information from web pages** in Python. Let&#39;s say postal address. It has thousands of forms, but still, it is somehow recognizable. As there is a large number of forms, it would be probably very difficult to write **regular expression** or even something like a **grammar** and to use a **parser generator** for parsing it out.

So I think the way I should go is **machine learning**. If I understand it well, I should be able to make a sample of data where I will point out what should be the result and then I have something which can learn from this how to recognize the result by itself. This is all I know about machine learning. Maybe I could use some **natural language** processing, but probably not much as all the libraries work with English mostly and I need this for Czech.

Questions:

 1. Can I solve this problem easily by machine learning? Is it a good way to go?
 2. Are there any **simple** examples which would allow me to start? I am machine learning noob and I need something practical for start; closer to my problem is better; simpler is better.
 3. There are plenty of Python libraries for machine learning. Which one would suit my problem best?
 4. Lots of such libs have not very easy-to-use docs as they come from scientific environment. Are there any good sources (books, articles, quickstarts) bridging the gap, i.e. focused on newbies who know totally nothing about machine learning? Every docs I open start with terms I don&#39;t understand such as *network*, *classification*, *datasets*, etc.

Update:

As you all mentioned I should show a piece of data I am trying to get out of the web, here is an example. I am interested in cinema *showtimes*. They look like this (three of them):

    &lt;div class=&quot;Datum&quot; rel=&quot;d_0&quot;&gt;27. června – středa, 20.00
    &lt;/div&gt;&lt;input class=&quot;Datum_cas&quot; id=&quot;2012-06-27&quot; readonly=&quot;&quot;&gt;&lt;a href=&quot;index.php?den=0&quot; rel=&quot;0&quot; class=&quot;Nazev&quot;&gt;Zah&#225;jen&#237; letn&#237;ho kina 
    &lt;/a&gt;&lt;div style=&quot;display: block;&quot; class=&quot;ajax_box d-0&quot;&gt;
    &lt;span class=&quot;ajax_box Orig_nazev&quot;&gt;z&#225;bava • hudba • film • letn&#237; bar
    &lt;/span&gt;
    &lt;span class=&quot;Tech_info&quot;&gt;Svět podle Fagi
    &lt;/span&gt;
    &lt;span class=&quot;Popis&quot;&gt;Facebookov&#225;  komiksov&#225; Fagi v pod&#225;n&#237; divadla DNO. Divok&#233; p&#237;sně, co nezařad&#237;te, ale slušně si na ně zař&#225;d&#237;te. Slovn&#237; smyčky, co se na nich jde oběsit. Kabaret, improvizace, p&#237;sně, humor, zběsilost i v srdci.&lt;br&gt;Koncert Tres Quatros Kvintet. Instrument&#225;ln&#237; muzika s pevn&#253;m funkov&#253;m groovem, jazzov&#253;mi standardy a neodmysliteln&#253;mi improvizacemi.
    &lt;/span&gt;
    &lt;input class=&quot;Datum_cas&quot; id=&quot;ajax_0&quot; type=&quot;text&quot;&gt;
    &lt;/div&gt;

    &lt;div class=&quot;Datum&quot; rel=&quot;d_1&quot;&gt;27. června – středa, 21.30
    &lt;/div&gt;&lt;input class=&quot;Datum_cas&quot; id=&quot;2012-06-27&quot; readonly=&quot;&quot;&gt;&lt;a href=&quot;index.php?den=1&quot; rel=&quot;1&quot; class=&quot;Nazev&quot;&gt;Soul Kitchen
    &lt;/a&gt;&lt;div style=&quot;display: block;&quot; class=&quot;ajax_box d-1&quot;&gt;
    &lt;span class=&quot;ajax_box Orig_nazev&quot;&gt;Soul Kitchen
    &lt;/span&gt;
    &lt;span class=&quot;Tech_info&quot;&gt;Komedie, Německo, 2009, 99 min., čes. a angl. tit.
    &lt;/span&gt;
    &lt;span class=&quot;Rezie&quot;&gt;REŽIE: Fatih Akin 
    &lt;/span&gt;
    &lt;span class=&quot;Hraji&quot;&gt;HRAJ&#205;: Adam Bousdoukos, Moritz Bleibtreu, Birol &#220;nel, Wotan Wilke M&#246;hring
    &lt;/span&gt;
    &lt;span class=&quot;Popis&quot;&gt;Posledn&#237; film mil&#225;čka publika Fatiho Akina, je turbulentn&#237;m vyzn&#225;n&#237;m l&#225;sky multikulturn&#237;mu Hamburku. S humorem zde Akin vykresluje př&#237;běh Řeka žij&#237;c&#237;ho v Německu, kter&#253; z mal&#233;ho bufetu vytvoř&#237; origin&#225;ln&#237; restauraci, jež se brzy stane obl&#237;benou hudebn&#237; sc&#233;nou. &quot;Soul Kitchen&quot; je skvěl&#225; komedie o př&#225;telstv&#237;, l&#225;sce, rozchodu a boji o domov, kter&#253; je třeba v dnešn&#237;m nevypočitateln&#233;m světě chr&#225;nit v&#237;c než kdykoliv předt&#237;m. Zvl&#225;štn&#237; cena poroty na festivalu v Ben&#225;tk&#225;ch
    &lt;/span&gt;
    &lt;input class=&quot;Datum_cas&quot; id=&quot;ajax_1&quot; type=&quot;text&quot;&gt;
    &lt;/div&gt;

    &lt;div class=&quot;Datum&quot; rel=&quot;d_2&quot;&gt;28. června – čtvrtek, 21:30
    &lt;/div&gt;&lt;input class=&quot;Datum_cas&quot; id=&quot;2012-06-28&quot; readonly=&quot;&quot;&gt;&lt;a href=&quot;index.php?den=2&quot; rel=&quot;2&quot; class=&quot;Nazev&quot;&gt;Rodina je z&#225;klad st&#225;tu
    &lt;/a&gt;&lt;div style=&quot;display: block;&quot; class=&quot;ajax_box d-2&quot;&gt;
    &lt;span class=&quot;Tech_info&quot;&gt;Drama, Česko, 2011, 103 min.
    &lt;/span&gt;
    &lt;span class=&quot;Rezie&quot;&gt;REŽIE: Robert Sedl&#225;ček
    &lt;/span&gt;
    &lt;span class=&quot;Hraji&quot;&gt;HRAJ&#205;: Igor Chmela, Eva Vrbkov&#225;, Martin Finger, Monika A. Fingerov&#225;, Simona Babč&#225;kov&#225;, Jiř&#237; Vyor&#225;lek, Jan Fišar, Jan Budař, Marek Tacl&#237;k, Marek Daniel
    &lt;/span&gt;
    &lt;span class=&quot;Popis&quot;&gt;Když v&#225;m hoř&#237; půda pod nohama, nen&#237; nad rodinn&#253; v&#253;let. B&#253;val&#253; učitel dějepisu, kter&#253; dos&#225;hl vysok&#233;ho manažersk&#233;ho postu ve v&#253;znamn&#233;m finančn&#237;m &#250;stavu, si řadu let spokojeně žije společně se svou rodinou v luxusn&#237; vile na okraji Prahy. Bezstarostn&#253; život ale netrv&#225; věčně a na povrch začnou vyplouvat machinace s penězi klientů t&#253;kaj&#237;c&#237; se cel&#233;ho veden&#237; banky. Libor se n&#225;sledně ocit&#225; pod dohledem policejn&#237;ch vyšetřovatelů, kteř&#237; mu začnou tvrdě šlapat na paty. Snaž&#237; se uniknout před hroz&#237;c&#237;m vězen&#237;m a odd&#225;lit osvětlen&#237; cel&#233; situace sv&#233; nic netuš&#237;c&#237; manželce. Rozhodne se tak pro netradičn&#237; &#250;těk, kdy pod z&#225;minkou společn&#233; dovolen&#233; odveze celou rodinu na jižn&#237; Moravu…  Rodinn&#253; v&#253;let nebo zoufal&#253; &#250;prk před spravedlnost&#237;? Igor Chmela, Eva Vrbkov&#225; a Simona Babč&#225;kov&#225; v rodinn&#233;m dramatu a neobyčejn&#233; road-movie inspirovan&#233; skutečnost&#237;.
    &lt;/span&gt;

Or like this:

    &lt;strong&gt;POSEL&amp;nbsp;&amp;nbsp; 18.10.-22.10 v 18:30 &lt;/strong&gt;&lt;br&gt;Drama. ČR/90&#180;. Režie: Vladim&#237;r Mich&#225;lek Hraj&#237;: Matěj H&#225;dek, Eva Leinbergerov&#225;, Jiř&#237; Vyor&#225;vek&lt;br&gt;Třic&#225;tn&#237;k Petr miluje kolo a sv&#233; v&#225;šni podřizuje cel&#253; svůj život. Nepl&#225;nuje, neplat&#237; &#250;čty, neřeš&#237; nic, co může&lt;br&gt;počkat  do z&#237;tra. Budov&#225;n&#237; společn&#233;ho života s př&#233;telkyn&#237; je mu proti srsti  stejně jako dělat kari&#233;ru. Aby mohl jezdit na kole, raději pracuje jako  posl&#237;ček. Jeho život je neř&#237;zen&#225; střela, ve kter&#233; neplat&#237; ž&#225;dn&#225;  pravidla. Ale probl&#233;my se na sebe na kup&#237; a je st&#225;le těžš&#237; před nimi  ujet …&lt;br&gt; &lt;br&gt;
    
    &lt;strong&gt;VE ST&#205;NU&amp;nbsp; 18.10.-24.10. ve 20:30 a 20.10.-22.10. t&#233;ž v 16:15&lt;/strong&gt;&lt;br&gt;Krimi. ČR/98&#180;. Režie: D.Vondř&#237;ček Hraj&#237;: I.Trojan, S.Koch, S.Norisov&#225;, J.Štěpnička, M.Tacl&#237;k&lt;br&gt;Kapit&#225;n  Hakl (Ivan Trojan) vyšetřuje kr&#225;dež v klenotnictv&#237;. Z běžn&#233; vloupačky  se ale vlivem z&#225;kulisn&#237;ch intrik tajn&#233; policie zač&#237;n&#225; st&#225;vat politick&#225;  kauza. Z nař&#237;zen&#237; St&#225;tn&#237; bezpečnosti přeb&#237;r&#225; Haklovo vyšetřov&#225;n&#237; major  Zenke (Sebastian Koch), policejn&#237; specialista z NDR, pod jehož veden&#237;m  se vyšetřov&#225;n&#237; ub&#237;r&#225; jin&#253;m směrem, než Haklovi napov&#237;d&#225; instinkt  zkušen&#233;ho kriminalisty. Na vlastn&#237; pěst pokračuje ve vyšetřov&#225;n&#237;. Může  jedin&#253; spravedliv&#253; obst&#225;t v boji s dobře propojenou s&#237;t&#237; komunistick&#233;  policie?&amp;nbsp; Protivn&#237;k je siln&#253; a Hakl se brzy přesvědčuje, že věřit nelze  nikomu a ničemu. Každ&#253; m&#225; svůj st&#237;n minulosti, sv&#233; slab&#233; m&#237;sto, kter&#233;  dok&#225;že z obět&#237; udělat vin&#237;ky a z vin&#237;ků hrdiny. &lt;br&gt;&lt;br&gt;
    
    &lt;strong&gt;ASTERIX A OBELIX VE SLUŽB&#193;CH JEJ&#205;HO VELIČENSTVA&amp;nbsp; ve 3D&amp;nbsp;&amp;nbsp;&amp;nbsp; 20.10.-21.10. ve 13:45 &lt;/strong&gt;&lt;br&gt;Dobrodružn&#225; fantazy. Fr./124&#180;. ČESK&#221; DABING. Režie: Laurent Tirard&lt;br&gt;Hraj&#237;: G&#233;rard Depardieu, Edouard Baer, Fabrice Luchini&lt;br&gt;Pod  veden&#237;m Julia Caesara napadly proslul&#233; ř&#237;msk&#233; legie Brit&#225;nii. Jedn&#233;  mal&#233; vesničce se však dař&#237; statečně odol&#225;vat, ale každ&#253;m dnem je slabš&#237; a  slabš&#237;. Britsk&#225; kr&#225;lovna proto vyslala sv&#233;ho věrn&#233;ho důstojn&#237;ka  Anticlimaxe, aby vyhledal pomoc u Galů v druh&#233; malink&#233; vesničce ve  Francii vyhl&#225;šen&#233; sv&#253;m důmysln&#253;m bojem proti Ř&#237;manům… Když Anticlimax  popsal zoufalou situaci sv&#253;ch lid&#237;, Galov&#233; mu darovali barel sv&#233;ho  kouzeln&#233;ho lektvaru a Ast&#233;rix a Ob&#233;lix jsou pověřeni doprovodit ho domů.  Jakmile doraz&#237; do Brit&#225;nie, Anticlimax jim představ&#237; m&#237;stn&#237; zvyky ve  vš&#237; par&#225;dě a všichni to poř&#225;dně roztoč&#237;! Vytočen&#253; Caesar se však  rozhodne naverbovat Normanďany, hrůzu nah&#225;něj&#237;c&#237; bojovn&#237;ky Severu, aby  jednou provždy skoncovali s Brity. &lt;br&gt;&lt;br&gt;

Or it can look like anything similar to this. No special rules in HTML markup, no special rules in order, etc.

Extracting an information from web page by machine learning

I would like to scrape a list of items from a website, and preserve the order that they are presented in. These items are organized in a table, but they can be one of two different classes (in random order).

Is there any way to provide multiple classes and have BeautifulSoup4 find all items which are in any of the given classes?

I need to achieve what this code does, except preserve the order of items as it was in the source code:

    items = soup.findAll(True,{&#39;class&#39;:&#39;class1&#39;})
    items += soup.findAll(True,{&#39;class&#39;:&#39;class2&#39;})


BeautifulSoup findAll() given multiple classes?

How do you parse HTML with a variety of languages and parsing libraries? 

----

When answering:

Individual comments will be linked to in answers to questions about how to parse HTML with regexes as a way of showing the right way to do things.

For the sake of consistency, I ask that the example be parsing an HTML file for the `href` in anchor tags. To make it easy to search this question, I ask that you follow this format

Language: [language name]

Library: [library name]

    [example code]

Please make the library a link to the documentation for the library. If you want to provide an example other than extracting links, please also include:

Purpose: [what the parse does]

  [1]: http://stackoverflow.com/questions/701166

Can you provide examples of parsing HTML?

Is there any Python library that allows me to parse an HTML document similar to what `jQuery` does?

i.e. I&#39;d like to be able to use **CSS selectors syntax** to grab an arbitrary set of nodes from the document, read their content/attributes, etc.

The only Python HTML parsing lib I&#39;ve used before was **BeautifulSoup**, and even though it&#39;s fine I keep thinking it would be faster to do my parsing if I had jQuery syntax available. :D

jquery-like HTML parsing in Python?

I want to parse a string which contains HTML text. I want to do it in JavaScript.

I tried the [Pure JavaScript HTML Parser library](https://johnresig.com/blog/pure-javascript-html-parser/) but it seems that it parses the HTML of my current page, not from a string. Because when I try the code below, it changes the title of my page:

    var parser = new HTMLtoDOM(&quot;&lt;html&gt;&lt;head&gt;&lt;title&gt;titleTest&lt;/title&gt;&lt;/head&gt;&lt;body&gt;&lt;a href=&#39;test0&#39;&gt;test01&lt;/a&gt;&lt;a href=&#39;test1&#39;&gt;test02&lt;/a&gt;&lt;a href=&#39;test2&#39;&gt;test03&lt;/a&gt;&lt;/body&gt;&lt;/html&gt;&quot;, document);

My goal is to extract links from an HTML external page that I read just like a string.

Do you know an API to do it?

Parse an HTML string with JS

I&#39;m in halfway trough an html parser and found html5 defined **explicitly** the rules of thumb for parsing *ill formed html*. *(And I used to infer them from DTDs, sigh)*

I love that fact, but I know well that html5 isn&#39;t finalized yet (also I wonder if it ever will) and that it isn&#39;t developed by the W3C, but by the WHATWG.

Searching for the spec I need I&#39;m presented with:

 * 8.2 section of the **W3C** *TR*  
http://www.w3.org/TR/html5/syntax.html#parsing

or

* 11.2 section of the **WHATWG** *web-apps/current-work*  
http://www.whatwg.org/specs/web-apps/current-work/multipage/parsing.html

If it wasn&#39;t for the section numbers I would induce those are simply the same. But the different numbering makes me wonder. *Which version is, supposedly, the most authoritative?*

WHATWG seems to have more sections, and to have been *added to* since W3C uploaded its candidate recommendation.

Will W3C update to the WHATWG version?  
Or will they stick to their current candidate until it gets to the official recommendation status?

**Which html5 spec are we poor devils supposed to follow, when in doubt?**

HTML5: W3C vs WHATWG. Which gives the most authoritative spec?

I want to use the HTML agility pack to parse tables from complex web pages, but I am somehow lost in the object model.

I looked at the link example, but did not find any table data this way.
Can I use XPath to get the tables? I am basically lost after having loaded the data as to how to get the tables. I have done this in Perl before and it was a bit clumsy, but worked. (`HTML::TableParser`). 

I am also happy if one can just shed a light on the right object order for the parsing.

HTML Agility pack - parsing tables

From what I can make out, the two main HTML parsing libraries in Python are lxml and BeautifulSoup. I&#39;ve chosen BeautifulSoup for a project I&#39;m working on, but I chose it for no particular reason other than finding the syntax a bit easier to learn and understand. But I see a lot of people seem to favour lxml and I&#39;ve heard that lxml is faster.

So I&#39;m wondering what are the advantages of one over the other? When would I want to use lxml and when would I be better off using BeautifulSoup? Are there any other libraries worth considering?

Parsing HTML in python - lxml or BeautifulSoup? Which of these is better for what kinds of purposes?

Given a news article webpage (from any major news source such as times or bloomberg), I want to  identify the main article content on that page and throw out the other misc elements such as ads, menus, sidebars, user comments. 

What&#39;s a generic way of doing this that will work on most major news sites?  

What are some good tools or libraries for data mining? (preferably python based)



Web scraping - how to identify main content on a webpage

I am trying to grab the capital letters of a couple of words and wrap them in span tags. I am using [preg_replace][1] for extract and wrapping purposes, but it&#39;s not outputting anything.

    preg_replace(&quot;/[A-Z]/&quot;, &quot;&lt;span class=\&quot;initial\&quot;&gt;$1&lt;/span&gt;&quot;, $str)

   [1]: http://php.net/manual/en/function.preg-replace.php

All Html Parsing Solutions on Gang of Coders

Total of 25 Html Parsing Solutions