On Wed, Apr 13, 2016 at 9:57 AM, Marcelo Zabani <mzabani@gmail.com> wrote:
Hi, Tom,
You're right, I don't think one can argue that the default parser should know HTML.
How about your suggestion of there being an HTML parser, is it feasible? I ask this because I think that a lot of people store HTML documents these days, and although there probably aren't lots of HTML with words written along multiple inline elements, it would certainly be nice to have a proper parser for these use cases.
What do you think?
I recommend using Apache Tika [1] for plain text extraction from HTML. There are so many weird edge cases when parsing HTML that it is easier to use something that is already mature than reinventing the wheel.