From mboxrd@z Thu Jan  1 00:00:00 1970
Received: (from majordomo@localhost) by pauillac.inria.fr (8.7.6/8.7.3) id SAA18702; Mon, 21 Jun 2004 18:03:34 +0200 (MET DST)
X-Authentication-Warning: pauillac.inria.fr: majordomo set sender to owner-caml-list@pauillac.inria.fr using -f
Received: from concorde.inria.fr (concorde.inria.fr [192.93.2.39]) by pauillac.inria.fr (8.7.6/8.7.3) with ESMTP id SAA18630 for <caml-list@pauillac.inria.fr>; Mon, 21 Jun 2004 18:03:33 +0200 (MET DST)
Received: from aomori.annexia.org (annexia.force9.co.uk [212.56.101.183])
	by concorde.inria.fr (8.12.10/8.12.10) with ESMTP id i5LG3XSH001604
	for <caml-list@inria.fr>; Mon, 21 Jun 2004 18:03:33 +0200
Received: from rich by aomori.annexia.org with local (Exim 3.36 #1 (Debian))
	id 1BcRGb-0007az-00
	for <caml-list@inria.fr>; Mon, 21 Jun 2004 17:03:29 +0100
Date: Mon, 21 Jun 2004 17:03:28 +0100
To: caml-list@inria.fr
Subject: [Caml-list] Parse crazy HTML, output XML
Message-ID: <20040621160328.GA28952@redhat.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
User-Agent: Mutt/1.5.5.1+cvs20040105i
From: Richard Jones <rich@annexia.org>
X-Miltered: at concorde with ID 40D706D5.000 by Joe's j-chkmail (http://j-chkmail.ensmp.fr)!
X-Loop: caml-list@inria.fr
X-Spam: no; 0.00; fragment:01 pxp:01 dbi:99 threads:01 ltd:98 ocaml:01 ocaml:01 external:03 library:03 library:03 bunch:03 parse:04 parse:04 efficient:05 investment:94 
Sender: owner-caml-list@pauillac.inria.fr
Precedence: bulk

I have a bunch of HTML documents from an external source which I do
not control.  They aren't valid XML, by any means.  I need to read
them in, do a "best effort" to build a DOM, do various manipulations
over the DOM (such as removing <script> tags, replace <B> with
<strong>, etc.), and output an XHTML fragment.  I also need to do this
from an OCaml program.

Example input:

---
This is <B>the sort of document</B> which I have to parse.<br>
<br>
<br>
---

Desired output:

---
<p>
This is <strong>the sort of document</strong> which I have to parse.
</p>
---

The problem is the parsing phase.  Both PXP and XmlLight will only
parse valid XML (as far as I can see).  Is there any simple pure OCaml
library for parsing HTML and producing a DOM?

Rich.

-- 
Richard Jones. http://www.annexia.org/ http://www.j-london.com/
Merjis Ltd. http://www.merjis.com/ - improving website return on investment
PTHRLIB is a library for writing small, efficient and fast servers in C.
HTTP, CGI, DBI, lightweight threads: http://www.annexia.org/freeware/pthrlib/

-------------------
To unsubscribe, mail caml-list-request@inria.fr Archives: http://caml.inria.fr
Bug reports: http://caml.inria.fr/bin/caml-bugs FAQ: http://caml.inria.fr/FAQ/
Beginner's list: http://groups.yahoo.com/group/ocaml_beginners