Get a page from the Web

Get a page from the Web

[Martin Chabr]

Hello,

I have been looking for ways to get a page in HTML
from the Web, using an OCaml program, something like
the following Python snippet:

import urllib
URL = "http://www.ibm.com"
url = urllib.urlopen(URL)
html = url.read()

You supply the URL and receive the page in HTML. Is
there anything simple like that in OCaml?

Regards,

Martin



	

	
		
___________________________________________________________ 
Gesendet von Yahoo! Mail - Jetzt mit 1GB Speicher kostenlos - Hier anmelden: http://mail.yahoo.de

Re: [Caml-list] Get a page from the Web

[Karl Zilles]

Martin Chabr wrote:
> I have been looking for ways to get a page in HTML
> from the Web, using an OCaml program, something like
> the following Python snippet:
> 
> import urllib
> URL = "http://www.ibm.com"
> url = urllib.urlopen(URL)
> html = url.read()
> 
> You supply the URL and receive the page in HTML. Is
> there anything simple like that in OCaml?

I use the Ocaml binding to the curl library.  It has worked well for me 
and it can handle high level details like maintaining cookies across 
calls (for session continuity and logins):

http://sourceforge.net/projects/ocurl/

Re: [Caml-list] Get a page from the Web

[Florian Weimer]

* Martin Chabr:

> import urllib
> URL = "http://www.ibm.com"
> url = urllib.urlopen(URL)
> html = url.read()

You could use the Netclient library:

let s = Http_client.Convenience.http_get "http://www.ibm.com" in
  output_string stdout s

(Compile with: ocamlfind ocamlc -package netclient -linkpkg file.ml)

Re: [Caml-list] Get a page from the Web

[Richard Jones]

And yet another way is to use perl4caml[1] and WWW::Mechanize[2] which
is wrapped by perl4caml.  This allows you to fairly easily navigate
websites (click links, push buttons, fill in forms and so on).

Rich.

[1] http://merjis.com/developers/perl4caml/
[2] http://search.cpan.org/dist/WWW-Mechanize/lib/WWW/Mechanize.pm

-- 
Richard Jones, CTO Merjis Ltd.
Merjis - web marketing and technology - http://merjis.com
Team Notepad - intranets and extranets for business - http://team-notepad.com

Ant: Re: [Caml-list] Get a page from the Web

[Martin Chabr]

Many thanks to all of you for the information!

Martin


	

	
		
___________________________________________________________ 
Gesendet von Yahoo! Mail - Jetzt mit 1GB Speicher kostenlos - Hier anmelden: http://mail.yahoo.de

Re: Ant: Re: [Caml-list] Get a page from the Web

[Eric Cooper]

On Mon, Nov 07, 2005 at 10:47:02PM +0100, Martin Chabr wrote:
> --- Karl Zilles <zilles@1969web.com> schrieb:
> > http://sourceforge.net/projects/ocurl/

Here are two other ways: the ocamlnet package has an HTTP client,
or you can use Unix.open_process_in with "curl" or "wget".

-- 
Eric Cooper             e c c @ c m u . e d u

Ant: Re: [Caml-list] Get a page from the Web

[Martin Chabr]

That was fast! Thank you, Karl, I will have a look.

Martin

--- Karl Zilles <zilles@1969web.com> schrieb:

> Martin Chabr wrote:
> > Hello,
> > 
> > I have been looking for ways to get a page in HTML
> > from the Web, using an OCaml program, something
> like
> > the following Python snippet:
> > 
> > import urllib
> > URL = "http://www.ibm.com"
> > url = urllib.urlopen(URL)
> > html = url.read()
> > 
> > You supply the URL and receive the page in HTML.
> Is
> > there anything simple like that in OCaml?
> 
> I use the Ocaml binding to the curl library.  It has
> worked well for me 
> and it can handle high level details like
> maintaining cookies across 
> calls (for session continuity and logins):
> 
> http://sourceforge.net/projects/ocurl/
> 



	

	
		
___________________________________________________________ 
Gesendet von Yahoo! Mail - Jetzt mit 1GB Speicher kostenlos - Hier anmelden: http://mail.yahoo.de