Skip to topic | Skip to bottom
Home
Main
Main.ScreenScrapingr1.1 - 28 Jan 2005 - 22:01 - JeremyCothrantopic end

Start of topic | Skip to actions
Some sample scripts for screen scraping

JeremyCothran

NWLON (tides)

  • screen scrape the predicted water levels(lwpNWLONPredicted.pl) from a list of sites(Carocoops sample list of sites also attached as nwlon_stations.txt)

  • screen scrape the actual water levels(lwpNWLONActual.pl) from a list of stations

  • compute and update the difference for the collected values(NWLONDiff.pl)

Also attached a description of the postgres table(water_level.txt) this is running this against - note there is a unique index on the station and date time, so the initial process does an insert and the following processes do updates based on the same station and datetime.

-- JeremyCothran - 28 Jan 2005
to top

I Attachment Action Size Date Who Comment
nwlon_stations.txt manage 0.1 K 28 Jan 2005 - 22:00 JeremyCothran  
lwpNWLONPredicted.pl.txt manage 1.8 K 28 Jan 2005 - 22:01 JeremyCothran  
lwpNWLONActual.pl.txt manage 2.3 K 28 Jan 2005 - 22:01 JeremyCothran  
NWLONDiff.pl.txt manage 1.8 K 28 Jan 2005 - 22:01 JeremyCothran  
water_level.txt manage 1.2 K 28 Jan 2005 - 22:02 JeremyCothran  

You are here: Main > ScreenScraping

to top

Copyright © 1999-2017 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding DMCC? Send feedback