Sunday, March 30, 2008

crawling back with hpricot

I've managed to make significant progress using Hpricot. After having abandoned it for a while and turned to things like Mechanize, scRUBYt, etc, I was shown how Hpricot did everything I needed without all the behind-the-scenes magic. I now have a working script that'll pull data off the web and record it, as well as pull additional urls to pull even more data. Now its a matter of populating the db with all this info.

more to come...