one of the things i've done is using wget to fetch a list of (news,
article oriented) websites, figure out the difference (since last seen)
... select the individual article URLs that are new/different ... then
check the firefox sqlite history repository ... and get firefox to fetch
the new/unseen URls in different tabs. A days worth might be 300-600
tabs. the objective is that it eliminates the latency associated with
the traditional point&click on the web. once the URls are fetched ... it
is purely local response ... and in the past year or so, firefox
overhead has gotten significantly better handling hundreds of open tabs.
recent posts mentioning some of the glue for doing this
http://www.garlic.com/~lynn/2008b.html#32 Tap and faucet and spellcheckers
http://www.garlic.com/~lynn/2008b.html#35 Tap and faucet and spellcheckers
there is a little heuristic ... some news/article oriented sites have
countermeasures for multiple hits from the same client address in short
period of time ... i.e. the tab fetches have to be spaced out over time.