USG pulls 'sensitive' info off net

Subcommander Bob bob at black.org
Wed Oct 3 18:25:51 PDT 2001


02:49 PM 10/3/01 -0700, Steve Schear wrote:
>> > On Wed, Oct 03, 2001 at 06:38:05AM -0700, Khoder bin Hakkin wrote:
>> > > Must've never heard of caching..
>The trouble with Google and most other spiders is that they cannot
access
>the DBs behind the sites.  Various industry estimates place the amount
of
>data not accessible to crawlers at up to 500x the html content.  What's

>needed are open access data mining sites using more sophisticated
crawlers
>like http://telegraph.cs.berkeley.edu/

Or for readers to take "Google" as representative
of wget-crazed ephemeral rogue libertarian librarians.





More information about the cypherpunks-legacy mailing list