How come search engines don't crawl the list and I can't find 'robots.txt'?

Georgi Guninski guninski at guninski.com
Sun Apr 13 07:38:19 PDT 2014


On Sun, Apr 13, 2014 at 07:08:27AM -0700, coderman wrote:
> On Sun, Apr 13, 2014 at 6:53 AM, Georgi Guninski <guninski at guninski.com> wrote:
> > AFAICT the list archives don't show in search engines
> > and in addition don't see /robots.txt.
> >
> > How so?
> 
> back when traffic was handled on the al-qaeda.net domain, indexing by
> western search engines was considered to be "material support to
> Al-qaeda"...
> 
> now they've just forgotten to undo their filters.
> 
> ;)

lol...

the russian and chinese comrades don't show the
list too, might be for technical reasons.

does a single search engine crawls
the archives and displays the results?




More information about the cypherpunks mailing list