How come search engines don't crawl the list and I can't find 'robots.txt'?
Georgi Guninski
guninski at guninski.com
Sun Apr 13 07:38:19 PDT 2014
On Sun, Apr 13, 2014 at 07:08:27AM -0700, coderman wrote:
> On Sun, Apr 13, 2014 at 6:53 AM, Georgi Guninski <guninski at guninski.com> wrote:
> > AFAICT the list archives don't show in search engines
> > and in addition don't see /robots.txt.
> >
> > How so?
>
> back when traffic was handled on the al-qaeda.net domain, indexing by
> western search engines was considered to be "material support to
> Al-qaeda"...
>
> now they've just forgotten to undo their filters.
>
> ;)
lol...
the russian and chinese comrades don't show the
list too, might be for technical reasons.
does a single search engine crawls
the archives and displays the results?
More information about the cypherpunks
mailing list