How come search engines don't crawl the list and I can't find 'robots.txt'?
AFAICT the list archives don't show in search engines and in addition don't see /robots.txt. How so?
On Sun, Apr 13, 2014 at 6:53 AM, Georgi Guninski <guninski@guninski.com> wrote:
back when traffic was handled on the al-qaeda.net domain, indexing by western search engines was considered to be "material support to Al-qaeda"... now they've just forgotten to undo their filters. ;)
I have heard about the existence of this mailing list for years ... yet never found it with search engines. I never did a positive effort to find it too, let's be honest. It was kind of "one day I may meet that crowd by chance". One day a few months ago I found a guy that posted in another list I was subscribed and also here. Lo and behold, that's the famed mailing list that cannot be found anywhere where reasonable people would search. You guys are hidden in the deepwebz, Google doesn't index it, you are the bad bad turrists, lol.
On Sun, 13 Apr 2014 07:08:27 -0700 coderman <coderman@gmail.com> wrote:
https://www.google.com/search?q=test+site%3Acpunks.org%2Fpipermail%2Fcypherp... the archives are indeed indexed?
On Sun, Apr 13, 2014 at 04:53:52PM +0300, Georgi Guninski wrote:
As of now this list appears archived on gmane and is indexed on google: http://blog.gmane.org/gmane.comp.security.cypherpunks
participants (4)
-
coderman -
Georgi Guninski -
Linux User -
tpb-crypto＠laposte.net