Search engines and https

Adam Back aba at dcs.ex.ac.uk
Wed Nov 19 04:52:17 PST 1997




Lucky Green <shamrock at cypherpunks.to> writes:
> While trying to submit the cypherpunks.to website to a few search engines,
> I noticed that none of them seems to support indexing of https URL's. Is
> anybody here aware of a search engine that indexes secure web pages? And
> if there is no such search engine, what are the thoughts on using https to
> deliberately keep pages out of indices?

One thing you could do is to have your server use http (no s) iff the
connection comes from a known search engine.  Reasonably easy to do --
set up an http server, and block all sites, and put in allow
directives for the search engines.

It's not as if you're insisting on client certs for the HTTPS server.

Adam







More information about the cypherpunks-legacy mailing list