[FoRK] Scientific Search Option, Vertical Search Engines

Eugen Leitl eugen at leitl.org
Fri Apr 16 12:11:35 PDT 2004

On Mon, Apr 12, 2004 at 07:56:30AM -0700, Dave Long wrote:

> cf. Sitaker, (more on) "distributed peer-to-peer full-text web searching" 
> http://lists.canonical.org/pipermail/kragen-tol/2004-February/000753.html
> http://lists.canonical.org/pipermail/kragen-tol/2004-February/000754.html

Good stuff, but p2p community has been addressing the missing issues lately.
Empirical info shows most nodes are unreliable, but for some. Prestige needs
to be addressed in the queries. Pipe bandwidth needs to be addressed. 

The holy grail is an agoric encrypted global store, URI being host-agnostic,
and indexing documents with a crypto hash; reliable and high-performance. We
might be a decade away from such a system, maybe longer.

Sure, if Apache would come with a spider, submission hooks (WebDAV?), full
text indexer and a search engine, all built and enabled by default, much
would be gained.

Even if you only crawl your intranet, it's very usable. I once inadvertedly
indexed a few Windows systems with updatedb, found quite a few things.

Eugen* Leitl <a href="http://leitl.org">leitl</a>
ICBM: 48.07078, 11.61144            http://www.leitl.org
8B29F6BE: 099D 78BA 2FD3 B014 B08A  7779 75B0 2443 8B29 F6BE
http://moleculardevices.org         http://nanomachines.net
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 198 bytes
Desc: not available
Url : http://lair.xent.com/pipermail/fork/attachments/20040416/22d4086f/attachment.pgp

More information about the FoRK mailing list