RE: [ILUG] Web Logger + Indexer

From: Kenn Humborg (kenn at domain bluetree.ie)
Date: Thu 11 May 2000 - 15:20:39 IST


> Who was asking a few months ago about a user-space
> proxy that would log all HTTP requests so they
> could be indexed and then searched later?
> (basically a history file merged from all browsers)

That was me.

> Anyway, I just downloaded JunkBuster and discovered
> it is GPLed and compiles for Unix and Win32. It's
> a user-space proxy for blocking URLs/domains one
> doesn't like (such as doubleclick.net)and allows
> good control over cookies also.
>
> Why not simply put logging code into it?

Implementing the proxying is the easy part. These are
the hard parts:

1. Full-text indexing all the incoming HTML.
2. Providing a CGI search front-end to this index.
3. Making sure that each user can only access his
   own index.
4. Allow the proxy and/or indexer and/or index
   and/or search front-end to be on separate machines
   so that I can access my index from anywhere,
   securely.

Actually, no 2 is fairly easy...

Later,
Kenn



This archive was generated by hypermail 2.1.6 : Thu 06 Feb 2003 - 13:06:06 GMT