Re: [ILUG] Caching downloaded programs at gateway

From: Ray Kelly (ray at domain skynet.ie)
Date: Thu 18 Jul 2002 - 14:50:30 IST


one basic option that I know of is Squidalyser, http://ababa.org/
This doesn't do everything that you want but I've found
it useful myself on a number of fronts
Now it won't hive off things that have been downloaded but
it your cache is so tuned and you've got the dick space you
can keep some rather large objects in that.

It works by going through your squid logs & chucking them into a MySQL db
with an expiration date (default is one month).
it's frontend is a perl cgi & from this you can do a "relativly" quick
search on what's gone through squid & potentially from there save
stuff from your cache to disk.

it's also useful to see how much Pr0n your directors are grabbing per hour :)

another (probably simpler) way is
"grep interesting_stuff squid/access.log" & from there attack your
(pruned) output with a proxy configured wget
I'm pretty sure that this wouldn't be too difficult to script

le meas
        Ray ...

Justin MacCarthy wrote:
> I have a Linux gateway, with squid & firewall & IDS at home. I was
> wondering is there a way of caching / saving any downloads that are
> requested from machines on the network and coping the them with their URLs
> to a central repository.
>
> Something like
>
> E.G. all rpm are saved to rpms/url_of_rpm/downloadedfile.rpm
>
> It there anything that does it? Can you get Squid to do something like this



This archive was generated by hypermail 2.1.6 : Thu 06 Feb 2003 - 13:17:58 GMT