> "Kenn Humborg" said:
> > Before I go and write a mega-pipe that uses select() or
> > poll() to implement a large buffer between two processes,
> > does anyone know of any existing tool to do this?
>> I doubt the pipe buffer will help much.
>> The big problem is probably the fact that you're using NFS. Try plain
> TCP, such as "rsh" if possible, to make it a bit more efficient.
I'll try it, but I'm not convinced. Just pulling across NFS
(i.e. 100% network-I/O-bound) takes 20secs. Decompression
(CPU-bound) takes 20secs of CPU time. Doing them together
takes 40secs, while, in theory, the I/O and CPU could happen
in parallel, giving a run time of 20secs.
However, using raw TCP will give me a 32K buffer in the kernel,
which may be enough to stay ahead of gunzip.
I'll be back...
Later,
Kenn
Maintained by the ILUG website team. The aim of Linux.ie is to
support and help commercial and private users of Linux in Ireland. You can
display ILUG news in your own webpages, read backend
information to find out how. Networking services kindly provided by HEAnet, server kindly donated by
Dell. Linux is a trademark of Linus Torvalds,
used with permission. No penguins were harmed in the production or maintenance
of this highly praised website. Looking for the
Indian Linux Users' Group? Try here. If you've read all this and aren't a lawyer: you should be!
