Linux Log optimiztion software

[frpeter]

Hello,

I have written a program that optimizes log writting. Here are the Features:

Logger is a gpl licensed linux utility to take control of system logs. features include:

* Ability to handle logs over 2 gigs.

* Automatic nightly log rotation without effecting any services dependent on it.

* Perforamce increase in software logging to Logger. High log usage software like Apache, Exim, and Squid show dramatic improvement.

* Any application that writes a log can be maintained be Logger (including syslogd).

* Light, small, and fast.

* Emphasizes security.

* Reduces drive usage through memory queueing. On my system, my log drive temperature dropped from 125 deg. (F) to 95 deg (F). This also makes available the option of spinning down the hard drive to conserve power (a must for laptops).

Please check it out and let me know what you think. The URL is:

http://freshmeat.net/projects/slogger

Thank you.

[SirDice]

* Emphasizes security.

* Reduces drive usage through memory queueing.

So, what will happen to the logs in memory if the server suddenly dies?

[frpeter]

Hello,

So, what will happen to the logs in memory if the server suddenly dies?

Good queston.

If the server is on a UPS, Logger will respond to the killall issued by the server shutdown scripts and flush all logged data to disk. Otherwise, unfortunately the same fate as any other log that hasn't been actually flushed to disk.

The key is to balance performance vs risk. That applies to any software that writes a log.

I do have plans for TCP connections to transfer logs to a dedicated log server using the same memory queueing approach to maximize bandwidth.

[frpeter]

Hello,

Just a quick update...

TCP connections are fully implemented. One use that I rely on heavily is having my system logs from my laptop saved to my desktop. This has a considerabe saving on my battery and increases performance quite a bit.

Also, sys/klogd can be completely replaced now. This is a very significant performance boost for anyone using Logger instead of sys/klogd.

Please have a look and let me know what you think:

http://freshmeat.net/projects/slogger/