You may also want to look into Swatch. It's a utility to help manage and watch log files. SANS has an article "Using Swatch to Utilize Your Logs" which may help you determine if Swatch will work for you.

Cheers: