Duffbert does admin! Exclude From Log setting in the server doc is great...
Category IBM/Lotus
I rely upon the domlog.nsf file for a number of things in some of my web applications. My user base wants to know basic hit counts for various items in the applications, so I parse out relevant entries into "webhit" databases that can then be sliced and diced. So far so good...
But have you ever looked at the domlog.nsf file for an active Domino web server? It gets really large, really fast. And quite frankly, I don't care that the browser had requests to four different gif files every time a particular page was loaded. I wondered if there was a way to filter out certain types of domlog.nsf entries so that I was getting more wheat, less chaff.
Keep in mind I'm a developer by nature, not an admin... :)
Some research took me to the Exclude From Log section in the Server document. The URL field allows you to place certain strings that, when appearing in the URL of the log entry, cause it not to be written to domlog.nsf. I quickly determined that I really had no need for the following entries:
*.gif
*.jpg
*.jpeg
*.bmp
*.js
*.css
*IEmen.htc
*?OpenImageResource
After the filtering kicked in, I was starting to see a lot more important content rather than a ton of junk to sift through. Very nice...
As an experiment to see how much volume I was saving, I compared a one hour time period (1 to 2 pm) from last Friday (pre-filter) and today (post-filter). The number of domlog.nsf entries dropped from approximately 35000 documents to 16000 documents. Over a 50% savings in volume. I *really* like that!
Even better, that means my daily domlog.nsf parsing agents will only have to run against 50% of the previously normal volumes. Whoo-hoo!
You know you're a geek when something like this really makes your day...
I rely upon the domlog.nsf file for a number of things in some of my web applications. My user base wants to know basic hit counts for various items in the applications, so I parse out relevant entries into "webhit" databases that can then be sliced and diced. So far so good...
But have you ever looked at the domlog.nsf file for an active Domino web server? It gets really large, really fast. And quite frankly, I don't care that the browser had requests to four different gif files every time a particular page was loaded. I wondered if there was a way to filter out certain types of domlog.nsf entries so that I was getting more wheat, less chaff.
Keep in mind I'm a developer by nature, not an admin... :)
Some research took me to the Exclude From Log section in the Server document. The URL field allows you to place certain strings that, when appearing in the URL of the log entry, cause it not to be written to domlog.nsf. I quickly determined that I really had no need for the following entries:
*.gif
*.jpg
*.jpeg
*.bmp
*.js
*.css
*IEmen.htc
*?OpenImageResource
After the filtering kicked in, I was starting to see a lot more important content rather than a ton of junk to sift through. Very nice...
As an experiment to see how much volume I was saving, I compared a one hour time period (1 to 2 pm) from last Friday (pre-filter) and today (post-filter). The number of domlog.nsf entries dropped from approximately 35000 documents to 16000 documents. Over a 50% savings in volume. I *really* like that!
Even better, that means my daily domlog.nsf parsing agents will only have to run against 50% of the previously normal volumes. Whoo-hoo!
You know you're a geek when something like this really makes your day...
| Permalink |
Comments
Peace
Posted by Trina At 18:31:38 On 21/11/2006 | - Website - |
Posted by Duffbert At 06:34:30 On 18/11/2006 | - Website - |
Posted by Duffbert At 19:12:20 On 21/11/2006 | - Website - |
have you ever considered "logging to files" instead of the domlog.nsf? The files created adher to to standard Apache/NCSA Logfile format and can therefor be analyzed with all the standard tools for that job.
Julian posted his article "Reporting On Domino Web Server Logs With AWStats" a while ago and this is IMHO way more usable and featurerich then any other solution.
http://www.nsftools.com/tips/UsingAwstatsWithDomino.htm
Posted by Martin 'm3' Leyrer At 05:56:33 On 18/11/2006 | - Website - |