|
|
|
| |||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
#1
|
||||
|
||||
|
Best lightweight database to use for log files
I just want to throw this question out there to see what other people's opinions are on this subject. My goal in my current project is this. I want to parse the Postfix log files and dump the contents to a database for fast lookups by our support staff. Currently the log files reach sizes on a per-day basis of approximately 12 gigs (this is for a small ISP). We frequently need to access the log files to troubleshoot email problems that customers have. What I'm looking for is something that is lightweight, simple, has a Perl API and is fast for lookups. My experience to this point has been with SQL databases such as postgres, MySQL and MSSQL. I'm thinking that these may be a slower and more feature ridden than what I'm really looking for, but then again, I may be wrong... Anyhow, I'm looking for opinions here. Incidentally, this is a Sun OS 5.8 machine.
__________________
badger badger badger badger badger badger badger badger MUSHROOM MUSHROOM |
|
#2
|
||||
|
||||
|
Quote:
__________________
~~ Peter ~~ ( My Blog: It's exactly like normal nerdiness, but completely different. ) :: ( Supporter of the EFF & FSF ) :: ( I'm a GNU/Linux addict and Free Software Advocate. ) :: ( How to Ask Questions the Smart Way ) :: ( The Fedora Project, sponsored by Red Hat ) :: ( GNOME: The Free Software Desktop Project ) :: ( GnuPG Public Key ) |
|
#3
|
||||
|
||||
|
MySQL is one of the lighter-weight DB's ( especially if you go for an older version like 3.2x or 4.0 - they've progressively added more features, and the latest 5.0 is noticeably slower ).
There are two others that are much lighter, but I'm not sure if they'll work on your OS. Firebird ( haven't used it myself, but I've heard very good things ) and SQLite which is very cool, and only a few hundred kb. Not sure how well it handles multiple users, but this may not be a problem for you. It can handle DB's up to 2TB, and is very fast. --Simon
__________________
|
|
#4
|
||||
|
||||
|
It depends how much work it will actually be doing but by the sounds of it, i'd go with SQLite. If demand gets too big, switch to PostGresSQL (the `big gun`, if you like). Both are free to use and have lovely PERL modules for using them
__________________
~James [Not currently seeking freelance work] Like philosophy or interested in spirituality? Philosophorum. Game Dev Experts Forums Foresight Linux - Because your desktop should be cool! Linux FAQ FedoraFAQ UbuntuGuide |
![]() |
| Viewing: Dev Shed Forums > Operating Systems > UNIX Help > Best lightweight database to use for log files |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|