Database Management
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsDatabasesDatabase Management

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
Generate data entry and reporting .NET Web apps in minutes, straight from your database. Read our FREE whitepaper “Build Web 2.0 Applications Without Hand-Coding” Download now!
  #1  
Old July 6th, 2003, 05:26 PM
mytwocents mytwocents is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jun 2003
Posts: 222 mytwocents User rank is Private First Class (20 - 50 Reputation Level)mytwocents User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 2 Days 2 h 26 m 14 sec
Reputation Power: 6
Importing data from webtracker to database

I have a webtracking script that sends me an email whenever my site is visited which includes a few different pieces of information (i.e. ip, referer, etc) And the data comes to me looking something like this (for example):

Remote Host: 12.345.678.910
FQDN: 12-345-678-910.client.something.com
Date: Sunday, July 6, 2003
Time: 12:49:12 MST
Referer: www.yahoo.com
User Agent: Mozilla/4.0
Request: /home.php



What I want to be able to do is get this into an Access Database and I know there is an easier way to do this than by manually entering the data! I can combine all the messages and save it as a text file, if that helps any, which I tried to do, but the only thing I could think to do was to convert it to a table, but the data runs vertically rather than horizontally so obviously it doesn't work! I'm sure I'm missing something very basic about converting data to tables or something.... but really, I'm just incredibly frustrated! Any suggestions would be greatly appreciated!!

Reply With Quote
  #2  
Old July 6th, 2003, 10:39 PM
rycamor rycamor is offline
Gödelian monster
Dev Shed Regular (2000 - 2499 posts)
 
Join Date: Jul 1999
Location: Pembroke Pines, Florida, USA
Posts: 2,300 rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level)rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level)rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level)rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level)rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level)rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 3 Days 3 h 2 m 4 sec
Reputation Power: 43
Do you have access to the code of this webtracking script? What language was it written in? The easiest thing would be to simply modify the script to send you the data in a comma-delimited (CSV) format. Better yet, have the script append its data to a growing CSV file on the site, which you can download and import into Access at any time.

Also, do you have any experience with scripting languages like Perl or PHP? A problem like yours could be solved in literally less than 20 lines of code in either of these languages (or less than 10, if you are a wiz).
__________________
The real n-tier system:

FreeBSD -> PostgreSQL -> [any_language] -> Apache -> Mozilla/XUL

Amazon wishlist -- rycamor (at) gmail.com

Reply With Quote
  #3  
Old July 7th, 2003, 08:27 PM
mytwocents mytwocents is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jun 2003
Posts: 222 mytwocents User rank is Private First Class (20 - 50 Reputation Level)mytwocents User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 2 Days 2 h 26 m 14 sec
Reputation Power: 6
Well, the short answer to that question is, I am by no means a php or perl programmer, I'm able to crawl my way around it and while I 'think' I have access to the code, I still have a bunch of previous emails (upwards of a few thousand) that are already sent to my inbox.., but for instance...someone suggested that I 'parse' the information and even gave me the code for it, the problem is....what do I do now? Where do I put this code? AHHH? I'm going to post this as a new thread, just in case the parsing catches someone's eye......

Reply With Quote
  #4  
Old July 7th, 2003, 08:56 PM
rycamor rycamor is offline
Gödelian monster
Dev Shed Regular (2000 - 2499 posts)
 
Join Date: Jul 1999
Location: Pembroke Pines, Florida, USA
Posts: 2,300 rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level)rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level)rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level)rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level)rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level)rycamor User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 3 Days 3 h 2 m 4 sec
Reputation Power: 43
Honestly, if you are having this much trouble, you are probably better off just hiring someone who can do this for you. I say this because to do the things you want to do, you need knowledge of several areas of system administration, file/text manipulation, etc... and it really all takes some good background knowledge.

You are posting very general questions, without showing any details of what you might have tried, or what error messages or other problems you had, so its impossible for someone to just give you a quick easy answer.

No one can help you without knowing exactly what you have, and what you want to do with it. Here are the answers needed just for starters:

1. what email program are you using?
2. can you post the source code that the other person gave you to extract data from the emails?
3. Why not get the code to the webtracker program and post it here
4. in your first post, you say "I can combine all the messages and save it as a text file, if that helps any". Yes, this helps. If you can turn all your emails into one file, and if each "record" is formed exactly thesame way, then it should be fairly simple to manipulate the data into a readable format for Access import.

The thing is, you have to be willing to do your homework.

Reply With Quote
Reply

Viewing: Dev Shed ForumsDatabasesDatabase Management > Importing data from webtracker to database


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 4 hosted by Hostway