MySQL Help
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsDatabasesMySQL Help

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
SlickEdit: Code in over 40 languages across 7 platforms. SlickEdit’s unmatched power, speed, and flexibility allows even the most accomplished developers to write better code faster. Download a free trial today!
  #1  
Old July 10th, 2000, 04:01 AM
woodgnome woodgnome is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jun 2000
Posts: 29 woodgnome User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 10 m 43 sec
Reputation Power: 0
Has anyone any experience of using MySQL to implement a web based address finder? I am looking to create one table from the UK Postcode (ZIP) Address File which has about 3 million street addresses and 1.7 million postcodes, index it on postcode, and then use php to allow a user to enter a postcode and retrieve the street address. I've seen a demo of this in action using CGI and I don't know what database/file structure at http://www.afd.co.uk/internet/postcode/index.htm but they charge a lot of money (£1500). Not that I'm a cheapskate but I can buy the data for about £850 so if it takes 2 days to develop something myself I save.

The questions are really -
How effecient is MySQL indexing given that it will have a high cardinality?
How quickly does a mass insert from a text file perform - 3 million rows of 'INSERT INTO....'?
Has anyone else done anything like this before?

Reply With Quote
  #2  
Old July 12th, 2000, 11:08 PM
yoshi yoshi is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jan 2000
Posts: 108 yoshi User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 9
Send a message via ICQ to yoshi
I don't know if I can be that much help, but here it goes:

There is a maximum limit on the size of a table at 5G (In case you are planning of exceeding that).

Also, I do believe that the speed of an INSERT statement depends on the speed of the server, and the speed of your connection (if you are transferring the data from your computer). I have done large INSERT statements before (none being 3 million rows), but I can tell you that running one with 10,000 to 20,000 rows takes about 2 minutes (with the data already on the server). So, at the same speed, it would take approx. 400 min. to do 3,000,000 rows (around 6 and a half hours). That is my best guess.

Good Luck!
yoshi
datera@datera.com http://www.datera.com

Reply With Quote
Reply

Viewing: Dev Shed ForumsDatabasesMySQL Help > Very Large Table


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 4 hosted by Hostway