Database Management
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me

The Shed is going Social! Join us on FaceBook and Twitter and chime in on the conversation.

Go Back   Dev Shed ForumsDatabasesDatabase Management

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old September 21st, 2011, 07:06 PM
noobstartup noobstartup is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Sep 2011
Posts: 2 noobstartup User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 44 m 59 sec
Reputation Power: 0
Transfer from one DB to next

I'm working with a few people to design a large scale social networking site. We are still looking for our DB guy, so no one on my team can help me with this. My first question is what type of database should we be looking at? I know sql server express limits you to 10gb per database. We don't have much money, so I was thinking open source? Maybe postgres?

Second, if we choose a database, what is involved in transferring to a bigger one? Especially with a live site?

Any thoughts would be great.

Reply With Quote
  #2  
Old September 21st, 2011, 08:39 PM
E-Oreo's Avatar
E-Oreo E-Oreo is offline
Lost in code
Click here for more information.
 
Join Date: Dec 2004
Posts: 7,939 E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)  Folding Points: 945 Folding Title: Novice Folder
Time spent in forums: 2 Months 9 h 13 m 20 sec
Reputation Power: 7053
Most database systems don't have artificial size limits, and for a website you shouldn't use one that does. MySQL and Postgresql are respectively the #1 and #2 database systems used by PHP programmers. Neither imposes an artificial size limit.

Moving a large application with a large database from one DBMS to a different one would be a truly massive undertaking, on par with the level of effort required to program it originally. It's not something you ever want to have to do.
__________________
PHP FAQ
How to program a basic, secure login system using PHP

Quote:
Originally Posted by Spad
Ah USB, the only rectangular connector where you have to make 3 attempts before you get it the right way around

Reply With Quote
  #3  
Old September 22nd, 2011, 07:23 AM
r937's Avatar
r937 r937 is offline
SQL Consultant
Click here for more information.
 
Join Date: Feb 2003
Location: Toronto Canada
Posts: 26,375 r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level)r937 User rank is General 47th Grade (Above 100000 Reputation Level) 
Time spent in forums: 3 Months 1 Week 2 Days 7 h 28 m 3 sec
Reputation Power: 4140
Quote:
Originally Posted by E-Oreo
Moving a large application with a large database from one DBMS to a different one would be a truly massive undertaking
sorry, i disagree

there is definitely work involved, as the SQL used from one database system to the next is similar but with differences, so you'll be modifying some of your queries

however, it's not a "truly massive undertaking"
__________________
r937.com | rudy.ca
please visit Simply SQL and buy my book

Reply With Quote
  #4  
Old September 22nd, 2011, 08:55 PM
E-Oreo's Avatar
E-Oreo E-Oreo is offline
Lost in code
Click here for more information.
 
Join Date: Dec 2004
Posts: 7,939 E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)E-Oreo User rank is General 91st Grade (Above 100000 Reputation Level)  Folding Points: 945 Folding Title: Novice Folder
Time spent in forums: 2 Months 9 h 13 m 20 sec
Reputation Power: 7053
Modifying the queries is only a relatively small part of the work that would be involved in migrating a large social network (large enough to have 10GB of database-stored data) from one DBMS to another. Theoretically it shouldn't be too difficult, but I can tell you from personal experience that the code running a large percentage of websites is absolutely hideous.

For a large scale website you have to factor in the time required to re-test the entire site for functionality, performance and, to a lesser extent, security. Since nearly every page on a website depends on the database in some way you can't really get around re-testing the whole site (unless you choose to release untested code).

Then there's the process of actually performing the data migration. I'm not an expert on databases, but I doubt that there is an easy way of seamlessly transferring the data from one system to another without having to shut down the site while the transfer runs. Obviously though it depends on exactly what systems you are migrating between. But, it will likely require more programming to handle the migration, and more testing to ensure that all of the data is migrated properly.

Maybe I exaggerate a bit when I say it would be on par with the level of effort required to program it originally, but I still believe that in most cases it would be a massive undertaking.

Reply With Quote
  #5  
Old October 17th, 2011, 03:25 AM
scalebase scalebase is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jun 2011
Posts: 8 scalebase User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 30 m 33 sec
Reputation Power: 0
Its very true that transferring the DB is not an easy task specially if its need to be done on large scale.Also in case of websites the DB is required to be stored at multiple locations and there may be the problem of scalability which may arise at that point. So, if you really want to transfer the DB into a different format then make sure to retain the backup of DB and after that apply the stored procedures for the same. Even you require an expert DB manager for the same, but you can also do it at your end.


Quote:
Originally Posted by E-Oreo
Modifying the queries is only a relatively small part of the work that would be involved in migrating a large social network (large enough to have 10GB of database-stored data) from one DBMS to another. Theoretically it shouldn't be too difficult, but I can tell you from personal experience that the code running a large percentage of websites is absolutely hideous.

For a large scale website you have to factor in the time required to re-test the entire site for functionality, performance and, to a lesser extent, security. Since nearly every page on a website depends on the database in some way you can't really get around re-testing the whole site (unless you choose to release untested code).

Then there's the process of actually performing the data migration. I'm not an expert on databases, but I doubt that there is an easy way of seamlessly transferring the data from one system to another without having to shut down the site while the transfer runs. Obviously though it depends on exactly what systems you are migrating between. But, it will likely require more programming to handle the migration, and more testing to ensure that all of the data is migrated properly.

Maybe I exaggerate a bit when I say it would be on par with the level of effort required to program it originally, but I still believe that in most cases it would be a massive undertaking.

Reply With Quote
Reply

Viewing: Dev Shed ForumsDatabasesDatabase Management > Transfer from one DB to next

Developer Shed Advertisers and Affiliates



Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 


Powered by: vBulletin Version 3.0.5
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.

© 2003-2013 by Developer Shed. All rights reserved. DS Cluster - Follow our Sitemap