SunQuest
           Suggestions & Feedback
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed Forums > Forum Information > Suggestions & Feedback
Reload this Page

Why does "Find all threads/posts" take so long to load?

Discuss Why does "Find all threads/posts" take so long to load? in the Suggestions & Feedback forum on Dev Shed.
Why does "Find all threads/posts" take so long to load? Use this forum for either suggesting ideas or submitting feedback about our forums. Suggestions, constructive criticism, and other feedback appreciated.

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
« Previous Thread | Next Thread »  
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
Get inside! Sample the range of functionality easily built with JMSL Library for Time Series Data Analysis, Heat Maps, Portfolio Optimization, Monte Carlo Simulation, Stock Price Charting and more. Download Now!
  #1  
Old April 5th, 2007, 04:38 AM
ryon420's Avatar
ryon420 ryon420 is offline
Oscar Wilde addict
Dev Shed Frequenter (2500 - 2999 posts)
  
Join Date: Jun 2006
Location: Was lost, then found, now lost again.
Posts: 2,815 ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)  Folding Points: 1496 Folding Title: Novice Folder
Time spent in forums: 5 Months 1 Week 2 Days 12 h 55 m 12 sec
Reputation Power: 879
Send a message via MSN to ryon420 Send a message via Google Talk to ryon420
Why does "Find all threads/posts" take so long to load?
Hey everyone,

I was wondering if anyone has noticed why "Find all threads/posts" take so long to load? Even for a 1 post person:
Quote:
Showing results 1 to 1 of 1
Search took 31.80 seconds.

I find that weird.
__________________

Warning, the post above may contain extreme sarcasm, crude language, and code that may confuse amateurs and professionals.


Helpful stuff: Google your question first | Read the rules | How to ask a question | Read the [PHP] manual, it is good for you
Proud supporter of: Philosophorum - "where even the trolls are smart" | Chikyu Hakken - digging for trolls
"Children begin by loving their parents; as they grow older they judge them; sometimes, they forgive them" -- Oscar Wilde.

Reply With Quote
  #2  
Old April 5th, 2007, 07:12 AM
aitken325i's Avatar
aitken325i aitken325i is offline
At a NO MA'AM meeting . . . .
Dev Shed God 17th Plane (13000 - 13499 posts)
  
Join Date: Mar 2004
Location: nr Edinburgh, Scotland
Posts: 13,444 aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)  Folding Points: 10110 Folding Title: Novice Folder
Time spent in forums: 5 Months 1 Week 6 Days 22 h 58 m 15 sec
Reputation Power: 1903
I've noticed that before too, but always thought it's becuase of the size of the db for here. Hundreds of thousands of threads and millions of posts to search through won't exactly be a 2 second query.

Although, I have been wrong before
__________________
The No Ma'am commandments:

1.) It is O.K. to call hooters 'knockers' and sometimes snack trays
2.) It is wrong to be French
3.) It is O.K. to put all bad people in a giant meat grinder
4.) Lawyers, see rule 3
5.) It is O.K. to drive a gas guzzler if it helps you get babes
6.) Everyone should car pool but me
7.) Bring back the word 'stewardesses'
8.) Synchronized swimming is not a sport
9.) Mud wrestling is a sport
Reply With Quote
  #3  
Old April 5th, 2007, 07:14 AM
ryon420's Avatar
ryon420 ryon420 is offline
Oscar Wilde addict
Dev Shed Frequenter (2500 - 2999 posts)
  
Join Date: Jun 2006
Location: Was lost, then found, now lost again.
Posts: 2,815 ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)ryon420 User rank is Lieutenant General (80000 - 90000 Reputation Level)  Folding Points: 1496 Folding Title: Novice Folder
Time spent in forums: 5 Months 1 Week 2 Days 12 h 55 m 12 sec
Reputation Power: 879
Send a message via MSN to ryon420 Send a message via Google Talk to ryon420
True, but a simple:
Code:
SELECT poster FROM some_table WHERE poster='Blah'

Would be rather fast. Unless they are scowing the entire DB and checking each and every poster for the username.
Reply With Quote
  #4  
Old April 5th, 2007, 03:33 PM
Rich's Avatar
Rich Rich is offline
Administrator
Developer Shed Admin.
  
Join Date: Sep 2003
Location: Davie, FL
Posts: 476 Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level) 
Time spent in forums: 3 Days 21 h 1 m 23 sec
Reputation Power: 10
Quote:
Originally Posted by BlackNine
True, but a simple:
Code:
SELECT poster FROM some_table WHERE poster='Blah'

Would be rather fast. Unless they are scowing the entire DB and checking each and every poster for the username.


These tables are unfortunately a little more complex than that. Thread tables, post tables, keyword tables, hash tables. They are all huge, especially when joining them together.

Now, if you give us an example of a search that you think should be quick, we can research more in-depth why it took so long. But Id need to know everything about that search.

And yeah, we are searching literally millions of records.

Rich
Reply With Quote
  #5  
Old April 5th, 2007, 05:40 PM
LinuxPenguin's Avatar
LinuxPenguin LinuxPenguin is offline
fork while true;
Dev Shed God 1st Plane (5500 - 5999 posts)
  
Join Date: May 2005
Location: England, UK
Posts: 5,535 LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)  Folding Points: 11590 Folding Title: Novice Folder
Time spent in forums: 1 Month 3 Weeks 1 Day 19 h 23 m 58 sec
Reputation Power: 1008
How about this one?

"Search took 24.98 seconds."

He's a 1-post newbie is why I selected him
Reply With Quote
  #6  
Old April 6th, 2007, 07:37 AM
thaminda's Avatar
thaminda thaminda is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
  
Join Date: Sep 2004
Posts: 396 thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level) 
Time spent in forums: 1 Week 3 Days 19 h 45 m 3 sec
Reputation Power: 415
We are looking into this now
Reply With Quote
  #7  
Old April 6th, 2007, 09:49 AM
thaminda's Avatar
thaminda thaminda is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
  
Join Date: Sep 2004
Posts: 396 thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level)thaminda User rank is Lieutenant Colonel (40000 - 50000 Reputation Level) 
Time spent in forums: 1 Week 3 Days 19 h 45 m 3 sec
Reputation Power: 415
We did some query optimization to you search script and added extra indexes to our database to speed up search process.

Quote:
Originally Posted by LinuxPenguin
How about this one?

"Search took 24.98 seconds."

He's a 1-post newbie is why I selected him

Now this search take about 0.05 Sec
Comments on this post
ChiefWigs1982 agrees: Awesome.
ryon420 agrees!
Adrastea0413 agrees: DevShed's dedication to its users is amazing. Thank you for everything you do.
Annie79 agrees: Great!
aitken325i agrees!
gimp agrees!
Reply With Quote
  #8  
Old April 6th, 2007, 10:06 AM
Rich's Avatar
Rich Rich is offline
Administrator
Developer Shed Admin.
  
Join Date: Sep 2003
Location: Davie, FL
Posts: 476 Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level)Rich User rank is First Lieutenant (10000 - 20000 Reputation Level) 
Time spent in forums: 3 Days 21 h 1 m 23 sec
Reputation Power: 10
Quote:
Originally Posted by thaminda
We did some query optimization to you search script and added extra indexes to our database to speed up search process.


Now this search take about 0.05 Sec



So to answer your question why it took so long, by default it seems that vbulletin does not have that table indexed by userid. Keep in mind that each index added to a table takes up precious disk space. With a new index on one of the biggest tables, we just took up another 5% of disk.
Comments on this post
Adrastea0413 agrees: Like I said above, DevShed's dedication to its users is amazing. Thank you for everything you do.
Annie79 agrees!
aitken325i agrees!
Reply With Quote
  #9  
Old April 6th, 2007, 10:08 AM
aitken325i's Avatar
aitken325i aitken325i is offline
At a NO MA'AM meeting . . . .
Dev Shed God 17th Plane (13000 - 13499 posts)
  
Join Date: Mar 2004
Location: nr Edinburgh, Scotland
Posts: 13,444 aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)aitken325i User rank is General 14th Grade (Above 100000 Reputation Level)  Folding Points: 10110 Folding Title: Novice Folder
Time spent in forums: 5 Months 1 Week 6 Days 22 h 58 m 15 sec
Reputation Power: 1903
That's a big difference - nice one Admins
Reply With Quote
  #10  
Old April 6th, 2007, 01:10 PM
LinuxPenguin's Avatar
LinuxPenguin LinuxPenguin is offline
fork while true;
Dev Shed God 1st Plane (5500 - 5999 posts)
  
Join Date: May 2005
Location: England, UK
Posts: 5,535 LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)LinuxPenguin User rank is General (90000 - 100000 Reputation Level)  Folding Points: 11590 Folding Title: Novice Folder
Time spent in forums: 1 Month 3 Weeks 1 Day 19 h 23 m 58 sec
Reputation Power: 1008
You guys are absolutely awesome. That's one hell of a speed improvement!
Reply With Quote
Reply

Viewing: Dev Shed Forums > Forum Information > Suggestions & Feedback > Why does "Find all threads/posts" take so long to load?

« Previous Thread | Next Thread »

Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Linear Mode Linear Mode
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump