Python Programming
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsProgramming LanguagesPython Programming

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old July 12th, 2004, 01:11 PM
fairwinds fairwinds is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 5 fairwinds User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
Large Dictionaries and Memory

I have a database application I am working on an I have been trying to figure out the best way of keeping the memory requirements reasonable (lower than 150 Mb total) preferably since the ISP may take exception if I am bogging the server.

I need to use between 2000 to 15000 records to build what I want in html. I know xslt well but it would have to put the whole xml file in memory to use xslt which could be 40+ Mb plus the stylesheets and dtd.

I could do this in Sax but I don't want to create and maintain something like this long term.

Because I am pulling the original data out of a Postgres database, my thought was to pull the records in a dictionary which would likely use memory better and output the pages of output in xml, then transform each page since now I have small xml docs instead of one huge one to begin with. Is this a better idea or will I have similar trouble working with a 15000 record dictionary before I get to the transformation as I expect with a large xml file using xslt?

I read on a post awhile back about someone suggesting a wrapper class for dealing with large dictionaries (around June 7/04). Does anyone have an example and some knowledge on what this will accomplish?

Also does one know of a tool that could measure the difference between RAM requirement for a xslt process vs using a python dictionary to break the information into smaller bites.

Advice appreciated.

Reply With Quote
Reply

Viewing: Dev Shed ForumsProgramming LanguagesPython Programming > Large Dictionaries and Memory


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 6 hosted by Hostway
Stay green...Green IT