FTP Help
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me

The Shed is going Social! Join us on FaceBook and Twitter and chime in on the conversation.

Go Back   Dev Shed ForumsSystem AdministrationFTP Help

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #46  
Old October 24th, 2012, 05:46 PM
DonR DonR is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2009
Posts: 463 DonR User rank is Captain (20000 - 30000 Reputation Level)DonR User rank is Captain (20000 - 30000 Reputation Level)DonR User rank is Captain (20000 - 30000 Reputation Level)DonR User rank is Captain (20000 - 30000 Reputation Level)DonR User rank is Captain (20000 - 30000 Reputation Level)DonR User rank is Captain (20000 - 30000 Reputation Level)DonR User rank is Captain (20000 - 30000 Reputation Level)DonR User rank is Captain (20000 - 30000 Reputation Level)DonR User rank is Captain (20000 - 30000 Reputation Level)  Folding Points: 29722 Folding Title: Starter FolderFolding Points: 29722 Folding Title: Starter Folder
Time spent in forums: 2 Weeks 1 Day 23 h 58 m 27 sec
Reputation Power: 216
that still doesn't quite fulfill the OP's original request of ...
Quote:
Originally Posted by jaidev.anand
There are thousands of recordings that get saved on the link each day, and I need to extract only about 150-300 out of that lot.

I honestly don't believe there is going to be any 1 filter [using either of the above programs] that is going to catch ALL of the files wanted without including some that aren't wanted.

Its still going to require multiple filters being setup to capture only the files wanted while excluding the unwanted files. And will most likely require alot of trial/error in setting these filters up.

If the files wanted were all named sequentially it wouldnt be much of an issue, and in that case, 1 filter would most likely suffice. But, if the files wanted aren't, then, it requires multiple filters. This is just my opinion as I see it....hopefully I'm wrong.

Reply With Quote
  #47  
Old October 24th, 2012, 08:21 PM
jaidev.anand jaidev.anand is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2012
Posts: 37 jaidev.anand User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
Hi Spacebar208 and Don,

Thank you for your inputs!

However, given there are 10000's odd file. It will be extremely challenging and time consuming for me to be able to select files individually. Moreover, as they are not in a chronological order it might not be possible, as I'll need to search each one manually.

The https link does not even have a check box.

I'm afraid this isn't going to work

Do I have any other options? Sorry to be bother you again and again!

Kind reagrds,
Jai

Reply With Quote
  #48  
Old October 25th, 2012, 09:51 PM
spacebar208's Avatar
spacebar208 spacebar208 is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Apr 2012
Location: spaceBAR Central
Posts: 191 spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 2 Days 9 h 54 m 47 sec
Reputation Power: 41
Do you know the names of the files you want to download before you go to the web site?
If so, How? Do they get emailed you, someone tells you, etc....

If you do not know the file names before you go to the web site, How do you determine which files to download, please give examples of how you determine them.

Also post a few of what the file url's look like, just right click a link in Internet Explorer and select "Copy shortcut" and then paste them in your message as text.

Reply With Quote
  #49  
Old October 25th, 2012, 10:04 PM
jaidev.anand jaidev.anand is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2012
Posts: 37 jaidev.anand User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
This the way each file URL appears on the link:

1. 20121008-0650-36614191-in.wav
2. 20121008-0650-36614191-out.wav
3. 20121008-0844-36614525-in.wav
4. 20121008-0844-36614525-out.wav
5. 20121008-1027-36612209-in.wav
6. 20121008-1027-36612209-out.wav
7. 20121008-1056-36631178-in.wav
8. 20121008-1056-36631178-out.wav
9. 20121008-1253-36634929-out.wav
10. 20121008-1259-36646635-in.wav

The numeric 8 values starting with 3 (36646635, 36614191 etc) are the unique numbers for each of those...I get them on a spreadsheet and search the above URLs using these 8 digit unique numbers...There are at least 2 recordings with each unique 8 digit number (1 for in and out) and can go upto 6, but as long as the IDs map I need all.

I tried the coomplete download of the date folder for Oct 24 there was 60 GB of recoordings it did not succed even after 6-hours

Please advise.

Thanks

Reply With Quote
  #50  
Old October 25th, 2012, 11:27 PM
spacebar208's Avatar
spacebar208 spacebar208 is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Apr 2012
Location: spaceBAR Central
Posts: 191 spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 2 Days 9 h 54 m 47 sec
Reputation Power: 41
Ok, since you get them in a spreadsheet you can write a excel formula or macro to create the url for the files(that why I said post what the url looks like) and save the urls to a text file, then import the saved urls into the download manager(ex. Internet Download Manager) to download via the "Import from txt file" option.

Reply With Quote
  #51  
Old October 25th, 2012, 11:40 PM
jaidev.anand jaidev.anand is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2012
Posts: 37 jaidev.anand User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
Quote:
Originally Posted by spacebar208
Ok, since you get them in a spreadsheet you can write a excel formula or macro to create the url for the files(that why I said post what the url looks like) and save the urls to a text file, then import the saved urls into the download manager(ex. Internet Download Manager) to download via the "Import from txt file" option.


Yes, I can create the URLs pretty easily in the xls. I'll try this fisrt thing and update you on what the result tuurns out to be.

Thank you!

Reply With Quote
  #52  
Old October 27th, 2012, 10:34 AM
jaidev.anand jaidev.anand is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2012
Posts: 37 jaidev.anand User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
Quote:
Originally Posted by spacebar208
Ok, since you get them in a spreadsheet you can write a excel formula or macro to create the url for the files(that why I said post what the url looks like) and save the urls to a text file, then import the saved urls into the download manager(ex. Internet Download Manager) to download via the "Import from txt file" option.


Dearest Sir,

I think I'm getting a bit closer. I tried downloading the files via the Internet Download Manager, while it downloaded a single file on pasting the url very quickly. I faced an Error in the "File Type" column on importing through a text file...

Here's a snapshot of the way, I copied the links on the text file:
https.....20121008-0650-36614191-out.wav;https... 20121008-0844-36614525-in.wav;https... 20121008-0844-36614525-out.wav

I'm not sure if this is how it should be done. Somehow, I did not find anything on research as well...

Could you please advise and maybe guide me to a link where the process is defined...

I really, truly appreciate your help...

Kindest regards,
Jai

Reply With Quote
  #53  
Old October 27th, 2012, 06:22 PM
spacebar208's Avatar
spacebar208 spacebar208 is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Apr 2012
Location: spaceBAR Central
Posts: 191 spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 2 Days 9 h 54 m 47 sec
Reputation Power: 41
Let's say your text file containing the URL's is called: mylinks.txt
In this text file I believe that you should have each URL on a separate line, like this:

https.....20121008-0650-36614191-out.wav
https....20121008-0844-36614525-in.wav
https....20121008-0844-36614525-out.wav


Then try the "Tasks->>Import->>From text file" option

Reply With Quote
  #54  
Old October 27th, 2012, 09:12 PM
jaidev.anand jaidev.anand is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2012
Posts: 37 jaidev.anand User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
Quote:
Originally Posted by spacebar208
Let's say your text file containing the URL's is called: mylinks.txt
In this text file I believe that you should have each URL on a separate line, like this:

https.....20121008-0650-36614191-out.wav
https....20121008-0844-36614525-in.wav
https....20121008-0844-36614525-out.wav


Then try the "Tasks->>Import->>From text file" option


Dear Sir,

Yes, I named it recordings and tried the same as well but it gave me error in the "File Type".

Thanks

Reply With Quote
  #55  
Old October 27th, 2012, 11:25 PM
spacebar208's Avatar
spacebar208 spacebar208 is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Apr 2012
Location: spaceBAR Central
Posts: 191 spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level)spacebar208 User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 2 Days 9 h 54 m 47 sec
Reputation Power: 41
Send in a question describing what you are doing and screen shot of error message on their support web site:
IDM - Support

Reply With Quote
  #56  
Old October 29th, 2012, 02:05 PM
jaidev.anand jaidev.anand is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2012
Posts: 37 jaidev.anand User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
Quote:
Originally Posted by spacebar208
Let's say your text file containing the URL's is called: mylinks.txt
In this text file I believe that you should have each URL on a separate line, like this:

https.....20121008-0650-36614191-out.wav
https....20121008-0844-36614525-in.wav
https....20121008-0844-36614525-out.wav


Then try the "Tasks->>Import->>From text file" option


Dear Spacebar208 and Don,

I think I'm there. A word of thanks coming soon. Hopefuly by tomorrow.

Though, I'm already thankful or can't thank you enough:-)

You guys are the best!

In the meantime positing another thread that one should be simple I guess.

Best regards,
Jai

Reply With Quote
  #57  
Old October 31st, 2012, 09:15 AM
jaidev.anand jaidev.anand is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2012
Posts: 37 jaidev.anand User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
Quote:
Originally Posted by spacebar208
Send in a question describing what you are doing and screen shot of error message on their support web site:
IDM - Support


First thing first - I would like to convey a "BIG THANK YOU" to you Spacebar208 for all the help on this. I finally managed to get this done. Its working beautifully up till now.

I'm sure it would have not been possible without your help and advice.

Once again, please accept my apologies in case I came back with some queries which might have been not really good ones so to say...

I also take this opportunity to thank Don for his inputs on it.

You guys are the best! "THANK YOU"

Reply With Quote
  #58  
Old November 6th, 2012, 10:49 PM
jaidev.anand jaidev.anand is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2012
Posts: 37 jaidev.anand User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
Quote:
Originally Posted by DonR
that still doesn't quite fulfill the OP's original request of ...
I honestly don't believe there is going to be any 1 filter [using either of the above programs] that is going to catch ALL of the files wanted without including some that aren't wanted.

Its still going to require multiple filters being setup to capture only the files wanted while excluding the unwanted files. And will most likely require alot of trial/error in setting these filters up.

If the files wanted were all named sequentially it wouldnt be much of an issue, and in that case, 1 filter would most likely suffice. But, if the files wanted aren't, then, it requires multiple filters. This is just my opinion as I see it....hopefully I'm wrong.


Hey Don,

Hope you are doing great! A big "Thank you" my query has been resolved, it now takes only 20-25 mins max. I did wrote a thank you note, not sure if you read it.

So thanking u again.

I also had posted another query, but haven't got any inputs was wondering if can look into it please...

Regards,
Jai

Reply With Quote
Reply

Viewing: Dev Shed ForumsSystem AdministrationFTP Help > Downloading Specific Files from FTP

Developer Shed Advertisers and Affiliates



Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 


Powered by: vBulletin Version 3.0.5
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.

© 2003-2013 by Developer Shed. All rights reserved. DS Cluster - Follow our Sitemap