The Shed is going Social! Join us on FaceBook and Twitter and chime in on the conversation.
|
 |
|
Dev Shed Forums
> System Administration
> FTP Help
|
Page 4 -
Downloading Specific Files from FTP
Page 4 - Discuss Downloading Specific Files from FTP in the FTP Help forum on Dev Shed. Downloading Specific Files from FTP FTP Help forum discussing FTP practices, tips and solutions for problems with FTP on multiple platforms. File Transfer Protocol (FTP) was designed specifically for transferring files from one machine to another.
|
|
 |
|
|
|
|
|

Dev Shed Forums Sponsor:
|
|
|

October 24th, 2012, 05:46 PM
|
|
|
that still doesn't quite fulfill the OP's original request of ... Quote: | Originally Posted by jaidev.anand There are thousands of recordings that get saved on the link each day, and I need to extract only about 150-300 out of that lot. |
I honestly don't believe there is going to be any 1 filter [using either of the above programs] that is going to catch ALL of the files wanted without including some that aren't wanted.
Its still going to require multiple filters being setup to capture only the files wanted while excluding the unwanted files. And will most likely require alot of trial/error in setting these filters up.
If the files wanted were all named sequentially it wouldnt be much of an issue, and in that case, 1 filter would most likely suffice. But, if the files wanted aren't, then, it requires multiple filters. This is just my opinion as I see it....hopefully I'm wrong.
|

October 24th, 2012, 08:21 PM
|
|
Contributing User
|
|
Join Date: Oct 2012
Posts: 37
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
|
|
Hi Spacebar208 and Don,
Thank you for your inputs!
However, given there are 10000's odd file. It will be extremely challenging and time consuming for me to be able to select files individually. Moreover, as they are not in a chronological order it might not be possible, as I'll need to search each one manually.
The https link does not even have a check box.
I'm afraid this isn't going to work
Do I have any other options? Sorry to be bother you again and again!
Kind reagrds,
Jai
|

October 25th, 2012, 09:51 PM
|
 |
Contributing User
|
|
Join Date: Apr 2012
Location: spaceBAR Central
|
|
|
Do you know the names of the files you want to download before you go to the web site?
If so, How? Do they get emailed you, someone tells you, etc....
If you do not know the file names before you go to the web site, How do you determine which files to download, please give examples of how you determine them.
Also post a few of what the file url's look like, just right click a link in Internet Explorer and select "Copy shortcut" and then paste them in your message as text.
|

October 25th, 2012, 10:04 PM
|
|
Contributing User
|
|
Join Date: Oct 2012
Posts: 37
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
|
|
This the way each file URL appears on the link:
1. 20121008-0650-36614191-in.wav
2. 20121008-0650-36614191-out.wav
3. 20121008-0844-36614525-in.wav
4. 20121008-0844-36614525-out.wav
5. 20121008-1027-36612209-in.wav
6. 20121008-1027-36612209-out.wav
7. 20121008-1056-36631178-in.wav
8. 20121008-1056-36631178-out.wav
9. 20121008-1253-36634929-out.wav
10. 20121008-1259-36646635-in.wav
The numeric 8 values starting with 3 (36646635, 36614191 etc) are the unique numbers for each of those...I get them on a spreadsheet and search the above URLs using these 8 digit unique numbers...There are at least 2 recordings with each unique 8 digit number (1 for in and out) and can go upto 6, but as long as the IDs map I need all.
I tried the coomplete download of the date folder for Oct 24 there was 60 GB of recoordings it did not succed even after 6-hours
Please advise.
Thanks
|

October 25th, 2012, 11:27 PM
|
 |
Contributing User
|
|
Join Date: Apr 2012
Location: spaceBAR Central
|
|
|
Ok, since you get them in a spreadsheet you can write a excel formula or macro to create the url for the files(that why I said post what the url looks like) and save the urls to a text file, then import the saved urls into the download manager(ex. Internet Download Manager) to download via the "Import from txt file" option.
|

October 25th, 2012, 11:40 PM
|
|
Contributing User
|
|
Join Date: Oct 2012
Posts: 37
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
|
|
Quote: | Originally Posted by spacebar208 Ok, since you get them in a spreadsheet you can write a excel formula or macro to create the url for the files(that why I said post what the url looks like) and save the urls to a text file, then import the saved urls into the download manager(ex. Internet Download Manager) to download via the "Import from txt file" option. |
Yes, I can create the URLs pretty easily in the xls. I'll try this fisrt thing and update you on what the result tuurns out to be.
Thank you!
|

October 27th, 2012, 10:34 AM
|
|
Contributing User
|
|
Join Date: Oct 2012
Posts: 37
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
|
|
Quote: | Originally Posted by spacebar208 Ok, since you get them in a spreadsheet you can write a excel formula or macro to create the url for the files(that why I said post what the url looks like) and save the urls to a text file, then import the saved urls into the download manager(ex. Internet Download Manager) to download via the "Import from txt file" option. |
Dearest Sir,
I think I'm getting a bit closer. I tried downloading the files via the Internet Download Manager, while it downloaded a single file on pasting the url very quickly. I faced an Error in the "File Type" column on importing through a text file...
Here's a snapshot of the way, I copied the links on the text file:
https.....20121008-0650-36614191-out.wav;https... 20121008-0844-36614525-in.wav;https... 20121008-0844-36614525-out.wav
I'm not sure if this is how it should be done. Somehow, I did not find anything on research as well...
Could you please advise and maybe guide me to a link where the process is defined...
I really, truly appreciate your help...
Kindest regards,
Jai
|

October 27th, 2012, 06:22 PM
|
 |
Contributing User
|
|
Join Date: Apr 2012
Location: spaceBAR Central
|
|
|
Let's say your text file containing the URL's is called: mylinks.txt
In this text file I believe that you should have each URL on a separate line, like this:
https.....20121008-0650-36614191-out.wav
https....20121008-0844-36614525-in.wav
https....20121008-0844-36614525-out.wav
Then try the "Tasks->>Import->>From text file" option
|

October 27th, 2012, 09:12 PM
|
|
Contributing User
|
|
Join Date: Oct 2012
Posts: 37
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
|
|
Quote: | Originally Posted by spacebar208 Let's say your text file containing the URL's is called: mylinks.txt
In this text file I believe that you should have each URL on a separate line, like this:
https.....20121008-0650-36614191-out.wav
https....20121008-0844-36614525-in.wav
https....20121008-0844-36614525-out.wav
Then try the "Tasks->>Import->>From text file" option |
Dear Sir,
Yes, I named it recordings and tried the same as well but it gave me error in the "File Type".
Thanks
|

October 27th, 2012, 11:25 PM
|
 |
Contributing User
|
|
Join Date: Apr 2012
Location: spaceBAR Central
|
|
Send in a question describing what you are doing and screen shot of error message on their support web site:
IDM - Support
|

October 29th, 2012, 02:05 PM
|
|
Contributing User
|
|
Join Date: Oct 2012
Posts: 37
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
|
|
Quote: | Originally Posted by spacebar208 Let's say your text file containing the URL's is called: mylinks.txt
In this text file I believe that you should have each URL on a separate line, like this:
https.....20121008-0650-36614191-out.wav
https....20121008-0844-36614525-in.wav
https....20121008-0844-36614525-out.wav
Then try the "Tasks->>Import->>From text file" option |
Dear Spacebar208 and Don,
I think I'm there. A word of thanks coming soon. Hopefuly by tomorrow.
Though, I'm already thankful or can't thank you enough:-)
You guys are the best!
In the meantime positing another thread that one should be simple I guess.
Best regards,
Jai
|

October 31st, 2012, 09:15 AM
|
|
Contributing User
|
|
Join Date: Oct 2012
Posts: 37
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
|
|
Quote: | Originally Posted by spacebar208 Send in a question describing what you are doing and screen shot of error message on their support web site:
IDM - Support |
First thing first - I would like to convey a "BIG THANK YOU" to you Spacebar208 for all the help on this. I finally managed to get this done. Its working beautifully up till now.
I'm sure it would have not been possible without your help and advice.
Once again, please accept my apologies in case I came back with some queries which might have been not really good ones so to say...
I also take this opportunity to thank Don for his inputs on it.
You guys are the best! "THANK YOU"
|

November 6th, 2012, 10:49 PM
|
|
Contributing User
|
|
Join Date: Oct 2012
Posts: 37
Time spent in forums: 6 h 45 m 28 sec
Reputation Power: 1
|
|
Quote: | Originally Posted by DonR that still doesn't quite fulfill the OP's original request of ...
I honestly don't believe there is going to be any 1 filter [using either of the above programs] that is going to catch ALL of the files wanted without including some that aren't wanted.
Its still going to require multiple filters being setup to capture only the files wanted while excluding the unwanted files. And will most likely require alot of trial/error in setting these filters up.
If the files wanted were all named sequentially it wouldnt be much of an issue, and in that case, 1 filter would most likely suffice. But, if the files wanted aren't, then, it requires multiple filters. This is just my opinion as I see it....hopefully I'm wrong. |
Hey Don,
Hope you are doing great! A big "Thank you" my query has been resolved, it now takes only 20-25 mins max. I did wrote a thank you note, not sure if you read it.
So thanking u again  .
I also had posted another query, but haven't got any inputs was wondering if can look into it please...
Regards,
Jai
|
Developer Shed Advertisers and Affiliates
| Thread Tools |
Search this Thread |
|
|
|
| Display Modes |
Rate This Thread |
Linear Mode
|
|
Posting Rules
|
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is Off
|
|
|
|
|