Software Design
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me

The Shed is going Social! Join us on FaceBook and Twitter and chime in on the conversation.

Go Back   Dev Shed ForumsProgramming Languages - MoreSoftware Design

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old June 22nd, 2010, 09:00 PM
deepyogi deepyogi is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: May 2009
Posts: 60 deepyogi User rank is Corporal (100 - 500 Reputation Level)deepyogi User rank is Corporal (100 - 500 Reputation Level)deepyogi User rank is Corporal (100 - 500 Reputation Level)deepyogi User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 1 Day 8 h 31 m 41 sec
Reputation Power: 6
Youtube get user's uploads id's

I am going to explain my problem so please bare with me. What I want to be able to do is:
get all the video ids (11 character long youtube video id) for all the uploads by a user. How i started doing this was see the source code for the users all uploads and then look for ids. But in doing so i found out that not all the video links are there on the web page. For example for this user's (its not me but this user has very good collection!) all uploads, when you see the source there is only like 12 video ids on the page (do a quick CTLR-F with "href="/watch?v=" and you will see) but in fact there is about 500 video uploads by the user. I don't know why is that the case. can someone explain this to me and hopefully help me with a solution? I really appreciate your time.

Reply With Quote
  #2  
Old June 23rd, 2010, 06:28 AM
jzd's Avatar
jzd jzd is offline
Contributing User
Dev Shed Intermediate (1500 - 1999 posts)
 
Join Date: Feb 2007
Posts: 1,940 jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level) 
Time spent in forums: 2 Weeks 1 Day 4 h 7 m 2 sec
Reputation Power: 3116
I assume Youtube has some logic to only display some of the user's videos is some lists. Are you looking at uploads by user or one the user's page? Either way once you get to 500 videos I am sure there is some paging that is put into us.

What good do the video id's do for you? What is the end goal? Are you trying to build a site that creates links for a user's videos or are you harvesting the videos through an automated process.

As a side note did you mean very large collection when you said "very good collection". (Why would you include this detail in your post? What difference does it make?)

Reply With Quote
  #3  
Old June 23rd, 2010, 11:08 AM
deepyogi deepyogi is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: May 2009
Posts: 60 deepyogi User rank is Corporal (100 - 500 Reputation Level)deepyogi User rank is Corporal (100 - 500 Reputation Level)deepyogi User rank is Corporal (100 - 500 Reputation Level)deepyogi User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 1 Day 8 h 31 m 41 sec
Reputation Power: 6
Quote:
Originally Posted by jzd
I assume Youtube has some logic to only display some of the user's videos is some lists. Are you looking at uploads by user or one the user's page? Either way once you get to 500 videos I am sure there is some paging that is put into us.

What good do the video id's do for you? What is the end goal? Are you trying to build a site that creates links for a user's videos or are you harvesting the videos through an automated process.

As a side note did you mean very large collection when you said "very good collection". (Why would you include this detail in your post? What difference does it make?)


You are right. end goal is to harvest video uploaded by a user in an automated way. so i want to get all the videos in that list. but as i said before source code does not have all the videos contained in that list. I wanted to ask why is that and is there any way i can achieve my goal?

Lastly, i meant this collection is good and it had nothing to do with the problem. should not have included that..my mistake

Reply With Quote
  #4  
Old June 23rd, 2010, 12:28 PM
jzd's Avatar
jzd jzd is offline
Contributing User
Dev Shed Intermediate (1500 - 1999 posts)
 
Join Date: Feb 2007
Posts: 1,940 jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level)jzd User rank is General 32nd Grade (Above 100000 Reputation Level) 
Time spent in forums: 2 Weeks 1 Day 4 h 7 m 2 sec
Reputation Power: 3116
My guess (since it is unclear where you are looking). Is that paging or some sort of filter is limiting the number of videos on the list due to its size. You might have to code flipping the pages to be able to get all the ids.

Question, out of curiosity, why are you harvesting the videos? Follow up question, I haven't read rules on YouTube, but since you are not in contact with the author, then what you are doing might be illegal or at least unethical.

Reply With Quote
  #5  
Old July 1st, 2010, 09:52 AM
stdunbar's Avatar
stdunbar stdunbar is offline
Contributing User
Dev Shed Regular (2000 - 2499 posts)
 
Join Date: May 2004
Location: Superior, CO, USA
Posts: 2,398 stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level)stdunbar User rank is General 10th Grade (Above 100000 Reputation Level) 
Time spent in forums: 1 Month 2 Weeks 18 h 15 m 45 sec
Reputation Power: 1660
Send a message via Yahoo to stdunbar Send a message via Google Talk to stdunbar
I'm pretty late to this thread but have you looked at the client libraries that Google/YouTube offer? In looking at an example (in Java but there are others) one of the things that it does is "Retrieving a user's uploaded videos" according the comments.
__________________
Need Java help? Want to help people who do? Sit down with a cup of Java at the hotjoe forums.

Reply With Quote
  #6  
Old July 3rd, 2010, 09:58 PM
deepyogi deepyogi is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: May 2009
Posts: 60 deepyogi User rank is Corporal (100 - 500 Reputation Level)deepyogi User rank is Corporal (100 - 500 Reputation Level)deepyogi User rank is Corporal (100 - 500 Reputation Level)deepyogi User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 1 Day 8 h 31 m 41 sec
Reputation Power: 6
Quote:
Originally Posted by stdunbar
I'm pretty late to this thread but have you looked at the client libraries that Google/YouTube offer? In looking at an example (in Java but there are others) one of the things that it does is "Retrieving a user's uploaded videos" according the comments.

wow i did not even know this existed.thanks a lot for posting it. it should help me a lot.again thanks a lot for your time.

Reply With Quote
  #7  
Old August 4th, 2010, 08:23 PM
yara yara is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Aug 2010
Posts: 2 yara User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 17 m 6 sec
Reputation Power: 0
i use aneesoft youtube downloader to download the videos, and its a very good downloader

Reply With Quote
  #8  
Old August 25th, 2010, 04:10 AM
nazishkhan33 nazishkhan33 is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Aug 2010
Posts: 7 nazishkhan33 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 18 m 55 sec
Reputation Power: 0
use the idm downloader,its very nice...

Reply With Quote
  #9  
Old September 1st, 2010, 05:00 AM
ketty20 ketty20 is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Aug 2010
Location: florida
Posts: 1 ketty20 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 6 m 47 sec
Reputation Power: 0
Thumbs up re:Youtube get user's uploads id's

User's id are very important to know whether the user is genuine or not.
There are thousand of video on youtube each user can post video of whatever type.

Reply With Quote
Reply

Viewing: Dev Shed ForumsProgramming Languages - MoreSoftware Design > Youtube get user's uploads id's

Developer Shed Advertisers and Affiliates



Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 


Powered by: vBulletin Version 3.0.5
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.

© 2003-2013 by Developer Shed. All rights reserved. DS Cluster - Follow our Sitemap