#1
  1. No Profile Picture
    Contributing User
    Devshed Novice (500 - 999 posts)

    Join Date
    Jan 2017
    Posts
    817
    Rep Power
    0

    Question Re: Questions on Web Proxy Resources Like Vps or Dedicated Server


    Folks,

    Do you have experience in running vps or dedicated server or with web proxies ?
    I want to run a web proxy that only allows videos to be watched from youtube, vimeo and meta cafe.
    You won't be able to browse any other website apart from these 3.

    Q1. Now, how much bandwidth (in-bound & out-bound) should I get ?

    Q2. Youtube is mostly filled with 3 minutes videos.
    Average, how much in size is a 3 mins vid on low, medium and high resolution ?

    Q3. How much ram should I get ?

    Q4. What should be the processor speed min ?

    Q5. Is a vps enough or should I opt for a dedicated server ?

    To start-off with, I do not want to rent a dedicated server. Let me try vps first and if it gets clogged with traffic and the user experience gets slow then I can upgrade to dedicated server.
    And so, give me answers bearing these in mind.

    Actually, give me answers based on 1,000 (1k) users.
    Then give me another set of answers based on 10,000 (10k) users.
    Users who use my web proxy. Web proxy like:
    Anonymouse.org

    Q6. If you do not recommend a web proxy for this public service of mine to allow users to watch youtube, vimeo and meta cafe then what other types of proxies you recommend and what are the top 10 tools to run such a proxy ?
    Last edited by UniqueIdeaMan; June 2nd, 2018 at 06:16 AM.
  2. #2
  3. No Profile Picture
    Contributing User
    Devshed Novice (500 - 999 posts)

    Join Date
    Jan 2017
    Posts
    817
    Rep Power
    0
    Bump! And a serious one at that!
  4. #3
  5. Code Monkey V. 0.9
    Devshed Regular (2000 - 2499 posts)

    Join Date
    Mar 2005
    Location
    A Land Down Under
    Posts
    2,405
    Rep Power
    2105
    Originally Posted by UniqueIdeaMan
    Q1. Now, how much bandwidth (in-bound & out-bound) should I get ?
    Nore than you can afford. Seriosuly. Bandwidth for video hosting is not cheap. You will use 100-100,000 times more than you think that you will.

    Originally Posted by UniqueIdeaMan
    Q2. Youtube is mostly filled with 3 minutes videos.
    Average, how much in size is a 3 mins vid on low, medium and high resolution ?
    You download YouTube videos all the time. You tell us what size the videos are.

    Originally Posted by UniqueIdeaMan
    Q3. How much ram should I get ?
    Nore than you can afford.

    Originally Posted by UniqueIdeaMan
    Q4. What should be the processor speed min ?
    You will need the fastest you can find, and multiples. I'd say at least 4, but I'd look for 8 as a minimum, and anything up to 64.

    If you do this, you should look more at running multiple servers, not a single big server. That's how everyone else does it.

    Originally Posted by UniqueIdeaMan
    Q5. Is a vps enough or should I opt for a dedicated server ?
    The onyl way to know is to try and see. These days a VPS can have more power then a single dedicated server using places like amazon, because they "pool" serves together to give more resources.

    Originally Posted by UniqueIdeaMan
    To start-off with, I do not want to rent a dedicated server. Let me try vps first and if it gets clogged with traffic and the user experience gets slow then I can upgrade to dedicated server.
    So, do it...

    Originally Posted by UniqueIdeaMan
    Actually, give me answers based on 1,000 (1k) users.
    Then give me another set of answers based on 10,000 (10k) users.
    1,000 users... doing what? Watching non-stop 4K videos 24 hours a day, or watching 2 or 3 2-minute clips a week?

    But honestly, there's no "average". You won't get a reasonable average until you're running at a capacity that has crippled a single server months ago.

    Originally Posted by UniqueIdeaMan
    Q6. if you do not recommend a web proxy for this public service of mine to allow users to watch youtuve. vimeo and meta cafe then what other types of proxies you recommend and what are the top 10 tools to run such a proxy ?
    As a lot of people have said before, you should look at a browser extension. That way you don't need any of this major infrastructure that you're talking about, you will only need one central server to collect and crunch the stats. Using a proxy to do this jsut to find out the URl that peope have visited is madness and a blind waste of resources.
  6. #4
  7. No Profile Picture
    Contributing User
    Devshed Novice (500 - 999 posts)

    Join Date
    Jan 2017
    Posts
    817
    Rep Power
    0
    Catacaustic,

    Yes, you are right. It is madness to run a proxy just to log what my users are browsing as it will be a serious bandwidth drainer. The vps I have found provide you no more than 2TB of bandwidth and I believe that will run-out in a single day or an hr. Let alone a mnth.
    That is why, originally, I wanted to do things through the iframe. Where the page would have a top frame and a bottom frame which would show an iframe and users would browse websites through the bottom frame and the top frame would do all the logging.
    But, many sites break-out of frames/iframes and html 5 no longer supports frames or iframes.

    When I built my .exe browser nearly 2yrs back, I was not gonna get any bandwidth draining on the users' downloads but only on my browser copies uploads (browsed page urls submissions to my mysql db).

    Cato (reminded me of Bruce Lee's Kato from the Green Hornet), I'm not gonna give-up on these venture. Don't forget, I got green-light from every individual from India, Indian subcontinent (other countries) and Japan too who I showed and mentioned my browser to by word of mouth or youtube clip. I've got the green light from 2 ad networks in Europe, remember ?
    I approached them because they're big online and I tailored my browser to earn for it's users via them networks. Let me try more nearer to me. Let me try Australia, Usa, Canada, New Zealand, Japan, China and Russia.
    And these European ad networks definitely know their business more than me or you or Kicken or Simon JM and if they do not think my browser was gonna be a bad ROI for their advertisers then that speaks volumes. Does it not ?
    (But saying all this, I myself do not think it will be good ROI. Talking about my browser, mobile app, web app (web proxy). They are my 1st php projects. They are complete.
    My 2nd php project: Searchengine, PPC searchengine and Meta Engine which are my 2nd best tools will be a massive hit with good ROI. And, I reckon it will annihalate the major SEs and the major SNs. They are nearly complete. They too use the same ad networks or their models as nearly all my projects revolve around earning out of these ad networks. One day, I will build my own ad concept and it's network).
    Therefore, not giving up. This is gonna be HUUUUGGE!
    Why I did not take the browser extension route ?
    1. I do not have experience with browser plugins.
    2. Dreading it will cost me an arm if not the leg too.
    3. I want to spend as less as possible so I can show the third world that even you can do it and you don't need to earn as much as the Americas or the Europeans in $, , etc. to get things like this rolling. The total expense is so low that even someone from Ethiopia can start things like this online. I just want to teach the poor regions of the world that capital is no barrier. Capital did not put me in the position.
    A little market research, thorough planning and smart, clever and wise thinking put me in a position to give the big monopolizing online brands a bloody nose!
    I want to be a good example. Start a revolution. So, others start daring to compete and challenge the big capitalist companies.
    This will not only result in the poor weak guys daring but the average person too (not too rich nor poor Western guy) to think big. Think out of the box and not just follow other losers' footsteps.

    I'm gonna be Karl Marx (innovator of Communism), Lenin, Ghandi (2 revolutionists), Malcolm x and Martin Luther King (2 racial discrimination fighters), Fidel Castro (Small guy not afraid of his big capitalist bully neighbour). You understand what I mean ?
    Btw, I'm not communist. Don't like "comrades". Don't hate them, either. They forcefully takeover your properties. Extreme socialism. I no support.
    You may think of me as a small socialist who thinks big and dares to find loopholes non-stop to find weakness in the capitalist economy in order to provide for the not so rich people (which is the majority of people on this earth).
    Provide for the homeless, bankrupt, unemployed, people in debt, house wives. People with tight pockets.
    Want to be like Robin Hood a little but no damn prince of thieves because I do not believe in ripping others off. Even the rich. Don't believe in cheating even a fox or a hyena.
    Want to be like that guy who invented Bit Coin. He ripped no big capitalist off. Just competed with the silly fiat currency that is used by the big cheating capitalists to make the poor poorer and the rich richer.
    Oh btw, I do not believe he was a Jap. More a Yanky pretending to be a Jap to keep any capitalist off his trail.

    Anyway, any idea how much it will cost to get a Fire Fox plugin built that silently in the background submits the user browsed urls and their meta tag descriptions to my mysql db ? Roughly, how much it is gonna cost and how long it will take to build ?
    Last edited by UniqueIdeaMan; June 2nd, 2018 at 01:16 PM.
  8. #5
  9. No Profile Picture
    Contributing User
    Devshed Novice (500 - 999 posts)

    Join Date
    Jan 2017
    Posts
    817
    Rep Power
    0

    Question


    Cato,

    Another idea I had few yrs back. I think I asked about it in some forum. Not sure if I asked here and so gonna ask now. I think other forums told me that it is impossible.
    This is what I wanted to do ...
    Build a browsing history exchange site. This is where you singup for an account. When everytime you want to see what others are browsing you just login to your account.
    When you login to your account, you see a mssg like this ....

    "Uploading your browsing history into our database ..."

    The uploading occurs in the background without you having to click any link or button. A bit like the redirect scripts. You can either click a link to get redirected to a page or the javascript would auto redirect you.
    Similarly, you can click a link to upload all your browsing history to my db or the login homepage would have a script that would auto upload your browsing history onto my db.
    Other programmers told me that, this will be security issue and so no javascript or any script can auto upload any user's browsing history (from the place where browsing history resides on your hdd. Press CTRL H to see where your browser is saving your browsing history what exactly it is saving).
    Now, if it is a security issue then tell me how did del.icio.us manage to auto upload our bookmarks then ? del.icio.us was the world's first social bookmarking site. It is not anymore. Yahoo or some other site bought it out.
    But originally del.icio.us was a social bookmarking site. This is where you login to your account and your account homepage would give you similar mssg to wait while it auto uploads all your bookmarks/favs from your browser to their db.
    Once the upload is finished. Anyone can browse what you bookmarked and you can see other people's bookmarks too. My idea was to open a "social history" site. Instead of your account auto uploading bookmarks, it uploads your browsing history.
    Now, I ask again. If auto uploading our browsing histories to some website's db is not possible with any form of webscript then how did del.icio.us do it then to auto upload our bookmarks ?

    You see Cato, how good my conecpts and/or ideas are ? You saw social bookmarks become trendy back in 2004 before facebook and twitter came along.
    Did you ever thought of running your own social browsing history network instead ?
    You see, my concepts and ideas are not baseless. So, next time. Believe in me.
    Oh btw, this social history idea was not a derivation of the social bookmark idea. If you really must know, I was aware of del.icio.us back in 2004 and I only dreamt-up this social browsing history idea around 2012-13 after I built my .exe browser. And so the idea was a derivation of my browser. Only recently, I realized it is similar to the social bookmark del.icio.us.

    And, if users cannot auto upload their browsing histories without clicking any link or button to trigger the upload through double consent from the user then is it possible to write a javascript or any script for that matter where when the user clicks a link or a button then all his browsing histories get extracted from his hdd where his browser stores his browsed urls list ?
    That way, when users login to their accs, they can click a link to upload their browsing histories.
    What I do not want to be doing is this ....
    Get user to login to his acc where his acc homepage shows a webform for them to attach their browsing histories manually. Not want this simply due to I won't be in control what they upload. They may just upload any list of urls they made. A false list.
    Therefore, best not give the user to manually upload anything. Best get them to click some link/button that will trigger the script to search his hdd where his browser stores his browsing histories which we are able to see when clicking CTRL+H.

    A dacade back, I saw a script. When you go to a webpage, the script triggers and auto loads your outlook, eudora, etc. to send the site owner an email so he gets your email address. Ofcourse, you would have to click the SEND button.
    Another script I saw before that, did not wait for you to click the SEND button and it auto got your email client (.exe) out and got it to auto email them so they get hold of your email address.
    Now imagine, it auto emailed your bookmarks & browsing histories to my website's email. And imagine my website's email is set to auto ditch the data ont my mysql db. I would now get hold of all your browsing history via your email client. (With your permission ofcourse as the permission request can be in the reg tos).
    Don't advise me what is legal and what is not. Aslong as user is aware (through site tos) the auto uploading or auto emailing will be done and they consent then it is legal.
    And, don't tell me no-one gonna use this service. Let us test and find-out!

    I have deliberately kept secret my browsing history, keywords searches links monetizing method.
    I mean, you guys are programmers. You can easily build these scripts I just mentioned. Build them overnight.
    But none of you still have guessed how the users (who submit their bookmarks & browsing histories & KWs histories to my websites) will earn money through my sites.
    If you knew that then you'd be billionnaires within 30 days by building websites based on my ideas before I do.
    Therefore, you will just have to wait and see how I build my websites and then copy or clone them. As of now just hold your breath.
    You know what, I'm googling now for these scripts. If you know of any or come across any then let me know. Or better, if you know how to build them then open a tutorial on this forum so we can learn. And then hold your breath and see where the rabbit hole leads Alice too.
    You programmers probably only know people from the West. I know the mentality of the West, East and the South.
    Therefore, I have a better chance of making my concepts work which are really tailored towards the Eastern & Southern hemisphere people.
    But, the not so rich Western people, especially teens, will love them too! Love them all! This forum will become very famous soon.
    All thanks to me and my genius thinking. My super thinking brain.

    Googling now ...
    how to auto upload to your mysql database ?
    auto uploading script
    auto emailing script
    auto uploading bookmarks script
    auto uploading browsing history script
    auto CTRL+H script

    Say, can a browser extension do all this ? Cato ? Kicken ? Sepo ?
    And, how much will it cost me to get one built and programmer would need how many hrs to build them ?

    Btw, when I mean "auto uploading", I mean "auto exporting". Exporting your bookmarks and your browsing history. Better, if auto exporting cache is possible.
    Last edited by UniqueIdeaMan; June 2nd, 2018 at 02:45 PM.
  10. #6
  11. No Profile Picture
    Contributing User
    Devshed Novice (500 - 999 posts)

    Join Date
    Jan 2017
    Posts
    817
    Rep Power
    0
    Cato Man,

    Seems like Google is doing the same as what my own built web browser did back in 2016:
    https://en.wikipedia.org/wiki/Web_browsing_history

    Only thing they have not done is monetize their users' browsing histories so that when others browse their browsing histories they earn money.
    Also, they have not added feature where a user can publicize their browsing histories.
    My browser takes 3 steps:

    1. Log your browsing history and upload to my DB;
    2. Publicize your browsing history via my DB;
    3. Monetize your browsing history. (Followee earns the money and not the follower. On my new version even the follower would earn money !!! ).

    Google so far has only done the first one. In their darkest snooping dream, it has yet to occur to them to give their browser users the ability to publicize their browsing histories (my browser's step 2) and monetize their browsing histories (my browser's step 3) so trailing clicks earns the browsing history owner money.

    You see Cato, when I said other internet giants will go bankrupt unless they follow my lead. I was not KIDDING. It seems some are already thinking along the same lines as me. I am just 2 steps ahead of them and atleast 2yrs advanced them all of them companies put together. I'm a one man/woman show while they have thousands of employees and think tanks behind them. And yet, none of them are as good as me. Put them altogether in one scale and me in another. I would weight double than them all put together!
    Just imagine if they read my threads in this forum and other forums and learn what kind of a money making browser I have built and now about to build a money making searchengine where they all (major searchengines) about to go bankrupt. Then, what do you think they would do ? They would keep tabs on my threads in the hope that I reveal my future plans so that they can jump in and do them first before me. But, I am such a good thinking tank nowadays that I can build projects where I will not be imitable and they will all sink in the quick sand and I will watch mercilessly.
    You want to be on my other side ? It won't be pleasant. Will be a sow death. Lol!
    Maybe, it is a blessing for you guys that I am crap at php or God knows what Frankenstein I would have built who would have eaten Sepodati raw and alive. Right Sepo ? Munch! Munch! Lol!
    Anyway, got to continue searching for the "auto uploading script".
    Was googling following when came across that link which I never bothered to read thoroughly. Only had a quick glance.

    "where does google store your browsing history ?"

    On other things also for a dacade or so I have seen that whatever I thinkup, 2yrs later, others build them if I do not. I am always 2 yrs advanced.
    That means, if I do not hurry up and build my SE that will annihilate all major SEs then somebody will come-up with the idea 2yrs later and build it without me.
    Actually, this SE idea, half of it was dreamtup nearly 2 dacades ago. I waited 2 dacades and no human in the face of this earth manage to think like me. What a shame human race! I'm too good for you.
    Maybe, I'm not human Cato. I could be an alien from Mars communicating with humans on earth. Or, I could be a super Android. Or, maybe I'm a time traveller ? Maybe, I saw the future and experienced it and returned back to cash in in advance (like in Back To The Future).
    https://www.youtube.com/results?sear...Caught+on+Tape

    Opps! I'm getting carried away now! Yikes!
    Carried away that online giants think like me but way backward than me. thousands of think tanks not even close to a single think man/woman.
    I was planning on becoming a billionnair. Now, I'm thinking, it's likely I will be a trillionnaire. And, a mighty multi trillionnaire at that!

    Bye! Bye! Bajaw! Chaww!
    Last edited by UniqueIdeaMan; June 2nd, 2018 at 03:39 PM.
  12. #7
  13. No Profile Picture
    Contributing User
    Devshed Novice (500 - 999 posts)

    Join Date
    Jan 2017
    Posts
    817
    Rep Power
    0
    Folks,

    Can you tell me if this webpage loads on your screen fast or not.
    https://alfabank.ua/ru

    I will list some more links if I am provided more.
    I'm just asking vps hosts to show me examples of pages run by their vps so I can checkout their server speed. Loading speed.
    The above page loaded slow on my end but that could be due to me on a wireless network and 3g only. How is it loading on your end ? is it ok or fast or slow ?
    Remember, it's not my link.
    Let me finish reading all the replies of vps hosts to see if anyone else has provided any links as examples of their server speeds.

IMN logo majestic logo threadwatch logo seochat tools logo