DNS Nameserver Domain lists....

Dunno if I'm explaining this correctly...

But does anyone know of an ASP code snippet, that will take a namerserver address (ie ns1.kkti.com) and then go and get a full listing of ALL the domains that are housed there?

IE a method to see who and how many domains a webhost has on their nameservers?

Figuring that this isnt' new, so someone may know of such a code snippet...

;-)

Jim

impossible!

try this site and plug in your own or any nameserver...

http://www.whois.sc/members/reverse-ip.html

this one shows only the first 3, but does report that there are 68 on them on that nameserver. buying the access to all costs $99 yearly I think...so I want to do this myself...

what I'm after is how to do this reverse lookup in ASP?

???

Jim

heh, I was thinking of that site. But what I say is still true. Impossible! That site has a limited index of websites it has compiled. It checks to see what name server each website domain is hosted on - which is very possible to see. Then, in the database it finds all the domains that happen to share the same server.

But they do not provide a comprehensive list of all domains on a given server.

I can't agree with you on this site.

I have more than 80 sites on various nameservers and this site USED to show them all. That is, I plug in a nameserver and see that it has say 240 domains and a full list of same is shown.

They cover ALL nameservers that I've ever plugged into it, and they USED to show all the domains....now they charge $$$ for it....

Like http://developers.evrsoft.com/name-server-search.shtml

I mean this is just a reverse lookup -- if you can search the dbase for a domain, it's obvious that you can also search based on a nameserver and report all found....
And I want an asp solution for that...

Rather tho than argue, can anyone offer that solution?

;-)

Jim

I'm telling you man, they've compiled this gargantuan list of domains. And they throw it into a huge database and are able to compile all kinds of statistics.

How did they make that domain list? They might have a DNS crawler - similar to the concept of my very own DNS crawler which just crawls around the DNS system looking for new domains to query. Or maybe they take this list from all the domains people query at their site. Or maybe both. I don't know, but do you want to know what I DO know?

I've probably read a dozen DNS related RFC's. Know what RFC's are? They pretty much lay out the standards for all kinds of tech related subjects including internet protocols. I've developed DNS software in 3 different programming languages, where each program performs a different function. I know how a client communicates with a server. I know the protocol and how flexible it is. I know about extensions to that protocol probably nobody on this board knows about. I've made DNS my business in more than one sense of the word. If there was a query type you can send to a DNS server that'll return a list of domains on that server - I would know about it. Therefor I know it doesn't exist.

IN addition... I've explored the whois protocol to know enough that each whois server has its own implementation of commands you can send it to retrieve different pieces of information, and never have I come across a server that has a command where you can browse around in the entire domain database on a given server.

IN addition... I've explored the rwhois protocol which is like the DNS system in its referral system. It is FAR more powerful than the whois system, but I have extreme doubts that they would incorporate functionality that will allow you to find every publically hosted domain on a dns server.

In summary...

Is it possible with the DNS protocol alone? no!!! I'm 100% certain.
Is it possible with the whois protocol alone? no!!! I'm 100% certain.
Is it possible with the rwhois protocol alone? no!!! I'm 99% certain.



I'm not the least bit upset, I'm just trying to convince you I'm not just a guy on the internet giving you his opinion. I'm an authority on the subject, and know. I've given you a reasonable possible explanation as to how whois.sc accomplishes what they do. There's no reason not to accept it.

okay, you sound like you'd know...

so, how can I do a "workaround" that will give the same answer to a nameserver query...

that is, is there no "other" way to do this? I do not have a DNS crawler, nor do I wish to store millions of domains into a dbase..

hmm...maybe it'd be best just to pay the fees for these guys?

anyone?

Jim

Here's all the implausible ways I thought of. I made sure to exclude domain database and dns/web/whois crawling techniques, which is the most plausible way I could think of.

Forward brute force
Query the server with every possible letter combonation to find domains hosted on it.

Reverse brute force
Query the server with every possible IP to test whether it also hosts the domain(s) associated with that IP.

Hack the server
And pull up statistical information that includes a list of domains on the server.

heh, not very good options. But perhaps I can still offer a solution. Maybe pulling up a list of domains on a given server is just a means to solving an entirely different problem? If you tell me what it is you are wanting to do (or why you are wanting to pull up a domain list for a server), then maybe I can offer a different means.

I thought of the most plausible way of all. If you can get your hands on the actual database the root servers use to update themselves with, you can find out what all domains is assigned to what dns servers. In my research I found the following FTP address with the comment that this is where the root servers update themselves from. However, this may not be precisely what you need. It may only be the top level domain delegations and NOT the second level domain delegations which GTLD servers have for the com,net,edu registries.

ftp://rs.internic.net/domain/

I found this spot -- http://developers.evrsoft.com/name-server-search.shtml

And here's the report that I paid for -- http://www.dnslocator.com/reports/r9182493313.html

Which is accurate, as it's my own server...

As you can see, these folks know how to do this kind of querey...

What I'd like to do, is to create a little app, either in VB or online, that could do the same thing. Take a nameserver and show what domains are on it.

That's what I'd like to do. I did visit that FTP site you listed, and noted that it holds lists of nameservers -- but we're at the top of my understanding of same.

What are these files? Why after reading your post, do I think that they may not be "right" for use? Can you explain what I need to first know, then be prepared to ask questions about?

???

This bugs me. Why can someone do this, and so far, no one else???

JIm

Ahh..try this link. it looks like this has been searched for by others....at -- http://www.webhostingtalk.com/showt...?threadid=52404

can anyone make sense of those pointers?

:-)


Jim

I'm a genius, muahahaha... My latest post hit it right on the nose. It IS impossible to do it using DNS, whois, or rwhois, but if you got your hands on the database used at the second level domain servers you're in business.

And that's precisely what that topic is talking about.

NOTICE!!! - You will only find the domains hosted on a server that fall under the TLD databases you have access to.

You can get access to the .COM and .NET TLD databases by submitting a request form below:

http://www.verisign.com/nds/naming/tld/

You can get access to the .ORG database by submitting a request form below:

http://www.pir.org/registrars/zone_file_access

Thank you ever so much for asking this question! Looks like I'm still learning stuff. I had no idea that TLD databases were publically accessible.

got there too...have already applied for rights to d/l same...

and will end up with an app, I think...

Thanks for the pointers and help tho...much appreciated!

;-)


Jim

PS..what do you think someone might "pay" to do a query based on a single nameserver entry?

???

Well you could take a leaf out of my book. DNS Crawler is a dns server query tool that I've developed. There's nothing like it on the internet, and it is by far the most actively used aspect about my website. It alone has brought additional visitors to my site. I've even recieved an offer from somebody to buy the source so that they can use it on their private network - to which I declined.

And yet, it is completely free to use. Why? For one, I don't think people would pay to use it. Two, it encourages people to use it, which is good advertising. I think that if you developed a script to do something similar to those pay-for sites you've shown me, and made it free, you may have a very heavily trafficked website in your future. On that website you can offer other stuff which will earn your income.

However, if you DO choose to do a free version, paid version setup, that is also good - but I recommend giving more power to the free version than what I've seen at the other 2 sites you've shown me. As for how much you should charge for the paid version? dunno, depends on how much more powerful it is. $5/month or $40/year is probably my recommendation.