[IPv6crawler-wg] Input domain name data / TLDs / Domains

[Olivier MJ Crepin-Leblond]

Hello everyone,

I am leaving Nairobi today but needed to update you on the situation wrt
obtaining an input set of data for the IPv6 Crawler. In our
specifications, we mention a "sample" of 50 000 domains. I guess that
we'll have a higher percentage of .UK domains, since our project is for
ISOC England, but we really need a sample even for the really small TLDs.

I have spoken to the head of Strategy at ISOC who liaised with PIR (the
people who run .org) to obtain zone maps for .org - as a test to see how
likely it is to be able to obtain this data.
The response, although not negative, was something along the lines of
"if you wish us to provide the data, you should get us involved" - ie.
this is a project which interests them too.

We are, of course, not willing to add yet more partners - since we would
end us with as many partners as there are gTLDs, ccTLDs etc.

I spoke at length to someone at Afilias (they support the tlds described
at: http://www.afilias.info/global-registry-services )
and I am yet to receive a formal reply. The person I spoke to told me:
"but why don't you just do a zone dump for each TLD? Then you can
pick/choose what domain you wish..."

I am unsure whether Zone dumps are possible for every TLD these days?
Will someone please advise whether we can do this?
I asked re: LEGALITY of doing such a thing. I am told there is nothing
wrong with it, a-priori, since we are not using the data collected to
spam people or do anything malicious. This area of the law is not
defined, so unless we do something malicious, we are fine.

Okay - I'll look to your feedback on that.

Kind regards,

Olivier


-- 
Olivier MJ Crépin-Leblond, PhD
http://www.gih.com/ocl.html