I am currently loading domains into the database. This involves a DNS lookup for each domain name, so it's only going at an average rate of a few per second. I have several million domain names ready to be loaded, so I expect the initial load to take a few weeks. I have grabbed domain names from the following sources so far:
- dmoz from Open Directory RDF Dump (~3 million unique domains)
- en.wikipedia.org from Wikimedia Downloads (~800k unique domains)
- Alexa from Alexa Top Sites (just the first 500 which is free!)
- An old (2003?) copy of the entire list of registered domains in .com, .net, and .org (haven't counted yet)
If you can think of any other easily obtainable list of domain names, let me know!
And for what it's worth, the highest-alexa-ranked domain that publishes SPF -all is ...drumroll... blogger.com.