Default top-level domain names

The crawlscope.top-level-domains.generic property contains the following TLD names in the default.xml configuration file:

  • aero
  • asia
  • biz
  • cat
  • com
  • coop
  • edu
  • gov
  • info
  • int
  • jobs
  • mil
  • mobi
  • museum
  • name
  • net
  • org
  • pro
  • tel
  • travel

As mentioned in the property table above, you should not modify this list because it may affect how domain names are determined.