internic.net
robots.txt

Robots Exclusion Standard data for internic.net

Resource Scan

Scan Details

Site Domain internic.net
Base Domain internic.net
Scan Status Ok
Last Scan2026-01-01T14:50:20+00:00
Next Scan 2026-01-15T14:50:20+00:00

Last Scan

Scanned2026-01-01T14:50:20+00:00
URL https://internic.net/robots.txt
Redirect https://www.internic.net/robots.txt
Redirect Domain www.internic.net
Redirect Base internic.net
Domain IPs 192.0.43.9, 2001:500:88:200::9
Redirect IPs 192.0.46.9, 2620:0:2830:200::b:9
Response IP 192.0.46.9
Found Yes
Hash 863958b103a224a185933b58afeafa08be7812ae959ed11ebccf5519c764a3a9
SimHash ac266012cfdf

Groups

ia_archiver

Rule Path
Disallow

*

Rule Path
Disallow /problem_reports/

Other Records

Field Value
sitemap https://www.internic.net/sitemap.xml

Comments

  • Hi, welcome to the Internic robots.txt
  • Permit the Internet Archive to display anything (avoiding retroactive respect.)
  • Then by default just deny pages that redirect to ICANN (mainly problems)
  • Disallow: /403/
  • Finally a sitemap
  • Thanks, ptudor@icann