docs.minecraftforge.net
robots.txt

Robots Exclusion Standard data for docs.minecraftforge.net

Resource Scan

Scan Details

Site Domain docs.minecraftforge.net
Base Domain minecraftforge.net
Scan Status Ok
Last Scan7/1/2025, 12:17:44 PM
Next Scan 7/31/2025, 12:17:44 PM

Last Scan

Scanned7/1/2025, 12:17:44 PM
URL https://docs.minecraftforge.net/robots.txt
Domain IPs 104.21.58.163, 172.67.161.211, 2606:4700:3032::6815:3aa3, 2606:4700:3036::ac43:a1d3
Response IP 172.67.161.211
Found Yes
Hash a833e9df9f4f39b11387c8bd8c3467af41d0e86ec26d4fbc3117f81f53abce39
SimHash aa013f43a7e7

Groups

*

Rule Path Comment
Disallow Allow everything

Other Records

Field Value
sitemap https://docs.minecraftforge.net/sitemap.xml

Comments

  • This robots.txt file is autogenerated by Read the Docs.
  • It controls the crawling and indexing of your documentation by search engines.
  • You can learn more about robots.txt, including how to customize it, in our documentation:
  • * Our documentation on Robots.txt: https://docs.readthedocs.com/platform/stable/reference/robots.html
  • * Our guide about SEO techniques: https://docs.readthedocs.com/platform/stable/guides/technical-docs-seo-guide.html