docs.pytest.org
robots.txt

Robots Exclusion Standard data for docs.pytest.org

Resource Scan

Scan Details

Site Domain docs.pytest.org
Base Domain pytest.org
Scan Status Ok
Last Scan7/31/2025, 7:47:11 AM
Next Scan 8/30/2025, 7:47:11 AM

Last Scan

Scanned7/31/2025, 7:47:11 AM
URL https://docs.pytest.org/robots.txt
Domain IPs 104.16.253.120, 104.16.254.120, 2606:4700::6810:fd78, 2606:4700::6810:fe78
Response IP 104.16.253.120
Found Yes
Hash 2bde40cda7cb3e6fee5ff05ecc26d2af7d294823725d0ecdde259a7b70a27c8c
SimHash 2a053d0ba7e7

Groups

*

Rule Path Comment
Disallow Allow everything

Other Records

Field Value
sitemap https://docs.pytest.org/sitemap.xml

Comments

  • This robots.txt file is autogenerated by Read the Docs.
  • It controls the crawling and indexing of your documentation by search engines.
  • You can learn more about robots.txt, including how to customize it, in our documentation:
  • * Our documentation on Robots.txt: https://docs.readthedocs.com/platform/stable/reference/robots.html
  • * Our guide about SEO techniques: https://docs.readthedocs.com/platform/stable/guides/technical-docs-seo-guide.html