Log In Sign Up

period.org
robots.txt

Robots Exclusion Standard data for period.org

Resource Scan

Scan Details

Site Domain period.org
Base Domain period.org
Scan Status Ok
Last Scan2024-05-23T12:30:28+00:00
Next Scan 2024-06-22T12:30:28+00:00

Last Scan

Scanned2024-05-23T12:30:28+00:00
URL https://period.org/robots.txt
Domain IPs 13.225.4.101, 13.225.4.11, 13.225.4.16, 13.225.4.86
Response IP 13.225.4.16
Found Yes
Hash 18d45b5b97046dee4cf2d7475fcba36243d8292e114c1ee61043706ea0cf6778
SimHash c1701d563d35

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Back to top

Other Records

Field Value
sitemap https://period.org/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://period.org/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top