aopschools.com
robots.txt

Robots Exclusion Standard data for aopschools.com

Resource Scan

Scan Details

Site Domain aopschools.com
Base Domain aopschools.com
Scan Status Ok
Last Scan2024-06-09T06:19:44+00:00
Next Scan 2024-07-09T06:19:44+00:00

Last Scan

Scanned2024-06-09T06:19:44+00:00
URL https://aopschools.com/robots.txt
Redirect https://www.aopschools.com/robots.txt
Redirect Domain www.aopschools.com
Redirect Base aopschools.com
Domain IPs 108.157.254.118, 108.157.254.74, 108.157.254.83, 108.157.254.96
Redirect IPs 184.51.6.202, 184.51.6.223
Response IP 23.52.171.202
Found Yes
Hash 86a585c82e5356d5ef2957612caec513a6944e57144b9f4d057199c08da4c096
SimHash 65b0ce52cdb1

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.aopschools.com/sitemap_www.aopschools.com_Index.xml

Comments

  • Allow all robots to spider everything by disallowing nothing