community.theartofeducation.edu
robots.txt

Robots Exclusion Standard data for community.theartofeducation.edu

Resource Scan

Scan Details

Site Domain community.theartofeducation.edu
Base Domain theartofeducation.edu
Scan Status Ok
Last Scan2025-09-19T08:10:54+00:00
Next Scan 2025-10-03T08:10:54+00:00

Last Scan

Scanned2025-09-19T08:10:54+00:00
URL https://community.theartofeducation.edu/robots.txt
Domain IPs 162.159.128.53, 162.159.138.52
Response IP 162.159.138.52
Found Yes
Hash 81f8b68afe5e1ababa204658164aeb8a87f716265a3c302e7dd9dd24536fe4a7
SimHash 7a50d802ab1a

Groups

botify
spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /search?
Disallow /list?
Disallow /sign_in?
Disallow /sign_up?
Disallow /*?*filters=*
Disallow /*comments
Disallow /spaces/19219175*
Disallow /spaces/14221301*
Disallow /spaces/20945079*
Disallow /spaces/20149891*
Disallow /spaces/14221300*
Disallow /spaces/14291065*
Disallow /spaces/16635112*
Disallow /spaces/19306847*
Disallow /spaces/20103806*
Disallow /communities/

Other Records

Field Value
sitemap https://community.theartofeducation.edu/sitemap.xml