westfieldathletics.org
robots.txt

Robots Exclusion Standard data for westfieldathletics.org

Resource Scan

Scan Details

Site Domain westfieldathletics.org
Base Domain westfieldathletics.org
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-06-25T11:39:36+00:00
Next Scan 2024-09-23T11:39:36+00:00

Last Successful Scan

Scanned2023-05-28T15:04:56+00:00
URL https://westfieldathletics.org/robots.txt
Domain IPs 3.224.3.137, 52.44.129.47, 54.88.210.142
Response IP 52.44.129.47
Found Yes
Hash 8fc4f570611afd1cb6d0d04d11b702d8d860ce2dd597f5adffd9e0405b3b3bf6
SimHash 3b80ec0087f1

Groups

mj12bot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

spbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /cfformprotect/
Disallow /cftags/
Disallow /common/
Disallow /config/
Disallow /export/
Disallow /fonts/
Disallow /frameworks/
Disallow /img/
Disallow /includes/
Disallow /layouts/
Disallow /model/
Disallow /modules/
Disallow /services/
Disallow /src/
Disallow /udf/
Disallow /WEB-INF/