mansfieldtown.net
robots.txt

Robots Exclusion Standard data for mansfieldtown.net

Resource Scan

Scan Details

Site Domain mansfieldtown.net
Base Domain mansfieldtown.net
Scan Status Ok
Last Scan2024-06-18T06:04:06+00:00
Next Scan 2024-06-25T06:04:06+00:00

Last Scan

Scanned2024-06-18T06:04:06+00:00
URL https://mansfieldtown.net/robots.txt
Redirect https://www.mansfieldtown.net/robots.txt
Redirect Domain www.mansfieldtown.net
Redirect Base mansfieldtown.net
Domain IPs 217.114.94.2
Redirect IPs 104.18.43.168, 172.64.144.88, 2606:4700:4400::6812:2ba8, 2606:4700:4400::ac40:9058
Response IP 172.64.144.88
Found Yes
Hash 11044eb53e15ac870270c07dd260b672fbe63ee768171dc47413d8027ab2be60
SimHash 6716b015c5b4

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.mansfieldtown.net/sitemap.xml