suttonunited.net
robots.txt

Robots Exclusion Standard data for suttonunited.net

Resource Scan

Scan Details

Site Domain suttonunited.net
Base Domain suttonunited.net
Scan Status Ok
Last Scan2024-06-27T17:53:14+00:00
Next Scan 2024-07-04T17:53:14+00:00

Last Scan

Scanned2024-06-27T17:53:14+00:00
URL https://www.suttonunited.net/robots.txt
Domain IPs 104.18.38.231, 172.64.149.25, 2606:4700:4400::6812:26e7, 2606:4700:4400::ac40:9519
Response IP 104.18.38.231
Found Yes
Hash 5302031c5429d94db47c0a1560d667909138d6997816b702a5c9b7f3468cb40a
SimHash 6316f037e514

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.suttonunited.net/sitemap.xml