totalexposure.com
robots.txt

Robots Exclusion Standard data for totalexposure.com

Resource Scan

Scan Details

Site Domain totalexposure.com
Base Domain totalexposure.com
Scan Status Ok
Last Scan2025-10-09T10:51:02+00:00
Next Scan 2025-11-08T10:51:02+00:00

Last Scan

Scanned2025-10-09T10:51:02+00:00
URL https://totalexposure.com/robots.txt
Redirect http://www.totalexposure.com/robots.txt
Redirect Domain www.totalexposure.com
Redirect Base totalexposure.com
Domain IPs 104.21.29.20, 172.67.171.66, 2606:4700:3030::ac43:ab42, 2606:4700:3033::6815:1d14
Redirect IPs 104.21.29.20, 172.67.171.66, 2606:4700:3030::ac43:ab42, 2606:4700:3033::6815:1d14
Response IP 104.21.29.20
Found Yes
Hash 3057494e821be2a42d2c2f15ad8d5768043e6cd42341138eb5a65d05f31f1516
SimHash 624ad895e281

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /go/
Disallow /search/

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /go/
Disallow /search/

Other Records

Field Value
crawl-delay 20

slurp

Rule Path
Disallow /go/
Disallow /search/

Other Records

Field Value
crawl-delay 30

jeeves

Rule Path
Disallow /go/
Disallow /search/

Other Records

Field Value
crawl-delay 30

mediapartners-google*

Rule Path
Disallow