wetandpissy.com
robots.txt

Robots Exclusion Standard data for wetandpissy.com

Resource Scan

Scan Details

Site Domain wetandpissy.com
Base Domain wetandpissy.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-14T18:56:27+00:00
Next Scan 2025-08-13T18:56:27+00:00

Last Successful Scan

Scanned2024-11-24T09:37:31+00:00
URL https://wetandpissy.com/robots.txt
Redirect https://www.wetandpissy.com/robots.txt
Redirect Domain www.wetandpissy.com
Redirect Base wetandpissy.com
Domain IPs 162.254.214.72
Redirect IPs 162.254.214.72
Response IP 162.254.214.72
Found Yes
Hash df31e62216e866404bb63e8ab36c46a7a98a17baea00f8e6d931b5ac31ab46c9
SimHash 6748d4d1d135

Groups

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 40

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 12

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 12

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20