yitty.com
robots.txt

Robots Exclusion Standard data for yitty.com

Resource Scan

Scan Details

Site Domain yitty.com
Base Domain yitty.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-23T08:20:00+00:00
Next Scan 2024-06-30T08:20:00+00:00

Last Successful Scan

Scanned2023-11-10T02:49:42+00:00
URL https://yitty.com/robots.txt
Redirect https://yitty.fabletics.com/robots.txt
Redirect Domain yitty.fabletics.com
Redirect Base fabletics.com
Domain IPs 104.18.39.11, 172.64.148.245, 2606:4700:4400::6812:270b, 2606:4700:4400::ac40:94f5
Redirect IPs 104.18.42.9, 172.64.145.247
Response IP 172.64.145.247
Found Yes
Hash c69b46f5500f6e0c66fb6eb9d8ee5a59a3edfa90a38ce2dfe2d6c0b5c6f310c3
SimHash ed851479d10c

Groups

googlebot

Rule Path
Disallow /dms*/
Disallow /*?altoken=*
Disallow /*?alkey=*
Disallow /*?*&altoken=
Disallow /*?*&alkey=

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

snapchatadsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5