fabletics.com
robots.txt

Robots Exclusion Standard data for fabletics.com

Resource Scan

Scan Details

Site Domain fabletics.com
Base Domain fabletics.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-07T21:13:46+00:00
Next Scan 2024-10-21T21:13:46+00:00

Last Successful Scan

Scanned2023-11-09T19:14:02+00:00
URL https://www.fabletics.com/robots.txt
Domain IPs 104.18.42.9, 172.64.145.247
Response IP 104.18.42.9
Found Yes
Hash c69b46f5500f6e0c66fb6eb9d8ee5a59a3edfa90a38ce2dfe2d6c0b5c6f310c3
SimHash ed851479d10c

Groups

googlebot

Rule Path
Disallow /dms*/
Disallow /*?altoken=*
Disallow /*?alkey=*
Disallow /*?*&altoken=
Disallow /*?*&alkey=

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

snapchatadsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5