fabletics.es
robots.txt

Robots Exclusion Standard data for fabletics.es

Resource Scan

Scan Details

Site Domain fabletics.es
Base Domain fabletics.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-22T14:51:50+00:00
Next Scan 2024-10-06T14:51:50+00:00

Last Successful Scan

Scanned2023-11-09T00:47:10+00:00
URL https://fabletics.es/robots.txt
Redirect https://www.fabletics.es/robots.txt
Redirect Domain www.fabletics.es
Redirect Base fabletics.es
Domain IPs 104.18.38.16, 172.64.149.240
Redirect IPs 104.18.38.16, 172.64.149.240
Response IP 104.18.38.16
Found Yes
Hash c69b46f5500f6e0c66fb6eb9d8ee5a59a3edfa90a38ce2dfe2d6c0b5c6f310c3
SimHash ed851479d10c

Groups

googlebot

Rule Path
Disallow /dms*/
Disallow /*?altoken=*
Disallow /*?alkey=*
Disallow /*?*&altoken=
Disallow /*?*&alkey=

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

snapchatadsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5