dollscroll.com
robots.txt

Robots Exclusion Standard data for dollscroll.com

Resource Scan

Scan Details

Site Domain dollscroll.com
Base Domain dollscroll.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-03T13:05:10+00:00
Next Scan 2025-12-17T13:05:10+00:00

Last Successful Scan

Scanned2025-10-25T10:43:35+00:00
URL https://dollscroll.com/robots.txt
Domain IPs 104.21.58.127, 172.67.159.224, 2606:4700:3031::6815:3a7f, 2606:4700:3033::ac43:9fe0
Response IP 172.67.159.224
Found Yes
Hash 05a8ab6df09ed5d65009a8818cba96cdaa3373d96c558e28884e293df2a22baf
SimHash 5054d000da38

Groups

bytespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /random_page.php
Disallow /random_page.php?lang=en_US
Disallow /random_page.php?lang=fr_FR
Disallow /random_page.php?lang=ru_RU

Other Records

Field Value
crawl-delay 60.0