biglots-store.com
robots.txt

Robots Exclusion Standard data for biglots-store.com

Resource Scan

Scan Details

Site Domain biglots-store.com
Base Domain biglots-store.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-01-24T01:16:58+00:00
Next Scan 2025-04-24T01:16:58+00:00

Last Successful Scan

Scanned2024-06-06T01:06:32+00:00
URL https://biglots-store.com/robots.txt
Redirect https://www.biglots-store.com/robots.txt
Redirect Domain www.biglots-store.com
Redirect Base biglots-store.com
Domain IPs 104.21.90.165, 172.67.158.50, 2606:4700:3032::ac43:9e32, 2606:4700:3037::6815:5aa5
Redirect IPs 104.21.90.165, 172.67.158.50, 2606:4700:3032::ac43:9e32, 2606:4700:3037::6815:5aa5
Response IP 104.21.90.165
Found Yes
Hash 427b700910755a5d397a234312e4d48895e9f184390d151a2b9d0e60e38cf1a3
SimHash 0d15590527d2

Groups

googlebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /