bucktop.com
robots.txt

Robots Exclusion Standard data for bucktop.com

Resource Scan

Scan Details

Site Domain bucktop.com
Base Domain bucktop.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-17T18:23:37+00:00
Next Scan 2026-03-17T18:23:37+00:00

Last Successful Scan

Scanned2023-05-30T01:57:48+00:00
URL https://bucktop.com/robots.txt
Domain IPs 104.21.233.157, 104.21.233.158, 2606:4700:3038::6815:e99d, 2606:4700:3038::6815:e99e
Response IP 104.21.233.158
Found Yes
Hash 293e9aa20dea56387752c986c087002d343c2da43da73874345e732db0a378a2
SimHash da06bf6262db

Groups

bytespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

iaskspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /