bon-bast.com
robots.txt

Robots Exclusion Standard data for bon-bast.com

Resource Scan

Scan Details

Site Domain bon-bast.com
Base Domain bon-bast.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-02T16:26:21+00:00
Next Scan 2026-03-03T16:26:21+00:00

Last Successful Scan

Scanned2025-11-02T22:37:16+00:00
URL https://bon-bast.com/robots.txt
Redirect https://www.bon-bast.com/robots.txt
Redirect Domain www.bon-bast.com
Redirect Base bon-bast.com
Domain IPs 104.21.9.56, 172.67.159.32, 2606:4700:3036::ac43:9f20, 2606:4700:3037::6815:938
Redirect IPs 104.21.9.56, 172.67.159.32, 2606:4700:3036::ac43:9f20, 2606:4700:3037::6815:938
Response IP 172.67.159.32
Found Yes
Hash 1e169ec0c2c800a37693d90e966786b94dd4ac7c3291a1fa64753bc5486a0245
SimHash 0d345e30c49a

Groups

mediapartners-google

Rule Path
Disallow /pagead

adsbot-google

Rule Path
Disallow /pagead

twitterbot

Rule Path
Disallow /pagead

archivebot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /cdn-cgi/l/email-protection
Disallow /pagead
Disallow /api/