bcm-surfpatrol.com
robots.txt

Robots Exclusion Standard data for bcm-surfpatrol.com

Resource Scan

Scan Details

Site Domain bcm-surfpatrol.com
Base Domain bcm-surfpatrol.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-01-23T15:02:08+00:00
Next Scan 2025-04-23T15:02:08+00:00

Last Successful Scan

Scanned2024-09-26T14:59:09+00:00
URL https://bcm-surfpatrol.com/robots.txt
Redirect https://www.bcm-surfpatrol.com/robots.txt
Redirect Domain www.bcm-surfpatrol.com
Redirect Base bcm-surfpatrol.com
Domain IPs 210.140.169.6
Redirect IPs 104.21.89.139, 172.67.160.53, 2606:4700:3032::6815:598b, 2606:4700:3033::ac43:a035
Response IP 104.21.89.139
Found Yes
Hash 86682bb500c86e7a21056d60ae28240eec2b096965a96c08317a4ecb0fdf0f0f
SimHash 084ccb627411

Groups

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

*

Rule Path
Disallow /webview/

mediapartners-google

Rule Path
Allow /webview/