bothub.ai
robots.txt

Robots Exclusion Standard data for bothub.ai

Resource Scan

Scan Details

Site Domain bothub.ai
Base Domain bothub.ai
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-14T05:21:47+00:00
Next Scan 2024-10-13T05:21:47+00:00

Last Successful Scan

Scanned2024-05-24T05:20:35+00:00
URL https://bothub.ai/robots.txt
Domain IPs 104.21.0.179, 172.67.128.43, 2606:4700:3032::ac43:802b, 2606:4700:3033::6815:b3
Response IP 172.67.128.43
Found Yes
Hash 9ab5014eb75656ab9a67aa141768b03823b839b7a66e8af164103db56cbb5443
SimHash 8434ff2c2512

Groups

baiduspider

Rule Path
Disallow