Log In Sign Up

bihorel.ro
robots.txt

Robots Exclusion Standard data for bihorel.ro

Resource Scan

Scan Details

Site Domain bihorel.ro
Base Domain bihorel.ro
Scan Status Ok
Last Scan2025-11-28T17:41:30+00:00
Next Scan 2025-12-05T17:41:30+00:00

Last Scan

Scanned2025-11-28T17:41:30+00:00
URL https://bihorel.ro/robots.txt
Domain IPs 78.47.155.244
Response IP 78.47.155.244
Found Yes
Hash 5276085f3bb3911d2944c6abb0bf033666979c6077ff23c858712701e46d50e1
SimHash 944fd632f9f8

Groups

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

qwantify

Rule Path
Disallow /
Back to top

Comments

  • Block CazoodleBot as it does not present correct accept content headers
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot
  • Block dotbot as it cannot parse base urls properly
Back to top