bonesa.ro
robots.txt

Robots Exclusion Standard data for bonesa.ro

Resource Scan

Scan Details

Site Domain bonesa.ro
Base Domain bonesa.ro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-03-06T14:39:19+00:00
Next Scan 2026-06-04T14:39:19+00:00

Last Successful Scan

Scanned2023-11-17T18:49:08+00:00
URL https://bonesa.ro/robots.txt
Redirect https://www.bonesa.ro/static/robots.txt
Redirect Domain www.bonesa.ro
Redirect Base bonesa.ro
Domain IPs 185.181.100.79
Redirect IPs 185.181.100.79
Response IP 185.181.100.79
Found Yes
Hash cd19890eef6fc39d87cc9fb55a05f0ccac97fd63626a04308f6b7be8fd996ddf
SimHash a638fb3689d8

Groups

*

Rule Path
Disallow /feed/
Disallow /html/
Disallow /scripts/
Disallow /invoice
Disallow /*?f=*
Disallow /*?fb_xd_fragment
Disallow /*?qty=*

Other Records

Field Value
crawl-delay 5

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bonesa.ro/sitemap.xml

Comments

  • Powered by MerchantPro
  • No need to index this stuff
  • Avoid duplicate content as it may do more harm than good
  • Disallow some bots we do not care about

Warnings

  • 2 invalid lines.