barcaholic.ro
robots.txt

Robots Exclusion Standard data for barcaholic.ro

Resource Scan

Scan Details

Site Domain barcaholic.ro
Base Domain barcaholic.ro
Scan Status Ok
Last Scan2024-05-26T18:28:29+00:00
Next Scan 2024-06-02T18:28:29+00:00

Last Scan

Scanned2024-05-26T18:28:29+00:00
URL https://barcaholic.ro/robots.txt
Domain IPs 89.45.171.61
Response IP 89.45.171.61
Found Yes
Hash bf66a1924c96aeb0ddda0bb149ca101dc8c3a0525c203767e5c2301c89e681c9
SimHash 000cd081ee11

Groups

petalbot
aspiegelbot
ahrefsbot
semrushbot
dotbot
mauibot
mj12bot

Rule Path
Disallow /community/

amazonbot

Rule Path
Disallow /community/threads/*/reply

*

Rule Path
Disallow /community/whats-new/
Disallow /community/account/
Disallow /community/attachments/
Disallow /community/goto/
Disallow /community/posts/
Disallow /community/login/
Disallow /community/search/
Disallow /community/admin.php
Allow /

Other Records

Field Value
sitemap https://barcaholic.ro/sitemap.xml

Comments

  • Crawl-delay: 10