topbnb.it
robots.txt

Robots Exclusion Standard data for topbnb.it

Resource Scan

Scan Details

Site Domain topbnb.it
Base Domain topbnb.it
Scan Status Ok
Last Scan2024-06-14T14:15:25+00:00
Next Scan 2024-06-21T14:15:25+00:00

Last Scan

Scanned2024-06-14T14:15:25+00:00
URL https://topbnb.it/robots.txt
Redirect https://www.topbnb.it/robots.txt
Redirect Domain www.topbnb.it
Redirect Base topbnb.it
Domain IPs 108.138.246.51, 108.138.246.54, 108.138.246.73, 108.138.246.83
Redirect IPs 65.9.112.32, 65.9.112.75, 65.9.112.76, 65.9.112.94
Response IP 3.160.246.117
Found Yes
Hash 02f5e1d614a457c89f196998d6e2d3e0fa8693a452650d8849db70f471df142d
SimHash d95d4272f69a

Groups

*

Rule Path
Disallow /admin/
Disallow /ajax/
Disallow /style.topbnb.css
Disallow /sitoweb.cfm
Disallow /rrp/
Disallow /rrp2/
Disallow /rrp3/
Disallow /rrp4/

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

seznambot

Rule Path
Disallow /