topbnb.it
robots.txt

Robots Exclusion Standard data for topbnb.it

Resource Scan

Scan Details

Site Domain topbnb.it
Base Domain topbnb.it
Scan Status Ok
Last Scan2024-09-23T14:20:05+00:00
Next Scan 2024-09-30T14:20:05+00:00

Last Scan

Scanned2024-09-23T14:20:05+00:00
URL https://topbnb.it/robots.txt
Redirect https://www.topbnb.it/robots.txt
Redirect Domain www.topbnb.it
Redirect Base topbnb.it
Domain IPs 65.9.112.32, 65.9.112.75, 65.9.112.76, 65.9.112.94
Redirect IPs 3.164.85.11, 3.164.85.37, 3.164.85.52, 3.164.85.80
Response IP 18.165.140.106
Found Yes
Hash 0189a098991bec73ade54f476624ddfc760bb6c507b938fa29ea0c1133065ab2
SimHash d9ddc222e69a

Groups

*

Rule Path
Disallow /admin/
Disallow /ajax/
Disallow /style.topbnb.css
Disallow /sitoweb.cfm
Disallow /rrp/
Disallow /rrp2/
Disallow /rrp3/
Disallow /rrp4/

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /