bed-and-breakfast.it
robots.txt

Robots Exclusion Standard data for bed-and-breakfast.it

Resource Scan

Scan Details

Site Domain bed-and-breakfast.it
Base Domain bed-and-breakfast.it
Scan Status Ok
Last Scan2024-10-03T15:51:20+00:00
Next Scan 2024-10-10T15:51:20+00:00

Last Scan

Scanned2024-10-03T15:51:20+00:00
URL https://bed-and-breakfast.it/robots.txt
Redirect https://www.bed-and-breakfast.it/robots.txt
Redirect Domain www.bed-and-breakfast.it
Redirect Base bed-and-breakfast.it
Domain IPs 34.254.126.208, 52.215.194.100, 52.31.79.75
Redirect IPs 34.254.126.208, 52.215.194.100, 52.31.79.75
Response IP 52.31.79.75
Found Yes
Hash 1717b818688078ba24fdc7e7ff2cf186ce3c175f246c85ef161064c85f692bce
SimHash 5b5c5268f69a

Groups

*

Rule Path
Disallow /ajaxinternational/
Disallow /android/
Disallow /app/
Disallow /i/
Disallow /ii/
Disallow /mappa/
Disallow /paypal/
Disallow /scripts/
Disallow /manutenzione/
Disallow /rrp/
Disallow /rrp2/
Disallow /rrp3/
Disallow /scheduledtasks/
Disallow /sitoweb.cfm
Disallow /mappa.cfm
Disallow /mappalocalita.cfm
Disallow /mappa_streetview.cfm
Disallow /style.mappe_v3.0.css
Disallow /cr.cfm
Disallow /en/cr.cfm
Disallow /fr/cr.cfm
Disallow /de/cr.cfm
Disallow /es/cr.cfm
Disallow /crd.cfm
Disallow /ssil.cfm

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /