borsinoimmobiliare.it
robots.txt
Robots Exclusion Standard data for borsinoimmobiliare.it
Resource Scan
Scan Details
| Site Domain | borsinoimmobiliare.it |
| Base Domain | borsinoimmobiliare.it |
| Scan Status | Ok |
| Last Scan | 2024-06-06T00:35:53+00:00 |
| Next Scan | 2024-07-06T00:35:53+00:00 |
Last Scan
| Scanned | 2024-06-06T00:35:53+00:00 |
| URL | https://borsinoimmobiliare.it/robots.txt |
| Domain IPs | 104.26.8.224, 104.26.9.224, 172.67.74.62, 2606:4700:20::681a:8e0, 2606:4700:20::681a:9e0, 2606:4700:20::ac43:4a3e |
| Response IP | 104.26.9.224 |
| Found | Yes |
| Hash | d43a9b1ac983744ef7356adb4d1b859f9024afbe33c7c5ebac7a9d7c3a0873ac |
| SimHash | 6d1d74e7c679 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /ads/preferences/ |
| Allow | /gpt/ |
| Allow | /pagead/show_ads.js |
| Allow | /pagead/js/adsbygoogle.js |
| Allow | /pagead/js/*/show_ads_impl.js |
| Allow | /static/glade.js |
| Allow | /static/glade/ |
| Allow | /tag/js/ |
| Allow | /sitemaps/ |
| Disallow | /logs/ |
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
downloadexpress
wget
wget/1.4.0
wget
wget/1.4.0
mj12bot
proximic
grapeshot
sirdatabot
liebaofast
mauibot
mauibot (crawler.feedback+wc@gmail.com)
megaindex.ru/2.0
mqqbrowser
nimbostratus-bot/v1.3.2
qwant-news
qwantify
seekport crawler
semrushbot
semrushbot-sa
seznambot
sputnikbot/2.3
grapeshotcrawler/2.0
grapeshotcrawler
the knowledge ai
timpibot/0.8
tinytestbot
aspiegelbot
barkrowler
blackboard safeassign
blexbot
bytespider
crawler4j
facebookexternalhit
facebookexternalhit/1.1
dataforseobot
censysinspect/1.1
censysinspect
| Rule | Path |
|---|---|
| Disallow | / |
criteobot/0.1
| Rule | Path |
|---|---|
| Disallow | /quotazioni-immobiliari/ |
| Disallow | /quotazioni*/ |
| Disallow | /*/*/quotazioni_mq_immobiliari/ |
| Disallow | /*/*/quotazioni-mq-immobiliari-indirizzo/ |
| Disallow | /*/*/quotazioni*/ |
msnbot
msnbot
googlebot
storebot-google
googlebot-news
googlebot-news
adsbot-google
mediapartners-google
| Rule | Path |
|---|---|
| Allow | /sitemaps/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://borsinoimmobiliare.it/sitemap.xml |
| sitemap | https://borsinoimmobiliare.it/sitemap.xml |
| sitemap | https://borsinoimmobiliare.it/sitemap.xml |
| sitemap | https://borsinoimmobiliare.it/sitemap.xml |
| sitemap | https://borsinoimmobiliare.it/sitemap.xml |
| sitemap | https://borsinoimmobiliare.it/sitemap.xml |