mercato-immobiliare.info
robots.txt

Robots Exclusion Standard data for mercato-immobiliare.info

Resource Scan

Scan Details

Site Domain mercato-immobiliare.info
Base Domain mercato-immobiliare.info
Scan Status Ok
Last Scan2024-11-13T12:15:17+00:00
Next Scan 2024-11-20T12:15:17+00:00

Last Scan

Scanned2024-11-13T12:15:17+00:00
URL https://mercato-immobiliare.info/robots.txt
Redirect https://www.mercato-immobiliare.info/robots.txt
Redirect Domain www.mercato-immobiliare.info
Redirect Base mercato-immobiliare.info
Domain IPs 217.182.148.196
Redirect IPs 217.182.148.196, 217.182.148.197
Response IP 217.182.148.197
Found Yes
Hash 44a0f925991b47fc8893fe25f482ec13a30e54c9d435079eecc82422507fe67c
SimHash 610c9c72ce9b

Groups

*

Rule Path
Disallow /examples/
Disallow /docs/
Disallow /widget/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

grapeshotcrawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

gptbot

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mercato-immobiliare.info/sitemapindex.xml