cookitaly.it
robots.txt

Robots Exclusion Standard data for cookitaly.it

Resource Scan

Scan Details

Site Domain cookitaly.it
Base Domain cookitaly.it
Scan Status Ok
Last Scan2024-11-15T00:56:55+00:00
Next Scan 2024-11-22T00:56:55+00:00

Last Scan

Scanned2024-11-15T00:56:55+00:00
URL https://cookitaly.it/robots.txt
Domain IPs 104.21.80.212, 172.67.153.213, 2606:4700:3036::ac43:99d5, 2606:4700:3037::6815:50d4
Response IP 104.21.80.212
Found Yes
Hash d4e8d1502228a2829441e73021445fe613aa03667a2251e51c1a1d6b39406bad
SimHash 46080843c2b7

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://cookitaly.it/sitemap.xml
sitemap https://cookitaly.it/info/293672670?id=293673143
sitemap https://cookitaly.it/info/293672849?id=293673322
sitemap https://cookitaly.it/info/293672800?id=293673273
sitemap https://cookitaly.it/info/293673011?id=293673484
sitemap https://cookitaly.it/info/293673346?id=293673819