arteni.it
robots.txt

Robots Exclusion Standard data for arteni.it

Resource Scan

Scan Details

Site Domain arteni.it
Base Domain arteni.it
Scan Status Ok
Last Scan2024-11-16T06:56:25+00:00
Next Scan 2024-12-16T06:56:25+00:00

Last Scan

Scanned2024-11-16T06:56:25+00:00
URL https://www.arteni.it/robots.txt
Domain IPs 108.156.133.19, 108.156.133.20, 108.156.133.25, 108.156.133.8, 2600:9000:2755:2e00:6:b0f7:4ac0:93a1, 2600:9000:2755:4400:6:b0f7:4ac0:93a1, 2600:9000:2755:6c00:6:b0f7:4ac0:93a1, 2600:9000:2755:b400:6:b0f7:4ac0:93a1, 2600:9000:2755:e000:6:b0f7:4ac0:93a1, 2600:9000:2755:e200:6:b0f7:4ac0:93a1, 2600:9000:2755:e800:6:b0f7:4ac0:93a1, 2600:9000:2755:f600:6:b0f7:4ac0:93a1
Response IP 108.156.133.8
Found Yes
Hash 070707e51b0d26fa21d5b20133bace077b9cb034af1b965f7b830b5cf8b19eb8
SimHash e438cd474dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap https://www.arteni.it/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.