Log In Sign Up

comet.it
robots.txt

Robots Exclusion Standard data for comet.it

Resource Scan

Scan Details

Site Domain comet.it
Base Domain comet.it
Scan Status Ok
Last Scan2024-05-28T16:40:47+00:00
Next Scan 2024-06-27T16:40:47+00:00

Last Scan

Scanned2024-05-28T16:40:47+00:00
URL https://comet.it/robots.txt
Redirect https://www.comet.it:443/robots.txt
Redirect Domain www.comet.it
Redirect Base comet.it
Domain IPs 15.197.149.186, 3.33.158.58
Redirect IPs 2600:9000:234c:1c00:a:4790:4d80:93a1, 2600:9000:234c:4200:a:4790:4d80:93a1, 2600:9000:234c:6000:a:4790:4d80:93a1, 2600:9000:234c:6800:a:4790:4d80:93a1, 2600:9000:234c:8000:a:4790:4d80:93a1, 2600:9000:234c:a400:a:4790:4d80:93a1, 2600:9000:234c:d000:a:4790:4d80:93a1, 2600:9000:234c:f000:a:4790:4d80:93a1, 99.84.66.15, 99.84.66.40, 99.84.66.91, 99.84.66.92
Response IP 108.157.52.41
Found Yes
Hash 424e47e4455f42ea8be428f2be2e5a29db490fb82f8d185bdab6578487b4a8ad
SimHash 39055dac62f3

Groups

*

Rule Path
Disallow /admin/
Disallow /wcsstore/
Disallow /store-totem/
Disallow /flex/Extensions/assets/fe/css
Disallow */f/*
Disallow /disabled/
Disallow /cart/insert/
Back to top

Other Records

Field Value
sitemap https://www.comet.it/sitemap.xml
sitemap https://www.comet.it/sitemaps/categoria-computer-e-tablet.xml
sitemap https://www.comet.it/sitemaps/categoria-console-e-games.xml
sitemap https://www.comet.it/sitemaps/categoria-fotografia.xml
sitemap https://www.comet.it/sitemaps/categoria-grandi-elettrodomestici.xml
sitemap https://www.comet.it/sitemaps/categoria-illuminazione.xml
sitemap https://www.comet.it/sitemaps/categoria-piccoli-elettrodomestici.xml
sitemap https://www.comet.it/sitemaps/categoria-smartphone-e-telefonia.xml
sitemap https://www.comet.it/sitemaps/categoria-tv-audio.xml
sitemap https://www.comet.it/sitemaps/categoria-wearables-e-smart-tech.xml
sitemap https://www.comet.it/sitemaps/stores.xml
Back to top

Comments

  • Attenzione: questo file รจ un link simbolico - non modificare direttamente !
  • Disallow: /user/
Back to top