Log In Sign Up

genteroma.com
robots.txt

Robots Exclusion Standard data for genteroma.com

Resource Scan

Scan Details

Site Domain genteroma.com
Base Domain genteroma.com
Scan Status Ok
Last Scan2024-10-28T14:26:37+00:00
Next Scan 2024-11-27T14:26:37+00:00

Last Scan

Scanned2024-10-28T14:26:37+00:00
URL https://genteroma.com/robots.txt
Redirect https://www.genteroma.com/it/robots.txt
Redirect Domain www.genteroma.com
Redirect Base genteroma.com
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash cc3f2eb0a9cd41b91aeed9613196a9f767164a8c5b8aaaa66fbee52382ece437
SimHash 8d25386343b0

Groups

*

No rules defined. All paths allowed.

Back to top

Comments

  • Directories
  • Disallow: /404/
  • Disallow: /app/
  • Disallow: /cgi-bin/
  • Disallow: /downloader/
  • Disallow: /includes/
  • Disallow: /lib/
  • Disallow: /media/ // Allow this folder for google product caching
  • Disallow: /media/tmp/
  • Disallow: /pkginfo/
  • Disallow: /report/
  • Disallow: /stats/
  • Disallow: /var/
  • Paths (clean URLs)
  • Disallow: /index.php/
  • Disallow: /cache/
  • Disallow: /catalog/product/gallery/
  • Disallow: /catalog/product_compare/
  • Disallow: /catalog/category/view/
  • Disallow: /catalog/product/view/
  • Disallow: /catalogsearch/
  • Disallow: /sales/
  • Disallow: /checkout/
  • Disallow: /contacts/
  • Disallow: /customer/
  • Disallow: /errors/
  • Disallow: /newsletter/
  • Disallow: /poll/
  • Disallow: /review/
  • Disallow: /scripts/
  • Disallow: /sendfriend/
  • Disallow: /shell/
  • Disallow: /staging/
  • Disallow: /tag/
  • Disallow: /tmp/
  • Disallow: /wishlist/
  • Disallow: /*product_compare/
  • Disallow: /*wishlist/
  • Disallow: /upsell
  • Files
  • Disallow: /cron.php
  • Disallow: /cron.sh
  • Disallow: /error_log
  • Disallow: /install.php
  • Disallow: /LICENSE.html
  • Disallow: /LICENSE.txt
  • Disallow: /LICENSE_AFL.txt
  • Disallow: /STATUS.txt
  • Paths (no clean URLs)
  • Disallow: /*.php$
  • Disallow: /*?SID=
  • Filters
  • Disallow: /*product_list_dir=
  • Disallow: /*product_list_order=
  • Disallow: /*price=
  • Disallow: /*gr_size=
  • Disallow: /*color=
  • Disallow: /*msp_brand=
  • Disallow: /*cat=
  • Sitemap: https://www.genteroma.com/media/sitemap_it.xml
  • Sitemap: https://www.genteroma.com/media/sitemap_en.xml
Back to top