vitajuwel.us
robots.txt

Robots Exclusion Standard data for vitajuwel.us

Resource Scan

Scan Details

Site Domain vitajuwel.us
Base Domain vitajuwel.us
Scan Status Ok
Last Scan2024-05-03T07:17:57+00:00
Next Scan 2024-06-02T07:17:57+00:00

Last Scan

Scanned2024-05-03T07:17:57+00:00
URL https://www.vitajuwel.us/robots.txt
Domain IPs 104.26.12.19, 104.26.13.19, 172.67.69.227, 2606:4700:20::681a:c13, 2606:4700:20::681a:d13, 2606:4700:20::ac43:45e3
Response IP 104.26.12.19
Found Yes
Hash 08fd57baa8f9f1d9211c0a78410c6d6211a636de3d7008a9947a3d39a4c3a902
SimHash 612453769134

Groups

*

Rule Path
Allow /
Disallow /*app/
Disallow /bin/
Disallow /dev/
Disallow /phpserver/
Disallow /*downloader/
Disallow /*includes/
Disallow /*lib/
Disallow /*magento/
Disallow /*pkginfo/
Disallow /*report/
Disallow /*stats/
Disallow /*var/
Disallow /*errors/
Disallow /*shell/
Disallow /*.php$
Disallow /*index.php/
Disallow /*catalog/product_compare/
Disallow /*catalog/category/view/
Disallow /*catalog/product/view/
Disallow /*catalogsearch/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /*control/
Disallow /*contacts/
Disallow /*customize/
Disallow /*newsletter/
Disallow /*poll/
Disallow /*review/
Disallow /*sendfriend/
Disallow /*wishlist/
Disallow /*review/product/*
Disallow /customer/account/login/referer/*

Other Records

Field Value
sitemap https://www.vitajuwel.us/media/google_sitemap_3.xml

Comments

  • Sitemaps
  • Directories
  • Paths (clean URLs)
  • Filters / Session ID