durovinbathrooms.com
robots.txt

Robots Exclusion Standard data for durovinbathrooms.com

Resource Scan

Scan Details

Site Domain durovinbathrooms.com
Base Domain durovinbathrooms.com
Scan Status Ok
Last Scan2026-01-18T12:55:45+00:00
Next Scan 2026-02-17T12:55:45+00:00

Last Scan

Scanned2026-01-18T12:55:45+00:00
URL https://durovinbathrooms.com/robots.txt
Domain IPs 104.26.8.48, 104.26.9.48, 172.67.72.67, 2606:4700:20::681a:830, 2606:4700:20::681a:930, 2606:4700:20::ac43:4843
Response IP 172.67.72.67
Found Yes
Hash 0952a377b973887145d4413407ce21d9629d0e4bf0e7d16a0b98163a53566484
SimHash 2325eb534733

Groups

googlebot

Rule Path
Disallow /customer/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /contact/

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /review/
Disallow /*SID%3D
Disallow /checkout/
Disallow /catalogsearch/
Disallow /contact/
Disallow /pr-amp-review/
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*?price*
Disallow /*?size*
Disallow /*?colour*
Disallow /*?width*
Disallow /*?height*
Disallow /*?shape*
Disallow /*?finish*
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/
Disallow /404/
Disallow /cgi-bin/
Disallow /cleanup.php
Disallow /apc.php
Disallow /memcache.php
Disallow /phpinfo.php
Disallow /*?length_choice=

gptbot

Rule Path
Disallow /catalogsearch/
Disallow /*?*
Allow /

chatgpt-user

Rule Path
Disallow /catalogsearch/
Disallow /*?*
Allow /

oai-searchbot

Rule Path
Disallow /catalogsearch/
Disallow /*?*
Allow /

Other Records

Field Value
sitemap https://www.durovinbathrooms.com/Sitemap/sitemap.xml

Comments

  • Default instructions:
  • Disallow common Magento files in the root directory:
  • Disallow URL Filter Searches
  • Disallow CMS Directories:
  • Server Settings
  • Disallow general technical directories and files on a server
  • --- AI crawler control (added 2025-10) ---