Log In Sign Up

essitco.com
robots.txt

Robots Exclusion Standard data for essitco.com

Resource Scan

Scan Details

Site Domain essitco.com
Base Domain essitco.com
Scan Status Ok
Last Scan2026-02-19T06:04:58+00:00
Next Scan 2026-03-21T06:04:58+00:00

Last Scan

Scanned2026-02-19T06:04:58+00:00
URL https://essitco.com/robots.txt
Domain IPs 104.21.59.167, 172.67.181.88
Response IP 172.67.181.88
Found Yes
Hash 79c76f4a6848dc908da7747c0986d954e3fbc8390a5162d3b0b2ef6545b30abb
SimHash 24989e73e3a0

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /tmp/
Disallow /private/
Disallow /administrator/
Disallow /login/
Disallow /register/
Disallow /cart/
Disallow /checkout/
Disallow /search/
Disallow /*?*
Disallow /*%26*
Disallow /*.htm$
Disallow /*.sei$
Disallow /page01
Disallow /page03
Disallow /net/
Disallow /essitco.com/

gptbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

openai

Rule Path
Allow /

google-extended

Rule Path
Allow /

googleother

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

microsoftcopilot

Rule Path
Allow /

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.essitco.com/sitemap.xml
Back to top

Comments

  • Block system & temp folders
  • Block auth & user flows
  • Block internal search & parameters
  • Block spam / auto-generated files
  • Block fake folders created by bots
  • ==========================================
  • Explicit rules for AI / ChatGPT-style crawlers
  • ==========================================
  • ==========================================
  • Google Ads and Image Crawlers
  • ==========================================
  • Google Ads
  • Google Images
Back to top