lecolevancleefarpels.com
robots.txt

Robots Exclusion Standard data for lecolevancleefarpels.com

Resource Scan

Scan Details

Site Domain lecolevancleefarpels.com
Base Domain lecolevancleefarpels.com
Scan Status Ok
Last Scan2024-09-15T02:27:28+00:00
Next Scan 2024-10-15T02:27:28+00:00

Last Scan

Scanned2024-09-15T02:27:28+00:00
URL https://www.lecolevancleefarpels.com/robots.txt
Domain IPs 23.215.7.27, 23.215.7.32, 2600:1413:b000:1b::17d7:71b, 2600:1413:b000:1b::17d7:720
Response IP 23.32.29.98
Found Yes
Hash 9c687f295dc499a055a909cb8bf966014346311ecb5286d594ba120deab856c3
SimHash 29690d06f5b0

Groups

*

Rule Path
Allow /*re/*.css$
Allow /*re/*.css?
Allow /*re/*.js$
Allow /*re/*.js?
Allow /*re/*.gif
Allow /*re/*.jpg
Allow /*re/*.jpeg
Allow /*re/*.png
Allow /*re/*.svg
Disallow /*ore/
Disallow /README.txt
Disallow /*.config$
Disallow /*dmin/
Disallow /*ode/add/
Disallow /*ilter/*ips/
Disallow /subs*tion/
Disallow /login/
Disallow /logout/
Disallow /e-library/popup/*
Disallow /*ode/*
Disallow /switch-form/*
Disallow /*/css/*.css
Disallow /*/js/*.js
Disallow *?subject=subscribe_to_waitlist*
Disallow *?categories*
Disallow */popup/*

Other Records

Field Value
sitemap https://www.lecolevancleefarpels.com/sitemap.xml

Comments

  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • SEO related