Log In Sign Up

crepier.com
robots.txt

Robots Exclusion Standard data for crepier.com

Resource Scan

Scan Details

Site Domain crepier.com
Base Domain crepier.com
Scan Status Ok
Last Scan2025-10-17T21:38:20+00:00
Next Scan 2025-11-16T21:38:20+00:00

Last Scan

Scanned2025-10-17T21:38:20+00:00
URL https://crepier.com/robots.txt
Redirect https://www.crepier.com/robots.txt
Redirect Domain www.crepier.com
Redirect Base crepier.com
Domain IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 146.75.45.124
Found Yes
Hash c74edac4b1ee855e679eba61e417cc798e3a2febfae8175c0a0e600e07492acd
SimHash 4d35bd4f6653

Groups

*
googlebot
googlebot-image

Rule Path
Disallow /index.php/
Disallow /*?
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Back to top

Other Records

Field Value
sitemap https://www.crepier.com/media/sitemap/sitemap.xml
Back to top

Comments

  • Define user agents/bots
Back to top