Log In Sign Up

charmess.com
robots.txt

Robots Exclusion Standard data for charmess.com

Resource Scan

Scan Details

Site Domain charmess.com
Base Domain charmess.com
Scan Status Ok
Last Scan2025-08-31T00:50:13+00:00
Next Scan 2025-09-30T00:50:13+00:00

Last Scan

Scanned2025-08-31T00:50:13+00:00
URL https://charmess.com/robots.txt
Domain IPs 104.21.8.81, 172.67.130.97, 2606:4700:3031::6815:851, 2606:4700:3035::ac43:8261
Response IP 172.67.130.97
Found Yes
Hash 915dc1dff1f99d0831a17c516baf36f5fee7db39810dab41ec2f14378d2a92ef
SimHash ad55fbe9f5c2

Groups

*

Rule Path
Disallow /checkout.html
Disallow /cart.html
Disallow /user/
Disallow /search
Disallow /ajax-request

adsbot-google

Rule Path
Disallow /checkout.html
Disallow /cart.html
Disallow /user/
Disallow /search
Disallow /ajax-request

ia_archiver

Rule Path
Disallow /
Back to top

Comments

  • Google adsbot ignores robots.txt unless specifically named!
  • Alexa
Back to top