easyonthetongue.com
robots.txt

Robots Exclusion Standard data for easyonthetongue.com

Resource Scan

Scan Details

Site Domain easyonthetongue.com
Base Domain easyonthetongue.com
Scan Status Ok
Last Scan2025-08-28T13:25:07+00:00
Next Scan 2025-09-04T13:25:07+00:00

Last Scan

Scanned2025-08-28T13:25:07+00:00
URL https://easyonthetongue.com/robots.txt
Domain IPs 104.18.37.69, 172.64.150.187, 2606:4700:4400::6812:2545, 2606:4700:4400::ac40:96bb
Response IP 104.18.37.69
Found Yes
Hash 9c8ab5b32a7b4da2781650cda30e70b3c2bd75b381ebaf6a30e34a7ee1d1e455
SimHash a0507114e155

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /*add-to-cart%3D*

*

Rule Path
Disallow /blocks
Disallow /concrete
Disallow /config
Disallow /controllers
Disallow /css
Disallow /elements
Disallow /helpers
Disallow /jobs
Disallow /js
Disallow /languages
Disallow /libraries
Disallow /mail
Disallow /models
Disallow /packages
Disallow /page_types
Disallow /single_pages
Disallow /themes
Disallow /tools
Disallow /updates

Comments

  • Prevent Crawling Unnecessary Endpoints - Dynamically added by BigScoots