mahlatini.com
robots.txt

Robots Exclusion Standard data for mahlatini.com

Resource Scan

Scan Details

Site Domain mahlatini.com
Base Domain mahlatini.com
Scan Status Ok
Last Scan2025-10-10T05:49:50+00:00
Next Scan 2025-10-17T05:49:50+00:00

Last Scan

Scanned2025-10-10T05:49:50+00:00
URL https://mahlatini.com/robots.txt
Redirect https://www.mahlatini.com/robots.txt
Redirect Domain www.mahlatini.com
Redirect Base mahlatini.com
Domain IPs 104.26.8.148, 104.26.9.148, 172.67.69.62, 2606:4700:20::681a:894, 2606:4700:20::681a:994, 2606:4700:20::ac43:453e
Redirect IPs 104.26.8.148, 104.26.9.148, 172.67.69.62, 2606:4700:20::681a:894, 2606:4700:20::681a:994, 2606:4700:20::ac43:453e
Response IP 172.67.69.62
Found Yes
Hash 06aaac03bd64557bfb176f35cbdc9653aafc90bc021688c82b0e3ee9b303a354
SimHash a120197237b2

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.mahlatini.com/sitemaps-2-sitemap.xml
sitemap https://www.mahlatini.com/us/sitemaps-2-sitemap.xml

Comments

  • robots.txt for https://www.mahlatini.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/