tolucatecnm.mx
robots.txt

Robots Exclusion Standard data for tolucatecnm.mx

Resource Scan

Scan Details

Site Domain tolucatecnm.mx
Base Domain tolucatecnm.mx
Scan Status Ok
Last Scan2025-10-19T13:51:22+00:00
Next Scan 2025-11-18T13:51:22+00:00

Last Scan

Scanned2025-10-19T13:51:22+00:00
URL https://tolucatecnm.mx/robots.txt
Domain IPs 104.21.32.33, 172.67.182.152, 2606:4700:3031::ac43:b698, 2606:4700:3033::6815:2021
Response IP 172.67.182.152
Found Yes
Hash ae0e668d019154c0be416b50f16233684988ecc7b70b183e190fd452a1908817
SimHash 4a1bdc60ba92

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /wordpress/
Disallow /login/
Disallow /login
Disallow /ajax/
Disallow /api/
Disallow /blank.html

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://tolucatecnm.mx/sitemap.xml

Warnings

  • 2 invalid lines.