Log In Sign Up

cpte.gob.mx
robots.txt

Robots Exclusion Standard data for cpte.gob.mx

Resource Scan

Scan Details

Site Domain cpte.gob.mx
Base Domain cpte.gob.mx
Scan Status Ok
Last Scan2026-01-09T20:44:26+00:00
Next Scan 2026-02-08T20:44:26+00:00

Last Scan

Scanned2026-01-09T20:44:26+00:00
URL http://www.cpte.gob.mx/robots.txt
Domain IPs 69.49.115.40
Response IP 69.49.115.40
Found Yes
Hash 4c360c4a18b9b194c360a5a6b6f38edf2b65e1e76ba28933922ee455b9844fed
SimHash af10d7824fd3

Groups

*

No rules defined. All paths allowed.

Back to top

Comments

  • OPB Platform - Default robots.txt
  • Allows all search engine crawlers to access all content by default.
  • Users can upload a custom robots.txt file to override this policy.
  • Future: Per-page settings will allow dynamic control of crawling.
Back to top