Log In Sign Up

m.reforma.com
robots.txt

Robots Exclusion Standard data for m.reforma.com

Resource Scan

Scan Details

Site Domain m.reforma.com
Base Domain reforma.com
Scan Status Ok
Last Scan2024-05-19T14:10:23+00:00
Next Scan 2024-06-02T14:10:23+00:00

Last Scan

Scanned2024-05-19T14:10:23+00:00
URL https://m.reforma.com/robots.txt
Domain IPs 18.65.25.11, 18.65.25.41, 18.65.25.67, 18.65.25.75
Response IP 108.157.60.59
Found Yes
Hash c4e775345f29372c9772c7d642298a8f603220f79b61ca193ebe702ebe2ea287
SimHash 815c47100735

Groups

*

No rules defined. All paths allowed.

Back to top

Comments

  • Primero deben especificarse los Allow y despues los Disallow
  • Para el caso de que twitter pueda llegar al ImageTransformer (robots.txt es case sensitive)
  • Allow: /default.shtm
  • Allow: /aplicaciones/home/
Back to top