Log In Sign Up

elmundoenrecetas.com
robots.txt

Robots Exclusion Standard data for elmundoenrecetas.com

Resource Scan

Scan Details

Site Domain elmundoenrecetas.com
Base Domain elmundoenrecetas.com
Scan Status Ok
Last Scan2024-06-01T19:29:22+00:00
Next Scan 2024-06-08T19:29:22+00:00

Last Scan

Scanned2024-06-01T19:29:22+00:00
URL https://elmundoenrecetas.com/robots.txt
Domain IPs 52.212.52.84, 54.247.69.169, 63.32.161.232
Response IP 52.212.52.84
Found Yes
Hash a95fc04c33c95a4661d0afa2350d0afd82e1ffb6c697dfac288db3ddaaea492d
SimHash aa812d856cd4

Groups

*

Rule Path
Disallow /admin/
Disallow /tmp/
Disallow /confirmacion
Disallow /favoritos
Disallow /instagram_feed
Disallow /politica_de_privacidad
Disallow /aviso_legal
Disallow /terminos-y-condiciones
Disallow /quien_soy
Disallow /videos
Disallow /orden/
Back to top

Other Records

Field Value
sitemap https://elmundoenrecetas.com/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top