Log In Sign Up

natgeo.televisa.com
robots.txt

Robots Exclusion Standard data for natgeo.televisa.com

Resource Scan

Scan Details

Site Domain natgeo.televisa.com
Base Domain televisa.com
Scan Status Ok
Last Scan2024-05-22T03:25:22+00:00
Next Scan 2024-06-21T03:25:22+00:00

Last Scan

Scanned2024-05-22T03:25:22+00:00
URL http://natgeo.televisa.com/robots.txt
Redirect https://www.ngenespanol.com/robots.txt
Redirect Domain www.ngenespanol.com
Redirect Base ngenespanol.com
Domain IPs 40.119.3.6
Redirect IPs 2600:9000:21f8:1e00:18:6748:4100:93a1, 2600:9000:21f8:2000:18:6748:4100:93a1, 2600:9000:21f8:3c00:18:6748:4100:93a1, 2600:9000:21f8:4400:18:6748:4100:93a1, 2600:9000:21f8:5000:18:6748:4100:93a1, 2600:9000:21f8:5600:18:6748:4100:93a1, 2600:9000:21f8:c400:18:6748:4100:93a1, 2600:9000:21f8:f800:18:6748:4100:93a1, 3.163.165.14, 3.163.165.15, 3.163.165.32, 3.163.165.45
Response IP 108.157.60.47
Found Yes
Hash e5d4447eab5cf86ef30aabfe4770e2a8248e83e8f383e8a7ae43cc01f9bd95db
SimHash f01c88c0a9b1

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow *wp-admin*
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /search/
Disallow /264879/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.ngenespanol.com/sitemap_index.xml
Back to top

Comments

  • www.robotstxt.org/
  • WP Refugees
  • Disallow: /fotogalerias/vietnam-y-camboya-los-tigres-jovenes-de-oriente/amp/
  • Disallow: /fotogalerias/vietnam-y-camboya-los-tigres-jovenes-de-oriente/
  • Disallow: /traveler/fotogalerias/17/10/03/vietnam-y-camboya-los-tigres-jovenes-de-oriente/
  • Disallow: /fotogalerias/vietnam-y-camboya-los-tigres-jovenes-de-oriente/?nonamp=1
  • Disallow GPT
  • Disallow GE
Back to top