Log In Sign Up

telesaltillo.com
robots.txt

Robots Exclusion Standard data for telesaltillo.com

Resource Scan

Scan Details

Site Domain telesaltillo.com
Base Domain telesaltillo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-25T19:27:48+00:00
Next Scan 2026-03-25T19:27:48+00:00

Last Successful Scan

Scanned2025-05-30T14:43:47+00:00
URL https://telesaltillo.com/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.32.1
Found Yes
Hash a1ef53f3efa0f74bd8fc425bfb8a412bfa87f834a8a42e0e946b1c1396222524
SimHash 4da4da6068b5

Groups

twitterbot

Rule Path
Allow /
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /.tmb/
Disallow /.quarantine/
Allow /

Other Records

Field Value
crawl-delay 15

googlebot

Rule Path
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /.tmb/
Disallow /.quarantine/
Allow /
Back to top

Comments

  • Exclude Files From All Robots:
  • Disallow: /wp-content/
  • UserAgent: Facebot
  • Disallow: /
  • UserAgent: facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
  • Disallow: /
  • UserAgent: facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
  • Disallow: /
  • UserAgent: CrowdTanglebot/1.0
  • Disallow: /
Back to top