Log In Sign Up

espirituracer.com
robots.txt

Robots Exclusion Standard data for espirituracer.com

Resource Scan

Scan Details

Site Domain espirituracer.com
Base Domain espirituracer.com
Scan Status Ok
Last Scan2024-11-11T11:03:07+00:00
Next Scan 2024-11-18T11:03:07+00:00

Last Scan

Scanned2024-11-11T11:03:07+00:00
URL https://espirituracer.com/robots.txt
Domain IPs 104.21.76.224, 172.67.201.233, 2606:4700:3034::ac43:c9e9, 2606:4700:3037::6815:4ce0
Response IP 104.21.76.224
Found Yes
Hash af62f7b702114ee2392d4cecfb1680e09db4593df80c4fb2a6075381d90261be
SimHash 2ad01d51c9f9

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /*/*.css
Allow /*/*.js
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */disclaimer/*
Disallow *?attachment_id=
Disallow /privacy-policy

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /archivos/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /archivos/

applebot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

qwantify

Rule Path
Allow /

twitterbot

Rule Path
Allow /archivos

facebookexternalhit

Rule Path
Allow /archivos

googlebot

Rule Path
Allow /*.css$
Allow /*.js$
Back to top

Other Records

Field Value
sitemap https://espirituracer.com/sitemap_index.xml
sitemap https://espirituracer.com/page-sitemap.xml
sitemap https://espirituracer.com/category-sitemap.xml
sitemap https://espirituracer.com/author-sitemap.xml
Back to top

Comments

  • robots.txt espirituracer.com
  • Certain social media sites are whitelisted to allow crawlers to access page markup when links to /images are shared.
  • Previene problemas de recursos bloqueados en Google Webmaster Tools
  • Sitemap
Back to top