Log In Sign Up

riogaleao.com
robots.txt

Robots Exclusion Standard data for riogaleao.com

Resource Scan

Scan Details

Site Domain riogaleao.com
Base Domain riogaleao.com
Scan Status Ok
Last Scan2024-09-12T16:14:53+00:00
Next Scan 2024-10-12T16:14:53+00:00

Last Scan

Scanned2024-09-12T16:14:53+00:00
URL https://www.riogaleao.com/robots.txt
Domain IPs 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c
Response IP 152.199.39.108
Found Yes
Hash 2e6384bf6bd155c5f0327c893b4d8e78579d07d9624d4f902cd3401bfec6ef84
SimHash aa92dd134504

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.riogaleao.com/sitemap.xml
Back to top

Comments

  • robots.txt
  • testando 6 integração
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • http://www.robotstxt.org/robotstxt.html
Back to top