Log In Sign Up

thunderx3.com.br
robots.txt

Robots Exclusion Standard data for thunderx3.com.br

Resource Scan

Scan Details

Site Domain thunderx3.com.br
Base Domain thunderx3.com.br
Scan Status Ok
Last Scan2024-09-17T16:03:33+00:00
Next Scan 2024-10-17T16:03:33+00:00

Last Scan

Scanned2024-09-17T16:03:33+00:00
URL https://thunderx3.com.br/robots.txt
Domain IPs 13.33.30.127, 13.33.30.25, 13.33.30.75, 13.33.30.99
Response IP 13.33.30.127
Found Yes
Hash 8d0fac0c54c205378c62c81118d946092ec2ec649707e4e2a15caa54f82b88de
SimHash 60110c9563d5

Groups

*

Rule Path
Disallow /admin
Disallow /admin/*

googlebot

Rule Path
Allow /*

googlebot-image

Rule Path
Allow /*

mediapartners-google*

Rule Path
Allow /*

adsbot-google

Rule Path
Allow /*
Back to top

Other Records

Field Value
sitemap https://thunderx3.com.br/sitemap.xml
Back to top

Comments

  • Disallow all crawlers access to certain pages.
  • allow google bot
  • allow google image bot to search all images
  • allow adsense bot on entire site
  • allow adsense bot google
Back to top