mundomax.com.br
robots.txt

Robots Exclusion Standard data for mundomax.com.br

Resource Scan

Scan Details

Site Domain mundomax.com.br
Base Domain mundomax.com.br
Scan Status Ok
Last Scan2024-04-30T19:55:51+00:00
Next Scan 2024-05-30T19:55:51+00:00

Last Scan

Scanned2024-04-30T19:55:51+00:00
URL https://mundomax.com.br/robots.txt
Domain IPs 108.156.133.55, 108.156.133.81, 108.156.133.92, 108.156.133.94
Response IP 108.156.133.92
Found Yes
Hash 10ae73dcdbcb0483890f4838dcce7387a157fe71b4be65b536a5d9e3b7280a5e
SimHash 60118e9767c5

Groups

*

Rule Path
Allow

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mediapartners-google*

Rule Path
Allow

adsbot-google

Rule Path
Allow

Other Records

Field Value
sitemap https://www.mundomax.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.
  • allow google bot
  • allow google image bot to search all images
  • allow adsense bot on entire site
  • allow adsense bot google