todamateriabr.com.br
robots.txt

Robots Exclusion Standard data for todamateriabr.com.br

Resource Scan

Scan Details

Site Domain todamateriabr.com.br
Base Domain todamateriabr.com.br
Scan Status Ok
Last Scan2024-09-21T12:04:01+00:00
Next Scan 2024-09-28T12:04:01+00:00

Last Scan

Scanned2024-09-21T12:04:01+00:00
URL https://www.todamateriabr.com.br/robots.txt
Domain IPs 104.21.73.128, 172.67.190.11, 2606:4700:3033::6815:4980, 2606:4700:3034::ac43:be0b
Response IP 172.67.190.11
Found Yes
Hash 72775b21d0af7cf50ceba22685fa2e4936ca31b991eade80656b9f3ad06fb3f8
SimHash 1d499c118811

Groups

*

Rule Path
Allow /ads.txt
Disallow /cdn-cgi/l/email-protection
Disallow /login?*
Disallow /question/add?*
Disallow /register?*
Disallow /busca-resposta?*
Disallow /megamozg?*

yandex

Rule Path
Disallow /cdn-cgi/l/email-protection
Disallow /login?*
Disallow /question/add?*
Disallow /register?*
Disallow /busca-resposta?*
Disallow /megamozg?*
Disallow /assets/

Other Records

Field Value
sitemap https://www.todamateriabr.com.br/sitemap.xml

Comments

  • Disallow: /assets/