classificados-brasil.com
robots.txt

Robots Exclusion Standard data for classificados-brasil.com

Resource Scan

Scan Details

Site Domain classificados-brasil.com
Base Domain classificados-brasil.com
Scan Status Ok
Last Scan2024-05-25T00:10:05+00:00
Next Scan 2024-06-01T00:10:05+00:00

Last Scan

Scanned2024-05-25T00:10:05+00:00
URL https://classificados-brasil.com/robots.txt
Redirect https://www.classificados-brasil.com/robots.txt
Redirect Domain www.classificados-brasil.com
Redirect Base classificados-brasil.com
Domain IPs 104.21.83.146, 172.67.177.114, 2606:4700:3034::6815:5392, 2606:4700:3035::ac43:b172
Redirect IPs 104.21.83.146, 172.67.177.114, 2606:4700:3034::6815:5392, 2606:4700:3035::ac43:b172
Response IP 104.21.83.146
Found Yes
Hash 70877c1d6cf88d08241fc45b099f3b1c39e8096132ede0691e183188da4f873b
SimHash 2300ea5695e2

Groups

*

Rule Path
Allow /*.html$

*

Rule Path
Disallow /*?*
Disallow /*.html?_escaped_fragment_=

*

Rule Path
Disallow /editar*.html
Disallow /logs/*
Disallow /comentarios/*

Comments

  • robots.txt zu www.classificados-brasil.com
  • Allow indexing all html pages
  • 12.01.2021 MGA: Google trying to index these pages
  • 13.07.2022 Updated
  • Disallow: /*#*
  • Disallow: /*#!*
  • Avoid indexing edit pages