penoticias.com.br
robots.txt

Robots Exclusion Standard data for penoticias.com.br

Resource Scan

Scan Details

Site Domain penoticias.com.br
Base Domain penoticias.com.br
Scan Status Ok
Last Scan2025-05-13T01:34:53+00:00
Next Scan 2025-06-12T01:34:53+00:00

Last Scan

Scanned2025-05-13T01:34:53+00:00
URL https://penoticias.com.br/robots.txt
Redirect https://penoticias.com.br/blog/robots.txt
Domain IPs 148.113.187.9
Response IP 148.113.187.9
Found Yes
Hash a405293e4df59fadbfca6104a6c7b67ca0559f36f903df35f86e2c4a6947f627
SimHash 48505091c7e5

Groups

googlebot

Rule Path
Allow *

feedfetcher-google

Rule Path
Allow *

bingbot

Rule Path
Allow *

slurp

Rule Path
Allow *

facebot

Rule Path
Allow *

facebookexternalhit

Rule Path
Allow *

ia_archiver

Rule Path
Allow *

twitterbot

Rule Path
Allow *

*

Rule Path
Disallow /