diariofinanceiro.com.br
robots.txt

Robots Exclusion Standard data for diariofinanceiro.com.br

Resource Scan

Scan Details

Site Domain diariofinanceiro.com.br
Base Domain diariofinanceiro.com.br
Scan Status Ok
Last Scan2024-09-25T22:14:19+00:00
Next Scan 2024-10-02T22:14:19+00:00

Last Scan

Scanned2024-09-25T22:14:19+00:00
URL https://diariofinanceiro.com.br/robots.txt
Domain IPs 164.92.100.113
Response IP 164.92.100.113
Found Yes
Hash 10fa2bc9d39f5de1f94b9583afd18a7bf6cbdc12748fa67a57ac37950bf93116
SimHash 48155d55e1d1

Groups

*

Rule Path
Disallow
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

bingbot

Rule Path
Disallow

twitterbot

Rule Path
Disallow

slurp

Rule Path
Disallow

applebot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandexbot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

Other Records

Field Value
sitemap http://diariofinanceiro.com.br/sitemap.xml