radiorecord.com.br
robots.txt

Robots Exclusion Standard data for radiorecord.com.br

Resource Scan

Scan Details

Site Domain radiorecord.com.br
Base Domain radiorecord.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-17T05:58:44+00:00
Next Scan 2024-06-15T05:58:44+00:00

Last Successful Scan

Scanned2022-10-08T02:36:33+00:00
URL http://radiorecord.com.br/robots.txt
Redirect https://www.r7.com/robots.txt
Redirect Domain www.r7.com
Redirect Base r7.com
Response IP 104.83.196.53
Found Yes
Hash 268a370dbd9d6ea953d0528f972cdb3f430d097a1b61a11567fc0e8ef8ac246d
SimHash f80c1056feb1

Groups

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

twitterbot

Rule Path
Allow

semrushbot-sa

Rule Path
Disallow /

starkbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

voluumdsp-content-bot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /embeds/
Disallow /index2.html
Disallow /supprod2022/*
Disallow /suporte/*

Other Records

Field Value
sitemap https://www.r7.com/indice_default_sitemaps.xml