radio.fr
robots.txt

Robots Exclusion Standard data for radio.fr

Resource Scan

Scan Details

Site Domain radio.fr
Base Domain radio.fr
Scan Status Ok
Last Scan2024-05-29T03:03:04+00:00
Next Scan 2024-06-05T03:03:04+00:00

Last Scan

Scanned2024-05-29T03:03:04+00:00
URL https://radio.fr/robots.txt
Redirect https://www.radio.fr/robots.txt
Redirect Domain www.radio.fr
Redirect Base radio.fr
Domain IPs 104.26.12.27, 104.26.13.27, 172.67.68.17, 2606:4700:20::681a:c1b, 2606:4700:20::681a:d1b, 2606:4700:20::ac43:4411
Redirect IPs 104.26.12.27, 104.26.13.27, 172.67.68.17, 2606:4700:20::681a:c1b, 2606:4700:20::681a:d1b, 2606:4700:20::ac43:4411
Response IP 104.26.13.27
Found Yes
Hash b1090a68fa59c99f41abab5c0f838d59ba23a1feddf7e044887a957bd4570cb8
SimHash 4a54d951cb93

Groups

*

Rule Path
Disallow /search?q=*&p=*
Disallow /p/*/app
Disallow /radio-stations/*/*
Disallow /s/*/stations
Disallow /amp/*

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.radio.fr/sitemap_index_fr-FR.xml