radio.it
robots.txt

Robots Exclusion Standard data for radio.it

Resource Scan

Scan Details

Site Domain radio.it
Base Domain radio.it
Scan Status Ok
Last Scan2024-06-21T06:51:35+00:00
Next Scan 2024-06-28T06:51:35+00:00

Last Scan

Scanned2024-06-21T06:51:35+00:00
URL https://radio.it/robots.txt
Redirect https://www.radio.it/robots.txt
Redirect Domain www.radio.it
Redirect Base radio.it
Domain IPs 104.26.12.92, 104.26.13.92, 172.67.74.189, 2606:4700:20::681a:c5c, 2606:4700:20::681a:d5c, 2606:4700:20::ac43:4abd
Redirect IPs 104.26.12.92, 104.26.13.92, 172.67.74.189, 2606:4700:20::681a:c5c, 2606:4700:20::681a:d5c, 2606:4700:20::ac43:4abd
Response IP 104.26.13.92
Found Yes
Hash 2b3034ae927889abc7e01f41f683c63bfd47fa58372a9eab36ed15fb4c761564
SimHash 4a54d9498b91

Groups

*

Rule Path
Disallow /search?q=*&p=*
Disallow /p/*/app
Disallow /radio-stations/*/*
Disallow /s/*/stations
Disallow /amp/*

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.radio.it/sitemap_index_it-IT.xml