tv.repubblica.it
robots.txt

Robots Exclusion Standard data for tv.repubblica.it

Resource Scan

Scan Details

Site Domain tv.repubblica.it
Base Domain repubblica.it
Scan Status Ok
Last Scan2024-05-12T09:05:14+00:00
Next Scan 2024-05-19T09:05:14+00:00

Last Scan

Scanned2024-05-12T09:05:14+00:00
URL http://tv.repubblica.it/robots.txt
Redirect http://video.repubblica.it/robots.txt
Redirect Domain video.repubblica.it
Redirect Base repubblica.it
Domain IPs 213.92.16.101
Redirect IPs 18.164.154.103, 18.164.154.108, 18.164.154.123, 18.164.154.46
Response IP 18.165.171.113
Found Yes
Hash aabdf3631977a947e0718554ad3cc1ef519356aaad5ff7df7b2fb19814b691e5
SimHash 40005b432510

Groups

*

Rule Path
Allow /static/images/
Allow /
Disallow /tecnologia/talk/tech-talk-startup-edition-marko-maras-di-fido/395847/396555
Disallow /static/
Disallow /ssi/
Disallow /salute/dossier/oncoline/alessandra-la-ginecologa-dell-ospedale/266550/266921
Disallow /politica/piscicelli-a-scio-non-fategli-pagare-il-conto/85343/83732
Disallow /php/
Disallow /edizione/napoli/pompei-il-caso-degli-appalti-parla-il-sovrintendente/180073/178860
Disallow /edizione/milano/grattacieli-di-lusso-e-occupazioni-abusive-la-due-facce-della-milano-in-lotta-per-la-casa/185166/184038
Disallow /edizione/genova/antimafia-la-finanziaria-era-dell-usuraio/60052/58924
Disallow /edizione/genova/a-nervi-un-gelato-che-fa-bene-anche-a-chi-lo-fa/281437/282033
Disallow /dossier/tangenti-mose/inchiesta-mose-la-gdf-riprende-la-mazzetta-pagata-da-un-imprenditore/168231/166715
Disallow /*?fromch=

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://video.repubblica.it/sitemap-n.xml.gz