napoli.repubblica.it
robots.txt

Robots Exclusion Standard data for napoli.repubblica.it

Resource Scan

Scan Details

Site Domain napoli.repubblica.it
Base Domain repubblica.it
Scan Status Ok
Last Scan2024-06-05T15:44:38+00:00
Next Scan 2024-06-12T15:44:38+00:00

Last Scan

Scanned2024-06-05T15:44:38+00:00
URL https://napoli.repubblica.it/robots.txt
Domain IPs 3.165.82.15, 3.165.82.39, 3.165.82.42, 3.165.82.50
Response IP 3.165.82.50
Found Yes
Hash e042fd590cc5b1f250a7a1c33c15a3dce6167e19a7afeb756e8def2422daa2f5
SimHash 600459218103

Groups

*

Rule Path
Disallow /ristoranti/
Disallow /multimedia/
Disallow /dettaglio/
Disallow /dettaglio-news/
Disallow /cronaca/2022/09/17/news/napoli_morta_graziella_pagano-366056189/
Disallow /blaize/datalayer

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://napoli.repubblica.it/sitemap-n.xml