calabria.gazzettadelsud.it
robots.txt
Robots Exclusion Standard data for calabria.gazzettadelsud.it
Resource Scan
Scan Details
Site Domain | calabria.gazzettadelsud.it |
Base Domain | gazzettadelsud.it |
Scan Status | Ok |
Last Scan | 2024-04-26T08:32:01+00:00 |
Next Scan | 2024-05-26T08:32:01+00:00 |
Last Scan
Scanned | 2024-04-26T08:32:01+00:00 |
URL | https://calabria.gazzettadelsud.it/robots.txt |
Domain IPs | 104.26.14.190, 104.26.15.190, 172.67.71.218, 2606:4700:20::681a:ebe, 2606:4700:20::681a:fbe, 2606:4700:20::ac43:47da |
Response IP | 104.26.15.190 |
Found | Yes |
Hash | c2b8441c9cdeac3ce7d1964b19e396dda0c0f7fd166204b1df2af525b718abce |
SimHash | 783945644f92 |
Groups
*
Rule | Path |
---|---|
Disallow | /errorpages/ |
Disallow | /articoli/includes/ |
Disallow | /includes/ |
Disallow | /*?p= |
Other Records
Field | Value |
---|---|
sitemap | https://calabria.gazzettadelsud.it/sitemap-index.xml |
Comments