diariodesevilla.es
robots.txt
Robots Exclusion Standard data for diariodesevilla.es
Resource Scan
Scan Details
Site Domain | diariodesevilla.es |
Base Domain | diariodesevilla.es |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-02T14:39:03+00:00 |
Next Scan | 2024-12-31T14:39:03+00:00 |
Last Successful Scan
Scanned | 2024-06-05T13:03:10+00:00 |
URL | https://diariodesevilla.es/robots.txt |
Redirect | https://www.diariodesevilla.es/robots.txt |
Redirect Domain | www.diariodesevilla.es |
Redirect Base | diariodesevilla.es |
Domain IPs | 176.34.179.218 |
Redirect IPs | 154.47.23.177, 212.102.42.89, 2a02:6ea0:d342::4, 2a02:6ea0:d638::4 |
Response IP | 212.102.42.89 |
Found | Yes |
Hash | 74244829c3535d946b50aa8f4b49dbdf703356f59bd24056d2e643d655909513 |
SimHash | 630d8fc475d7 |
Groups
googlebot
googlebot-news
googlebot-image
googlebot-video
Rule | Path |
---|---|
Disallow | /xyzpruebas/ |
Disallow | /diario-de-prospero/ |
Disallow | /amp/video/* |
Disallow | /promociones/ |
*
Rule | Path |
---|---|
Disallow | /bb3comment/ |
Disallow | /34616581/ |
Disallow | /bbtmail/sendEntity/ |
Disallow | /bbtstats/ |
Disallow | /185768294/ |
Disallow | /usuarios/login.html?* |
Disallow | /usuarios/logout.json |
Disallow | /*?_escaped_fragment* |
Other Records
Field | Value |
---|---|
sitemap | https://www.diariodesevilla.es/sitemap_index.xml |
sitemap | https://www.diariodesevilla.es/sitemap_google_news.xml |