diariodeleon.es
robots.txt
Robots Exclusion Standard data for diariodeleon.es
Resource Scan
Scan Details
Site Domain | diariodeleon.es |
Base Domain | diariodeleon.es |
Scan Status | Ok |
Last Scan | 2024-09-21T08:23:32+00:00 |
Next Scan | 2024-09-28T08:23:32+00:00 |
Last Scan
Scanned | 2024-09-21T08:23:32+00:00 |
URL | https://diariodeleon.es/robots.txt |
Redirect | https://www.diariodeleon.es/robots.txt |
Redirect Domain | www.diariodeleon.es |
Redirect Base | diariodeleon.es |
Domain IPs | 18.161.111.109, 18.161.111.118, 18.161.111.17, 18.161.111.64 |
Redirect IPs | 13.226.2.103, 13.226.2.13, 13.226.2.3, 13.226.2.53, 2600:9000:23d1:0:1e:56d9:8040:93a1, 2600:9000:23d1:2a00:1e:56d9:8040:93a1, 2600:9000:23d1:3c00:1e:56d9:8040:93a1, 2600:9000:23d1:4e00:1e:56d9:8040:93a1, 2600:9000:23d1:8800:1e:56d9:8040:93a1, 2600:9000:23d1:a200:1e:56d9:8040:93a1, 2600:9000:23d1:c800:1e:56d9:8040:93a1, 2600:9000:23d1:ec00:1e:56d9:8040:93a1 |
Response IP | 52.85.49.58 |
Found | Yes |
Hash | a411f13ed64673d241eca2347fc973ed8b5f4b9c63c6c107e5403980264b6631 |
SimHash | e45a59d8cef3 |
Groups
*
Rule | Path |
---|---|
Allow | /ads.txt |
Disallow | /*.swf$ |
Disallow | /*.tif$ |
Disallow | /*.mp3$ |
Disallow | /*.flv$ |
Disallow | /*.mp4$ |
Disallow | /*.avi$ |
Disallow | /*.txt$ |
Disallow | /*.ics$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.diariodeleon.es/sitemap-google-news.xml |
Comments