mentescuriosas.es
robots.txt
Robots Exclusion Standard data for mentescuriosas.es
Resource Scan
Scan Details
Site Domain | mentescuriosas.es |
Base Domain | mentescuriosas.es |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-07T08:43:06+00:00 |
Next Scan | 2024-11-05T08:43:06+00:00 |
Last Successful Scan
Scanned | 2024-04-10T08:41:31+00:00 |
URL | https://mentescuriosas.es/robots.txt |
Domain IPs | 104.21.30.51, 172.67.150.152, 2606:4700:3032::ac43:9698, 2606:4700:3033::6815:1e33 |
Response IP | 172.67.150.152 |
Found | Yes |
Hash | c07e20aa16c3f75313e5ff6c3d50b98dce25ddc9b6245c5d8877cd61f72c6f08 |
SimHash | c8645a84a910 |
Groups
mediapartners-google*
*
Rule | Path |
---|---|
Allow | /wp-content/uploads/ |
Allow | /feed/$ |
Disallow | /?s= |
Disallow | /feed |
Disallow | /comments/feed |
Disallow | /*/feed/$ |
Disallow | /*/feed/rss/$ |
Disallow | /*/trackback/$ |
Disallow | /*/*/feed/$ |
Disallow | /*/*/feed/rss/$ |
Disallow | /*/*/trackback/$ |
Disallow | /*/*/*/feed/$ |
Disallow | /*/*/*/feed/rss/$ |
Disallow | /*/*/*/trackback/$ |