opusdei.es
robots.txt
Robots Exclusion Standard data for opusdei.es
Resource Scan
Scan Details
| Site Domain | opusdei.es |
| Base Domain | opusdei.es |
| Scan Status | Ok |
| Last Scan | 2025-09-12T05:58:35+00:00 |
| Next Scan | 2025-09-26T05:58:35+00:00 |
Last Scan
| Scanned | 2025-09-12T05:58:35+00:00 |
| URL | https://opusdei.es/robots.txt |
| Redirect | https://opusdei.org/es-es/robots.txt |
| Redirect Domain | opusdei.org |
| Redirect Base | opusdei.org |
| Domain IPs | 104.21.26.61, 172.67.135.144, 2606:4700:3031::ac43:8790, 2606:4700:3035::6815:1a3d |
| Redirect IPs | 104.26.4.31, 104.26.5.31, 172.67.71.15, 2606:4700:20::681a:41f, 2606:4700:20::681a:51f, 2606:4700:20::ac43:470f |
| Response IP | 104.26.5.31 |
| Found | Yes |
| Hash | 82dac5874e1a66a2771152690806e4e234dd95a6490266806af61dc9d12ed988 |
| SimHash | 42b5546866a8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/search/* |
| Disallow | /most-visited/* |
| Disallow | /*/pdf/$ |
| Disallow | /*/epub/$ |
| Disallow | /*/mobi/$ |
| Disallow | /*/contact/*/ |
| Disallow | /*/favor/*/ |
| Disallow | /*/send_to_friend/*/ |
| Disallow | /*/kindle/*/ |
| Disallow | /*/articlelist/*/ |
| Disallow | /*/documentlist/*/ |
| Disallow | /*/videolist/*/ |
| Disallow | /*/gallerylist/*/ |
| Disallow | /*/whatsapp%3A/*/ |
| Disallow | /*/wlwmanifest.xml$ |
| Disallow | /*/tag/*/*/ |
| Disallow | /*/archive/*/ |
| Disallow | /*/rss/* |
| Disallow | /*/rss/$ |
| Disallow | /*/rss$ |
| Disallow | /rss$ |
| Disallow | /rss/$ |
| Disallow | *sitemap.xml$ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /*/search/* |
| Disallow | /most-visited/* |
| Disallow | /*/pdf/$ |
| Disallow | /*/epub/$ |
| Disallow | /*/mobi/$ |
| Disallow | /*/contact/*/ |
| Disallow | /*/favor/*/ |
| Disallow | /*/send_to_friend/*/ |
| Disallow | /*/kindle/*/ |
| Disallow | /*/articlelist/*/ |
| Disallow | /*/documentlist/*/ |
| Disallow | /*/videolist/*/ |
| Disallow | /*/gallerylist/*/ |
| Disallow | /*/whatsapp%3A/*/ |
| Disallow | /*/wlwmanifest.xml$ |
| Disallow | /*/tag/*/*/ |
| Disallow | /*/archive/*/ |
| Disallow | /*/rss/* |
| Disallow | /*/rss/$ |
| Disallow | /*/rss$ |
| Disallow | /rss$ |
| Disallow | /rss/$ |
| Disallow | *sitemap.xml$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |