crezu.es
robots.txt
Robots Exclusion Standard data for crezu.es
Resource Scan
Scan Details
| Site Domain | crezu.es |
| Base Domain | crezu.es |
| Scan Status | Ok |
| Last Scan | 2024-09-09T06:55:20+00:00 |
| Next Scan | 2024-09-16T06:55:20+00:00 |
Last Scan
| Scanned | 2024-09-09T06:55:20+00:00 |
| URL | https://crezu.es/robots.txt |
| Domain IPs | 104.21.32.84, 172.67.184.248, 2606:4700:3031::ac43:b8f8, 2606:4700:3037::6815:2054 |
| Response IP | 104.21.32.84 |
| Found | Yes |
| Hash | 556d85877184274ef7084d343f3b647251ad6b54598adf37feba05584291c3ed |
| SimHash | 7d147d64c593 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /? |
| Disallow | /main/ |
| Disallow | /email/ |
| Disallow | /feed/ |
| Disallow | /feed_promo/ |
| Disallow | /prestamistas/*/feed/ |
| Disallow | /offers* |
| Disallow | /landing* |
| Disallow | /ofertas-exclusivas-amazon/ |
| Disallow | /img/blog//data/img/* |
| Disallow | /thank-you/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://crezu.es/sitemap.xml |
Warnings
- `host` is not a known field.