elpesojusto.com
robots.txt
Robots Exclusion Standard data for elpesojusto.com
Resource Scan
Scan Details
| Site Domain | elpesojusto.com |
| Base Domain | elpesojusto.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T02:39:39+00:00 |
| Next Scan | 2024-09-27T02:39:39+00:00 |
Last Scan
| Scanned | 2024-09-20T02:39:39+00:00 |
| URL | https://elpesojusto.com/robots.txt |
| Domain IPs | 40.118.16.106 |
| Response IP | 40.118.16.106 |
| Found | Yes |
| Hash | 22ce0b3b5dd3cf4f86ba1fc89a1e33de70a2d52084de993f315cafd16fca02e8 |
| SimHash | eb38cc61c3b5 |
Groups
*
| Rule | Path |
|---|---|
| Allow | * |
| Disallow | /Search?q=* |
| Disallow | /Content/item* |
| Disallow | /content/item* |
| Disallow | /admin/* |
| Disallow | /customer-admin/* |
| Disallow | /archive/ |
| Disallow | /?page=* |
| Disallow | /blogpostcategory/ |
| Disallow | /blogpostcategory/noticias?page=* |
| Disallow | /blogpostcategory/motivacion?page=* |
| Disallow | /politica-de-cookies |
| Disallow | /aviso-legal |
| Disallow | /politica-cookies |
| Disallow | /authenticate?ReturnUrl=%2F* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://elpesojusto.com/sitemap.xml |