municipiospuebla.mx
robots.txt
Robots Exclusion Standard data for municipiospuebla.mx
Resource Scan
Scan Details
| Site Domain | municipiospuebla.mx |
| Base Domain | municipiospuebla.mx |
| Scan Status | Ok |
| Last Scan | 2024-11-14T06:33:48+00:00 |
| Next Scan | 2024-11-21T06:33:48+00:00 |
Last Scan
| Scanned | 2024-11-14T06:33:48+00:00 |
| URL | https://municipiospuebla.mx/robots.txt |
| Domain IPs | 104.21.61.113, 172.67.209.154, 2606:4700:3036::6815:3d71, 2606:4700:3037::ac43:d19a |
| Response IP | 104.21.61.113 |
| Found | Yes |
| Hash | b8b36f0413bb4a9c75955cd35723361c4174eae3af70259b8bbd89e837cab9b6 |
| SimHash | b0c84c04d975 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/track$ |
| Disallow | /*sort%3D |
| Disallow | /*size%3D |
| Disallow | /logout |
| Disallow | /user/register |
| Disallow | /user/password |
| Disallow | /user/login |
| Disallow | /comment/reply/ |
| Disallow | /?q=comment%2Freply%2F |
| Disallow | /aggregator |
| Disallow | /tracker |
| Disallow | /node/add |
| Disallow | /buscar |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Warnings
- `https` is not a known field.
Comments