municipiospuebla.com.mx
robots.txt
Robots Exclusion Standard data for municipiospuebla.com.mx
Resource Scan
Scan Details
| Site Domain | municipiospuebla.com.mx |
| Base Domain | municipiospuebla.com.mx |
| Scan Status | Ok |
| Last Scan | 2024-09-28T08:28:57+00:00 |
| Next Scan | 2024-10-05T08:28:57+00:00 |
Last Scan
| Scanned | 2024-09-28T08:28:57+00:00 |
| URL | https://municipiospuebla.com.mx/robots.txt |
| Redirect | https://municipiospuebla.mx/robots.txt |
| Redirect Domain | municipiospuebla.mx |
| Redirect Base | municipiospuebla.mx |
| Domain IPs | 104.21.25.57, 172.67.223.3, 2606:4700:3031::6815:1939, 2606:4700:3031::ac43:df03 |
| Redirect IPs | 104.21.61.113, 172.67.209.154, 2606:4700:3036::6815:3d71, 2606:4700:3037::ac43:d19a |
| Response IP | 172.67.209.154 |
| Found | Yes |
| Hash | b8b36f0413bb4a9c75955cd35723361c4174eae3af70259b8bbd89e837cab9b6 |
| SimHash | b0c84c04d975 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/track$ |
| Disallow | /*sort%3D |
| Disallow | /*size%3D |
| Disallow | /logout |
| Disallow | /user/register |
| Disallow | /user/password |
| Disallow | /user/login |
| Disallow | /comment/reply/ |
| Disallow | /?q=comment%2Freply%2F |
| Disallow | /aggregator |
| Disallow | /tracker |
| Disallow | /node/add |
| Disallow | /buscar |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Warnings
- `https` is not a known field.
Comments