mapfre.pt
robots.txt
Robots Exclusion Standard data for mapfre.pt
Resource Scan
Scan Details
| Site Domain | mapfre.pt |
| Base Domain | mapfre.pt |
| Scan Status | Ok |
| Last Scan | 4/4/2025, 2:36:33 AM |
| Next Scan | 5/4/2025, 2:36:33 AM |
Last Scan
| Scanned | 4/4/2025, 2:36:33 AM |
| URL | https://mapfre.pt/robots.txt |
| Redirect | https://www.mapfre.pt/robots.txt |
| Redirect Domain | www.mapfre.pt |
| Redirect Base | mapfre.pt |
| Domain IPs | 54.171.208.217 |
| Redirect IPs | 13.33.45.102, 13.33.45.34, 13.33.45.51, 13.33.45.70, 2600:9000:229f:3200:f:73b4:5200:93a1, 2600:9000:229f:4000:f:73b4:5200:93a1, 2600:9000:229f:5a00:f:73b4:5200:93a1, 2600:9000:229f:5c00:f:73b4:5200:93a1, 2600:9000:229f:8800:f:73b4:5200:93a1, 2600:9000:229f:b200:f:73b4:5200:93a1, 2600:9000:229f:c000:f:73b4:5200:93a1, 2600:9000:229f:c800:f:73b4:5200:93a1 |
| Response IP | 13.33.45.34 |
| Found | Yes |
| Hash | 3148b3651ee97ea423cb0c08b8360bfccb86dcdcd1adb52828449db1fc3b875c |
| SimHash | 4908d9e24bb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /archives/ |
| Disallow | /wp-* |
| Allow | /media/ |
| Disallow | /comments/feed/ |
| Disallow | /readme.html |
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.woff |
| Allow | /*.woff2 |
| Allow | /*.ttf |
| Allow | /*.png |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.php |
| Allow |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mapfre.pt/sitemap_index.xml |