mapfre.com.gt
robots.txt
Robots Exclusion Standard data for mapfre.com.gt
Resource Scan
Scan Details
Site Domain | mapfre.com.gt |
Base Domain | mapfre.com.gt |
Scan Status | Ok |
Last Scan | 2024-10-21T22:27:39+00:00 |
Next Scan | 2024-11-20T22:27:39+00:00 |
Last Scan
Scanned | 2024-10-21T22:27:39+00:00 |
URL | https://mapfre.com.gt/robots.txt |
Redirect | https://www.mapfre.com.gt/robots.txt |
Redirect Domain | www.mapfre.com.gt |
Redirect Base | mapfre.com.gt |
Domain IPs | 54.171.208.217 |
Redirect IPs | 108.157.254.40, 108.157.254.5, 108.157.254.56, 108.157.254.9, 2600:9000:2753:1000:f:1f3f:7a00:93a1, 2600:9000:2753:2800:f:1f3f:7a00:93a1, 2600:9000:2753:3400:f:1f3f:7a00:93a1, 2600:9000:2753:5a00:f:1f3f:7a00:93a1, 2600:9000:2753:800:f:1f3f:7a00:93a1, 2600:9000:2753:de00:f:1f3f:7a00:93a1, 2600:9000:2753:e000:f:1f3f:7a00:93a1, 2600:9000:2753:f400:f:1f3f:7a00:93a1 |
Response IP | 108.157.254.56 |
Found | Yes |
Hash | 37b2d2482dd7dda62727711b473108f589719a90b334e8a16e01e7689e0c7505 |
SimHash | 6988d9e24bb6 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /archives/ |
Disallow | /wp-* |
Allow | /media/ |
Disallow | /comments/feed/ |
Disallow | /readme.html |
Allow | /*.css |
Allow | /*.js |
Allow | /*.woff |
Allow | /*.woff2 |
Allow | /*.ttf |
Allow | /*.png |
Allow | /*.jpg |
Allow | /*.gif |
Allow | /*.php |
Allow |
Other Records
Field | Value |
---|---|
sitemap | https://www.mapfre.com.gt/sitemap_index.xml |