markelinsurance.com
robots.txt
Robots Exclusion Standard data for markelinsurance.com
Resource Scan
Scan Details
Site Domain | markelinsurance.com |
Base Domain | markelinsurance.com |
Scan Status | Ok |
Last Scan | 2024-11-09T10:54:03+00:00 |
Next Scan | 2024-12-09T10:54:03+00:00 |
Last Scan
Scanned | 2024-11-09T10:54:03+00:00 |
URL | https://www.markelinsurance.com/robots.txt |
Domain IPs | 13.107.246.59, 2620:1ec:bdf::59 |
Response IP | 13.107.246.59 |
Found | Yes |
Hash | 7e34b9496253212d9e261b4dcbe3bf5a8bfd2b0d1109e87fde0e7d304ed2f68c |
SimHash | 0008ca424b71 |
Groups
*
Rule | Path |
---|---|
Disallow | /~/media/specialty/agents-sales-materials/sales-materials/markel-firstcomp/fc3018%280215%29_bop-brochure.pdf?la=en |
Disallow | /~/media/specialty/msp-applications-and-supplements/new-apps-no-submit/accidentmedical-nationalpublicschoolaccidentapplication-1920-fillable.pdf |
Disallow | /~/media/specialty/small-business/injured-workers/documents/markel_complete_mpn_guide_03_2015%2C-d-%2Cpdf.pdf?la=en |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.markelinsurance.com/sitemap.xml |