mlssoccer.com
robots.txt
Robots Exclusion Standard data for mlssoccer.com
Resource Scan
Scan Details
| Site Domain | mlssoccer.com |
| Base Domain | mlssoccer.com |
| Scan Status | Ok |
| Last Scan | 2024-05-18T10:18:07+00:00 |
| Next Scan | 2024-05-25T10:18:07+00:00 |
Last Scan
| Scanned | 2024-05-18T10:18:07+00:00 |
| URL | https://mlssoccer.com/robots.txt |
| Redirect | https://www.mlssoccer.com/robots.txt |
| Redirect Domain | www.mlssoccer.com |
| Redirect Base | mlssoccer.com |
| Domain IPs | 23.32.29.104, 23.32.29.90, 2600:1417:3f::173d:cd3b, 2600:1417:3f::173d:cd59 |
| Redirect IPs | 184.50.85.171, 2600:1413:b000:1b::17d7:70f, 2600:1413:b000:1b::17d7:714, 96.17.180.171 |
| Response IP | 23.52.171.219 |
| Found | Yes |
| Hash | b2b5c8cc39ffe6dcd6f1db4cabdcd1480d198e51bbcef5be9ba5ab2d2f3d09ad |
| SimHash | a966f8428333 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /js/ |
| Disallow | /css/ |
| Disallow | /_libraries/ |
| Disallow | /errors/ |
| Disallow | /_d3_qa_test/ |
| Disallow | /handlers/ |
| Disallow | /layouts/ |
| Disallow | /modules/ |
| Disallow | /services/ |
| Disallow | /storybook/ |
| Disallow | /templates/ |
| Disallow | /views/ |
| Disallow | /d3-test-not-remove |