mlssoccer.com
robots.txt
Robots Exclusion Standard data for mlssoccer.com
Resource Scan
Scan Details
| Site Domain | mlssoccer.com |
| Base Domain | mlssoccer.com |
| Scan Status | Ok |
| Last Scan | 2024-11-11T02:24:17+00:00 |
| Next Scan | 2024-11-18T02:24:17+00:00 |
Last Scan
| Scanned | 2024-11-11T02:24:17+00:00 |
| URL | https://mlssoccer.com/robots.txt |
| Redirect | https://www.mlssoccer.com/robots.txt |
| Redirect Domain | www.mlssoccer.com |
| Redirect Base | mlssoccer.com |
| Domain IPs | 23.215.7.11, 23.215.7.8, 2600:1413:1::1734:abd1, 2600:1413:1::1734:abe1 |
| Redirect IPs | 23.215.7.15, 23.215.7.20, 2600:1413:b000:1b::17d7:70f, 2600:1413:b000:1b::17d7:714 |
| Response IP | 23.59.168.112 |
| Found | Yes |
| Hash | b2b5c8cc39ffe6dcd6f1db4cabdcd1480d198e51bbcef5be9ba5ab2d2f3d09ad |
| SimHash | a966f8428333 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /js/ |
| Disallow | /css/ |
| Disallow | /_libraries/ |
| Disallow | /errors/ |
| Disallow | /_d3_qa_test/ |
| Disallow | /handlers/ |
| Disallow | /layouts/ |
| Disallow | /modules/ |
| Disallow | /services/ |
| Disallow | /storybook/ |
| Disallow | /templates/ |
| Disallow | /views/ |
| Disallow | /d3-test-not-remove |