austinfc.com
robots.txt
Robots Exclusion Standard data for austinfc.com
Resource Scan
Scan Details
| Site Domain | austinfc.com |
| Base Domain | austinfc.com |
| Scan Status | Ok |
| Last Scan | 2024-05-31T10:33:59+00:00 |
| Next Scan | 2024-06-30T10:33:59+00:00 |
Last Scan
| Scanned | 2024-05-31T10:33:59+00:00 |
| URL | https://austinfc.com/robots.txt |
| Redirect | https://www.austinfc.com/robots.txt |
| Redirect Domain | www.austinfc.com |
| Redirect Base | austinfc.com |
| Domain IPs | 23.52.40.50, 23.52.40.57, 2600:1413:5000:13::1737:27d0, 2600:1413:5000:13::1737:27d8 |
| Redirect IPs | 23.52.171.209, 23.52.171.225, 2600:1413:1::173b:a860 |
| Response IP | 23.52.171.225 |
| Found | Yes |
| Hash | b2b5c8cc39ffe6dcd6f1db4cabdcd1480d198e51bbcef5be9ba5ab2d2f3d09ad |
| SimHash | a966f8428333 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /js/ |
| Disallow | /css/ |
| Disallow | /_libraries/ |
| Disallow | /errors/ |
| Disallow | /_d3_qa_test/ |
| Disallow | /handlers/ |
| Disallow | /layouts/ |
| Disallow | /modules/ |
| Disallow | /services/ |
| Disallow | /storybook/ |
| Disallow | /templates/ |
| Disallow | /views/ |
| Disallow | /d3-test-not-remove |