newyorkcityfc.com
robots.txt
Robots Exclusion Standard data for newyorkcityfc.com
Resource Scan
Scan Details
| Site Domain | newyorkcityfc.com |
| Base Domain | newyorkcityfc.com |
| Scan Status | Ok |
| Last Scan | 2024-10-27T23:17:34+00:00 |
| Next Scan | 2024-11-26T23:17:34+00:00 |
Last Scan
| Scanned | 2024-10-27T23:17:34+00:00 |
| URL | https://newyorkcityfc.com/robots.txt |
| Redirect | https://www.newyorkcityfc.com/robots.txt |
| Redirect Domain | www.newyorkcityfc.com |
| Redirect Base | newyorkcityfc.com |
| Domain IPs | 23.215.7.11, 23.215.7.8, 2600:1413:1::1720:1d09, 2600:1413:1::6011:b42b |
| Redirect IPs | 23.215.7.11, 23.215.7.8, 2600:1413:b000:1b::17d7:708, 2600:1413:b000:1b::17d7:70b |
| Response IP | 96.17.180.184 |
| Found | Yes |
| Hash | b2b5c8cc39ffe6dcd6f1db4cabdcd1480d198e51bbcef5be9ba5ab2d2f3d09ad |
| SimHash | a966f8428333 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /js/ |
| Disallow | /css/ |
| Disallow | /_libraries/ |
| Disallow | /errors/ |
| Disallow | /_d3_qa_test/ |
| Disallow | /handlers/ |
| Disallow | /layouts/ |
| Disallow | /modules/ |
| Disallow | /services/ |
| Disallow | /storybook/ |
| Disallow | /templates/ |
| Disallow | /views/ |
| Disallow | /d3-test-not-remove |