columbuscrew.com
robots.txt
Robots Exclusion Standard data for columbuscrew.com
Resource Scan
Scan Details
| Site Domain | columbuscrew.com |
| Base Domain | columbuscrew.com |
| Scan Status | Ok |
| Last Scan | 2024-09-05T04:44:41+00:00 |
| Next Scan | 2024-10-05T04:44:41+00:00 |
Last Scan
| Scanned | 2024-09-05T04:44:41+00:00 |
| URL | https://columbuscrew.com/robots.txt |
| Redirect | https://www.columbuscrew.com/robots.txt |
| Redirect Domain | www.columbuscrew.com |
| Redirect Base | columbuscrew.com |
| Domain IPs | 23.215.7.11, 23.215.7.8, 2600:1413:1::6011:b4bd, 2600:1413:1::b832:55b3 |
| Redirect IPs | 23.215.7.11, 23.215.7.8, 2600:1413:b000:1b::17d7:708, 2600:1413:b000:1b::17d7:70b |
| Response IP | 96.17.180.43 |
| Found | Yes |
| Hash | b2b5c8cc39ffe6dcd6f1db4cabdcd1480d198e51bbcef5be9ba5ab2d2f3d09ad |
| SimHash | a966f8428333 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /js/ |
| Disallow | /css/ |
| Disallow | /_libraries/ |
| Disallow | /errors/ |
| Disallow | /_d3_qa_test/ |
| Disallow | /handlers/ |
| Disallow | /layouts/ |
| Disallow | /modules/ |
| Disallow | /services/ |
| Disallow | /storybook/ |
| Disallow | /templates/ |
| Disallow | /views/ |
| Disallow | /d3-test-not-remove |