thecsiproject.com
robots.txt
Robots Exclusion Standard data for thecsiproject.com
Resource Scan
Scan Details
| Site Domain | thecsiproject.com |
| Base Domain | thecsiproject.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T18:07:23+00:00 |
| Next Scan | 2024-09-27T18:07:23+00:00 |
Last Scan
| Scanned | 2024-09-20T18:07:23+00:00 |
| URL | https://thecsiproject.com/robots.txt |
| Domain IPs | 194.1.147.51, 194.1.147.82 |
| Response IP | 194.1.147.51 |
| Found | Yes |
| Hash | 8685502bd69deb95deedea97b722c6bc463285c93207805577b8a39038d6f921 |
| SimHash | 2a661f2f4cd3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /wp-includes/ |
| Disallow | /feed/ |
| Disallow | /trackback/ |
| Disallow | /cgi-bin/ |
| Disallow | /ANY-FOLDER-YOU-WANT/ |
Other Records
| Field | Value |
|---|---|
| sitemap | /sitemap.xml |
Comments