repofinder.com
robots.txt
Robots Exclusion Standard data for repofinder.com
Resource Scan
Scan Details
| Site Domain | repofinder.com |
| Base Domain | repofinder.com |
| Scan Status | Ok |
| Last Scan | 2024-07-01T20:47:02+00:00 |
| Next Scan | 2024-07-08T20:47:02+00:00 |
Last Scan
| Scanned | 2024-07-01T20:47:02+00:00 |
| URL | https://repofinder.com/robots.txt |
| Redirect | https://www.repofinder.com/robots.txt |
| Redirect Domain | www.repofinder.com |
| Redirect Base | repofinder.com |
| Domain IPs | 104.26.10.176, 104.26.11.176, 172.67.74.43 |
| Redirect IPs | 104.26.10.176, 104.26.11.176, 172.67.74.43 |
| Response IP | 104.26.11.176 |
| Found | Yes |
| Hash | c471103f81bb53b94d92f4f6fc63e978f42f73f039771d85780a0dd65da990b5 |
| SimHash | 6920188543b0 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-includes/*.js |
| Allow | /wp-includes/*.css |
| Disallow | /wp-admin/ |
| Disallow | /wp-content/upgrade/ |
| Disallow | /license.txt |
| Disallow | /readme.html |
| Disallow | /tag/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.repofinder.com/sitemap_index.xml |