arkoselabs.com
robots.txt
Robots Exclusion Standard data for arkoselabs.com
Resource Scan
Scan Details
| Site Domain | arkoselabs.com |
| Base Domain | arkoselabs.com |
| Scan Status | Ok |
| Last Scan | 2024-05-28T12:58:14+00:00 |
| Next Scan | 2024-06-27T12:58:14+00:00 |
Last Scan
| Scanned | 2024-05-28T12:58:14+00:00 |
| URL | https://arkoselabs.com/robots.txt |
| Redirect | https://www.arkoselabs.com/robots.txt |
| Redirect Domain | www.arkoselabs.com |
| Redirect Base | arkoselabs.com |
| Domain IPs | 108.156.133.104, 108.156.133.117, 108.156.133.127, 108.156.133.88 |
| Redirect IPs | 104.18.43.238, 172.64.144.18, 2606:4700:4400::6812:2bee, 2606:4700:4400::ac40:9012 |
| Response IP | 172.64.144.18 |
| Found | Yes |
| Hash | 95a3dfb6650f9fb80c60dcb2d85bff4ca5dd714891d32d1ca601813aea24dd89 |
| SimHash | c14ba2014db1 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin/ | - |
| Disallow | /wp-login | - |
| Disallow | Block pdf files. Non-standard but works for major search engines. | |
| Allow | /wp-admin/admin-ajax.php | - |