domainr.com
robots.txt
Robots Exclusion Standard data for domainr.com
Resource Scan
Scan Details
| Site Domain | domainr.com |
| Base Domain | domainr.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T06:52:32+00:00 |
| Next Scan | 2024-10-20T06:52:32+00:00 |
Last Scan
| Scanned | 2024-09-20T06:52:32+00:00 |
| URL | https://domainr.com/robots.txt |
| Domain IPs | 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217 |
| Response IP | 151.101.194.217 |
| Found | Yes |
| Hash | 9cc8d6706393335acb46de8c04d4aebec7aa757104a69660a27deec2b2e5d87c |
| SimHash | d55ed6926f91 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/register |
| Disallow | /*/register |
| Disallow | /*/register/* |
| Disallow | /*/register/* |
| Disallow | /*domainr* |
| Disallow | /*found%20via* |
| Disallow | /*text*found* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |