themcelroy.family
robots.txt
Robots Exclusion Standard data for themcelroy.family
Resource Scan
Scan Details
| Site Domain | themcelroy.family |
| Base Domain | themcelroy.family |
| Scan Status | Ok |
| Last Scan | 2024-06-07T06:37:39+00:00 |
| Next Scan | 2024-06-14T06:37:39+00:00 |
Last Scan
| Scanned | 2024-06-07T06:37:39+00:00 |
| URL | https://themcelroy.family/robots.txt |
| Redirect | https://www.themcelroy.family/robots.txt |
| Redirect Domain | www.themcelroy.family |
| Redirect Base | themcelroy.family |
| Domain IPs | 151.101.129.52, 151.101.193.52 |
| Redirect IPs | 151.101.1.52, 151.101.129.52, 151.101.193.52, 151.101.65.52 |
| Response IP | 199.232.45.52 |
| Found | Yes |
| Hash | 66b41d7e1affc700534220b7213299bec21b56046f03c81a30bd3bb4b1d8dd10 |
| SimHash | 7018d960ad92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /newfanshot |
| Disallow | /users/*/replies |
| Disallow | /users/*/comments |
| Disallow | /search |
| Disallow | /account |
| Disallow | /login |
| Disallow | /chorus_auth |
| Disallow | /sso |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.themcelroy.family/sitemaps |
| sitemap | https://www.themcelroy.family/sitemaps/authors |
| sitemap | https://www.themcelroy.family/sitemaps/groups |
| sitemap | https://www.themcelroy.family/sitemaps/videos |