fairspin-htb.top
robots.txt
Robots Exclusion Standard data for fairspin-htb.top
Resource Scan
Scan Details
| Site Domain | fairspin-htb.top |
| Base Domain | fairspin-htb.top |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-08-26T20:07:23+00:00 |
| Next Scan | 2025-11-24T20:07:23+00:00 |
Last Successful Scan
| Scanned | 2025-04-05T23:25:30+00:00 |
| URL | https://fairspin-htb.top/robots.txt |
| Redirect | https://fairspin-fki.top/robots.txt |
| Redirect Domain | fairspin-fki.top |
| Redirect Base | fairspin-fki.top |
| Domain IPs | 104.21.59.146, 172.67.179.77, 2606:4700:3034::6815:3b92, 2606:4700:3036::ac43:b34d |
| Redirect IPs | 104.21.46.61, 172.67.168.32, 2606:4700:3031::ac43:a820, 2606:4700:3036::6815:2e3d |
| Response IP | 172.67.168.32 |
| Found | Yes |
| Hash | 902067809229ab1091bcb1584fe9c497a2b748f6595bbd17433096f2744167ff |
| SimHash | cb6dd2e70634 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /reg |
| Disallow | /wp-includes |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /?s=* |
| Disallow | /search* |
| Disallow | */trackback/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | */comment |
| Disallow | */attachment/* |
| Disallow | */print/ |
| Disallow | *?print=* |
| Disallow | */embed* |
| Allow | /wp-content/uploads/ |
mail.ru
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /reg |
| Disallow | /wp-includes |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /?s=* |
| Disallow | /search* |
| Disallow | */trackback/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | */comment |
| Disallow | */attachment/* |
| Disallow | */print/ |
| Disallow | *?print=* |
| Disallow | */embed* |
| Allow | /wp-content/uploads/ |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /reg |
| Disallow | /wp-includes |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /?s=* |
| Disallow | /search* |
| Disallow | */trackback/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | */comment |
| Disallow | */attachment/* |
| Disallow | */print/ |
| Disallow | *?print=* |
| Disallow | */embed* |
| Allow | /wp-content/uploads/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fairspin-fki.top/sitemap_index.xml |
Warnings
- `host` is not a known field.