hayatouki.com
robots.txt
Robots Exclusion Standard data for hayatouki.com
Resource Scan
Scan Details
| Site Domain | hayatouki.com |
| Base Domain | hayatouki.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-03-24T17:01:15+00:00 |
| Next Scan | 2024-06-22T17:01:15+00:00 |
Last Successful Scan
| Scanned | 2023-02-28T02:55:15+00:00 |
| URL | https://hayatouki.com/robots.txt |
| Redirect | http://hayatouki.com/robots.txt |
| Domain IPs | 184.87.193.148, 184.87.193.156 |
| Response IP | 23.46.25.201 |
| Found | Yes |
| Hash | 8944de72c71dab0b3f34c707bcec16a53d27e8e3425f4a0da220cc6fa4c07f52 |
| SimHash | 1301473e7d95 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | */new$ |
| Disallow | */p/login |
| Disallow | /*?logout |
| Disallow | /*xhr |
| Disallow | /xhr/ |
| Disallow | */c/update_counter |
| Disallow | */c/search |
| Disallow | /*/s/ |
| Disallow | /forum/*/ |
| Allow | /forum/*/solved* |
| Allow | /forum/*/bestof* |
| Disallow | /profile/*?follow |
| Disallow | /profile/*?unfollow |
| Disallow | /fashion-pictures/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://hayatouki.com/sitemap |
Comments