linkweb.top
robots.txt
Robots Exclusion Standard data for linkweb.top
Resource Scan
Scan Details
| Site Domain | linkweb.top |
| Base Domain | linkweb.top |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-09-25T07:13:29+00:00 |
| Next Scan | 2025-12-24T07:13:29+00:00 |
Last Successful Scan
| Scanned | 2025-02-28T07:10:55+00:00 |
| URL | https://linkweb.top/robots.txt |
| Domain IPs | 172.96.185.166 |
| Response IP | 172.96.185.166 |
| Found | Yes |
| Hash | b9e6c4a07388bb5978b0cb947b1f2dec08c6403eb0f3f0d852f5052a805769fe |
| SimHash | 494d5c05ae44 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /feed |
| Disallow | /*/feed |
| Disallow | /comments |
| Disallow | /author |
| Disallow | /archives |
Other Records
| Field | Value |
|---|---|
| sitemap | https://linkweb.top/sitemap.xml |