hutaobot.moe
robots.txt
Robots Exclusion Standard data for hutaobot.moe
Resource Scan
Scan Details
| Site Domain | hutaobot.moe |
| Base Domain | hutaobot.moe |
| Scan Status | Ok |
| Last Scan | 2025-06-03T14:59:05+00:00 |
| Next Scan | 2025-07-03T14:59:05+00:00 |
Last Scan
| Scanned | 2025-06-03T14:59:05+00:00 |
| URL | https://hutaobot.moe/robots.txt |
| Domain IPs | 104.21.54.144, 172.67.139.76, 2606:4700:3034::6815:3690, 2606:4700:3035::ac43:8b4c |
| Response IP | 104.21.54.144 |
| Found | Yes |
| Hash | 97419ca45388d3841a0a435e0d11aabef053efb735b72f66a7a061df1a4c9110 |
| SimHash | 6b1ad272ef92 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /api/sitemap |
| Disallow | /api/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://hutaobot.moe/api/sitemap |