thebooks.su
robots.txt

Robots Exclusion Standard data for thebooks.su

Resource Scan

Scan Details

Site Domain thebooks.su
Base Domain thebooks.su
Scan Status Ok
Last Scan2025-09-27T14:37:05+00:00
Next Scan 2025-10-04T14:37:05+00:00

Last Scan

Scanned2025-09-27T14:37:05+00:00
URL https://thebooks.su/robots.txt
Domain IPs 104.21.81.137, 172.67.189.157, 2606:4700:3031::ac43:bd9d, 2606:4700:3032::6815:5189
Response IP 104.21.81.137
Found Yes
Hash a6f20b357d6ba1649ee715be40abd9230ddc81565b9910ca3bfd4eee37ae3bed
SimHash 49409c218192

Groups

*

Rule Path
Disallow /download*
Disallow /go*

Other Records

Field Value
sitemap https://thebooks.su/sitemap.txt

Warnings

  • `host` is not a known field.