bithike.com
robots.txt

Robots Exclusion Standard data for bithike.com

Resource Scan

Scan Details

Site Domain bithike.com
Base Domain bithike.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-09T00:21:26+00:00
Next Scan 2025-10-23T00:21:26+00:00

Last Successful Scan

Scanned2025-08-31T14:29:25+00:00
URL http://bithike.com/robots.txt
Domain IPs 160.251.229.16
Response IP 160.251.229.16
Found Yes
Hash 61d753f1b055683f76b537512d79eb4d07b8e665a57d43f4edef65ab6b4dc90f
SimHash ab55d88eaf93

Groups

nerdybot

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap http://bithike.com/sitemap.xml