bleb.org
robots.txt
Robots Exclusion Standard data for bleb.org
Resource Scan
Scan Details
Site Domain | bleb.org |
Base Domain | bleb.org |
Scan Status | Ok |
Last Scan | 2025-05-18T10:43:41+00:00 |
Next Scan | 2025-06-17T10:43:41+00:00 |
Last Scan
Scanned | 2025-05-18T10:43:41+00:00 |
URL | https://bleb.org/robots.txt |
Domain IPs | 3.164.85.115, 3.164.85.53, 3.164.85.80, 3.164.85.85 |
Response IP | 18.165.140.128 |
Found | Yes |
Hash | 4c3a52097bb5f4db56786bad2246d30295347f397b0fd6b66516390f9aaef701 |
SimHash | 751ac1ccf1d8 |
Groups
*
Rule | Path |
---|---|
Disallow | /h2g2/ |
Disallow | /misc/h2g2/ |
Disallow | /tv/listings/data/ |
Disallow | /tv/info.html |
Disallow | /tv2/listings/data/ |
Disallow | /tv2/info.html |
Disallow | /cgi-bin/ |
Disallow | /services/kings/ |
Disallow | /kings/ |