internet.bs
robots.txt

Robots Exclusion Standard data for internet.bs

Resource Scan

Scan Details

Site Domain internet.bs
Base Domain internet.bs
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-01T20:24:34+00:00
Next Scan 2025-09-30T20:24:34+00:00

Last Successful Scan

Scanned2025-05-27T20:23:26+00:00
URL https://internet.bs/robots.txt
Redirect https://internetbs.net//robots.txt
Redirect Domain internetbs.net
Redirect Base internetbs.net
Domain IPs 52.31.32.65
Redirect IPs 104.18.10.177, 104.18.11.177, 2606:4700::6812:ab1, 2606:4700::6812:bb1
Response IP 104.18.11.177
Found Yes
Hash c57adef4e9fb258fd4b03f74fea34f8b87df19218f10425fe4ae93b18cb1e029
SimHash 5635d8108732

Groups

yandex

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 10 specifies a 2 second timeout

*

Rule Path
Disallow