13disciple.stream
robots.txt

Robots Exclusion Standard data for 13disciple.stream

Resource Scan

Scan Details

Site Domain 13disciple.stream
Base Domain 13disciple.stream
Scan Status Ok
Last Scan2025-06-26T21:26:32+00:00
Next Scan 2025-07-03T21:26:32+00:00

Last Scan

Scanned2025-06-26T21:26:32+00:00
URL https://13disciple.stream/robots.txt
Redirect https://www.13disciple.stream/robots.txt
Redirect Domain www.13disciple.stream
Redirect Base 13disciple.stream
Domain IPs 199.34.228.77
Redirect IPs 199.34.228.77
Response IP 199.34.228.77
Found Yes
Hash ecb52ed328d8eefa6082c02e1b80063bc07c522d744be9b9a009a0ecf1b257b6
SimHash 6a44d8c6e333

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /reviews.html
Disallow /triple-moe-guides.html
Disallow /commentary.html

Other Records

Field Value
sitemap https://www.13disciple.stream/sitemap.xml