runetki-chat.su
robots.txt

Robots Exclusion Standard data for runetki-chat.su

Resource Scan

Scan Details

Site Domain runetki-chat.su
Base Domain runetki-chat.su
Scan Status Ok
Last Scan2026-01-18T22:46:29+00:00
Next Scan 2026-02-17T22:46:29+00:00

Last Scan

Scanned2026-01-18T22:46:29+00:00
URL https://runetki-chat.su/robots.txt
Domain IPs 31.59.129.32
Response IP 31.59.129.32
Found Yes
Hash b4401d7d01fe36f18531461c0e8c1cffc10e878b2fc800994e39656b008a5059
SimHash 6c3ddc60a0da

Groups

*

Rule Path
Disallow /assets/
Disallow /login
Disallow /register

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /news/

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://runetki-chat.su/sitemap.xml

Comments

  • Block known bad or aggressive crawlers