dszh.org
robots.txt

Robots Exclusion Standard data for dszh.org

Resource Scan

Scan Details

Site Domain dszh.org
Base Domain dszh.org
Scan Status Ok
Last Scan2025-09-14T13:48:10+00:00
Next Scan 2025-09-21T13:48:10+00:00

Last Scan

Scanned2025-09-14T13:48:10+00:00
URL https://dszh.org/robots.txt
Domain IPs 104.21.18.196, 172.67.183.77, 2606:4700:3036::6815:12c4, 2606:4700:3037::ac43:b74d
Response IP 172.67.183.77
Found Yes
Hash 861b3049c540dc135d6bc4a31c4fe8ddb43a3fa7a6f0ced7f1c1a237eca82319
SimHash 0a9a4443411a

Groups

yodaobot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

*

Rule Path
Disallow /manage.php
Disallow /post
Disallow /rank.php
Disallow /onlineuser.php
Disallow /optrack.php
Disallow /register.php
Disallow /search.php
Disallow /updatereg.php
Disallow /vimage.php
Disallow /ft/search.cgi
Disallow /101/manage.php
Disallow /102/
Disallow /list.php?f=1&t
Disallow /list.php?f=2&t
Disallow /list.php?f=3&t
Disallow /list.php?f=4&t
Disallow /list.php?f=5&t
Disallow /list.php?f=6&t
Disallow /list.php?f=7&t
Disallow /list.php?f=8&t
Disallow /list.php?f=9&t
Disallow /list.php?f=10&t
Disallow /list.php?f=11&t
Disallow /list.php?f=12&t
Disallow /wap/
Disallow /showcontent.php

Other Records

Field Value
crawl-delay 60