subnhanh.xyz
robots.txt

Robots Exclusion Standard data for subnhanh.xyz

Resource Scan

Scan Details

Site Domain subnhanh.xyz
Base Domain subnhanh.xyz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-12T20:47:59+00:00
Next Scan 2025-11-10T20:47:59+00:00

Last Successful Scan

Scanned2025-03-23T20:46:26+00:00
URL https://subnhanh.xyz/robots.txt
Redirect https://subnhanh1.org/robots.txt
Redirect Domain subnhanh1.org
Redirect Base subnhanh1.org
Domain IPs 104.21.4.162, 172.67.132.64, 2606:4700:3033::6815:4a2, 2606:4700:3033::ac43:8440
Redirect IPs 104.21.70.180, 172.67.138.42, 2606:4700:3036::6815:46b4, 2606:4700:3037::ac43:8a2a
Response IP 104.21.70.180
Found Yes
Hash 98fa68dda40b13ed12746c87bafe90c1b377963564bcea73b8ab162e91aff66c
SimHash 2f1f8070e3f9

Groups

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

ia_archiver

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

muso

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

musobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

coccoc

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

coccocbot-web

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /register/
Disallow /login/
Disallow /xac-minh
Disallow /info/
Disallow /account/
Disallow /logout/
Disallow /tu-phim/
Disallow /lich-su/
Disallow /tim-kiem/
Disallow /ajax/

Warnings

  • 3 invalid lines.