Log In Sign Up

shining3d.cn
robots.txt

Robots Exclusion Standard data for shining3d.cn

Resource Scan

Scan Details

Site Domain shining3d.cn
Base Domain shining3d.cn
Scan Status Ok
Last Scan2026-01-20T22:04:21+00:00
Next Scan 2026-02-19T22:04:21+00:00

Last Scan

Scanned2026-01-20T22:04:21+00:00
URL https://www.shining3d.cn/robots.txt
Domain IPs 154.41.93.240, 154.41.93.241
Response IP 154.41.93.241
Found Yes
Hash 5576c280c7143001e19c634881edb153a9a05cc1186bbdce22cfce8d63fcb1f9
SimHash 2f17da63e7d0

Groups

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

sogou spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Allow /
Disallow /admin/
Disallow /login/
Disallow /tmp/
Disallow /config/
Disallow /private/
Disallow /cgi-bin/
Back to top

Comments

  • 针对 360Spider
  • 针对 Google
  • 针对 Bing
  • 针对 Yahoo
  • 针对 DuckDuckGo
  • 针对 Yandex
  • 针对 Sogou
  • 通用规则（所有爬虫）
  • 禁止抓取的敏感目录
Back to top

Warnings

  • 2 invalid lines.
Back to top