dngz.net
robots.txt

Robots Exclusion Standard data for dngz.net

Resource Scan

Scan Details

Site Domain dngz.net
Base Domain dngz.net
Scan Status Ok
Last Scan2025-11-25T04:42:05+00:00
Next Scan 2025-12-25T04:42:05+00:00

Last Scan

Scanned2025-11-25T04:42:05+00:00
URL https://dngz.net/robots.txt
Redirect https://www.dngz.net/robots.txt
Redirect Domain www.dngz.net
Redirect Base dngz.net
Domain IPs 118.24.8.68
Redirect IPs 118.24.8.68
Response IP 118.24.8.68
Found Yes
Hash e0b42fd51fbb1540f5235051536786b9a2ed2ba84df7fd608edca2abcfcaeb5f
SimHash 5d1c9c71f291

Groups

thinkchaos

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

*

Rule Path
Disallow /d/
Disallow /e/class/
Disallow /e/config/
Disallow /e/data/
Disallow /e/enews/
Disallow /e/update/
Disallow /z/
Disallow /api/
Disallow /bbs/include/
Disallow /tj.php
Disallow /youhui/
Disallow /zujirensheng/track.php
Disallow /zujirensheng/feedback.php
Disallow /zujirensheng/admin.php
Allow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://www.dngz.net/sitemap.xml