nepw.cn
robots.txt

Robots Exclusion Standard data for nepw.cn

Resource Scan

Scan Details

Site Domain nepw.cn
Base Domain nepw.cn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-18T17:38:17+00:00
Next Scan 2026-01-16T17:38:17+00:00

Last Successful Scan

Scanned2024-03-05T02:16:06+00:00
URL https://nepw.cn/robots.txt
Redirect https://www.nepw.cn/robots.txt
Redirect Domain www.nepw.cn
Redirect Base nepw.cn
Domain IPs 104.21.73.72, 172.67.158.182, 2606:4700:3034::6815:4948, 2606:4700:3034::ac43:9eb6
Redirect IPs 104.21.73.72, 172.67.158.182, 2606:4700:3034::6815:4948, 2606:4700:3034::ac43:9eb6
Response IP 172.67.158.182
Found Yes
Hash 7593259c48b3f5e1343ce25ad8c9818a25d89dd2fb559e37222025f1436953e4
SimHash 4d1d544c25d2

Groups

*

Rule Path
Disallow /uploads
Disallow /home

baiduspider

Rule Path
Allow /

sogou spider

Rule Path
Allow /

sosospider

Rule Path
Allow /

bytespider

Rule Path
Allow /

bingbot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap/baidu?index=1.xml
sitemap /sitemap/baidu?index=2.xml
sitemap /sitemap/baidu?index=3.xml
sitemap /sitemap/baidu?index=4.xml
sitemap /sitemap/baidu?index=5.xml
sitemap /sitemap/baidu?index=6.xml
sitemap /sitemap/baidu?index=7.xml
sitemap /sitemap/baidu?index=8.xml
sitemap /sitemap/baidu?index=9.xml
sitemap /sitemap/baidu?index=10.xml
sitemap /sitemap/baidu?index=11.xml
sitemap /sitemap/baidu?index=12.xml
sitemap /sitemap/baidu?index=13.xml
sitemap /sitemap/baidu?index=14.xml
sitemap /sitemap/baidu?index=15.xml
sitemap /sitemap/baidu?index=16.xml
sitemap /sitemap/baidu?index=17.xml
sitemap /sitemap/baidu?index=18.xml
sitemap /sitemap/baidu?index=19.xml
sitemap /sitemap/baidu?index=20.xml

Warnings

  • 2 invalid lines.