m.nepw.cn
robots.txt

Robots Exclusion Standard data for m.nepw.cn

Resource Scan

Scan Details

Site Domain m.nepw.cn
Base Domain nepw.cn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-13T11:15:25+00:00
Next Scan 2026-02-11T11:15:25+00:00

Last Successful Scan

Scanned2024-03-30T19:11:56+00:00
URL https://m.nepw.cn/robots.txt
Domain IPs 104.21.73.72, 172.67.158.182, 2606:4700:3034::6815:4948, 2606:4700:3034::ac43:9eb6
Response IP 104.21.73.72
Found Yes
Hash 7593259c48b3f5e1343ce25ad8c9818a25d89dd2fb559e37222025f1436953e4
SimHash 4d1d544c25d2

Groups

*

Rule Path
Disallow /uploads
Disallow /home

baiduspider

Rule Path
Allow /

sogou spider

Rule Path
Allow /

sosospider

Rule Path
Allow /

bytespider

Rule Path
Allow /

bingbot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap/baidu?index=1.xml
sitemap /sitemap/baidu?index=2.xml
sitemap /sitemap/baidu?index=3.xml
sitemap /sitemap/baidu?index=4.xml
sitemap /sitemap/baidu?index=5.xml
sitemap /sitemap/baidu?index=6.xml
sitemap /sitemap/baidu?index=7.xml
sitemap /sitemap/baidu?index=8.xml
sitemap /sitemap/baidu?index=9.xml
sitemap /sitemap/baidu?index=10.xml
sitemap /sitemap/baidu?index=11.xml
sitemap /sitemap/baidu?index=12.xml
sitemap /sitemap/baidu?index=13.xml
sitemap /sitemap/baidu?index=14.xml
sitemap /sitemap/baidu?index=15.xml
sitemap /sitemap/baidu?index=16.xml
sitemap /sitemap/baidu?index=17.xml
sitemap /sitemap/baidu?index=18.xml
sitemap /sitemap/baidu?index=19.xml
sitemap /sitemap/baidu?index=20.xml

Warnings

  • 2 invalid lines.