Log In Sign Up

mibaoxian.com
robots.txt

Robots Exclusion Standard data for mibaoxian.com

Resource Scan

Scan Details

Site Domain mibaoxian.com
Base Domain mibaoxian.com
Scan Status Ok
Last Scan2025-04-28T17:01:13+00:00
Next Scan 2025-05-28T17:01:13+00:00

Last Scan

Scanned2025-04-28T17:01:13+00:00
URL https://www.mibaoxian.com/robots.txt
Domain IPs 113.219.142.35
Response IP 113.219.142.35
Found Yes
Hash c43b7435accc632d1e8e30fd75e87dcdc2947cbc7b69e4ac8d4fa71b7f977c49
SimHash e8375d551cca

Groups

baiduspider

Rule Path
Disallow /admin/

sogou web spider

Rule Path
Disallow /admin/
Disallow /labels/%

googlebot

Rule Path
Disallow /admin/
Disallow /labels/%

bingbot

Rule Path
Disallow /admin/

yisouspider

Rule Path
Disallow /admin/

bytespider

Rule Path
Disallow /admin/

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

daum

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

node-fetch

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.mibaoxian.com/sitemap.xml
sitemap https://m.mibaoxian.com/baidusitemap.xml
Back to top

Comments

  • å
Back to top

Warnings

  • 3 invalid lines.
Back to top