bujie.com
robots.txt

Robots Exclusion Standard data for bujie.com

Resource Scan

Scan Details

Site Domain bujie.com
Base Domain bujie.com
Scan Status Ok
Last Scan2025-03-12T16:51:18+00:00
Next Scan 2025-03-19T16:51:18+00:00

Last Scan

Scanned2025-03-12T16:51:18+00:00
URL https://bujie.com/robots.txt
Domain IPs 104.21.95.137, 172.67.145.1, 2606:4700:3032::ac43:9101, 2606:4700:3034::6815:5f89
Response IP 104.21.95.137
Found Yes
Hash e512793a4c08155603e2220cc33f77deededb1292469b069b6277dde6ca83c24
SimHash 6e4051d68131

Groups

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

slurp

Rule Path
Disallow /

*

Rule Path
Disallow /go/
Disallow /index/
Disallow /deal/
Disallow /s/*?page=*
Allow /

Warnings

  • 2 invalid lines.