Log In Sign Up

sinhvien.daihocnguyentrai.edu.vn
robots.txt

Robots Exclusion Standard data for sinhvien.daihocnguyentrai.edu.vn

Resource Scan

Scan Details

Site Domain sinhvien.daihocnguyentrai.edu.vn
Base Domain daihocnguyentrai.edu.vn
Scan Status Ok
Last Scan2025-07-24T07:34:41+00:00
Next Scan 2025-08-23T07:34:41+00:00

Last Scan

Scanned2025-07-24T07:34:41+00:00
URL http://sinhvien.daihocnguyentrai.edu.vn/robots.txt
Domain IPs 123.31.12.60
Response IP 123.31.12.60
Found Yes
Hash c833869022ba7d3194e53fefa9ca67fc1742459a20b43843e3219fdc82a7ab3b
SimHash 4815d800e390

Groups

googlebot

Rule Path
Disallow /

googlebot
adsbot-google

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • Example 1: Block only Googlebot
  • Example 2: Block Googlebot and Adsbot
  • Example 3: Block all crawlers except AdsBot (AdsBot crawlers must be named explicitly)
Back to top