Log In Sign Up

pubg01.com
robots.txt

Robots Exclusion Standard data for pubg01.com

Resource Scan

Scan Details

Site Domain pubg01.com
Base Domain pubg01.com
Scan Status Ok
Last Scan2024-08-29T23:11:49+00:00
Next Scan 2024-09-28T23:11:49+00:00

Last Scan

Scanned2024-08-29T23:11:49+00:00
URL https://pubg01.com/robots.txt
Domain IPs 104.21.74.44, 172.67.197.196, 2606:4700:3034::6815:4a2c, 2606:4700:3036::ac43:c5c4
Response IP 104.21.74.44
Found Yes
Hash dd6e7421dd09a12c9e604fb2e06d92290dc52a27d56b8f437d11151efcad2c78
SimHash 9244dd3a690b

Groups

baiduspider

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

chinasospider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /
Back to top