Log In Sign Up

wangzi.uk
robots.txt

Robots Exclusion Standard data for wangzi.uk

Resource Scan

Scan Details

Site Domain wangzi.uk
Base Domain wangzi.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-31T01:45:27+00:00
Next Scan 2025-10-29T01:45:27+00:00

Last Successful Scan

Scanned2023-12-17T00:28:32+00:00
URL https://wangzi.uk/robots.txt
Domain IPs 104.21.25.124, 172.67.134.58, 2606:4700:3030::ac43:863a, 2606:4700:3036::6815:197c
Response IP 104.21.25.124
Found Yes
Hash 8385dafd9f85f60cefee656efa17f91814a918a8c26f9187127fd5006e810b98
SimHash 2056d80b4482

Groups

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

slurp

Rule Path
Disallow /

teoma

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

psbot

Rule Path
Disallow /
Disallow /

Other Records

Field Value
crawl-delay 120
Back to top

Comments

  • robots.txt generated at http://tool.chinaz.com/robots/
Back to top