pixiv.kurocore.com
robots.txt

Robots Exclusion Standard data for pixiv.kurocore.com

Resource Scan

Scan Details

Site Domain pixiv.kurocore.com
Base Domain kurocore.com
Scan Status Ok
Last Scan2024-08-21T22:13:36+00:00
Next Scan 2024-09-20T22:13:36+00:00

Last Scan

Scanned2024-08-21T22:13:36+00:00
URL https://pixiv.kurocore.com/robots.txt
Redirect http://kurocore.com/robots.txt
Redirect Domain kurocore.com
Redirect Base kurocore.com
Domain IPs 104.21.43.103, 172.67.178.33
Redirect IPs 104.21.43.103, 172.67.178.33
Response IP 172.67.178.33
Found Yes
Hash 288690e7965623a32f08616fdccc97646b4c8b3476d3a8aec25d45c112bfb867
SimHash 9a47da2a2fd2

Groups

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /