sokkuri.net
robots.txt

Robots Exclusion Standard data for sokkuri.net

Resource Scan

Scan Details

Site Domain sokkuri.net
Base Domain sokkuri.net
Scan Status Ok
Last Scan2024-09-16T17:42:23+00:00
Next Scan 2024-09-23T17:42:23+00:00

Last Scan

Scanned2024-09-16T17:42:23+00:00
URL https://sokkuri.net/robots.txt
Domain IPs 153.127.41.210
Response IP 153.127.41.210
Found Yes
Hash 2751480d5eaeefd790187d264331099292c3ac13d67c51e50c22828482f8cdd8
SimHash 605e95e16f81

Groups

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

just-crawler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

*

Rule Path
Disallow /vote*
Disallow /*sp%3D0

Other Records

Field Value
crawl-delay 30

googlebot

Rule Path
Disallow /vote*
Disallow /*sp%3D0
Disallow /alike/%E6%B8%A1%E8%BE%BA%E5%B0%86%E4%BA%BA/%E7%A7%8B%E5%85%83%E5%BA%B7