Log In Sign Up

web-yakko.net
robots.txt

Robots Exclusion Standard data for web-yakko.net

Resource Scan

Scan Details

Site Domain web-yakko.net
Base Domain web-yakko.net
Scan Status Ok
Last Scan2025-10-19T23:37:51+00:00
Next Scan 2025-11-18T23:37:51+00:00

Last Scan

Scanned2025-10-19T23:37:51+00:00
URL https://web-yakko.net/robots.txt
Domain IPs 163.44.176.17, 2400:8500:1301:162::17:1
Response IP 163.44.176.17
Found Yes
Hash d6886a0cfcc6fbafd9815a6d76749cd2c0900ae310a629bf61c2fb5d29c79f8f
SimHash ce1e542ac69b

Groups

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

sogoubot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

meta-external-agent

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap https://web-yakko.net/sitemap.txt
Back to top