Log In Sign Up

zenn.dev
robots.txt

Robots Exclusion Standard data for zenn.dev

Resource Scan

Scan Details

Site Domain zenn.dev
Base Domain zenn.dev
Scan Status Ok
Last Scan2024-08-29T12:52:52+00:00
Next Scan 2024-09-28T12:52:52+00:00

Last Scan

Scanned2024-08-29T12:52:52+00:00
URL https://zenn.dev/robots.txt
Domain IPs 104.26.14.203, 104.26.15.203, 172.67.72.220, 2606:4700:20::681a:ecb, 2606:4700:20::681a:fcb, 2606:4700:20::ac43:48dc
Response IP 172.67.72.220
Found Yes
Hash 8063e6e58b6bbe34b59372c8104bc15693855d443638423452fe88250a238c78
SimHash 8d145456c251

Groups

yahoo pipes 1.0

Rule Path
Disallow /

voltron

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

megalodon

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://zenn.dev/sitemaps/_index.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top