nile.io
robots.txt

Robots Exclusion Standard data for nile.io

Resource Scan

Scan Details

Site Domain nile.io
Base Domain nile.io
Scan Status Ok
Last Scan2024-06-30T22:47:48+00:00
Next Scan 2024-07-30T22:47:48+00:00

Last Scan

Scanned2024-06-30T22:47:48+00:00
URL https://www.nile.io/robots.txt
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 56f51f19d0310b68eaa2b6d024b4e7916d7669b7fdc3bd4c04b2b552a0c3224c
SimHash 8b5489524db0

Groups

*

Rule Path
Allow /

Comments

  • user-agent: 규칙이 적용되는 크롤러를 식별합니다.
  • allow: 크롤링할 수 있는 URL 경로입니다.
  • disallow: 크롤링할 수 없는 URL 경로입니다.
  • sitemap: 사이트맵 xml file의 URL입니다.
  • 참고: https://developers.google.com/search/docs/crawling-indexing/robots/robots_txt?hl=ko
  • sitemap: https://nile.io/sitemap.xml