Log In Sign Up

runeterra.ar
robots.txt

Robots Exclusion Standard data for runeterra.ar

Resource Scan

Scan Details

Site Domain runeterra.ar
Base Domain runeterra.ar
Scan Status Ok
Last Scan2024-10-29T18:08:38+00:00
Next Scan 2024-11-05T18:08:38+00:00

Last Scan

Scanned2024-10-29T18:08:38+00:00
URL https://runeterra.ar/robots.txt
Domain IPs 104.21.73.4, 172.67.156.6, 2606:4700:3032::6815:4904, 2606:4700:3034::ac43:9c06
Response IP 104.21.73.4
Found Yes
Hash aa8fb3350e3da6483df221d839c66480e7ead7de2462833043566c8dd5b09bbd
SimHash 2ebefa19e5f4

Groups

googlebot

Rule Path
Allow /?_escaped_fragment_
Allow /*?lang=
Allow /search?q=%23
Allow /*?ref_src=
Allow /*?src=
Disallow /*?
Disallow /*/followers
Disallow /*/following

slurp

Rule Path
Allow /?_escaped_fragment_
Allow /*?lang=
Allow /search?q=%23
Disallow /*?
Disallow /*/followers
Disallow /*/following

yandex

Rule Path
Allow /?_escaped_fragment_
Allow /*?lang=
Allow /search?q=%23
Disallow /*?
Disallow /*/followers
Disallow /*/following

msnbot

Rule Path
Allow /?_escaped_fragment_
Allow /*?lang=
Allow /search?q=%23
Disallow /*?
Disallow /*/followers
Disallow /*/following

bingbot

Rule Path
Allow /?_escaped_fragment_
Allow /*?lang=
Allow /search?q=%23
Disallow /*?
Disallow /*/followers
Disallow /*/following

*

Rule Path
Allow /*?lang=
Allow /search?q=%23
Disallow /*?
Disallow /*/followers
Disallow /*/following
Disallow /oauth
Disallow /1/oauth
Disallow /i/u

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://runeterra.ar/sitemap.xml
Back to top

Comments

  • Google Search Engine Robot
  • ==========================
  • Yahoo! Search Engine Robot
  • ==========================
  • Yandex Search Engine Robot
  • ==========================
  • Microsoft Search Engine Robot
  • =============================
  • Bing Search Engine Robot
  • ========================
  • Every bot that might possibly read and respect this file
  • ========================================================
  • WHAT-4882 - Block indexing of links in notification emails. This applies to all bots.
  • =====================================================================================
  • Wait 1 second between successive requests. See ONBOARD-2698 for details.
  • Independent of user agent. Links in the sitemap are full URLs using https:// and need to match
  • the protocol of the sitemap.
Back to top

Warnings

  • `noindex` is not a known field.
Back to top