номернедели.рф
robots.txt

Robots Exclusion Standard data for номернедели.рф

Resource Scan

Scan Details

Site Domain номернедели.рф
Base Domain номернедели.рф
Scan Status Ok
Last Scan2025-04-01T12:37:19+00:00
Next Scan 2025-04-08T12:37:19+00:00

Last Scan

Scanned2025-04-01T12:37:19+00:00
URL https://номернедели.рф/robots.txt
Redirect https://xn--d1ababprchchy.xn--p1ai/robots.txt
Domain IPs 104.21.30.60, 172.67.172.48, 2606:4700:3035::6815:1e3c, 2606:4700:3036::ac43:ac30
Response IP 172.67.172.48
Found Yes
Hash a0c384e0253902aa2edde9f729b38335c409fec0544a5264453ef6dbf0fd70e0
SimHash 6310e9efc203

Groups

mediapartners-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow /gfx/72x72/
Disallow /gfx/114x114/

mj12bot

Rule Path
Disallow /?q=*
Disallow /?year=*

Other Records

Field Value
crawl-delay 600

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /*2000*
Disallow /*2001*
Disallow /*2002*
Disallow /*2003*
Disallow /*2004*
Disallow /*2005*
Disallow /*2006*
Disallow /*2007*
Disallow /*2008*
Disallow /*2009*
Disallow /*2010*
Disallow /*2011*
Disallow /*2012*
Disallow /*2013*
Disallow /*2014*
Disallow /*2031*
Disallow /*2032*
Disallow /*2033*
Disallow /*2034*
Disallow /*2035*
Disallow /*2036*
Disallow /*2037*
Disallow /*2038*
Disallow /*2039*
Disallow /*2040*
Disallow /*2041*
Disallow /*2042*
Disallow /*2043*
Disallow /*2044*
Disallow /*2045*
Disallow /*2046*
Disallow /*2047*
Disallow /*2048*
Disallow /*2049*
Disallow /*2050*
Disallow /*2051*
Disallow /*2052*
Disallow /*2053*
Disallow /*2054*
Disallow /*2055*
Disallow /*2056*
Disallow /*2057*
Disallow /*2058*
Disallow /*2059*
Disallow /*2060*
Disallow /*2061*
Disallow /*2062*
Disallow /*2063*
Disallow /*2064*
Disallow /*2065*
Disallow /*2066*
Disallow /*2067*
Disallow /*2068*
Disallow /*2069*
Disallow /*2070*
Disallow /*2071*
Disallow /*2072*
Disallow /*2073*
Disallow /*2074*
Disallow /*2075*
Disallow /*2076*
Disallow /*2077*
Disallow /*2078*
Disallow /*2079*
Disallow /*2080*
Disallow /*2081*

Other Records

Field Value
sitemap https://xn--d1ababprchchy.xn--p1ai/sitemap.xml

Comments

  • Google AdSense

Warnings

  • `host` is not a known field.