t30p.ru
robots.txt

Robots Exclusion Standard data for t30p.ru

Resource Scan

Scan Details

Site Domain t30p.ru
Base Domain t30p.ru
Scan Status Ok
Last Scan2024-10-02T22:02:17+00:00
Next Scan 2024-10-09T22:02:17+00:00

Last Scan

Scanned2024-10-02T22:02:17+00:00
URL https://t30p.ru/robots.txt
Domain IPs 212.233.97.217
Response IP 212.233.97.217
Found Yes
Hash ce21d1930f9268e7507436a9cedf8a436b21a6927f36899565db379b6257009f
SimHash 2910a4486eb1

Groups

*

Rule Path
Disallow /search.aspx
Disallow /error404.aspx
Disallow /error503.aspx
Disallow /widget.aspx
Disallow /GooglePlus.aspx
Disallow /ok
Disallow /g
Disallow /search-rss.aspx
Disallow /cache.aspx
Disallow /text.aspx
Disallow /l.aspx
Allow /telegramtop.aspx
Allow /telegram.aspx
Allow /Instagram.aspx
Allow /Tenchat.aspx
Allow /Youtube.aspx
Allow /Stats.aspx
Allow /Twitter.aspx
Allow /TikTok.aspx
Allow /Discord.aspx
Allow /Vktop.aspx

Other Records

Field Value Comment
crawl-delay 2.5 задает таймаут в 2.5 секунды

Other Records

Field Value
sitemap https://www.t30p.ru/sitemap.xml

Warnings

  • `host` is not a known field.