paranormal-news.ru
robots.txt

Robots Exclusion Standard data for paranormal-news.ru

Resource Scan

Scan Details

Site Domain paranormal-news.ru
Base Domain paranormal-news.ru
Scan Status Ok
Last Scan2024-09-19T23:25:28+00:00
Next Scan 2024-09-26T23:25:28+00:00

Last Scan

Scanned2024-09-19T23:25:28+00:00
URL https://paranormal-news.ru/robots.txt
Domain IPs 193.109.246.86
Response IP 193.109.246.86
Found Yes
Hash 9e75a8a9d9fb7d67647627a87bc975599e427b3d4bb28aa208958b1014d49378
SimHash acbdb1a37f83

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

yandexadditional

Rule Path
Disallow /

googlebot-mobile

Rule Path
Allow /

*

Rule Path
Allow /*.js
Allow /*.css
Allow /*.jpg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*?ref=
Allow /*.ttf
Allow /*.woff
Allow /*.woff2
Allow /*.eot
Allow /*.svg
Allow /news/rss
Allow /blog/rssya_turbo
Allow /news/rssya_turbo
Disallow /*?
Disallow /a/
Disallow /stat/
Disallow /index/1
Disallow /index/2
Disallow /index/3
Disallow /index/5
Disallow /index/7
Disallow /index/8
Disallow /index/9
Disallow /panel/
Disallow /admin/
Disallow /secure/
Disallow /informer/
Disallow /mchat
Disallow /search
Disallow /?ssid=
Disallow /abnl/
Disallow /publ/
Disallow /*_escaped_fragment_%3D
Disallow /*-*-*-*-987$
Disallow /news/0-0-***-0-17-3
Disallow /*0-*-0-17$
Disallow /*-0-0-
Disallow /confirm/

Other Records

Field Value
sitemap https://paranormal-news.ru/sitemap.xml
sitemap https://paranormal-news.ru/sitemap-forum.xml
sitemap https://paranormal-news.ru/sitemap-news.xml
sitemap https://paranormal-news.ru/sitemap-blog.xml