ntagil.ru
robots.txt

Robots Exclusion Standard data for ntagil.ru

Resource Scan

Scan Details

Site Domain ntagil.ru
Base Domain ntagil.ru
Scan Status Ok
Last Scan2025-11-16T02:36:54+00:00
Next Scan 2025-12-16T02:36:54+00:00

Last Scan

Scanned2025-11-16T02:36:54+00:00
URL https://ntagil.ru/robots.txt
Redirect https://www.ntagil.ru/robots.txt
Redirect Domain www.ntagil.ru
Redirect Base ntagil.ru
Domain IPs 193.233.63.103
Redirect IPs 193.233.63.103
Response IP 193.233.63.103
Found Yes
Hash dfe50290e4c375bcc3a71a795427fc8932da0eda72e85ea3c742dcc621b90e29
SimHash 0e347830e773

Groups

*

Rule Path
Disallow /search
Disallow /admin
Disallow /search?*
Disallow /search?search=
Disallow /*.pdf$
Disallow /?
Disallow /*?
Disallow /*?page=
Disallow /cgi-bin*
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ntagil.ru/sitemap.xml