incnews.ru
robots.txt

Robots Exclusion Standard data for incnews.ru

Resource Scan

Scan Details

Site Domain incnews.ru
Base Domain incnews.ru
Scan Status Ok
Last Scan2024-11-15T11:33:58+00:00
Next Scan 2024-11-22T11:33:58+00:00

Last Scan

Scanned2024-11-15T11:33:58+00:00
URL https://incnews.ru/robots.txt
Domain IPs 94.198.53.67
Response IP 94.198.53.67
Found Yes
Hash 6149e410254701beda281d9794843425e7c3356da71d0e0fc0fc4d306beca131
SimHash 5c89b9642d52

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /auth
Disallow /login
Disallow /logout
Disallow /adm
Disallow /search
Disallow /use
Disallow /api
Disallow /ax
Disallow /widget
Disallow /promo

Warnings

  • `clean-param` is not a known field.