blacksprutashop.top
robots.txt

Robots Exclusion Standard data for blacksprutashop.top

Resource Scan

Scan Details

Site Domain blacksprutashop.top
Base Domain blacksprutashop.top
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-03T15:08:49+00:00
Next Scan 2026-01-01T15:08:49+00:00

Last Successful Scan

Scanned2024-05-19T09:02:31+00:00
URL https://blacksprutashop.top/robots.txt
Redirect https://blacksprutfshop.top/robots.txt
Redirect Domain blacksprutfshop.top
Redirect Base blacksprutfshop.top
Domain IPs 104.21.61.181, 172.67.212.158, 2606:4700:3030::6815:3db5, 2606:4700:3033::ac43:d49e
Redirect IPs 104.21.34.213, 172.67.165.148, 2606:4700:3031::ac43:a594, 2606:4700:3037::6815:22d5
Response IP 104.21.34.213
Found Yes
Hash 083ce2839df1638850180280b904b16e5d8dc3e34592a69aaddc65a23ad8c64d
SimHash 29688241a923

Groups

*

Product Comment
* общие правила для роботов
Rule Path Comment
Disallow /*?* блокирует все страницы, содержащие в URL знак вопроса
Disallow /wp- все файлы WP: /wp-json/, /wp-includes, /wp-content/plugins
Disallow *?s= поиск
Disallow *%26s%3D поиск
Disallow *utm*%3D ссылки с utm-метками
Disallow *openstat%3D ссылки с метками openstat
Disallow /site_blacksprut_dark_net_market_onion.php -
Allow */uploads открываем папку с файлами uploads

Other Records

Field Value
sitemap https://blacksprutfshop.top/sitemap.xml

Warnings

  • `host` is not a known field.