nsbroker.com
robots.txt

Robots Exclusion Standard data for nsbroker.com

Resource Scan

Scan Details

Site Domain nsbroker.com
Base Domain nsbroker.com
Scan Status Ok
Last Scan2025-02-23T21:30:35+00:00
Next Scan 2025-03-25T21:30:35+00:00

Last Scan

Scanned2025-02-23T21:30:35+00:00
URL https://nsbroker.com/robots.txt
Domain IPs 104.21.44.32, 172.67.194.87
Response IP 172.67.194.87
Found Yes
Hash fb8efbb7ae94f316a7f2e2dac66de4b3c0f95b523e6698f60586fd9c00a5a0fe
SimHash cd14f434cfd3

Groups

*

Rule Path
Disallow /admin
Disallow /search
Disallow /ru/search
Disallow /financial-news
Disallow *?page=
Disallow *%26page%3D
Disallow *filter-spec
Disallow *?firtlett
Disallow *?flf
Disallow *?srch=
Disallow *?month=
Disallow *?kvvq
Disallow *?sort=

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://nsbroker.com/sitemap.xml

Warnings

  • `host` is not a known field.