static-global.nhst.tech
robots.txt

Robots Exclusion Standard data for static-global.nhst.tech

Resource Scan

Scan Details

Site Domain static-global.nhst.tech
Base Domain nhst.tech
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-06-25T17:33:54+00:00
Next Scan 2025-09-23T17:33:54+00:00

Last Successful Scan

Scanned2024-11-28T16:22:15+00:00
URL https://static-global.nhst.tech/robots.txt
Domain IPs 52.187.174.233
Response IP 52.187.174.233
Found Yes
Hash c0424b9afc68673415431cd6c9c49820ab735b370eac55fe4c62d1a403bb1d2b
SimHash 295b18c7ce95

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /forgotpw/*

*

Rule Path
Disallow /auth/user/login/*

*

Rule Path
Disallow /myprofile/*

*

Rule Path
Disallow /subscription/*

*

Rule Path
Disallow /test_frontpage

*

Rule Path
Disallow /front

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

linko

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

facebookexternalhit

Rule Path
Allow /annonsorinnhold*

facebot

Rule Path
Allow /annonsorinnhold*

linkedinbot

Rule Path
Allow /annonsorinnhold*

twitterbot

Rule Path
Allow /annonsorinnhold*

facebookexternalhit

Rule Path
Allow /sponsor-content*

facebot

Rule Path
Allow /sponsor-content*

linkedinbot

Rule Path
Allow /sponsor-content*

twitterbot

Rule Path
Allow /sponsor-content*

*

Rule Path
Disallow /annonsorinnhold*

*

Rule Path
Disallow /sponsor-content*

Other Records

Field Value
sitemap https://www.tradewindsnews.com/sitemap.xml