nstechworks.com
robots.txt

Robots Exclusion Standard data for nstechworks.com

Resource Scan

Scan Details

Site Domain nstechworks.com
Base Domain nstechworks.com
Scan Status Ok
Last Scan2025-09-29T22:03:48+00:00
Next Scan 2025-10-06T22:03:48+00:00

Last Scan

Scanned2025-09-29T22:03:48+00:00
URL https://nstechworks.com/robots.txt
Domain IPs 104.21.12.74, 172.67.193.192, 2606:4700:3032::6815:c4a, 2606:4700:3032::ac43:c1c0
Response IP 104.21.12.74
Found Yes
Hash f42ccf1e7b7c2fdd0e818d2189e0024f2d486543d310f280e773843e12658f9a
SimHash 6901c240c793

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /archives/
Disallow /*?*
Disallow /comments/feed/
Disallow /refer/
Disallow /wp-content/plugins/

mediapartners-google*

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

facebookexternalhit

Rule Path
Disallow

twitterbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://nstechworks.com/news-sitemap.xml
sitemap https://nstechworks.com/sitemap_index.xml