news.forexlive.com
robots.txt

Robots Exclusion Standard data for news.forexlive.com

Resource Scan

Scan Details

Site Domain news.forexlive.com
Base Domain forexlive.com
Scan Status Ok
Last Scan2025-12-14T03:27:05+00:00
Next Scan 2026-01-13T03:27:05+00:00

Last Scan

Scanned2025-12-14T03:27:05+00:00
URL https://news.forexlive.com/robots.txt
Redirect https://investinglive.com:443/robots.txt
Redirect Domain investinglive.com
Redirect Base investinglive.com
Domain IPs 18.67.175.19, 18.67.175.2, 18.67.175.6, 18.67.175.62
Redirect IPs 3.170.229.116, 3.170.229.19, 3.170.229.52, 3.170.229.7
Response IP 3.170.229.116
Found Yes
Hash 28cf1c38f1fb8597c509ae87c2d019fa19c397fcec51ada12eb88370d0506a60
SimHash 003aca5301b2

Groups

*

Rule Path
Disallow /search-results
Disallow /terms/search-results
Disallow /tag/search-results
Disallow /signalr/
Disallow /*.pdf$

ai2bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

deepseekbot

Rule Path
Disallow /

deepseek

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

qwen-agent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://investinglive.com/sitemap.xml
sitemap https://investinglive.com/latest.xml
sitemap https://investinglive.com/articles-sitemap-index.xml

Comments

  • Global Rules for All Bots
  • Bot-Specific Restrictions
  • Sitemap Directives