fxstreet-id.com
robots.txt

Robots Exclusion Standard data for fxstreet-id.com

Resource Scan

Scan Details

Site Domain fxstreet-id.com
Base Domain fxstreet-id.com
Scan Status Ok
Last Scan2024-10-08T03:01:57+00:00
Next Scan 2024-10-15T03:01:57+00:00

Last Scan

Scanned2024-10-08T03:01:57+00:00
URL https://fxstreet-id.com/robots.txt
Redirect https://www.fxstreet-id.com/robots.txt
Redirect Domain www.fxstreet-id.com
Redirect Base fxstreet-id.com
Domain IPs 104.26.10.189, 104.26.11.189, 172.67.73.206, 2606:4700:20::681a:abd, 2606:4700:20::681a:bbd, 2606:4700:20::ac43:49ce
Redirect IPs 104.26.10.189, 104.26.11.189, 172.67.73.206, 2606:4700:20::681a:abd, 2606:4700:20::681a:bbd, 2606:4700:20::ac43:49ce
Response IP 104.26.11.189
Found Yes
Hash 7545823e2c8b916186e213a37972fd0b91479c9d2559a9450c60b1c6edcaee86
SimHash 9a16fcb8cc43

Groups

*

Rule Path
Disallow /Sitefinity/
Disallow /EventWidget/
Disallow /glossary/
Disallow /forum/
Disallow /futuresource/
Disallow /fxbeat/
Disallow /metatrader/
Disallow /nou/
Disallow /privateresources/
Disallow /search/
Disallow /tickers/
Disallow /futures/
Disallow /Futures/
Disallow /redirect/
Disallow /images/
Disallow /error/
Disallow /sitemap_news.xml
Disallow /skin/
Disallow /trade-now*

googlebot-news

Rule Path
Disallow /rates-charts
Disallow /economic-calendar
Disallow /brokers
Disallow /live-video
Disallow /currencies
Disallow /technical-analysis
Disallow /author
Disallow /company
Disallow /markets
Disallow /info
Disallow /trading
Disallow /macroeconomics
Disallow /strategy
Disallow /instruments
Disallow /money-management
Disallow /psychology
Disallow /bonds
Disallow /search
Disallow /subscription
Disallow /trade-now*

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.fxstreet-id.com/sitemap-analysis.xml
sitemap https://www.fxstreet-id.com/sitemap-news.xml
sitemap https://www.fxstreet-id.com/google-sitemap-news.xml
sitemap https://www.fxstreet-id.com/google-sitemap-analysis.xml
sitemap https://www.fxstreet-id.com/sitemap-all.xml
sitemap https://www.fxstreet-id.com/sitemap-education-24.xml