fxstreet.it
robots.txt

Robots Exclusion Standard data for fxstreet.it

Resource Scan

Scan Details

Site Domain fxstreet.it
Base Domain fxstreet.it
Scan Status Ok
Last Scan2024-10-10T18:42:27+00:00
Next Scan 2024-10-17T18:42:27+00:00

Last Scan

Scanned2024-10-10T18:42:27+00:00
URL https://fxstreet.it/robots.txt
Redirect https://www.fxstreet.it/robots.txt
Redirect Domain www.fxstreet.it
Redirect Base fxstreet.it
Domain IPs 104.21.58.182, 172.67.162.108, 2606:4700:3034::6815:3ab6, 2606:4700:3035::ac43:a26c
Redirect IPs 104.21.58.182, 172.67.162.108, 2606:4700:3034::6815:3ab6, 2606:4700:3035::ac43:a26c
Response IP 104.21.58.182
Found Yes
Hash a06889e17839e490d1e7423c70d752063e3e76ffbf0b8f41e17973500b681dab
SimHash 9012dc30c04b

Groups

*

Rule Path
Disallow /Sitefinity/
Disallow /EventWidget/
Disallow /glossary/
Disallow /forum/
Disallow /brokers/press-releases/*
Disallow /cryptocurrencies/industry-news*
Disallow /futuresource/
Disallow /fxbeat/
Disallow /metatrader/
Disallow /nou/
Disallow /privateresources/
Disallow /search/
Disallow /tickers/
Disallow /futures/
Disallow /Futures/
Disallow /redirect/
Disallow /images/
Disallow /error/
Disallow /sitemap_news.xml
Disallow /skin/
Disallow /news1*
Disallow /news2*
Disallow /analysis1*
Disallow /analysis2*
Disallow /education1*
Disallow /education2*
Disallow /live-video1*
Disallow /live-video2*
Disallow /cryptocurrencies/news1*
Disallow /cryptocurrencies/news2*
Disallow /news/*/feed
Disallow /trade-now*
Disallow /api/AmpAuthorizationApi/Auth

googlebot-news

Rule Path
Disallow /rates-charts
Disallow /economic-calendar
Disallow /brokers
Disallow /live-video
Disallow /currencies
Disallow /technical-analysis
Disallow /author
Disallow /company
Disallow /markets
Disallow /info
Disallow /trading
Disallow /macroeconomics
Disallow /strategy
Disallow /instruments
Disallow /money-management
Disallow /psychology
Disallow /bonds
Disallow /search
Disallow /subscription
Disallow /news1*
Disallow /news2*
Disallow /analysis1*
Disallow /analysis2*
Disallow /education1*
Disallow /education2*
Disallow /live-video1*
Disallow /live-video2*
Disallow /cryptocurrencies/news1*
Disallow /cryptocurrencies/news2*
Disallow /trade-now*
Disallow /api/AmpAuthorizationApi/Auth

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /