valutafx.com
robots.txt
Robots Exclusion Standard data for valutafx.com
Resource Scan
Scan Details
| Site Domain | valutafx.com |
| Base Domain | valutafx.com |
| Scan Status | Ok |
| Last Scan | 2024-09-26T13:17:08+00:00 |
| Next Scan | 2024-10-03T13:17:08+00:00 |
Last Scan
| Scanned | 2024-09-26T13:17:08+00:00 |
| URL | https://valutafx.com/robots.txt |
| Domain IPs | 104.21.10.118, 172.67.131.120, 2606:4700:3032::6815:a76, 2606:4700:3037::ac43:8378 |
| Response IP | 172.67.131.120 |
| Found | Yes |
| Hash | 8893ed17779bec8be89547ecf2e041bb9530f3e93b45ed85b0853442703313b2 |
| SimHash | c73c55626a03 |
Groups
mj12bot
semrushbot-sa
semrushbot
ahrefsbot
dotbot
mauibot
mauibot (crawler.feedback+wc@gmail.com)
megaindex.ru/2.0
seekport crawler
sputnikbot/2.3
the knowledge ai
turnitinbot
ucbrowser
yacybot
yeti
seznambot
| Rule | Path |
|---|---|
| Disallow | / |
coccocbot-web
| Rule | Path |
|---|---|
| Allow | /contact* |
| Allow | /privacy* |
| Allow | /terms* |
| Allow | /*VND* |
| Allow | /*USD* |
| Allow | /*GBP* |
| Allow | /*EUR* |
| Allow | /*AUD* |
| Allow | /*CAD* |
| Allow | /*CNY* |
| Allow | /*TWD* |
| Allow | /*JPY* |
| Allow | /*KRW* |
| Allow | /*HKD* |
| Allow | /*THB* |
| Allow | /*IDR* |
| Allow | /*MYR* |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.valutafx.com/sitemap_index.xml |