ja.exchange-rates.org
robots.txt
Robots Exclusion Standard data for ja.exchange-rates.org
Resource Scan
Scan Details
| Site Domain | ja.exchange-rates.org |
| Base Domain | exchange-rates.org |
| Scan Status | Ok |
| Last Scan | 2024-06-21T22:39:29+00:00 |
| Next Scan | 2024-07-21T22:39:29+00:00 |
Last Scan
| Scanned | 2024-06-21T22:39:29+00:00 |
| URL | https://ja.exchange-rates.org/robots.txt |
| Domain IPs | 104.21.55.127, 172.67.148.30, 2606:4700:3031::ac43:941e, 2606:4700:3035::6815:377f |
| Response IP | 172.67.148.30 |
| Found | Yes |
| Hash | 84d7cc5e2c3f4df6d93c6996419821e9023291c9ccba9dae63f0804cc5f17e05 |
| SimHash | ff1e14e2e2c1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /?layout=v2 |
| Disallow | /?layout=1 |
| Disallow | /GetCustomContent.aspx* |
| Disallow | /HistoryExchangeRatesReportDownload.aspx* |
| Disallow | /*.aspx$ |
| Disallow | /*.aspx* |
amazonbot
| Rule | Path |
|---|---|
| Disallow | /de/wechselkursverlauf/ |
| Disallow | /es/historial/ |
| Disallow | /fr/historique/ |
| Disallow | /id/riwayat-nilai-tukar/ |
| Disallow | /gr/istoriko-sinallagmatikon-isotimion/ |
| Disallow | /hu/korabbi-arfolyamok/ |
| Disallow | /it/storico-tassi-cambio/ |
| Disallow | /ja/exchange-rate-history/ |
| Disallow | /ko/exchange-rate-history/ |
| Disallow | /my/sejarah-kadar-pertukaran/ |
| Disallow | /no/valutakurs-historikk/ |
| Disallow | /nl/geschiedenis-van-wisselkoersen/ |
| Disallow | /pl/historyczne-kursy-wymiany/ |
| Disallow | /pt/historico/ |
| Disallow | /ro/istoric-curs-schimb/ |
| Disallow | /ru/%D0%B8%D1%81%D1%82%D0%BE%D1%80%D0%B8%D1%8F-%D0%BA%D1%83%D1%80%D1%81%D0%BE%D0%B2/ |
| Disallow | /sv/vaxelkurs-historia/ |
| Disallow | /th/exchange-rate-history/ |
| Disallow | /tr/gecmis-doviz-kurlari/ |
| Disallow | /vn/lich-su-ty-gia-hoi-doai/ |
| Disallow | /zh/exchange-rate-history/ |
| Disallow | /zh-hant/exchange-rate-history/ |
| Disallow | /exchange-rate-history/ |
| Allow | /exchange-rate-history/usd* |
| Allow | /exchange-rate-history/eur* |
| Allow | /exchange-rate-history/gbp* |
| Allow | /exchange-rate-history/cad* |
| Allow | /exchange-rate-history/aud* |
semrushbot-sa
semrushbot
ahrefsbot
dotbot
mj12bot
mauibot
mauibot (crawler.feedback+wc@gmail.com)
megaindex.ru/2.0
seekport crawler
sputnikbot/2.3
the knowledge ai
turnitinbot
ucbrowser
yacybot
yeti
seznambot
coccocbot-web
petalbot
| Rule | Path |
|---|---|
| Disallow | / |
baiduspider
| Rule | Path |
|---|---|
| Disallow | / |
| Allow | /zh |
| Allow | /zh-hant |
| Disallow | /zh/*.aspx$ |
| Disallow | /zh/api* |
| Disallow | /zh-hant/*.aspx$ |
| Disallow | /zh-hant/api* |
| Disallow | /*.aspx$ |
| Disallow | /*.aspx* |
baiduspider-image
| Rule | Path |
|---|---|
| Disallow | / |
| Allow | /zh |
| Allow | /zh-hant |
| Disallow | /zh/*.aspx$ |
| Disallow | /zh-hant/*.aspx$ |
| Disallow | /*.aspx$ |
| Disallow | /*.aspx* |
youdaobot
| Rule | Path |
|---|---|
| Disallow | / |
| Allow | /zh |
| Allow | /zh-hant |
| Disallow | /zh/*.aspx$ |
| Disallow | /zh-hant/*.aspx$ |
| Disallow | /*.aspx$ |
| Disallow | /*.aspx* |
sogou web spider
| Rule | Path |
|---|---|
| Disallow | / |
| Allow | /zh |
| Allow | /zh-hant |
| Disallow | /zh/*.aspx$ |
| Disallow | /zh-hant/*.aspx$ |
| Disallow | /*.aspx$ |
| Disallow | /*.aspx* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
sogou inst spider
| Rule | Path |
|---|---|
| Disallow | / |
| Allow | /zh |
| Allow | /zh-hant |
| Disallow | /zh/*.aspx$ |
| Disallow | /zh-hant/*.aspx$ |
| Disallow | /*.aspx$ |
| Disallow | /*.aspx* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
sogou spider2
| Rule | Path |
|---|---|
| Disallow | / |
| Allow | /zh |
| Allow | /zh-hant |
| Disallow | /zh/*.aspx$ |
| Disallow | /zh-hant/*.aspx$ |
| Disallow | /*.aspx$ |
| Disallow | /*.aspx* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |