de.bullion-rates.com
robots.txt

Robots Exclusion Standard data for de.bullion-rates.com

Resource Scan

Scan Details

Site Domain de.bullion-rates.com
Base Domain bullion-rates.com
Scan Status Ok
Last Scan2024-09-22T14:41:54+00:00
Next Scan 2024-10-22T14:41:54+00:00

Last Scan

Scanned2024-09-22T14:41:54+00:00
URL https://de.bullion-rates.com/robots.txt
Domain IPs 94.237.69.15
Response IP 94.237.69.15
Found Yes
Hash e4ace41a687efeed8a757c7fe1148ca02b3916023eb3785f6eb947355c7866e8
SimHash ea3c5d424e99

Groups

*

Rule Path
Disallow /*chart.png

semrushbot-sa
semrushbot
ahrefsbot
dotbot
blexbot
mauibot
mauibot (crawler.feedback+wc@gmail.com)
megaindex.ru/2.0
seekport crawler
sputnikbot/2.3
the knowledge ai
turnitinbot
ucbrowser
yacybot
yeti
seznambot
coccocbot-web

Rule Path
Disallow /

mj12bot
icc-crawler
grapeshot

Rule Path
Disallow /*chart.png

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://de.bullion-rates.com/sitemap_index.xml