bullion-rates.com
robots.txt

Robots Exclusion Standard data for bullion-rates.com

Resource Scan

Scan Details

Site Domain bullion-rates.com
Base Domain bullion-rates.com
Scan Status Ok
Last Scan2024-09-24T11:59:19+00:00
Next Scan 2024-10-01T11:59:19+00:00

Last Scan

Scanned2024-09-24T11:59:19+00:00
URL https://bullion-rates.com/robots.txt
Domain IPs 94.237.69.15
Response IP 94.237.69.15
Found Yes
Hash fe5f5ff41bd9e591208dc0d34ed08c3f0afbec7eda7afb83aab76f9fd656a20b
SimHash aa1c4d424e81

Groups

*

Rule Path
Disallow /*chart.png

semrushbot-sa
semrushbot
ahrefsbot
dotbot
blexbot
mauibot
mauibot (crawler.feedback+wc@gmail.com)
megaindex.ru/2.0
seekport crawler
sputnikbot/2.3
the knowledge ai
turnitinbot
ucbrowser
yacybot
yeti
seznambot
coccocbot-web

Rule Path
Disallow /

mj12bot
icc-crawler
grapeshot

Rule Path
Disallow /*chart.png

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.bullion-rates.com/sitemap_index.xml