it.bullion-rates.com
robots.txt

Robots Exclusion Standard data for it.bullion-rates.com

Resource Scan

Scan Details

Site Domain it.bullion-rates.com
Base Domain bullion-rates.com
Scan Status Ok
Last Scan2024-09-22T18:34:29+00:00
Next Scan 2024-10-22T18:34:29+00:00

Last Scan

Scanned2024-09-22T18:34:29+00:00
URL https://it.bullion-rates.com/robots.txt
Domain IPs 94.237.69.15
Response IP 94.237.69.15
Found Yes
Hash 769a1fd6ac2202f5b438cd1f89d2868ac6d320fed56b80954a82826736f46939
SimHash aa1c5d424e89

Groups

*

Rule Path
Disallow /*chart.png

semrushbot-sa
semrushbot
ahrefsbot
dotbot
blexbot
mauibot
mauibot (crawler.feedback+wc@gmail.com)
megaindex.ru/2.0
seekport crawler
sputnikbot/2.3
the knowledge ai
turnitinbot
ucbrowser
yacybot
yeti
seznambot
coccocbot-web

Rule Path
Disallow /

mj12bot
icc-crawler
grapeshot

Rule Path
Disallow /*chart.png

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://it.bullion-rates.com/sitemap_index.xml