myratna.com
robots.txt

Robots Exclusion Standard data for myratna.com

Resource Scan

Scan Details

Site Domain myratna.com
Base Domain myratna.com
Scan Status Ok
Last Scan2025-07-22T00:52:13+00:00
Next Scan 2025-08-21T00:52:13+00:00

Last Scan

Scanned2025-07-22T00:52:13+00:00
URL https://myratna.com/robots.txt
Domain IPs 104.21.49.233, 172.67.195.144, 2606:4700:3030::ac43:c390, 2606:4700:3033::6815:31e9
Response IP 172.67.195.144
Found Yes
Hash d013a5c1c1810bc30eec7b8030102d9bce7050958cded3259746f57d00ba34bc
SimHash bd447046ccc5

Groups

*

Rule Path
Disallow /admin/
Disallow /uploads/*
Disallow /cart.html
Disallow /checkout.html
Disallow /*?sortType=1
Disallow /*?sortType=2
Disallow /*?sortType=3
Disallow /*?sortType=4
Disallow /*?cpmin=*
Disallow /*?cpmax=*
Disallow /*?page=*
Disallow /*?cwmin=*
Disallow /*?cwmax=*
Disallow /*?origin=*
Disallow /*?s=*
Disallow /*?utm_source=*
Disallow /*?utm_medium=*
Disallow /*?utm_campaign=*
Disallow /*?cat=*
Disallow /*?embed=*
Disallow /*blog/*/page/*
Disallow /*gemstone-cat/*
Disallow /*weight/*
Disallow /*origin/*
Disallow /*quality/*
Disallow /*shape/*
Disallow /uploads/pdf/*
Disallow /?currency=
Disallow /?sortType=
Disallow /?pmin=
Disallow /?pmax=
Disallow /?rwmin=
Disallow /?rwmax=
Disallow /?origins=
Disallow /?quality=
Disallow /?shape=
Disallow /?cutting_style=
Disallow /?dimensions=
Disallow /?certification=
Disallow /?metal=

scrapy
teleport
teleportpro
emailcollector
emailsiphon
webbandit
webzip
webreaper
webstripper
web downloader
webcopier
offline explorer pro
httrack website copier
offline commander
leech
websnake
blackwidow
http weazel
extreme picture finder
omniexplorer_bot
freefind
becomebot
nutch
jetbot/1.0
jetbot
webvac
naver
dumbot
hatena antenna
grub-client
grub
larbin
b2w/0.1
copernic
psbot
python-urllib
netmechanic
url_spider_pro
cherrypicker

Rule Path
Disallow /

Other Records

Field Value
sitemap https://myratna.com/sitemap.xml

Comments

  • Robots User-agent Disallow