valueyourmusic.com
robots.txt
Robots Exclusion Standard data for valueyourmusic.com
Resource Scan
Scan Details
| Site Domain | valueyourmusic.com |
| Base Domain | valueyourmusic.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T23:15:46+00:00 |
| Next Scan | 2024-11-22T23:15:46+00:00 |
Last Scan
| Scanned | 2024-11-15T23:15:46+00:00 |
| URL | https://valueyourmusic.com/robots.txt |
| Redirect | https://www.valueyourmusic.com/robots.txt |
| Redirect Domain | www.valueyourmusic.com |
| Redirect Base | valueyourmusic.com |
| Domain IPs | 104.21.66.71, 172.67.168.16, 2606:4700:3030::ac43:a810, 2606:4700:3035::6815:4247 |
| Redirect IPs | 104.21.66.71, 172.67.168.16, 2606:4700:3030::ac43:a810, 2606:4700:3035::6815:4247 |
| Response IP | 104.21.66.71 |
| Found | Yes |
| Hash | 407f3951e023af58028b261ea2acda90ca477976fc647289c597fe4e460dcb41 |
| SimHash | cb1cc0447f9b |
Groups
ahrefsbot
alphabot
blexbot
bubing
barkrowler
clickagy intelligence bot v2
cliqzbot
domainappender
domaincrawler
dotbot
mj12bot
mauibot
megaindex.ru/2.0
smtbot
seekport crawler
semrushbot
semrushbot-sa
siteexplorer
velenpublicwebcrawler
archive.org_bot
musobot
panscient.com
proximic
spbot
gptbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /items/54321012345 |
| Disallow | /upgrade/* |
| Disallow | /announcements |
| Disallow | /accuracy |
| Disallow | /users |
| Disallow | /cdn-cgi |
| Disallow | /mobile |
| Disallow | /*?*q= |
| Disallow | /*?*currency= |
| Disallow | /*?from= |
| Disallow | /*%26from%3D |
| Disallow | /search |
| Disallow | /advancedsearch |
| Disallow | /?ref= |
| Disallow | /*?*sort=bids |
| Disallow | /*?*price_from= |
| Disallow | /*?*price_to= |
| Disallow | /items/*/report |
| Disallow | /*?*condition= |
| Disallow | /*?*seller_id= |
| Disallow | /*?*currency= |
| Disallow | /items*?*last_month= |
| Disallow | /items*?*last_week= |
| Disallow | /top*?*page= |
| Disallow | /items*?fmt=award |
| Disallow | /items/*/images/ |
| Disallow | /memorabilia-items/*/report |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 300 |
mediapartners-google
| Rule | Path |
|---|---|
| Allow | /items/*/images/ |
| Disallow | /items/54321012345 |
| Disallow | /upgrade/* |
| Disallow | /announcements |
| Disallow | /accuracy |
| Disallow | /users |
| Disallow | /cdn-cgi |
| Disallow | /mobile |
| Disallow | /search |
| Disallow | /advancedsearch |
| Disallow | /*?*sort=bids |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
grapeshot
| Rule | Path |
|---|---|
| Allow | /items/*/images/ |
| Disallow | /items/54321012345 |
| Disallow | /upgrade/* |
| Disallow | /announcements |
| Disallow | /accuracy |
| Disallow | /users |
| Disallow | /cdn-cgi |
| Disallow | /mobile |
| Disallow | /search |
| Disallow | /advancedsearch |
| Disallow | /*?*sort=bids |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /items/54321012345 |
| Disallow | /announcements |
| Disallow | /accuracy |
| Disallow | /users |
| Disallow | /cdn-cgi |
| Disallow | /mobile |
| Disallow | /*?*q= |
| Disallow | /search |
| Disallow | /advancedsearch |
| Disallow | /?ref= |
| Disallow | /items/*/report |
| Disallow | /*?*sort=bids |
| Disallow | /*?from= |
| Disallow | /*%26from%3D |
| Disallow | /*?*condition= |
| Disallow | /*?*seller_id= |
| Disallow | /*?*currency= |
| Disallow | /*?*price_from= |
| Disallow | /*?*price_to= |
| Disallow | /items*?*last_month= |
| Disallow | /items*?*last_week= |
| Disallow | /top*?*page= |
| Disallow | /items*?fmt=award |
| Disallow | /items/*/images/ |
| Disallow | /memorabilia-items/*/report |
bingbot
| Rule | Path |
|---|---|
| Disallow | /items/54321012345 |
| Disallow | /upgrade/* |
| Disallow | /announcements |
| Disallow | /accuracy |
| Disallow | /users |
| Disallow | /cdn-cgi |
| Disallow | /mobile |
| Disallow | /*?*q= |
| Disallow | /search |
| Disallow | /advancedsearch |
| Disallow | /?ref= |
| Disallow | /items/*/report |
| Disallow | /*?*sort=bids |
| Disallow | /*?from= |
| Disallow | /*%26from%3D |
| Disallow | /*?*condition= |
| Disallow | /*?*currency= |
| Disallow | /*?*price_from= |
| Disallow | /*?*price_to= |
| Disallow | /items*?*last_month= |
| Disallow | /items*?*last_week= |
| Disallow | /top*?*page= |
| Disallow | /items*?fmt=award |
| Disallow | /items/*/images/ |
| Disallow | /fake |
| Disallow | /memorabilia-items/*/report |
ask jeeves
| Rule | Path |
|---|---|
| Disallow | /items/54321012345 |
| Disallow | /upgrade/* |
| Disallow | /announcements |
| Disallow | /accuracy |
| Disallow | /users |
| Disallow | /cdn-cgi |
| Disallow | /mobile |
| Disallow | /*?*q= |
| Disallow | /search |
| Disallow | /advancedsearch |
| Disallow | /?ref= |
| Disallow | /items/*/report |
| Disallow | /*?*sort=bids |
| Disallow | /*?from= |
| Disallow | /*%26from%3D |
| Disallow | /*?*condition= |
| Disallow | /*?*seller_id= |
| Disallow | /*?*currency= |
| Disallow | /*?*price_from= |
| Disallow | /*?*price_to= |
| Disallow | /items*?*last_month= |
| Disallow | /items*?*last_week= |
| Disallow | /top*?*page= |
| Disallow | /items*?fmt=award |
| Disallow | /items/*/images/ |
| Disallow | /fake |
| Disallow | /memorabilia-items/*/report |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 6 |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /items/54321012345 |
| Disallow | /upgrade/* |
| Disallow | /announcements |
| Disallow | /accuracy |
| Disallow | /users |
| Disallow | /cdn-cgi |
| Disallow | /mobile |
| Disallow | /*?*q= |
| Disallow | /search |
| Disallow | /advancedsearch |
| Disallow | /?ref= |
| Disallow | /items/*/report |
| Disallow | /*?*sort=bids |
| Disallow | /*?from= |
| Disallow | /*%26from%3D |
| Disallow | /*?*condition= |
| Disallow | /*?*seller_id= |
| Disallow | /*?*currency= |
| Disallow | /*?*price_from= |
| Disallow | /*?*price_to= |
| Disallow | /items*?*last_month= |
| Disallow | /items*?*last_week= |
| Disallow | /top*?*page= |
| Disallow | /items*?fmt=award |
| Disallow | /items/*/images/ |
| Disallow | /fake |
| Disallow | /memorabilia-items/*/report |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 6 |
yandexbot
| Rule | Path |
|---|---|
| Disallow | /items/54321012345 |
| Disallow | /upgrade/* |
| Disallow | /announcements |
| Disallow | /accuracy |
| Disallow | /users |
| Disallow | /cdn-cgi |
| Disallow | /mobile |
| Disallow | /*?*q= |
| Disallow | /search |
| Disallow | /advancedsearch |
| Disallow | /?ref= |
| Disallow | /items/*/report |
| Disallow | /*?*sort=bids |
| Disallow | /*?from= |
| Disallow | /*%26from%3D |
| Disallow | /*?*condition= |
| Disallow | /*?*seller_id= |
| Disallow | /*?*currency= |
| Disallow | /*?*price_from= |
| Disallow | /*?*price_to= |
| Disallow | /items*?*last_month= |
| Disallow | /items*?*last_week= |
| Disallow | /top*?*page= |
| Disallow | /items*?fmt=award |
| Disallow | /items/*/images/ |
| Disallow | /fake |
| Disallow | /memorabilia-items/*/report |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 6 |
sogou
| Rule | Path |
|---|---|
| Disallow | /items/54321012345 |
| Disallow | /upgrade/* |
| Disallow | /announcements |
| Disallow | /accuracy |
| Disallow | /users |
| Disallow | /cdn-cgi |
| Disallow | /mobile |
| Disallow | /*?*q= |
| Disallow | /search |
| Disallow | /advancedsearch |
| Disallow | /?ref= |
| Disallow | /items/*/report |
| Disallow | /*?*sort=bids |
| Disallow | /*?from= |
| Disallow | /*%26from%3D |
| Disallow | /*?*condition= |
| Disallow | /*?*seller_id= |
| Disallow | /*?*currency= |
| Disallow | /*?*price_from= |
| Disallow | /*?*price_to= |
| Disallow | /items*?*last_month= |
| Disallow | /items*?*last_week= |
| Disallow | /top*?*page= |
| Disallow | /items*?fmt=award |
| Disallow | /items/*/images/ |
| Disallow | /fake |
| Disallow | /memorabilia-items/*/report |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 6 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.valueyourmusic.com/sitemaps/sitemap.xml.gz |
| sitemap | http://www.valueyourmusic.com/sitemaps/sitemap.xml.gz |
| sitemap | http://www.valueyourmusic.com/sitemaps/sitemap.xml.gz |