dmarket.live
robots.txt

Robots Exclusion Standard data for dmarket.live

Resource Scan

Scan Details

Site Domain dmarket.live
Base Domain dmarket.live
Scan Status Ok
Last Scan4/6/2025, 10:01:23 PM
Next Scan 5/6/2025, 10:01:23 PM

Last Scan

Scanned4/6/2025, 10:01:23 PM
URL https://dmarket.live/robots.txt
Redirect https://dmarket.com/robots.txt
Redirect Domain dmarket.com
Redirect Base dmarket.com
Domain IPs 104.21.93.215, 172.67.215.78, 2606:4700:3030::6815:5dd7, 2606:4700:3032::ac43:d74e
Redirect IPs 45.223.19.16, 45.223.25.16
Response IP 45.223.19.16
Found Yes
Hash d07ae8bb5158ff919d6956a229524b7b28f81b017cb2877acc8c5c42daa1cfbc
SimHash 320573b5de7b

Groups

*

Rule Path
Disallow /*?
Disallow /*%26
Disallow /*%2C
Disallow /graphcms*
Disallow /cart
Disallow /user
Disallow /cache-stats
Disallow /zh
Disallow */ingame-items/item-list/csgo-skins?exterior=*%2C
Disallow */ingame-items/item-list/csgo-skins?family=*%2C
Disallow */ingame-items/item-list/csgo-skins?quality=*%2C
Disallow */ingame-items/item-list/csgo-skins?collection=*%2C
Disallow */ingame-items/item-list/csgo-skins?exterior=*&
Disallow */ingame-items/item-list/csgo-skins?family=*&
Disallow */ingame-items/item-list/csgo-skins?quality=*&
Disallow */ingame-items/item-list/csgo-skins?collection=*&
Disallow */zh/*product-card*?*=*
Allow /*gameId%3D
Allow /*v1/*
Allow /games/*
Allow *.css
Allow *.js
Allow /*?page=
Allow */ingame-items/item-list/csgo-skins?exterior=
Allow */ingame-items/item-list/csgo-skins?family=
Allow */ingame-items/item-list/csgo-skins?quality=
Allow */ingame-items/item-list/csgo-skins?collection=
Allow */ingame-items/item-list/csgo-skins?category_0=stattrak_tm$
Allow */ingame-items/item-list/csgo-skins?category_1=souvenir$
Allow */csgo-skins/product-card/*?category_0=stattrak_tm$
Allow */csgo-skins/product-card/*?category_1=souvenir$
Allow */csgo-skins/product-card/*?sort-type=5$
Allow */zh$
Allow */zh/*product-card/
Allow */zh/*/csgo-skins$
Allow */zh/*/dota2-skins$
Allow */zh/*/tf2-skins$
Allow */zh/*/rust-skins$

adsbot-google
adsbot-google-mobile
screaming frog seo spider
oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://dmarket.com/sitemap.xml