dmtcartsrl.com
robots.txt

Robots Exclusion Standard data for dmtcartsrl.com

Resource Scan

Scan Details

Site Domain dmtcartsrl.com
Base Domain dmtcartsrl.com
Scan Status Ok
Last Scan2025-11-28T17:34:40+00:00
Next Scan 2025-12-12T17:34:40+00:00

Last Scan

Scanned2025-11-28T17:34:40+00:00
URL https://dmtcartsrl.com/robots.txt
Redirect https://www.dmtcartsrl.com/robots.txt
Redirect Domain www.dmtcartsrl.com
Redirect Base dmtcartsrl.com
Domain IPs 20.71.148.147
Redirect IPs 20.71.148.147
Response IP 20.71.148.147
Found Yes
Hash d2c97405b36099b717e04232b15405179a36c1a0b23476f34d0594f04c4b99c7
SimHash 714dc849ea3a

Groups

*

Rule Path
Disallow *SearchParameter%3D*
Disallow *PageNumber%3D
Disallow /WFS/*/*/-/viewdata
Disallow /INTERSHOP/
Disallow /online/web/WFS/*/*/-/
Disallow /online/web/BOS/*/*/-/
Disallow /online/web/WFX/*/*/-/
Allow /online/web/WFX/*/it_IT/-/EUR/ViewUserAccount-ShowLogin
Allow /WFX/*/it_IT/-/EUR/ViewUserAccount-ShowLogin
Allow /online/web/WFS/*/it_IT/-/EUR/ViewUserAccount-ShowLogin
Allow /WFS/*/it_IT/-/EUR/ViewUserAccount-ShowLogin

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-desktop

Rule Path
Disallow /

semrushbot-mobile

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 335

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

istellabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 45

semrushbot

Rule Path
Disallow /

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

facebookexternalhit

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

meta-externalagent

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dmtcartsrl.com/sitemap-store

Comments

  • Stop for filtered pages
  • Stop for paging pages
  • Stop for checkout urls
  • Stop for standard IS Url
  • Stop for not rewrited url
  • Stop for backoffice urls
  • Stop for not rewrited url