m.videdressing.com
robots.txt

Robots Exclusion Standard data for m.videdressing.com

Resource Scan

Scan Details

Site Domain m.videdressing.com
Base Domain videdressing.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-19T09:08:41+00:00
Next Scan 2025-01-17T09:08:41+00:00

Last Successful Scan

Scanned2023-06-20T10:34:49+00:00
URL https://m.videdressing.com/robots.txt
Domain IPs 141.95.121.163, 162.19.129.101, 2001:41d0:700:6598::80, 2001:41d0:700:6599::80, 212.82.233.130, 212.82.233.140, 2a00:1798:6:10::80, 2a00:1798:6:10::90
Response IP 162.19.129.101
Found Yes
Hash 65dfa5e97710af2053ccc727c47478b04e42435004e0a4a7988e70d713734977
SimHash 761ddb52c413

Groups

*

Rule Path
Disallow /cart/
Disallow /wishlist/
Disallow /taxonomy/
Disallow /*.swf$
Disallow /redirect/
Disallow /recherche/
Disallow /search/
Disallow /suche/
Disallow /ricerca/
Disallow /user/
Disallow /catalog/
Disallow /translate/
Disallow /individual/
Allow /ajax/b-b38602.html
Disallow /ajax/
Disallow /marque-inconnue/
Disallow /menu/
Disallow /recherche.html
Disallow /search.html
Disallow /suche.html
Disallow /ricerca.html
Disallow /category-name/
Disallow /mon-compte/
Disallow /mon-dressing/
Disallow /advanced-search/
Disallow /ticket/contactform/
Disallow /menu/get-deeplink-url.html
Allow /user/sell.html
Disallow *utm_source
Disallow *utm_medium
Disallow *utm_campaign
Disallow *utm_content
Disallow *al-ha
Disallow *al-iu

adsbot-google

Rule Path
Allow /redirect/
Disallow /cart/

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

spbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /