videdressing.com
robots.txt

Robots Exclusion Standard data for videdressing.com

Resource Scan

Scan Details

Site Domain videdressing.com
Base Domain videdressing.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-25T02:01:59+00:00
Next Scan 2024-10-23T02:01:59+00:00

Last Successful Scan

Scanned2023-07-02T00:02:03+00:00
URL https://videdressing.com/robots.txt
Domain IPs 195.157.4.130, 195.157.4.140, 212.61.166.130, 212.61.166.140, 212.82.233.130, 212.82.233.140, 62.240.232.130, 62.240.232.140
Response IP 62.240.232.130
Found Yes
Hash e17b5b588d0bb28e06e4e8f6b30745221317ddee918fb81e58f7d368d6e52358
SimHash 721ddb5ac413

Groups

*

Rule Path
Disallow /cart/
Disallow /wishlist/
Disallow /taxonomy/
Disallow /*.swf$
Disallow /redirect/
Disallow /recherche/
Disallow /search/
Disallow /suche/
Disallow /ricerca/
Disallow /user/
Disallow /catalog/
Disallow /translate/
Disallow /individual/
Allow /ajax/b-b38602.html
Disallow /ajax/
Disallow /marque-inconnue/
Disallow /recherche.html
Disallow /search.html
Disallow /suche.html
Disallow /ricerca.html
Disallow /category-name/
Disallow /mon-compte/
Disallow /mon-dressing/
Disallow /advanced-search/
Disallow /ticket/contactform/
Disallow /menu/get-deeplink-url.html
Allow /user/sell.html
Disallow *utm_source
Disallow *utm_medium
Disallow *utm_campaign
Disallow *utm_content
Disallow *al-ha
Disallow *al-iu

adsbot-google

Rule Path
Allow /redirect/
Disallow /cart/

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

spbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /