modlily.com
robots.txt

Robots Exclusion Standard data for modlily.com

Resource Scan

Scan Details

Site Domain modlily.com
Base Domain modlily.com
Scan Status Ok
Last Scan2024-05-24T10:37:12+00:00
Next Scan 2024-06-07T10:37:12+00:00

Last Scan

Scanned2024-05-24T10:37:12+00:00
URL https://www.modlily.com/robots.txt
Domain IPs 118.215.98.161
Response IP 23.50.21.193
Found Yes
Hash 691bb2b239183165e8c350b41d33e2d476d420ae7b2c327b122aa0594f72253c
SimHash 7e0659a8bdaa

Groups

baiduspider

Rule Path
Disallow /

sogou web spider/4.0

Rule Path
Disallow /

sogou inst spider/4.0

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /?&currency=
Disallow /affiche.php
Disallow /captcha.php
Disallow /comment.php
Disallow /cycle_image.php
Disallow /goods_script.php
Disallow /receive.php
Disallow /region.php
Disallow /respond.php
Disallow /feed.php
Disallow /gallery.php
Disallow /?u
Disallow /*?u=
Disallow /*-shop_price-ASC.html
Disallow /*-shop_price-DESC.html
Disallow /*?id=
Disallow /*lkid%3D*
Disallow /*-page_size36*
Disallow /*-page_size48*
Disallow /*-max20*
Disallow /*-max30*
Disallow /*-max40*
Disallow /*-max50*
Disallow /*-max100*
Disallow /*-shipin24hrs*
Disallow /*-attr*
Disallow /xs-*
Disallow /s-*
Disallow /m-*
Disallow /l-*
Disallow /xl-*
Disallow /xxl-*
Disallow /xxxl-*
Disallow /0xl-*
Disallow /1xl-*
Disallow /2xl-*
Disallow /3xl-*
Disallow /4xl-*
Disallow /5xl-*
Disallow /8-*
Disallow /10-*
Disallow /12-*
Disallow /14-*
Disallow /16-*
Disallow /18-*
Disallow /20-*
Disallow /*-start-*-e.html
Disallow /*-onsales.html
Disallow /*%2B*

Other Records

Field Value
sitemap https://www.modlily.com/sitemap-index.xml