rotita.com
robots.txt

Robots Exclusion Standard data for rotita.com

Resource Scan

Scan Details

Site Domain rotita.com
Base Domain rotita.com
Scan Status Ok
Last Scan2024-10-29T05:54:51+00:00
Next Scan 2024-11-12T05:54:51+00:00

Last Scan

Scanned2024-10-29T05:54:51+00:00
URL https://www.rotita.com/robots.txt
Domain IPs 108.156.133.109, 108.156.133.117, 108.156.133.24, 108.156.133.94
Response IP 108.156.133.24
Found Yes
Hash 88c20b39d09644003721670d21372b4af790525aa5e02b030d8a8cd2b8dcdab4
SimHash 7e0659b8bdaa

Groups

baiduspider

Rule Path
Disallow /

sogou web spider/4.0

Rule Path
Disallow /

sogou inst spider/4.0

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /?&currency=
Disallow /affiche.php
Disallow /captcha.php
Disallow /comment.php
Disallow /cycle_image.php
Disallow /goods_script.php
Disallow /receive.php
Disallow /region.php
Disallow /respond.php
Disallow /feed.php
Disallow /gallery.php
Disallow /?u
Disallow /*?u=
Disallow /*-shop_price-ASC.html
Disallow /*-shop_price-DESC.html
Disallow /*?id=
Disallow /*lkid%3D*
Disallow /*-page_size36*
Disallow /*-page_size48*
Disallow /*-max20*
Disallow /*-max30*
Disallow /*-max40*
Disallow /*-max50*
Disallow /*-max100*
Disallow /*-shipin24hrs*
Disallow /*-attr*
Disallow /xs-*
Disallow /s-*
Disallow /m-*
Disallow /l-*
Disallow /xl-*
Disallow /xxl-*
Disallow /xxxl-*
Disallow /0xl-*
Disallow /1xl-*
Disallow /2xl-*
Disallow /3xl-*
Disallow /4xl-*
Disallow /5xl-*
Disallow /8-*
Disallow /10-*
Disallow /12-*
Disallow /14-*
Disallow /16-*
Disallow /18-*
Disallow /20-*
Disallow /*-start-*-e.html
Disallow /*-onsales.html
Disallow /*%2B*

Other Records

Field Value
sitemap http://www.rotita.com/sitemap-index.xml