dresslily.com
robots.txt

Robots Exclusion Standard data for dresslily.com

Resource Scan

Scan Details

Site Domain dresslily.com
Base Domain dresslily.com
Scan Status Ok
Last Scan2024-05-29T04:29:24+00:00
Next Scan 2024-06-05T04:29:24+00:00

Last Scan

Scanned2024-05-29T04:29:24+00:00
URL https://dresslily.com/robots.txt
Redirect https://www.dresslily.com:443/robots.txt
Redirect Domain www.dresslily.com
Redirect Base dresslily.com
Domain IPs 107.21.53.120, 3.232.192.166, 54.80.91.56
Redirect IPs 13.225.4.117, 13.225.4.24, 13.225.4.88, 13.225.4.9
Response IP 13.225.4.117
Found Yes
Hash 3bde38a598a7b63841ba9feba2b279c7862b4788d1233cb4cd960940ac73f48f
SimHash f9489a44e397

Groups

petalbot
claudebot
sogou web spider
sogou wap spider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

*

Rule Path
Disallow /fun/?act=info_check&action=*
Disallow /fun/?act=verify$
Disallow /fun/?act=view_get_review_img&_=*
Disallow /fun/index.php?act=*
Disallow /page_not_found$
Disallow /m-review-a-write_inquiry-goods_id-*
Disallow /m-review-a-write_review-goods_id-*
Disallow /m-review_media-a-view_image-goods_id-*
Disallow /m-review-a-view_review-goods_id-*
Disallow /temp/skin3/
Disallow /*/init/jquery
Disallow /reviews_list.html?gid=*
Disallow /reviews/
Disallow /local.html$
Disallow /*~*/tag/*/*-c-*.html
Disallow /fun/
Disallow /*/*promotion-mega-sale-home-topic-138.html
Disallow /*/*promotion-mega-sale-home-topic-138-page-*

pinterestbot

Rule Path
Disallow /fun/?act=info_check&action=*
Disallow /fun/?act=verify$
Disallow /fun/?act=view_get_review_img&_=*
Disallow /fun/index.php?act=*
Disallow /page_not_found$
Disallow /m-review-a-write_inquiry-goods_id-*
Disallow /m-review-a-write_review-goods_id-*
Disallow /m-review_media-a-view_image-goods_id-*
Disallow /m-review-a-view_review-goods_id-*
Disallow /temp/skin3/
Disallow /*/init/jquery
Disallow /reviews_list.html?gid=*
Disallow /reviews/
Disallow /local.html$
Disallow /*~*/tag/*/*-c-*.html
Disallow /fun/

Other Records

Field Value
crawl-delay 1

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dresslily.com/sitemap/keywords-index.xml
sitemap https://www.dresslily.com/sitemap/category-sitemap.xml
sitemap https://www.dresslily.com/sitemap/products-sitemap.xml
sitemap https://www.dresslily.com/sitemap/images-sitemap.xml
sitemap https://www.dresslily.com/sitemap/products-new-sitemap.xml
sitemap https://www.dresslily.com/sitemap/images-new-sitemap.xml

Comments

  • SEO_sitemap
  • SEO_platform