utsavfashion.com
robots.txt

Robots Exclusion Standard data for utsavfashion.com

Resource Scan

Scan Details

Site Domain utsavfashion.com
Base Domain utsavfashion.com
Scan Status Ok
Last Scan2024-05-10T16:44:13+00:00
Next Scan 2024-05-24T16:44:13+00:00

Last Scan

Scanned2024-05-10T16:44:13+00:00
URL https://utsavfashion.com/robots.txt
Redirect https://www.utsavfashion.com/robots.txt
Redirect Domain www.utsavfashion.com
Redirect Base utsavfashion.com
Domain IPs 34.237.116.127, 44.215.253.106
Redirect IPs 13.35.18.107, 13.35.18.12, 13.35.18.68, 13.35.18.69
Response IP 13.35.18.68
Found Yes
Hash 72fce53dba22c54c439cb73186dddfd54ef7674a30fb3a0dfdc765079bb01d06
SimHash 33a56a92df33

Groups

*

Rule Path
Disallow /promotions
Disallow /*/*/*itemcode$
Disallow /*/*itemcode$
Disallow /*_*_*
Disallow /*multiselect
Disallow /concepts/*/
Disallow /plus-size/*
Disallow /usignature/*
Disallow /*gclid%3D
Disallow /*PageSpeed%3D
Disallow /*amp%
Disallow /*252525
Disallow /theme
Disallow /catalogsearch
Disallow /directory
Disallow /wishlist*
Disallow /customer/*
Disallow /media*
Disallow /*nosto%3D
Disallow /*sitelink%3D
Disallow /*dir%3D
Disallow /mmtimers
Disallow /newsletterpopup
Disallow /captcha/refresh
Disallow /islamic-wear/abayas*
Disallow /islamic-wear/kaftans*
Disallow /islamic-wear/hijab*
Disallow /abayas*
Disallow /kaftans*
Disallow /hijab*
Allow /*.jpg
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.xml

bingbot

Rule Path
Disallow /promotions
Disallow /*/*/*itemcode$
Disallow /*/*itemcode$
Disallow /*_*_*
Disallow /*multiselect
Disallow /concepts/*/
Disallow /plus-size/*
Disallow /usignature/*
Disallow /*gclid%3D
Disallow /*PageSpeed%3D
Disallow /*amp%
Disallow /*252525
Disallow /theme
Disallow /catalogsearch
Disallow /directory
Disallow /wishlist*
Disallow /customer/*
Disallow /media*
Disallow /*nosto%3D
Disallow /*sitelink%3D
Disallow /*dir%3D
Disallow /mmtimers
Disallow /newsletterpopup
Disallow /captcha/refresh
Disallow /islamic-wear/abayas*
Disallow /islamic-wear/kaftans*
Disallow /islamic-wear/hijab*
Disallow /abayas*
Disallow /kaftans*
Disallow /hijab*
Allow /*.jpg
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.xml

nostocrawlerbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.utsavfashion.com/sitemap.xml

Comments

  • Directory
  • Instructions for Bingbot
  • Allow all to Nosto crawler