mush.style
robots.txt

Robots Exclusion Standard data for mush.style

Resource Scan

Scan Details

Site Domain mush.style
Base Domain mush.style
Scan Status Ok
Last Scan2025-11-02T18:00:50+00:00
Next Scan 2025-11-16T18:00:50+00:00

Last Scan

Scanned2025-11-02T18:00:50+00:00
URL https://mush.style/robots.txt
Redirect https://www.mush.style/robots.txt
Redirect Domain www.mush.style
Redirect Base mush.style
Domain IPs 104.21.52.200, 172.67.203.95, 2606:4700:3032::ac43:cb5f, 2606:4700:3035::6815:34c8
Redirect IPs 104.21.52.200, 172.67.203.95, 2606:4700:3032::ac43:cb5f, 2606:4700:3035::6815:34c8
Response IP 104.21.52.200
Found Yes
Hash c4cf2d2f7395ffbd75b90771c7b95ac8401515e7001f305bac56abcde482664a
SimHash 78a0fcd9e404

Groups

*

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /
Allow /en/
Allow /uk/
Allow /ru/
Allow /about
Allow /features
Allow /pricing
Allow /faq
Allow /partners
Allow /reviews
Allow /for-stylists
Allow /for-clients
Allow /for-brands
Allow /services/
Allow /leskizzo/
Allow /affiliate-fashion/
Allow /digital-wardrobe/
Allow /ai-styling/
Allow /stylist-tools/
Disallow /admin/
Disallow /api/
Disallow /account/register-stylist/
Disallow /account/register-client/
Disallow /account/stylist-*/
Disallow /ai/
Disallow /calendar/
Disallow /chat/
Disallow /dashboard/
Disallow /data/
Disallow /favorites/
Disallow /invite/
Disallow /payment/
Disallow /profile/
Disallow /school-profile/
Disallow /search/
Disallow /style-quiz/
Disallow /stylists/
Disallow /support-and-legal/
Disallow /telegram/
Disallow /wardrobe/
Disallow /wayforpay-redirect/
Disallow /add/
Disallow /403/
Disallow /404/
Disallow /500/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://mush.style/sitemap.xml

Comments

  • Robots.txt for MUSH - AI Fashion Platform
  • https://mush.style
  • OpenAI ChatGPT crawler
  • ChatGPT User Agent
  • GPTBot (OpenAI's web crawler)
  • Allow indexing of all public pages
  • Block admin and backend pages
  • Block error pages
  • Sitemap location
  • Crawl-delay for respectful crawling