magicstory.com
robots.txt
Robots Exclusion Standard data for magicstory.com
Resource Scan
Scan Details
| Site Domain | magicstory.com |
| Base Domain | magicstory.com |
| Scan Status | Ok |
| Last Scan | 2025-12-15T03:10:32+00:00 |
| Next Scan | 2025-12-29T03:10:32+00:00 |
Last Scan
| Scanned | 2025-12-15T03:10:32+00:00 |
| URL | https://magicstory.com/robots.txt |
| Redirect | https://www.magicstory.com/robots.txt |
| Redirect Domain | www.magicstory.com |
| Redirect Base | magicstory.com |
| Domain IPs | 216.150.1.1 |
| Redirect IPs | 216.150.1.1, 216.150.16.1 |
| Response IP | 216.150.1.129 |
| Found | Yes |
| Hash | 550be7211dcc27a4a61cfda7f4de834cc38be4618c1c123a85db90129c646942 |
| SimHash | 6b1ab8f76702 |
Groups
gptbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
oai-searchbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
chatgpt-user
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
perplexitybot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
claudebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
claude-web
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
ccbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
google-extended
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
cohere-ai
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
amazonbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot-image
| Rule | Path |
|---|---|
| Allow | /*.jpg$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
| Allow | /*.png$ |
| Allow | /*.webp$ |
| Allow | /*.svg$ |
| Allow | /opengraph-image.png$ |
| Allow | /products/*/images/* |
| Allow | /collections/*/images/* |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Disallow | /private/*.jpg$ |
| Disallow | /admin/*.jpg$ |
| Disallow | /draft/*.jpg$ |
| Disallow | /preview/*.jpg$ |
| Disallow | /temp/*.jpg$ |
| Disallow | /beta/*.jpg$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot-mobile
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
adsbot-google
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot
| Rule | Path |
|---|---|
| Allow | /en-US/* |
| Allow | /sitemap.xml |
| Allow | /en-US/articles/* |
| Allow | /en-US/categories/* |
| Allow | /en-US/images/* |
| Allow | /en-US/public/* |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /internal/* |
| Disallow | /admin/* |
| Disallow | /draft/* |
| Disallow | /preview/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*?* |
| Disallow | /en-US/drafts/* |
| Disallow | /en-US/unpublished/* |
| Disallow | /en-US/admin/* |
| Disallow | /en-US/internal/* |
| Disallow | /en-US/preview/* |
| Disallow | /en-US/maintenance/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
bingbot
| Rule | Path |
|---|---|
| Allow | /en-US/* |
| Allow | /sitemap.xml |
| Allow | /en-US/articles/* |
| Allow | /en-US/categories/* |
| Allow | /en-US/images/* |
| Allow | /en-US/public/* |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /internal/* |
| Disallow | /admin/* |
| Disallow | /draft/* |
| Disallow | /preview/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*?* |
| Disallow | /en-US/drafts/* |
| Disallow | /en-US/unpublished/* |
| Disallow | /en-US/admin/* |
| Disallow | /en-US/internal/* |
| Disallow | /en-US/preview/* |
| Disallow | /en-US/maintenance/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
slurp
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
slurp
| Rule | Path |
|---|---|
| Allow | /en-US/* |
| Allow | /sitemap.xml |
| Allow | /en-US/articles/* |
| Allow | /en-US/categories/* |
| Allow | /en-US/images/* |
| Allow | /en-US/public/* |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /internal/* |
| Disallow | /admin/* |
| Disallow | /draft/* |
| Disallow | /preview/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*?* |
| Disallow | /en-US/drafts/* |
| Disallow | /en-US/unpublished/* |
| Disallow | /en-US/admin/* |
| Disallow | /en-US/internal/* |
| Disallow | /en-US/preview/* |
| Disallow | /en-US/maintenance/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
duckduckbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
duckduckbot
| Rule | Path |
|---|---|
| Allow | /en-US/* |
| Allow | /sitemap.xml |
| Allow | /en-US/articles/* |
| Allow | /en-US/categories/* |
| Allow | /en-US/images/* |
| Allow | /en-US/public/* |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /internal/* |
| Disallow | /admin/* |
| Disallow | /draft/* |
| Disallow | /preview/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*?* |
| Disallow | /en-US/drafts/* |
| Disallow | /en-US/unpublished/* |
| Disallow | /en-US/admin/* |
| Disallow | /en-US/internal/* |
| Disallow | /en-US/preview/* |
| Disallow | /en-US/maintenance/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
yandex
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
yandex
| Rule | Path |
|---|---|
| Allow | /en-US/* |
| Allow | /sitemap.xml |
| Allow | /en-US/articles/* |
| Allow | /en-US/categories/* |
| Allow | /en-US/images/* |
| Allow | /en-US/public/* |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /internal/* |
| Disallow | /admin/* |
| Disallow | /draft/* |
| Disallow | /preview/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*?* |
| Disallow | /en-US/drafts/* |
| Disallow | /en-US/unpublished/* |
| Disallow | /en-US/admin/* |
| Disallow | /en-US/internal/* |
| Disallow | /en-US/preview/* |
| Disallow | /en-US/maintenance/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /products/* |
| Allow | /all/* |
| Allow | /plus/* |
| Allow | /sitemap.xml |
| Allow | /collections/* |
| Allow | /categories/* |
| Allow | /blog/* |
| Allow | /stories/* |
| Allow | /search/* |
| Allow | /products/*/images |
| Allow | /collections/*/images |
| Allow | /assets/images/* |
| Allow | /public/images/* |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /robots.txt |
| Allow | /sitemap*.xml |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Allow | /share/video/* |
| Allow | /costume-swap/* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /halloween-buttons-showcase |
| Disallow | /halloween-buttons-showcase/* |
| Disallow | /dashboard/* |
| Disallow | /account/* |
| Disallow | /auth/* |
| Disallow | /login |
| Disallow | /login/* |
| Disallow | /register |
| Disallow | /register/* |
| Disallow | /sign-in |
| Disallow | /sign-up |
| Disallow | /forgot-password |
| Disallow | /reset-password |
| Disallow | /verify-email |
| Disallow | /waitlist |
| Disallow | /checkout/* |
| Disallow | /cart/* |
| Disallow | /create-story |
| Disallow | /create-story/* |
| Disallow | /onboarding |
| Disallow | /onboarding/* |
| Disallow | /library/* |
| Disallow | /my-world/* |
| Disallow | /admin/* |
| Disallow | /private/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /experimental/* |
| Disallow | /thank-you |
| Disallow | /success |
| Disallow | /error |
| Disallow | /preview/* |
| Disallow | /draft/* |
| Disallow | /main/* |
| Disallow | /php/* |
| Disallow | /phpmyadmin/* |
| Disallow | /wp* |
| Disallow | /wordpress/* |
| Disallow | /assets/downloads/* |
| Disallow | /cdn-cgi/* |
| Disallow | /webpack-runtime-* |
| Disallow | /search$ |
| Disallow | /search/$ |
| Disallow | /search?* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*.config.js |
| Disallow | /*.config.ts |
| Disallow | /*.jsx |
| Disallow | /*.tsx |
| Disallow | /*.ts |
| Disallow | /*.map |
| Disallow | /README.md |
| Disallow | /LICENSE |
| Disallow | /package.json |
| Disallow | /package-lock.json |
| Disallow | /yarn.lock |
| Disallow | /.prettierrc |
| Disallow | /.eslintrc |
| Disallow | /tsconfig.json |
| Disallow | /jest.config.* |
| Disallow | /*?q=* |
| Disallow | /*?filter=* |
| Disallow | /*?page=* |
| Disallow | /*?utm_* |
| Disallow | /*?ref=* |
| Disallow | /*?search=* |
| Disallow | /*?sort=* |
| Disallow | /*?tag=* |
| Disallow | /*?category=* |
| Disallow | /*?feature=* |
| Disallow | /*?session=* |
| Disallow | /*?redirectTo=* |
| Disallow | /*?auth=* |
| Disallow | /*?token=* |
| Disallow | /*?password* |
| Disallow | /*?email* |
| Disallow | /icon* |
| Disallow | /apple-icon* |
| Disallow | /manifest* |
| Disallow | /opengraph-image* |
| Disallow | /experimental/* |
| Disallow | /beta/* |
| Disallow | /test/* |
| Disallow | /dev/* |
| Disallow | /staging/* |
| Disallow | /sandbox/* |
| Disallow | /*?debug=* |
| Disallow | /*?maintenance=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
*
| Rule | Path |
|---|---|
| Allow | /en-US/* |
| Allow | /sitemap.xml |
| Allow | /en-US/articles/* |
| Allow | /en-US/categories/* |
| Allow | /en-US/images/* |
| Allow | /en-US/public/* |
| Allow | /_next/static/ |
| Allow | /_next/image?url=* |
| Disallow | /_next/* |
| Disallow | /next/* |
| Disallow | /.next/* |
| Disallow | /api/* |
| Disallow | /server-sitemap.xml/* |
| Disallow | /_errors/* |
| Disallow | /_middleware/* |
| Disallow | /build-manifest.json |
| Disallow | /react-loadable-manifest.json |
| Disallow | /app-build-manifest.json |
| Disallow | /.env* |
| Disallow | /.git* |
| Disallow | /node_modules/* |
| Disallow | /internal/* |
| Disallow | /admin/* |
| Disallow | /draft/* |
| Disallow | /preview/* |
| Disallow | /temp/* |
| Disallow | /test/* |
| Disallow | /beta/* |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*?* |
| Disallow | /en-US/drafts/* |
| Disallow | /en-US/unpublished/* |
| Disallow | /en-US/admin/* |
| Disallow | /en-US/internal/* |
| Disallow | /en-US/preview/* |
| Disallow | /en-US/maintenance/* |
| Disallow | /experimental/* |
| Disallow | /beta/* |
| Disallow | /test/* |
| Disallow | /dev/* |
| Disallow | /staging/* |
| Disallow | /sandbox/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.magicstory.com/sitemap.xml |
Warnings
- `host` is not a known field.