styleblueprint.com
robots.txt

Robots Exclusion Standard data for styleblueprint.com

Resource Scan

Scan Details

Site Domain styleblueprint.com
Base Domain styleblueprint.com
Scan Status Ok
Last Scan2024-10-31T12:05:24+00:00
Next Scan 2024-11-07T12:05:24+00:00

Last Scan

Scanned2024-10-31T12:05:24+00:00
URL https://styleblueprint.com/robots.txt
Domain IPs 104.26.2.186, 104.26.3.186, 172.67.68.36, 2606:4700:20::681a:2ba, 2606:4700:20::681a:3ba, 2606:4700:20::ac43:4424
Response IP 104.26.3.186
Found Yes
Hash aeba707f518bef3372e6027dc2a4e24801c726ec349beaac7c328c0442b558fb
SimHash 52aad971c477

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-content/cache/
Disallow /wp-content/plugins/
Disallow /trackback/
Disallow /comments/
Disallow /*.pdf
Disallow /guide/
Disallow /wprm_print/*
Disallow /atlanta/guide/
Disallow /charlotte/guide/
Disallow /specialties/
Disallow /easyrecipe-print/
Disallow /readme.html
Disallow /refer/
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Disallow *post_type%3Dtribe_events*
Disallow *hide_subsequent_recurrences%3D*
Disallow *tribe-bar-date%3D*
Disallow *tribe-venue%3D*
Disallow *eventDisplay%3D*
Disallow *eventDate%3D*
Disallow *paged%3D*
Disallow *shortcode%3D*
Disallow *ical%3D*
Disallow /*?doing_wp_cron*
Disallow /*?cid*

googlebot

Rule Path
Allow /*.js
Allow /*.css*
Allow /wp-includes/*.js*
Allow /wp-content/plugins/*.js*
Allow /wp-content/themes/*.js*
Allow /wp-content/plugins/*.css*
Allow /wp-content/themes/*.css*
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /*.pdf
Disallow /guide/
Disallow /atlanta/guide/
Disallow /charlotte/guide/
Disallow */feed/
Disallow /easyrecipe-print/
Disallow *post_type%3Dtribe_events*
Disallow *hide_subsequent_recurrences%3D*
Disallow *tribe-bar-date%3D*
Disallow *tribe-venue%3D*
Disallow *eventDisplay%3D*
Disallow *eventDate%3D*
Disallow *paged%3D*
Disallow *shortcode%3D*
Disallow *ical%3D*
Disallow /*?doing_wp_cron*
Disallow /*?cid*

alexabot

Rule Path
Disallow /easyrecipe-print/

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

semrushbot-ba

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

smartnews

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

trendictionbot

Rule Path
Disallow /

muckrack

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

ttd-content

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

proximic

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://styleblueprint.com/sitemap_index.xml

Comments

  • robots.txt
  • User-agent: MJ12bot
  • Disallow: /
  • AI bot crawlers ChatGPT & Google Bard

Warnings

  • `noindex` is not a known field.