whatsizebro.com
robots.txt

Robots Exclusion Standard data for whatsizebro.com

Resource Scan

Scan Details

Site Domain whatsizebro.com
Base Domain whatsizebro.com
Scan Status Ok
Last Scan2025-10-10T21:35:58+00:00
Next Scan 2025-10-17T21:35:58+00:00

Last Scan

Scanned2025-10-10T21:35:58+00:00
URL https://whatsizebro.com/robots.txt
Domain IPs 104.21.48.4, 172.67.175.38, 2606:4700:3034::ac43:af26, 2606:4700:3036::6815:3004
Response IP 172.67.175.38
Found Yes
Hash c954f041d2178e32b1c006676f28deaad07f491aaff5409af882763891e565e1
SimHash 2a0c480aacfb

Groups

*

Rule Path
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search/
Disallow /?s=
Disallow /*?*
Disallow /?
Disallow /search?
Disallow /*?p=*
Disallow /*?preview=*
Disallow /*?attachment_id=*
Disallow /author/
Disallow /date/
Disallow /*/date/
Disallow /*/author/
Disallow /feed/
Disallow /*/feed/
Disallow /comments/feed/
Disallow /trackback/
Disallow /*.rss$
Disallow /*.rdf$
Disallow /*.atom$
Disallow /feed
Disallow /rss
Disallow /rdf
Disallow /atom
Disallow /category/
Disallow /tag/
Disallow /*/category/
Disallow /*/tag/
Disallow /page/
Disallow /*/page/
Disallow /comment-page-*
Disallow /detroitchicago/
Disallow /porpoiseant/
Disallow /beardeddragon/
Disallow /tardisrocinante/
Disallow /parsonsmaize/
Disallow /edomontonalberta/
Disallow /ezais/
Disallow /*.php$
Disallow /*.js$
Disallow /*.css$
Disallow /*.inc$
Disallow /*.cgi$
Disallow /*.wmv$
Disallow /*.avi$
Disallow /*.mpg$
Disallow /*.mp4$
Disallow /*.mp3$
Disallow /*.pdf$
Disallow /*.doc$
Disallow /*.docx$
Disallow /*.xls$
Disallow /*.xlsx$
Disallow /*.zip$
Disallow /*.rar$
Disallow /wp-config.php
Disallow /readme.html
Disallow /license.txt
Disallow /wp-comments-post.php
Disallow /wp-cron.php
Disallow /wp-mail.php
Disallow /wp-content/cache/
Disallow /wp-content/backup/
Disallow /wp-content/backups/
Disallow /wp-content/upgrade/
Disallow /wp-content/uploads/backup/
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /*embed*
Disallow /*preview*
Disallow /*attachment*
Disallow /administrator/
Disallow /wp-content/debug.log
Disallow /.well-known/
Disallow /phpmyadmin/
Disallow /phpMyAdmin/

Other Records

Field Value
sitemap https://whatsizebro.com/sitemap.xml

Comments

  • Block admin areas
  • Block search and dynamic URLs
  • Block author and date archives
  • Block feeds (Enhanced)
  • Block categories and tags
  • Block pagination
  • Ezoic ad network directories
  • Block file types that shouldn't be crawled
  • Block specific WordPress files
  • Block unnecessary WordPress directories
  • Block common WordPress URLs
  • Block
  • Your sitemap