Log In Sign Up

st-minutiae.com
robots.txt

Robots Exclusion Standard data for st-minutiae.com

Resource Scan

Scan Details

Site Domain st-minutiae.com
Base Domain st-minutiae.com
Scan Status Ok
Last Scan2025-10-03T10:02:15+00:00
Next Scan 2025-11-02T10:02:15+00:00

Last Scan

Scanned2025-10-03T10:02:15+00:00
URL https://st-minutiae.com/robots.txt
Redirect https://www.st-minutiae.com/robots.txt
Redirect Domain www.st-minutiae.com
Redirect Base st-minutiae.com
Domain IPs 185.146.167.197, 2a07:7800::213
Redirect IPs 185.146.167.197, 2a07:7800::213
Response IP 185.146.167.197
Found Yes
Hash ad158e06dd2eb21c777a228d311e2fe0c75fe29967da11e0ecfbec2a566a759c
SimHash 2d4a5f4365f7

Groups

lt. cmdr. data
soji asha

Rule Path
Allow /

ruk
norman
lore
peanut hamper
a500
drednok
gptbot

Rule Path
Disallow /

googlebot-image
bingbot
msnbot-media
baiduspider

Rule Path
Disallow /*-t-2x.png$
Disallow /*-t.png$
Disallow /*-t-2x.jpg$
Disallow /*-t.jpg$
Disallow /*-t-2x.gif$
Disallow /*-t.gif$
Disallow /graphics/buttons/
Disallow /graphics/thumbnails/
Disallow /graphics/titles/

*

Rule Path
Disallow /cgi-bin/
Disallow /error/
Disallow /includes/
Disallow /search/
Disallow /temp/
Back to top

Other Records

Field Value
sitemap https://www.st-minutiae.com/sitemap.xml
sitemap https://www.st-minutiae.com/cafe/sitemap.xml
Back to top

Comments

  • robots.txt for https://www.st-minutiae.com/
  • Updated on 2023-08-25
  • Image search engines don't need thumbnails in their index.
  • Catch-all for support files not meant to be user-visible.
Back to top