tropicaltidbits.com
robots.txt

Robots Exclusion Standard data for tropicaltidbits.com

Resource Scan

Scan Details

Site Domain tropicaltidbits.com
Base Domain tropicaltidbits.com
Scan Status Ok
Last Scan2024-04-23T23:22:27+00:00
Next Scan 2024-04-30T23:22:27+00:00

Last Scan

Scanned2024-04-23T23:22:27+00:00
URL https://tropicaltidbits.com/robots.txt
Redirect https://www.tropicaltidbits.com/robots.txt
Redirect Domain www.tropicaltidbits.com
Redirect Base tropicaltidbits.com
Domain IPs 172.93.111.22
Redirect IPs 172.93.111.22
Response IP 172.93.111.22
Found Yes
Hash 87cb55fb3a5ecce4c1744237d1b4092eb7aae9a3310569a50bce1597c46a5037
SimHash 7020c3524f32

Groups

*

Rule Path
Disallow /analysis/models/*runtime%3D*
Disallow /analysis/models/*fh%3D*
Disallow /analysis/models/*/$
Disallow /analysis/models/sounding/*
Disallow /analysis/models/xsection/*
Disallow /sat/satlooper.php?*region=0*
Disallow /sat/satlooper.php?*region=1*
Disallow /sat/satlooper.php?*region=2*
Disallow /sat/satlooper.php?*region=3*
Disallow /sat/satlooper.php?*region=4*
Disallow /sat/satlooper.php?*region=5*
Disallow /sat/satlooper.php?*region=6*
Disallow /sat/satlooper.php?*region=9*
Disallow /5tuff/
Disallow /sat/images/
Disallow /data/
Disallow /public/
Disallow /*.txt
Allow /ads.txt
Allow /robots.txt
Disallow /blog/cgi-bin/
Disallow /blog/wp-admin/
Disallow /blog/wp-includes/
Disallow /blog/wp-content/plugins/
Disallow /blog/wp-content/cache/
Disallow /blog/wp-content/themes/
Disallow /blog/trackback/
Disallow /blog/feed/
Disallow /blog/author/
Disallow /blog/print/
Disallow /blog/*.inc$
Disallow /blog/*/feed/
Disallow /blog/*/trackback/
Disallow /blog/*/print/
Disallow /js/intro.js

twitterbot

Rule Path
Allow /analysis/models/*

mediapartners-google

Rule Path
Allow /

Comments

  • Exclude model page parameters not necessary to define canonical URL
  • Model subdirectories
  • Soundings and cross sections
  • Exclude satellite loops for TCs which are temporary URLs
  • Misc.
  • Satellite image directory
  • Root directory resources
  • Wordpress exclusions
  • Ignore javascript that results in confusing rendering results,
  • e.g. intro screens
  • Exceptions for specific bots
  • Adsense