Semiotics

A theorist called Saussare stated that in everything there is a sign and signified. If rain and frowns are the SIGN then sorrow/sadness is what has been signified.
Denotation - What you can see.
Connotation - What this might suggest.