I have always felt that you can apply any color to any emotion, you just need to maintain the feeling. For example if you use the color blue every time the bad guy is in the frame then you establish blue as an evil color. Sometimes it might be more fun to avoid stereotypes like red=love or evil. A good text to read is "The Visual Story" by Bruce Block