The only way that you can find any semblance of a rule, or make any semblance of your own rule, is to tear up the rulebook. Throw it out, burn it, throw it away, and make your own rules.
I throw a leather biker jacket over everything. It adds an instant downtown cool vibe and stops a look becoming too girlie. Bonus points if you wear it like a cape!