A simple pair of narrow navy trousers gives this look a firm foundation. If you're worried about looking short or stumpy in flats, choose a trouser color that matches your shoe. I like the contrast this provides, though.
A bright yellow fitted blazer elevates this outfit and makes it, rather than the loafers, the statement piece here. Not that you don't want people looking at your shoes — you just don't want that to be all they're looking at.
A gauzy white blouse softens the strident blazer while still filling the role of the collared white shirt — a work-wear staple. This combo is a great canvas for jewelry, as well. Anything from a large statement necklace to a delicate chain could work.
Add another colorful element with a simple satchel. This burgundy bag offers a striking contrast to the yellow blazer without itself being too unconventional for a professional setting.
How about you — would you ever wear loafers (or moccasins) to the office? How would you style them?