Stick to What Works with Labels