Re-writing the Labels that Hold Us Back