Syco-Sup: steering sycophancy out of small models
Is sycophancy a straight line in a model's hidden states? Linear probes say yes, and the signal peaks at 54–64% of network depth. Subtracting that direction during generation reduces sycophantic agreement with no RLHF and no fine-tuning.