Anthropic uses an automated classifier (the LLM-as-a-Judge method) to evaluate Claude's degree of sycophancy across four dimensions: willingness to contradict, firmness of position, appropriateness of praise, and frankness.