The Stronger AI Gets, the More Your Judgment Matters