"If someone confidently told me some largish number is prime, I’d probably believe it. We are primed (so to speak) to believe what supposedly impartial computers have to say. In any case, it’s surely better for a computer to admit failure than to insist on lying."
https://beta.buildcivitas.com/t/large-language-models-doing-some-harm-to-the-soul/265