Reading a conversation and deciding whether a chatbot wrote it can be surprisingly difficult. In a study involving more than 72,000 judgments of human and AI responses, participants frequently mistook machine-generated captions, word associations and conversational replies for human work. However, in a smaller experiment, direct questioning proved more successful at exposing a chatbot, though even that comes with caveats.