Mushroom hunting with LLMs: what can go wrong?