Jump to content

Cygnia

HERO Member
  • Posts

    35,477
  • Joined

  • Days Won

    1,129

Posts posted by Cygnia

  1. Google Search results polluted by buggy AI-written code frustrate coders

    Quote

    Google has indexed inaccurate infrastructure-as-code samples produced by Pulumi AI – a developer that uses an AI chatbot to generate infrastructure – and the rotten recipes are already appearing at the top of search results.

    This mess started with Pulumi's decision to publish the result of its users' prompts on a curated AI Answers page. Google's crawlers indexed the resulting robo-responses – but when users find them, the AI answers are often inaccurate.

    "It has happened," wrote developer Arian van Putten in a social media post over the weekend. "The number one Google result was an official Pulumi documentation page that was clearly written by an LLM (it had a disclaimer that it was) and hallucinated an AWS feature that didn't exist. This is the beginning of the end."

    As The Register opined in 2022 and reported in January this year, search quality has declined because search engines index low-quality AI-generated content and present it in search results. This remains an ongoing area of concern.

     

  2. The AI grift that can literally poison you
     

    Quote

    Six months ago, I spoke with a man named Elan Trybuch about a problem he was seeing online. He kept coming across different ebooks about mushroom foraging that looked somehow off. Off as in: maybe poisonous.

    The books were shorter than most foraging guides were, and way, way cheaper, says Trybuch. He’s a software engineer and volunteer secretary for the New York Mycological Society, a nonprofit devoted to “spreading knowledge, love and appreciation of fungi.” He knows mushrooms and he knows AI, and he thought the covers of these books were probably AI-generated.

    “They had mushroom structures that don’t quite make sense,” says Trybuch. They were the mycological equivalent of a picture of a hot blonde with six fingers and too many teeth.

    Most disturbing was the information inside the books was totally wrong. “They aren’t even giving you descriptions of real mushrooms. They’re giving you something completely made up,” Trybuch says. Any readers looking to try to use these books to figure out which mushrooms were safe to eat and which weren’t would be out of luck, which to Trybuch was seriously concerning. “It could literally mean life or death” if you eat the wrong mushroom, he says.

    The problem of very low-quality, very low-priced, probably at least partially AI-generated ebooks is not confined to mushroom foraging. Garbage ebooks have been a problem on Amazon for at least a decade, but — not unlike many strains of fungi — they’ve exploded over the last few years.

    I spent months investigating the shadowy economy where they’re produced, and what I learned took me by surprise.
     

    Inside the scammy world of garbage ebook publishing

    Garbage ebooks are all over Amazon’s Kindle store, on every topic. Searching for Jonathan Haidt’s bestselling new book The Anxious Generation, I found Jonathan Haidt: The Biography of Jonathan David Haidt, Navigating Morality and Policy; A Joosr Guide to... The Happiness Hypothesis by Jonathan Haidt: Finding Modern Truth in Ancient Wisdom; and The Jonathan Haidt Story: Exploring the Life and Work of a Renowned Social Psychologist, Author, and Advocate.

    None of these are actually books so much as book-shaped digital files, designed to be picked up in keyword searches and get

     

×
×
  • Create New...