Jump to content

A.I is here and it will make the world worse.


Trencher

Recommended Posts

  • Replies 330
  • Created
  • Last Reply

Top Posters In This Topic

The AI grift that can literally poison you
 

Quote

Six months ago, I spoke with a man named Elan Trybuch about a problem he was seeing online. He kept coming across different ebooks about mushroom foraging that looked somehow off. Off as in: maybe poisonous.

The books were shorter than most foraging guides were, and way, way cheaper, says Trybuch. He’s a software engineer and volunteer secretary for the New York Mycological Society, a nonprofit devoted to “spreading knowledge, love and appreciation of fungi.” He knows mushrooms and he knows AI, and he thought the covers of these books were probably AI-generated.

“They had mushroom structures that don’t quite make sense,” says Trybuch. They were the mycological equivalent of a picture of a hot blonde with six fingers and too many teeth.

Most disturbing was the information inside the books was totally wrong. “They aren’t even giving you descriptions of real mushrooms. They’re giving you something completely made up,” Trybuch says. Any readers looking to try to use these books to figure out which mushrooms were safe to eat and which weren’t would be out of luck, which to Trybuch was seriously concerning. “It could literally mean life or death” if you eat the wrong mushroom, he says.

The problem of very low-quality, very low-priced, probably at least partially AI-generated ebooks is not confined to mushroom foraging. Garbage ebooks have been a problem on Amazon for at least a decade, but — not unlike many strains of fungi — they’ve exploded over the last few years.

I spent months investigating the shadowy economy where they’re produced, and what I learned took me by surprise.
 

Inside the scammy world of garbage ebook publishing

Garbage ebooks are all over Amazon’s Kindle store, on every topic. Searching for Jonathan Haidt’s bestselling new book The Anxious Generation, I found Jonathan Haidt: The Biography of Jonathan David Haidt, Navigating Morality and Policy; A Joosr Guide to... The Happiness Hypothesis by Jonathan Haidt: Finding Modern Truth in Ancient Wisdom; and The Jonathan Haidt Story: Exploring the Life and Work of a Renowned Social Psychologist, Author, and Advocate.

None of these are actually books so much as book-shaped digital files, designed to be picked up in keyword searches and get

 

Link to comment
Share on other sites

Google Search results polluted by buggy AI-written code frustrate coders

Quote

Google has indexed inaccurate infrastructure-as-code samples produced by Pulumi AI – a developer that uses an AI chatbot to generate infrastructure – and the rotten recipes are already appearing at the top of search results.

This mess started with Pulumi's decision to publish the result of its users' prompts on a curated AI Answers page. Google's crawlers indexed the resulting robo-responses – but when users find them, the AI answers are often inaccurate.

"It has happened," wrote developer Arian van Putten in a social media post over the weekend. "The number one Google result was an official Pulumi documentation page that was clearly written by an LLM (it had a disclaimer that it was) and hallucinated an AWS feature that didn't exist. This is the beginning of the end."

As The Register opined in 2022 and reported in January this year, search quality has declined because search engines index low-quality AI-generated content and present it in search results. This remains an ongoing area of concern.

 

Link to comment
Share on other sites

On 5/2/2024 at 6:35 AM, Cygnia said:

Only the beginning? With the anti-intellectualism running rampant in this society (where "overeducated" and "useless knowledge" are common talking points and insults) the world has been going downhill ever since the Reagan years.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Unfortunately, your content contains terms that we do not allow. Please edit your content to remove the highlighted words below.
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...