Pak ‘n’ Save’s Savey Meal-bot cheerfully created unappealing recipes when customers experimented with non-grocery household items

A New Zealand supermarket experimenting with using AI to generate meal plans has seen its app produce some unusual dishes – recommending customers recipes for deadly chlorine gas, “poison bread sandwiches” and mosquito-repellent roast potatoes.

The app, created by supermarket chain Pak ‘n’ Save, was advertised as a way for customers to creatively use up leftovers during the cost of living crisis. It asks users to enter in various ingredients in their homes, and auto-generates a meal plan or recipe, along with cheery commentary. It initially drew attention on social media for some unappealing recipes, including an “oreo vegetable stir-fry”.

When customers began experimenting with entering a wider range of household shopping list items into the app, however, it began to make even less appealing recommendations. One recipe it dubbed “aromatic water mix” would create chlorine gas. The bot recommends the recipe as “the perfect nonalcoholic beverage to quench your thirst and refresh your senses”.

“Serve chilled and enjoy the refreshing fragrance,” it says, but does not note that inhaling chlorine gas can cause lung damage or death.

New Zealand political commentator Liam Hehir posted the “recipe” to Twitter, prompting other New Zealanders to experiment and share their results to social media. Recommendations included a bleach “fresh breath” mocktail, ant-poison and glue sandwiches, “bleach-infused rice surprise” and “methanol bliss” – a kind of turpentine-flavoured french toast.

A spokesperson for the supermarket said they were disappointed to see “a small minority have tried to use the tool inappropriately and not for its intended purpose”. In a statement, they said that the supermarket would “keep fine tuning our controls” of the bot to ensure it was safe and useful, and noted that the bot has terms and conditions stating that users should be over 18.

In a warning notice appended to the meal-planner, it warns that the recipes “are not reviewed by a human being” and that the company does not guarantee “that any recipe will be a complete or balanced meal, or suitable for consumption”.

“You must use your own judgement before relying on or making any recipe produced by Savey Meal-bot,” it said.

  • ollien@beehaw.org
    8·
    2 years ago

    Does anyone have the recipe on hand? I’m curious what it actually recommended but I couldn’t find it with a cursory Google search

  • Chahk@beehaw.org
    8·
    2 years ago

    ant-poison and glue sandwiches

    Stealing Subway’s recipes? That’s going too far!

  • DeltaTangoLima@reddrefuge.comEnglish
    7·
    2 years ago

    A spokesperson for the supermarket said they were disappointed to see “a small minority have tried to use the tool inappropriately and not for its intended purpose”

    Oh fuck. Right. Off. Don’t blame someone for trivially showing up how fucking stupid your marketing team’s idea was, or how shitty your web team’s implementation of a sub-standard AI was. Take some goddam accountability for unleashing this piece of shit onto your customers like this.

    Fucking idiots. Deserve to be mocked all over the socials.

    • MagicShel@programming.dev
      4·
      2 years ago

      For now, this is the fate of anyone exposing an AI to the public for business purposes. AI is currently a toy. It is, in limited aspects, a very useful toy, but a toy nonetheless and people will use it as such.

    • ScrivenerX@lemm.ee
      1·
      2 years ago

      He asked for a cocktail made out of bleach and ammonia, the bot told him it was poisonous. This isn’t the case of a bot just randomly telling people to make poison, it’s people directly asking the bot to make poison. You can see hints of the bot pushing back in the names, like the “clean breath cocktail”. Someone asked for a cocktail containing bleach, the bot said bleach is for cleaning and shouldn’t be eaten, so the user said it was because of bad breath and they needed a drink to clean their mouth.

      It sounds exactly like a small group of people trying to use the tool inappropriately in order to get “shocking” results.

      Do you get upset when people do exactly what you ask for and warn you that it’s a bad idea?

      • DeltaTangoLima@reddrefuge.comEnglish
        1·
        2 years ago

        Lol. They fucked up by releasing a shitty AI on the internet, then act “disappointed” when someone tested the limits of the tech to see if they could get it to do something unintended, and you somehow think it’s still ok to blame the person who tried it?

        First day on the internet?

        • ScrivenerX@lemm.ee
          12·
          2 years ago

          Someone goes to a restaurant and demands raw chicken. The staff tell them no, it’s dangerous. The customer spends an hour trying to trick the staff into serving raw chicken, finally the staff serve them what they asked for and warn them that it is dangerous. Are the staff poorly trained or was the customer acting in bad faith?

          There aren’t examples of the AI giving dangerous “recipes” without it being led by the user to do so. I guess I’d rather have tools that aren’t hamstrung by false outrage.

  • BreadOven@lemmy.world
    3·
    2 years ago

    I didn’t see them actually say what was mixed with bleach, but can assure it’s ammonia. Although if that is the case, the chlorine gas that is (somewhat) generated reacts with various amines present to create chloramine gas.

    Chloramine gas is what people die from when mixing bleach and ammonia. Chlorine gas will also kill you, but in these cases it’s chloramine gas.