What Is AI Poison?
The changes that are made to the source material are such that a human wouldn’t notice.
This is where tools likeNightshadeandGlazecome into the picture.
Sydney Louw Butler / DALL-E 3 / How-To Geek
Imagine you have a picture of a dog.
This is akin to teaching the AI the wrong information on purpose.
The AI might start producing distorted images or completely incorrect interpretations of certain prompts.
Sydney Louw Butler / MidJourney / How-To Geek
Why Do AI Poisons Exist?
Is This Too Little Too Late?
First, these poisons won’t affect any image generation models that already exist.
So any abilities they already have are here to stay.
It only affects the training of future models.
Second, AI researchers have learned a lot during the initial phases of training these models.
There are now approaches to training models that can work with much smaller datasets.
In other words, datasets that have explicit permission or rights to be used to train AI.
This is what Adobe’s attempted with their Firefly and its"ethically-sourced" data.
