Google Open Sources Synthid To Watermark Ai Generated Text


With the abundance of AI models at our disposal, it’s getting increasingly hard to tell what’s real and what’s not. As a result, it’s high time that advanced watermarking tools like Google’s SynthID are open-sourced and used by AI companies.
Earlier this month, we reported that Google Photos may detect AI-generated photos using a Credit tag attribute. SynthID being open-sourced could only suggest more such applications will gain the ability to detect AI-generated text and other content.
Pushmeet Kohli, the VP of Research at Google DeepMind, tells MIT Technology Review,
For those unaware of how SynthID works, I’ll try to make it easier for you to understand. To give you an analogy, remember those magical invisible pens where the writing could only be seen under UV light? Well, consider SynthID to be this light source that can see those invisible marks or watermarks on AI-generated images, videos, and text.
LLMs while generating texts look at the possible tokens and give each one a score. The score represents the probability of the token being chosen. During this process, SynthID adds extra information by “modulating the likelihood of tokens being generated.”
However, the biggest limitation for SynthID right now is that it can only detect content generated by Google’s proprietary AI models. Additionally, SynthID also starts to falter when someone heavily alters or rewrites AI-generated text like translating it from a different language altogether.
Soheil Feizi, an associate professor at the University of Maryland who has researched on this topic, tells MIT,
From the sound of it, we still have a long way to go before reliably detecting AI-generated content. Still, Google open-sourcing SynthID is a great step towards AI transparency.
The tool can be an absolute game-changer in standardizing the detection of AI-generated content. Most importantly, Google states that SynthID doesn’t interfere with the “quality, accuracy, creativity or speed of the text generation.”