Deepfake Software Startups That are Commercializing the Technology

In late 2017, a Reddit user released a series of synthetic videos containing celebrity likenesses. Since then, deepfake technology has exploded in popularity as people speculate over its future applications. Concerns over the tech’s potential for political disinformation and unauthorized pornographic content have led to the implementation of regulations surrounding its use. Simultaneously, innovators and deepfake software startups are scrambling to find ways we can use the tech to revolutionize commercial industries.

Deepfake technology refers to audiovisual content generated by deep learning AI systems. By using a system of neural networks to analyze patterns across datasets, we can use the tech to manipulate, alter and synthesize media. Popular applications of the tech include the face-swapping videos that have flooded social media, but several companies have recognized its potential for professional industries, including retail, customer service, and media.

Modulate’s speech-analyzing software uses machine learning to synthesize Voice Skins: vocal filters of famous characters and celebrities. Unlike traditional voice synthesizers that rely on text-to-speech tech, Modulate’s Voice Skins synthesize audio in real-time, allowing for more seamless conversations. More importantly, because your real voice is synthesized, the Vocal Skins convey the full range of emotional nuance. In other words, they sound real.

Modulate’s Voice Skins take gaming to the next level, enabling a more immersive experience with our digital avatars. Furthermore, the synthesized voices help protect users’ identities, which is especially beneficial for women and minority gamers who are often the victims of cyberbullying. The watermarks within the Voice Skins safeguard the owners of borrowed voices against retribution from inappropriate use and will soon include user IDs for verification purposes.

Respeecher uses both classical digital signal processing algorithms and proprietary deep generative modeling techniques to “create speech that’s indistinguishable from the original speaker.” After analyzing a person’s voice, their software creates an exact replica that can later be synthesized over other voices. They can even recreate the voices of historical figures, given enough sample data.

Like Modulate, Respeecher prides themselves on their Voice Clones’ quality and capacity for emotional nuance. However, the companies differ in their target demographics. Whereas Modulate’s Voice Skins cater to the gaming industry, Respeecher’s Voice Clones have the potential to revolutionize the film and animation industries.

Like most talent-based industries, film and animation studios are subject to human error. Too often, voice actors quit (or die, unfortunately), leaving half-finished projects, but with Respeecher’s Voice Clones, this will no longer be an issue. Their product also benefits the actors themselves. Instead of recording their lines, they can simply submit a sample of their voices, saving both time and effort and possibly reducing costs.

Rephrase.ai’s software creates fully AI-driven presentation videos. Their deep learning engine analyzes the facial movements and expressions that accompany speech to generate photorealistic faces for text or audio. While creating a video, Rephrase.ai users either select from a panel of onboarded public presenters or create their own. Users have complete control over their custom presenters and can extend access to other companies and organizations.

The customizability of Rephrase.ai’s text-to-video tech enables the creation of highly-personalized sales and marketing materials. Their software is currently being used by real estate, automotive and financial institutions.

In the face of privacy concerns around the rising use of facial-recognition software, the specialists at D-ID developed a solution. Their de-identification software uses AI and deep learning to remove identifiable facial features without compromising key attributes such as age, gender or emotion. Applicable to both images and videos, D-ID’s Smart Anonymization software provides top-of-the-line security for biometric databases.

D-ID’s Smart Anonymization guarantees adherence to the EU’s strict regulations of sensitive personal data. In addition to enabling the use of publicly available video data for analytics, it also reduces security and remediation costs by removing the risk of identification — even in the event of a data breach.

Topaz Labs uses machine learning to breathe new life into old media. Their Gigapixel AI software analyzes millions of pictures to deepen its understanding of the relationships between pixels, allowing it to enlarge images and allowing users to reenact their favorite scenes from Law & Order.

Gigapixel AI’s functionality goes beyond enlarging pictures. It can also restore low-resolution pictures, upscale compressed images by 600% without sacrificing photo quality, and its automated face refinement features ensure the subject always stays in focus.

Law & Order aside, law enforcement officials have expressed interest in Gigapixel AI’s potential for investigations. However, because the software specializes in scenery and landscapes, it’s currently marketed toward photographers along with Topaz Labs’ other image-editing tools.

The applications of deepfake software developed by the companies listed above suggest we’re on the cusp of another technological revolution. Soon, we may find ourselves in a futuristic society where Rephrase.ai’s AI-presenters provide technical support using Vocal Skins or Voice Clones to sound like our favorite celebrities.

Clearly, deepfake technology has more uses than creating fake videos of public officials. Voice synthesizers like those offered by Modulate and Respeecher could revitalize the audiobook industry. With Gigabit AI, you can convert pictures taken on your smartphone into full-sized prints. The utilizations for deepfake, machine learning and artificial intelligence are endless, and by studying their current applications, we can peek into the future of technology.

Related posts:

If you have been frantically scouring the web for explanations and solutions on any of these subjects: However, if you are looking for a beginner-friendly tutorial on how to set it all up, this might…

Mobile devices have a huge impact on the business world. With 81% of Americans owning a smartphone, there is a high probability that your users will expect to use your product from a mobile device…

Working from home means balancing work and domestic duties. Those tend to fall to me because I’m home all the time, but now most of us are home all the time and renegotiating how we spend our time…