Recent advancements in generative adversarial networks have created opportunities to develop highly realistic fake images and videos. While much of the attention in this area is paid to hyper-realism in images, I ague that equal attention should be paid towards alternative points of leverage around fake images. As trust in visual imagery is undermined, campaigns around the use of fake images, much like "fake news" will become more pronounced.
Generative Adversarial Networks (GAN) are able to produce images from a learned probability distribution of an image dataset. This allows the network to create new, unique images similar to images in the dataset. For more information on GANs please see my blog post. This is the same type of network used in the "deepfake" images.
One of the trends in GANs is towards hyper-realism. With the recent advancements in large-scale generative adversarial network models for images and videos, the concern over misuse of these technologies has intensified. Politicians have drafted legislation to hold platforms accountable for spreading faked information, including GAN generated images, and warn of the upcoming onslaught of fake text and images.
While hyper-realistic images are extremely useful in many current scenarios, I argue that it is not necessary to produce highly realistic fake images or text to sow doubt into public discourse. Merely the presence of potential fakes are enough to create suspicion in traditionally trusted institutions and sources. Generative images need not be photorealistic to create their intended effect, nor do they need to be fake at all. One such example this is the unconfirmed “deepfake” video surrounding the release of video featuring the president of Gabon.
In The Presence of Fakes - Ali Bongo
Ali Bongo was elected president of Gabon in 2009, following a successful but ethically questionable career in the political spotlight under the leadership of the Bongo family, which has held control of Gabon since 1967. In late 2018, 59-year-old Bongo purportedly suffered a stroke and had removed himself from public view, raising questions around his health and leadership capabilities. On New Year's Eve of 2018, he appeared in a taped New Year’s address to the public from Morocco, where he was receiving medical treatment. "[The] ..speech is proof that President Ali Bongo is fully recovered. His health problems are now behind him,” according to presidency spokesman Ike Ngouoni. With his health already in question and the center of much of the national debate, the release of the New Year’s address video fueled political tension.
The controversy and speculation around this video led the opposition party, including Bruno Ben Moubamba who had run against Bongo in the previous two elections, to suggest that the video was a deepfake. Moubamba notes that the eyes in the video seem “immobile” and “almost suspended above his jaw” and that the eye movements are out of sync with the movements of his mouth. “The composition of several elements of different faces, fused into one are the very specific elements that constitute a deepfake.”
While there is no consensus on whether the video is in fact a deepfake, the very suggestion of the use of deepfakes has stoked division and helped to undermine the government of Gabon. On January 7th, members of the Gabonese Republican Guard took over a radio station and announced that they had seized control of the government to "restore democracy". The attempted coup was eventually quashed, but many have speculated that the deepfake added fuel to mounting coup d'etat.
In the US, had a leader or public figure moved out of the political spotlight, there would be wall to wall coverage on their status. However, there are numerous places around the world where current leaders' absences and health are unknown, and questions of their status and leadership abilities abound. Recently, Algerian president Abdelaziz Bouteflika, for instance, found himself in a similar position. After suffering a stroke in 2013, Bouteflika generally removed himself from the public eye, prompting many Algerians to question his health, or whether he was alive at all, and it was only after intense public scrutiny and protests throughout Algeria just days ago, that he resigned and promised not to pursue a 5th term as the country's leader.
Speculation around public figures who have removed themselves from the spotlight, for health reasons or otherwise, have an enormous impact on public discourse, particularly around political leaders who have been out of the public eye. We have witnessed this phenomenon most recently in the US with speculation surrounding Melania Trump and look-alikes.
As the technology for developing deepfakes and GAN generated images accelerates, the landscape around images public figures will shift dramatically. I've posted previously about potential misuses in politics around Creating Fake Images with Glow and OpenPose + Pix2Pix. Generating cropped shot images of a politicians face requires high def footage that hide tell tale signs of GAN output. 1. This typically requires a very well constructed OpenPose + vid2vid pipeline (along with traditional video editing) 2. A Deepfake generative adversarial network model, which would require an actor that can convincingly represent the targets body movements and feature or 3. A composite bi-directional LSTM from audio to facial mask movements as documented in 'Learning to Lip Synch' publication. As we look at human faces most of our lives, we are uniquely adept at pinpointing flaws in facial movements and features. Added together, putting together a convincing fake is a tall but not unreasonable task.
However, the mere presence of deepfakes is enough to have social and political ramifications. This opens up an opportunity to develop deceptive campaigns around images and video. As our trust in the concreteness of images is undermined, our ability to throw images into question at the slightest hint of potential forgery increases. This opens up potential avenues not only to promote fake content, but also to drive campaigns around the truthfulness of images and videos, fake or otherwise. There are plenty of initiatives and research developing techniques and methods in how to spot deepfakes. DARPA's recent MediaFor initiative, for instance, has invested $68 million in a effort to detect faked media including deepfakes. As hype and intrigue around deepfakes reaches a fever pitch, we also need to consider secondary effects of deepfakes on institutions and public trust. Speculation itself can have real social and political consequences.
- “Top Senate Intel Democrat Proposes Measures to Counter Influence Campaigns on Social Media - The Washington Post.” 2019. Accessed April 15. https://www.washingtonpost.com/powerpost/top-senate-intel-democrat-proposes-measures-to-counter-influence-campaigns-on-social-media/2018/07/30/50de4786-9420-11e8-810c-5fa705927d54_story.html?utm_term=.334579370949.
- Pedrero, Agnès. 2019. “Algeria Opposition Figure Arrested at Bouteflika’s Hospital.” Accessed April 15. https://finance.yahoo.com/news/algeria-opposition-figure-arrested-bouteflikas-hospital-190547417.html.
- AFP. 2019. “‘I Am Now Fine’: Ali Bongo Tells Gabonese in New Year Message | Africanews.” Accessed April 15. https://www.africanews.com/2019/01/01/i-am-now-fine-ali-bongo-tells-gabonese-in-new-year-message/.
- “Gabon’s Government Quashes Coup Attempt, Killing 2, Officials Say | CBC News.” 2019. Accessed April 15. https://www.cbc.ca/news/world/gabon-coup-attempt-1.4968177.
- “US Lawmakers Say AI Deepfakes ‘Have the Potential to Disrupt Every Facet of Our Society’ - The Verge.” 2019. Accessed April 15. https://www.theverge.com/2018/9/14/17859188/ai-deepfakes-national-security-thr
- “Deep Fakes and the Next Generation of Influence Operations | Council on Foreign Relations.” 2019. Accessed April 15. https://www.cfr.org/event/deep-fakes-and-next-generation-influence-operations.
- “Cameroon Suspends TV Channel for Unfounded Report on Gabonese President - News Ghana.” 2019. Https://Www.Newsghana.Com.Gh/. Accessed April 15. https://www.newsghana.com.gh/cameroon-suspends-tv-channel-for-unfounded-report-on-gabonese-president/.
- “US Lawmakers Say AI Deepfakes ‘Have the Potential to Disrupt Every Facet of Our Society’ - The Verge.” 2019. Accessed April 15. https://www.theverge.com/2018/9/14/17859188/ai-deepfakes-national-security-threat-lawmakers-letter-intelligence-community.
- Chesney, Robert, and Danielle Keats Citron. 2018. “Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security.” SSRN Electronic Journal. doi:10.2139/ssrn.3213954.
- Hawkins, Derek. 2019. “The Cybersecurity 202: Doctored Videos Could Send Fake News Crisis into Overdrive, Lawmakers Warn - The Washington Post.” Accessed April 15. https://www.washingtonpost.com/news/powerpo
- Hui, Jonathan. 2018. “How Deep Learning Fakes Videos (Deepfake) and How to Detect It?” https://medium.com/@jonathan_hui/how-deep-learning-fakes-videos-deepfakes-and-how-to-detect-it-c0b50fbf7cb9.
- Warner, Mark R. 2018. “White Paper (DRAFT) - Potential Policy Proposals for Regulation of Social Media and Technology Firms.” Office for U.S.
- Senator.Suwajanakorn, Supasorn, Steven M Seitz, and Ira Kemelmacher-Shlizerman. 2017. “Synthesizing Obama: Learning Lip Sync from Audio.” ACM Transactions on Graphics 36 (4): 95:1-13. doi:10.1145/3072959.3073640.