Abstract

Limited data-availability and ethical concerns regarding individual privacy hinder large-scale understanding of protests using social media data. Current visual methods for human image understanding are capable of re-identifying faces, understanding complex scenes and objects, and associating them together. This presents an ethical dilemma, as large vision models can memorize and leak sensitive information from training data. To our knowledge, unfortunately, no existing protest analysis method takes privacy into consideration. To close the gap in the literature, we propose a simple and robust framework for understanding protest dynamics with privacy preservation, namely privacy preserving protest dynamics (P3D). Our P3D framework aims to replace private data with well labeled synthetic reproductions using conditional image synthesis. Extensive evaluation of the proposed P3D method demonstrates its ability to generate realistic and diverse imagery, and its efficacy in utility and privacy for downstream protest analysis. Moreover, unlike other private models, P3D can provide a moderate level of privacy by modeling complex visual features in protest images while maintaining downstream utility. Code is available at https://github.com/cgarchbold/P3D.

Original languageEnglish
Title of host publicationProceedings - 16th IEEE International Workshop on Information Forensics and Security, WIFS 2024
ISBN (Electronic)9798350364422
DOIs
StatePublished - 2024
Event16th IEEE International Workshop on Information Forensics and Security, WIFS 2024 - Rome, Italy
Duration: Dec 2 2024Dec 5 2024

Publication series

NameProceedings - 16th IEEE International Workshop on Information Forensics and Security, WIFS 2024

Conference

Conference16th IEEE International Workshop on Information Forensics and Security, WIFS 2024
Country/TerritoryItaly
CityRome
Period12/2/2412/5/24

Bibliographical note

Publisher Copyright:
©2024 IEEE.

Keywords

  • differential privacy
  • image synthesis
  • protest

ASJC Scopus subject areas

  • Safety, Risk, Reliability and Quality
  • Artificial Intelligence
  • Information Systems
  • Signal Processing
  • Software
  • Information Systems and Management
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Privacy Preserving Protest Dynamics'. Together they form a unique fingerprint.

Cite this