Skip to content
/ Papers Public

Image Forgery Detection and Localization (and related) Papers List

Notifications You must be signed in to change notification settings

greatzh/Papers

Repository files navigation

description
Deep learning papers notes sharing, especially for image forgery detection and localization

😀 Overview

Newly added papers will be organized at the top of every category now.

Related

Basics

Backbone

骨干网络,多为图像分类的网络。

Image Tampering

图像篡改检测定位

Image Editing

2024
  • EC-Net: General image tampering localization network based on edge distribution guidance and contrastive learning (KBS '24) [Paper]
  • Frequency-constrained transferable adversarial attack on image manipulation detection and localization (TVC '24) [Paper]
  • A Contribution-Aware Noise Feature representation model for image manipulation localization (KBS '24) [Paper]
  • Effective Image Tampering Localization via Enhanced Transformer and Co-attention Fusion (ICASSP '24) [Paper] GitHub
  • PROMPT-IML: Image Manipulation Localization with Pre-trained Foundation Models Through Prompt Tuning (arXiv '24) [Paper]
  • Diffusion models meet image counter-forensics (WACV '24) [Paper] [Code]
  • Research about the Ability of LLM in the Tamper-Detection Area (arXiv '24) [Paper]
  • Deep Image Restoration For Image Anti-Forensics (arXiv '24) [Paper] [Code]
  • Deep Image Composition Meets Image Forgery (arXiv '24) [Paper] [Code]
  • Fusion Transformer with Object Mask Guidance for Image Forgery Analysis (arXiv '24) [Paper]
  • Exploring Multi-Modal Fusion for Image Manipulation Detection and Localization (MMM '24) arXiv GitHub
  • A New Benchmark and Model for Challenging Image Manipulation Detection (AAAI '24) arXiv GitHub
  • MGQFormer: Mask-Guided Query-Based Transformer for Image Manipulation Localization (AAAI '24) arXiv [Paper]
  • Learning Discriminative Noise Guidance for Image Forgery Detection and Localization (AAAI '24) [Paper]
  • CatmullRom Splines-Based Regression for Image Forgery Localization (AAAI '24) [Paper]
  • UnionFormer: Unified-Learning Transformer with Multi-View Representation for Image Manipulation Detection and Localization (CVPR '24) [Abstract] [Paper]
  • Towards Modern Image Manipulation Localization: A Large-Scale Dataset and Novel Methods (CVPR '24)
  • EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protection (CVPR '24) arXiv GitHub
  • DiffForensics: Leveraging Diffusion Prior to Image Forgery Detection and Localization (CVPR '24)
  • IML-ViT: Image Manipulation Localization by Vision Transformer (AAAI '24) arXiv GitHub
  • CIMGEN: Controlled Image Manipulation by Finetuning Pretrained Generative Models on Limited Data (arXiv '24) arXiv
2023
2022
2021
  • MSTA-Net: Forgery Detection by Generating Manipulation Trace Based on Multi-Scale Self-Texture Attention (TCSVT '21) [Paper]
  • Image Manipulation Detection by Multi-View Multi-Scale Supervision (ICCV '21) [Paper] [Code]
  • TransForensics: Image Forgery Localization with Dense Self-Attention (ICCV '21) [Paper]
  • Self-supervised Domain Adaptation for Forgery Localization of JPEG Compressed Images (ICCV '21) [Paper]
  • Image Tampering Localization Using a Dense Fully Convolutional Network (TIFS '21) [Paper] [Code] (DenseFCN)
  • Image Manipulation Localization Using Attentional Cross-Domain CNN Features (TNNLS '21) [Paper]
2020 and before

CNN-synthesized

Some of the above papers also contain methods to detect tampered images generated by GANs or DMs for synthetic images

  • Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detection (CVPR '24) [Paper]
  • Preserving Fairness Generalization in Deepfake Detection (CVPR '24) [Paper] [Code]
  • Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detection (arXiv '24) [Paper] [Code]
  • Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detection (arXiv '23) [Paper]
  • AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectors (arXiv '23) [Paper] [Code]
  • MaLP: Manipulation Localization Using a Proactive Scheme (CVPR '23) [Paper] [Code]
  • Discrepancy-Guided Reconstruction Learning for Image Forgery Detection (IJCAI '23) [Paper] [Code]
  • Generalizable Synthetic Image Detection via Language-guided Contrastive Learning (arXiv '23) [Paper] [Code]
  • Detect Any Deepfakes: Segment Anything Meets Face Forgery Detection and Localization (arXiv '23) [Paper] [Code]
  • Discrepancy-Guided Reconstruction Learning for Image Forgery Detection (arXiv '23) [Paper]
  • Masked Relation Learning for DeepFake Detection (TIFS '23) [Paper]

Image Splicing

图像的拼接篡改检测定位

2024
  • UGEE-Net: Uncertainty-Guided and Edge-Enhanced Network for Image Splicing Localization (Neural Networks '24) [Paper] [Dataset]
  • DA-HFNet: Progressive Fine-Grained Forgery Image Detection and Localization Based on Dual Attention (arXiv '24) [Paper]
  • Research on Splicing Image Detection Algorithms Based on Natural Image Statistical Characteristics (arXiv '24) [Paper]
  • A Visually Attentive Splice Localization Network with Multi-Domain Feature Extractor and Multi-Receptive Field Upsampler
  • Feature Aggregation and Region-Aware Learning for Detection of Splicing Forgery (SPL '24) [Paper]
  • Towards Effective Image Forensics via A Novel Computationally Efficient Framework and A New Image Splice Dataset ( Signal, Image and Video Processing (IF: 2.3, not included in CCFs), '24 ) [Paper]
2023
  • GreatSplicing: A Semantically Rich Splicing Dataset (arXiv '23) [Paper] [Dataset]
  • Multi-scale attention context-aware network for detection and localization of image splicing: Efficient and robust identification network (Appl. Intell. 23') [Paper]
  • A Multi-Stream Fusion Network for Image Splicing Localization (MMM '23) [Paper]
  • Attacking Image Splicing Detection and Localization Algorithms Using Synthetic Traces (TIFS '23) [Paper] [IEEE Paper]
  • Biomedical Image Splicing Detection using Uncertainty-Guided Refinement (arXiv '23) [Paper]
  • A New Method to Detect Splicing Image Forgery Using Convolutional Neural Network (Applied Science (IF: 2.8, not included in CCFs), MDPI, '23) [Paper]
  • Multi-scale Target-Aware Framework for Constrained Image Splicing Detection and Localization (MM '23) [Paper]
2022
2021
2020 and before
  • D-Unet: A Dual-encoder U-Net for Image Splicing Forgery Detection and Localization (arXiv '20) [Paper]
  • Exposing splicing forgery in realistic scenes using deep fusion network (InfoS '20) [Paper]
  • Locating splicing forgery by adaptive-SVD noise estimation and vicinity noise descriptor (Neurocomputing '20) [Paper]
  • Adversarial Learning for Constrained Image Splicing Detection and Localization Based on Atrous Convolution (TIFS '19) [Paper] [Code]
  • RRU-Net: The Ringed Residual U-Net for Image Splicing Forgery Detection (CVPRW' 19) [Paper] [Code]
  • Mixed adversarial generators for image splice detection (NeuIPS '19) [Paper] [Code]
  • Image Splicing Localization via Semi-global Network and Fully Connected Conditional Random Fields (ECCV '18)
  • Image splicing localization using a multi-task fully convolutional network (mfcn) (JVCIR '18) [Paper] [Code]
  • Fighting Fake News: Image Splice Detection via Learned Self-Consistency (ECCV '18) [Paper] [Code]
  • Deep Fusion Network for Splicing Forgery Localization (ECCV '18)
  • Deep matching and validation network: An end-to-end solution to constrained image splicing localization and detection (MM '17) [Paper]

Image Harmonization

图像协调化

Face Forgery

人脸篡改,篡改方法以及检测问题

  • MCS-GAN: A Different Understanding for Generalization of Deep Forgery Detection (TMM '23) [Paper]
  • Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detection (AAAI '24) [Paper] [Code]
  • Contrastive Learning for DeepFake Classification and Localization via Multi-Label Ranking (CVPR '24)
  • Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection (CVPR '24) [Paper]
  • Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detection (ICLR '24) [Paper] [Code]
  • Improving Fairness in Deepfake Detection (WACV '24) [Paper] [Code]
  • Weakly-Supervised Deepfake Localization in Diffusion-Generated Images (WACV '24) [Paper] [Code]
  • Controllable Guide-Space for Generalizable Face Forgery Detection (ICCV '23) [Paper]
  • RAIRNet: Region-Aware Identity Rectification for Face Forgery Detection (MM '23) [Paper]
  • Not All Steps are Created Equal: Selective Diffusion Distillation for Image Manipulation (ICCV '23) [Paper] [Code]
  • UCF: Uncovering Common Features for Generalizable Deepfake Detection (ICCV '23) [Paper]
  • Learning Patch-Channel Correspondence for Interpretable Face Forgery Detection (TIP '23) [Paper] [Code]
  • Contrastive Multi-FaceForensics: An End-to-end Bi-grained Contrastive Learning Approach for Multi-face Forgery Detection (arXiv '23') [Paper]
  • Two-in-one Knowledge Distillation for Efficient Facial Forgery Detection (arXiv '23') [Paper]
  • AUNet: Learning Relations Between Action Units for Face Forgery Detection (CVPR '23) [Paper]
  • AltFreezing for More General Face Forgery Detection (CVPR '23) [Paper] **[Code]88
  • $F^2$Trans: High-Frequency Fine-Grained Transformer for Face Forgery Detection (TIFS '23) [Paper]
  • On the Security of the One-and-a-Half-Class Classifier for SPAM Feature-Based Image Forensics (TIFS '23) [Paper]
  • Multimodaltrace: Deepfake Detection Using Audiovisual Representation Learning (CVPRW '23) [Paper]
  • MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection (KBS '22) [Paper]
  • Multi-Scale Wavelet Transformer for Face Forgery Detection (ACCV '22) [Paper]
  • Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection (CVPR '22) [Paper] [Code]
  • SSTNet: Detecting Manipulated Faces Through Spatial, Steganalysis and Temporal Features (ICASSP '20) [Paper]
  • Portrait shadow manipulation (ACM MM / TOG '20) [Paper] [Code]

Copy Move

复制移动篡改定位问题

Tamper Text in Detection

图像中的文本篡改检测问题 (parts of)

  • A Two-Stage Dual-Path Framework for Text Tampering Detection and Recognition (arXiv '24) [Paper]
  • Toward Real Text Manipulation Detection: New Dataset and New Solution (arXiv '23) [Paper] [Code]
  • Towards Robust Tampered Text Detection in Document Image: New dataset and New Solution (CVPR '23) [Paper] [Code]
  • Progressive Supervision for Tampering Localization in Document Images (ICONIP '23) [Paper]
  • SigScatNet: A Siamese + Scattering based Deep Learning Approach for Signature Forgery Detection and Similarity Assessment (arXiv '23) [Paper]
  • Image Generation and Learning Strategy for Deep Document Forgery Detection (arXiv '23) [Paper]
  • Forgery-free signature verification with stroke-aware cycle-consistent generative adversarial network (Neurocomputing '22) [Paper] [Code]
  • Document Forgery Detection in the Context of Double JPEG Compression (ICPR '22) [Paper]

Low Level Vision

Related resources:

Low-level tasks include super-resolution, denoise, dehze, low-light enhancement, etc. High-level tasks include classification, detection, segmentation, etc. segmentation, and so on. However, the ones I have listed here are probably still mainly related to tampering detection.

Testing the new layout of paper title.

📖Paper, 👨‍💻Code, 📦Dataset, 🔗Other links, 📜News,

*Equal contribution. #Corresponding author.

Image Matching

特征匹配,图像匹配问题。

Object Detection

目标检测,包括伪装物体目标检测和突出目标检测,COD以及SOD。

  • HEAP: Unsupervised Object Discovery and Localization with Contrastive Grouping (AAAI '24) [Paper]
  • Endow SAM with Keen Eyes: Temporal-spatial Prompt Learning for Video Camouflaged Object Detection (CVPR '24)
  • VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learning (CVPR '24) [Paper]
  • Weakly Supervised Open-Vocabulary Object Detection (AAAI '24) [Paper]
  • OTA: Optimal Transport Assignment for Object Detection (CVPR '21) [Paper] [Code]
  • Consistency-basd Active Learning for Object Detection (CVPRW '22) [Paper] [Code]
  • Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detection (CVPR '22) [Paper] [Code]
  • Unsupervised Object Localization: Observing the Background to Discover Objects (CVPR '23) [Paper] [Code]
  • Camouflaged Object Detection with Feature Decomposition and Edge Reconstruction (CVPR '23) [Paper] [Code]
  • Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformers (CVPR '23) [Paper] [Code]
  • Locate, Refine and Restore: A Progressive Enhancement Network for Camouflaged Object Detection (IJCAI '23) [Paper]
  • Spatial-Aware Token for Weakly Supervised Object Localization (ICCV '23) [Paper] [Code]
  • Generative Prompt Model for Weakly Supervised Object Localization (ICCV '23) [Paper] [Code]
  • Category-aware Allocation Transformer for Weakly Supervised Object Localization (ICCV '23) [Paper]

Semantic Segmentation

语义分割,将图片中完整语义(具有标签或者类别)的部分分割出来。不仅要进行目标检测检测到图像中的物体,还需要对每个像素分类。

Anomaly Detection

异常检测,通常用于发现与正常模式或预期模式不符的图像与视频。

  • Contextual Affinity Distillation for Image Anomaly Detection (WACV '24) [Paper]
  • PromptAD: Zero-Shot Anomaly Detection Using Text Prompts (WACV '24) [Paper]
  • Holistic Representation Learning for Multitask Trajectory Anomaly Detection (WACV '24) [Paper] [Code]

Useful Links

  1. IJCAI 2024 Main Track Accepted Papers https://ijcai24.org/main-track-accepted-papers/
  2. CVPR 2024 Accepted Papers https://cvpr2023.thecvf.com/Conferences/2024/AcceptedPapers
  3. ICLR 2024 Papers List https://openreview.net/group?id=ICLR.cc/2024/Conference
  4. WACV 2024 Papers https://openaccess.thecvf.com/WACV2024
  5. MM 2023 Proceedings https://dl.acm.org/doi/proceedings/10.1145/3581783
  6. ICML 2023 https://dblp.org/db/conf/icml/icml2023.html
  7. ICCV 2023 Paper List https://huggingface.co/spaces/ICCV2023/ICCV2023-papers
  8. AAAI 2023 https://dblp.org/db/conf/aaai/aaai2023.html
  9. ECCV 2022 Accepted papers https://eccv2022.ecva.net/program/accepted-papers/
  10. SIGGRAPH unofficial https://kesen.realtimerendering.com/ eg SIGGRAPH 2023 https://kesen.realtimerendering.com/sig2023.html
  11. TIFS https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=10206
  12. More...