This repository contains a reading list of papers related to the Large-Scale Foundation (LSF) Models for Prognostics and Health Management (PHM). These papers are mainly categorized according to the key components of LSF models for PHM:

1. Large-Scale Datasets for PHM
2. Transformer for PHM
3. Self-Supervised Learning for PHM
4. Multi-Modal Fusion for PHM
5. Knowledge Transfer for PHM
6. Federated Learning for PHM
7. Interpretable for PHM
8. Imbalanced

We will try our best to continuously maintain this Repository in weekly manner. If you have found any relevant papers that you would like to be included in this repository, please feel free to submit a pull request (PR) or open an issue.

First, we list the Survey related in PHM-LSF, and then we tag the above eight key components related papers respectively. Furthermore, Knowledge Transfer for PHM includes two parts: Transfer Learning and Few Shot Learning. Finally, some valuable reference links are posted.

Date	Method	Type	Conference & Journals	Paper Title and Paper Interpretation (In Chinese)	code
22-04-01	Time–Frequency Transformer		MSSP	A novel time–frequency Transformer based on self–attention mechanism and its application in fault diagnosis of rolling bearings	None
22-04-01	LGF-Trans		QRS-C	Transformer for High-Speed Train Wheel Wear Prediction with Multiplex Local-Global Temporal Fusion	None
23-01-14	SANet		AEI	You can get smaller: A lightweight self-activation convolution unit modified by transformer for fault diagnosis	None
22-04-23	TST		Neurocom	A Time Series Transformer based method for the rotating machinery fault diagnosis	None
21-11-10	ProTran		NeurIPS 2021	Probabilistic Transformer for Time Series Analysis	TST
21-07-01	GFNet		NeurIPS 2021	Global Filter Networks for Image Classification	GFNet
23-03-19	MWA-CNN		MSSP	Interpretable convolutional neural network with multilayer wavelet for Noise-Robust Machinery fault diagnosis	MWA-CNN
21-06-25	TransFuser		CVPR 2021	Multi-Modal Fusion Transformer for End-to-End Autonomous Driving	transfuser
22-05-31	TransFuser		PAMI 2022	TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving	transfuser

Date	Method	Type	Conference & Journals	Paper Title and Paper Interpretation (In Chinese)	Code
23-01-30	Contrastive Feature Learning		TII	Domain Discrepancy-guided Contrastive Feature Learning for Few-shot Industrial Fault Diagnosis under Variable Working Conditions	None
22-01-11	Prior Features-augmented		TIE	Prior Knowledge-Augmented Self-Supervised Feature Learning for Few-shot Intelligent Fault Diagnosis of Machines	None
22–09-01	CSM		MSSP	Contrastive-weighted self-supervised model for long-tailed data classification with vision transformer augmented	None
23-01-19	I-JEPA		CVPR 2023	Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture	I-JEPA
23-06-16	SSL4TS		ArXiv 2023	Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects	Awesome-SSL4TS
23-05-18	TS-PTMs		ArXiv 2023	A Survey on Time-Series Pre-Trained Models	time-series-ptms
20-05-04	SSVFL		TPAMI	Self-supervised visual feature learning with deep neural networks: A survey	None
21-06-22	SSL		TKDE	Self-supervised Learning: Generative or Contrastive	None
20-10-16	CRL		ACCESS	Contrastive Representation Learning: A Framework and Review	None
22-02-01	SSPCL		RESS	Self-supervised pretraining via contrast learning for intelligent incipient fault detection of bearings	None
22-04-19	DSSDA		TIM	Deep Self-Supervised Domain Adaptation Network for Fault Diagnosis of Rotating Machine With Unlabeled Data	None
20-08-05	SSFL		TII	Toward Self-Supervised Feature Learning for Online Diagnosis of Multiple Faults in Electric Powertrains	None
22-01-28	GIDIM-CNN		Apacoust	Self-supervised learning for intelligent fault diagnosis of rotating machinery with limited labeled data	None
21-12-13	Self-CNN		KnoSys	Self-supervised signal representation learning for machinery fault diagnosis under limited annotation data	None
22-06-17	TF-C		NeurIPS 2022	Self-supervised contrastive pre-training for time series via time-frequency consistency	TFC-pretraining

Date	Method	Type	Conference & Journals	Paper Title and Paper Interpretation (In Chinese)	code
21-08-26	2MNet		RESS	2MNet: Multi-sensor and multi-scale model toward accurate fault diagnosis of rolling bearing	None
21-08-26	MRKRR		RESS	Multi-sensor gearbox fault diagnosis by using feature-fusion covariance matrix and multi-Riemannian kernel ridge regression	None
20-11-08	Impboost		Measurement	Motor fault diagnosis using attention mechanism and improved adaboost driven by multi-sensor information	None
21-04-19	Two-stage Fusion		Measurement	Fault diagnosis in a hydraulic directional valve using a two-stage multi-sensor information fusion	None
19-06-12	Wavelet		Meas. Sci. Technol.	A multi-sensor information fusion for fault diagnosis of a gearbox utilizing discrete wavelet features	None
22-10-04	MS^2-GNN		TCYB	MS^2 -GNN: Exploring GNN-Based Multimodal Fusion Network for Depression Detection	None
21-10-01	MSeqGraph		TMM	Graph-Based Multimodal Sequential Embedding for Sign Language Translation	None
21-08-31	GFN		TNNLS	Graph Fusion Network-Based Multimodal Learning for Freezing of Gait Detection	None
22-02-08	BTSF		ICML 2022	Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusion	None

Date	Method	Type	Conference & Journals	Paper Title and Paper Interpretation (In Chinese)	Code
21–03-11	Federated Transfer Learning		TMECH	Federated Transfer Learning for Intelligent Fault Diagnostics Using Deep Adversarial Networks With Data Privacy	None
20-06-30	Modified Transfer CNN		TII	Intelligent Fault Diagnosis of Rotor-Bearing System Under Varying Working Conditions With Modified Transfer Convolutional Neural Network and Thermal Images	None
20-05-14	WATN		TII	A Novel Weighted Adversarial Transfer Network for Partial Domain Fault Diagnosis of Machinery	None
21-04-22	DAGCN		TIM	Domain Adversarial Graph Convolutional Network for Fault Diagnosis Under Variable Working Conditions	DAGCN
21-11-09	T3A		NeurIPS 2021	Test-Time Classififier Adjustment Module for Model-Agnostic Domain Generalization	T3A
21-11-02	Domain Bed		CVPR 2021	Adaptive Methods for Real-World Domain Generalization	DomainBed
20-06-18	Tent		ICLR 2021 Spotlight	Tent: Fully Test-Time Adaptation by Entropy Minimization	tent
21-07-20	TADE		NeurIPS 2022	Self-Supervised Aggregation of Diverse Experts for Test-Agnostic Long-Tailed Recognition	TADE-AgnosticLT
21-09-13	CDTrans		ICLR 2022	CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation	CDTrans

Date	Method	Type	Conference & Journals	Paper Title and Paper Interpretation (In Chinese)	Code
22-09-09	DGNNet		TII	Few-Shot Learning for Fault Diagnosis With a Dual Graph Neural Network	None
22-12-26	MWPN		TIM	Multiscale Wavelet Prototypical Network for Cross-Component Few-Shot Intelligent Fault Diagnosis	None
23-02-20	Model-embedded		TII	Dynamic Model-embedded Intelligent Machine Fault Diagnosis without Fault Data	None
21-06-16	FSM3		MSSP	Metric-based meta-learning model for few-shot fault diagnosis under multiple limited data conditions	FSM3
21-01-05	MMC-HVDC		TCYB	Short-Time Wavelet Entropy Integrating Improved LSTM for Fault Diagnosis of Modular Multilevel Converter	None
22-06-06	TSML		TII	Task-Sequencing Meta Learning for Intelligent Few-Shot Fault Diagnosis with Limited Data	None
20-10-29	SSGCDBN		TII	Semisupervised Graph Convolution Deep Belief Network for Fault Diagnosis of Electormechanical System With Limited Labeled Data	None
20-03-25	DK-DBLF		TIE	Domain Knowledge-Based Deep-Broad Learning Framework for Fault Diagnosis	None
22-01-01	LDS-IFD		MSSP	A label description space embedded model for zero-shot intelligent diagnosis of mechanical compound faults	None
21-03-16	SSMN		ISATRA	Semi-supervised meta-learning networks with squeeze-and-excitation attention for few-shot fault diagnosis	SSMN
20-04-20	Fault Descriptions		TII	Fault Description Based Attribute Transfer for Zero-Sample Industrial Fault Diagnosis	Industrial_ZSL
20-10-09	MGPGAN		TII	A Small Sample Focused Intelligent Fault Diagnosis Scheme of Machines via Multi-modules Learning with Gradient Penalized Generative Adversarial Networks	None
20-05-06	Conditions Transfer		Measurement	Few-shot Transfer Learning for Intelligent Fault Diagnosis of Machine	FSTL
22-09-28	SCE		TII	Semantic-Consistent Embedding for Zero-Shot Fault Diagnosis	Semantic-consistent-Embedding
21-06-21	ZLCFDM		ESWA	Zero-shot learning for compound fault diagnosis of bearings	None

ate	Method	Type	Conference & Journals	Paper Title and Paper Interpretation (In Chinese)	Code
23-02-06	FL_WPD		TVT	Fault Diagnosis of Multi-railway High-Speed Train Bogies by Improved Federated Learning	None
20-12-11	FL_VD		KnoSys	Federated learning for machinery fault diagnosis with dynamic validation and self-supervision	None
22-08-22	CA-CNN		TIM	Hierarchical Federated Learning for Power Transformer Fault Diagnosis	None
22-01-11	Prior Features-augmented		TIE	Prior Knowledge-Augmented Self-Supervised Feature Learning for Few-shot Intelligent Fault Diagnosis of Machines	None

Date	Method	Type	Conference & Journals	Paper Title and Paper Interpretation (In Chinese)	code
22-09-05	TFN		ArXiv 2022	TFN: An Interpretable Neural Network with Time-Frequency Transform Embedded for Intelligent Fault Diagnosis	tfn
23-06-08	CTA-GNN		TII	Causal-Trivial Attention Graph Neural Network for Fault Diagnosis of Complex Industrial Processes	CTAB
22-12-28	GWDN		TNNLS	Explainable Graph Wavelet Denoising Network for Intelligent Fault Diagnosis	None
22-10-21	PCVNN		TNNLS	Physics-Constraint Variational Neural Network for Wear State Assessment of External Gear Pump	None
21-12-17	IAGNNs		TNNLS	Interaction-Aware Graph Neural Networks for Fault Diagnosis of Complex Industrial Processes	IAGNN
21-03-19	Trustworthy		Knowl Inf Syst	Interpretable deep learning: Interpretation, interpretability, trustworthiness, and beyond	None
20-10-26	Metrics		NeurIPS 2020	Benchmarking deep learning interpretability in time series predictions	TS-Interpretability-Benchmark
19-07-31	deep-SincNet		TIM	Robust interpretable deep learning for intelligent fault diagnosis of induction motors	None
21-01-20	WKN		TSMC	WaveletKernelNet: An interpretable deep neural network for industrial intelligent diagnosis	WaveletKernelNet
23-06-15	WPConvNet		TNNLS	Interpretable convolutional neural network with multilayer wavelet for Noise-Robust Machinery fault diagnosis	None

Date	Method	Type	Conference & Journals	Paper Title and Paper Interpretation (In Chinese)	code
21-07-27	DiagSelect		TII	Imbalanced Sample Selection With Deep Reinforcement Learning for Fault Diagnosis	None
21-09-29	DAGAN		JSEN	Dual-Attention Generative Adversarial Networks for Fault Diagnosis Under the Class-Imbalanced Conditions	None
20-05-20	Residual Signal		TIE	Fault diagnosis of an autonomous vehicle with an improved SVM algorithm subject to unbalanced datasets	None

• Bearings and Gearbox PHM

• Bearings PHM

• Rotating-Machine-Fault-Dataset

• Prognostics Center of Excellence (NASA ISD)

• Awesome-Graph-Neural-Network-for-PHM

• Awesome-Graph-Explainability-Papers

• Awesome-Domain-Adaptation

• Awesome-Industrial-Machine-Datasets

• Awesome Graph Causal Learning