PSSM-Distil: Protein Secondary Structure Prediction (PSSP) on Low-Quality PSSM by Knowledge Distillation with Contrastive Learning
LRC-BERT: Latent-Representation Contrastive Knowledge Distillation for Natural Language Understanding
Peer Collaborative Learning for Online Knowledge Distillation
Cross-Layer Distillation with Semantic Calibration
Few-Shot Class-Incremental Learning via Relation Knowledge Distillation
Harmoniz