Loading...
Unifying invariant and variant features for graph out-of-distribution via probability of necessity and sufficiency
Chen, Xuexin Cai, Ruichu Zheng, Kaitao Jiang, Zhifan Huang, Zhengting Hao, Zhifeng Li, Zijian
Chen, Xuexin
Cai, Ruichu
Zheng, Kaitao
Jiang, Zhifan
Huang, Zhengting
Hao, Zhifeng
Li, Zijian
Supervisor
Department
Machine Learning
Embargo End Date
Type
Journal article
Date
2025
License
Language
English
Collections
Research Projects
Organizational Units
Journal Issue
Abstract
Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has considerable real-world applications. One of the most mainstream methods is to extract the invariant subgraph by aligning the original and augmented data with the help of environment augmentation. However, these solutions might lead to the loss or redundancy of semantic subgraphs and result in suboptimal generalization. To address this challenge, we propose exploiting Probability of Necessity and Sufficiency (PNS) to extract sufficient and necessary invariant substructures. Beyond that, we further leverage the domain variant subgraphs related to the labels to boost the generalization performance in an ensemble manner. Specifically, we first consider the data generation process for graph data. Under mild conditions, we show that the sufficient and necessary invariant subgraph can be extracted by minimizing an upper bound, built on the theoretical advance of the probability of necessity and sufficiency. To further bridge the theory and algorithm, we devise the model called Sufficiency and Necessity Inspired Graph Learning (SNIGL), which ensembles an invariant subgraph classifier on top of latent sufficient and necessary invariant subgraphs, and a domain variant subgraph classifier specific to the test domain for generalization enhancement. Experimental results demonstrate that our SNIGL model outperforms the state-of-the-art techniques on six public benchmarks, highlighting its effectiveness in real-world scenarios. © 2024 Elsevier Ltd
Citation
X. Chen et al., “Unifying invariant and variant features for graph out-of-distribution via probability of necessity and sufficiency,” Neural Networks, vol. 184, p. 107044, Apr. 2025, doi: 10.1016/j.neunet.2024.107044.
Source
Neural Networks
Conference
Keywords
Domain generalization, Graph out-of-distribution, Probability of necessity, sufficiency
Subjects
Source
Publisher
Elsevier