PaTz — Physics-Aware Transformer with eXplainability
ā— API Offlinepatz_env

Research Overview

PhD RESEARCH

PaTz — Physics-Aware Transformer with eXplainability for HIV-TB Co-infection Protein Analysis

This research develops a novel deep learning framework — PaTz — that combines protein language model embeddings (ESM-2 650M), geometric reasoning (Pairformer), physics-constrained structure generation (score-based diffusion with differentiable energy terms), and explainability (Integrated Gradients + MC-Dropout uncertainty) for the analysis of HIV-TB co-infection proteins. The framework is evaluated on a curated dataset of 2,620 proteins from HIV-1 and M. tuberculosis H37Rv, achieving Fmax=0.3212 on GO function prediction — competitive for multilabel annotation of pathogen proteomes.

01
HIV-TB Co-infection Characterization

Identify structural and functional commonalities between HIV-1 and M. tuberculosis proteomes to understand co-infection mechanisms at the molecular level.

02
Physics-Aware Structure Prediction

Integrate differentiable Cα energy terms (bond, angle, clash) into a score-based diffusion model for physically-constrained 3D protein structure generation.

03
GO Function Annotation

Multilabel prediction of 354 Gene Ontology terms (BP, MF, CC) using a specialized FunctionHead. CAFA-style Fmax evaluation protocol.

04
Explainability via Integrated Gradients

Per-residue attribution analysis using Captum IG to identify which amino acid positions drive each functional prediction, supporting mechanistic interpretability.

05
Drug Candidate Screening

Multi-objective scoring of 20 flavonoid compounds against HIV-TB co-infection targets, combining structural, functional, binding, immune, and XAI scores.

Key Results Summary
Test Fmax
0.3212
CAFA GO prediction
AUROC
0.857
Binary classification
AUPRC
0.218
Precision-recall
Parameters
4,387,749
PaTz model
Training proteins
1,833
MMseqs2 30% split
GO vocabulary
354
Unique GO terms