QProtFuse: Query-Guided Layer Fusion for Retrieval-Augmented Protein Function Prediction

Introduction to the show: ident: Genomics Radio. Generated commentary on the latest computational biology and genomics papers.

Ines: I'm Ines.

Marcus: And I'm Marcus, here with Yuki.

Ines: We're looking at the paper: "QProtFuse: Query-Guided Layer Fusion for Retrieval-Augmented Protein Function Prediction".

Marcus: Here's the gist of the paper. The gist The QProtFuse method proposes query-guided layer fusion to adaptively fuse multilayer protein features and jointly learns protein and annotation retrieval through intra-modal and cross-modal contrastive objectives to improve retrieval-augmented protein function prediction.

Ines: Predicting protein functions from amino acid sequences is essential to understanding biological processes, yet existing retrieval methods primarily expand external signals while overlooking the rich knowledge encoded within a single protein language model (PLM) The paper investigates whether different PLM layers exhibit distinct strengths in protein retrieval and how this internal knowledge can be effectively used to improve protein RAG Layerwise Probing and Fusion Strategy The study first probed the layerwise retrieval performance of ESM-2 on Prot-Inst-OOD tasks, showing that "the four subtasks achieve their best retrieval performance using features from different intermediate layers" This observation led to the proposal of QProtFuse, which "leverages the query to adaptively assign layer-wise weights and fuse multi-layer features".

Marcus: The fusion process involves grouping consecutive PLM layers and then conditioning this fusion on a frozen text encoder that maps queries to group weights via an MLP.

Ines: Joint Contrastive Learning Objectives QProtFuse is trained with a dual-objective contrastive learning framework consisting of two complementary objectives: intra-modal protein-to-protein (PP) alignment and cross-modal protein-to-annotation (PA) alignment.

Paper summary: Marcus: Looking at the authors of this paper, Mianzhi Pan, Peishuo Liu, Yawen Ouyang, Botian Wang, Yiming Rong, Hao Zhou. They are all working in areas related to AI and bioinformatics research at places like Nanjing University and Tsinghua University > it shows how these kinds of cross-disciplinary teams are tackling these complex problems >

Ines: The paper QProtFuse: Query-Guided Layer Fusion for Retrieval-Augmented Protein Function Prediction is significant because it moves away from the old idea of just using the last layer of a protein model > it establishes that the way we fuse information internally matters more than just picking a single component >

Yuki: For someone looking at this, what does this mean practically? It suggests that when you use a protein language model for function prediction, you shouldn't assume every layer is equally good at finding the right biological matches >

Marcus: It means we should think about how to guide the fusion process with a query, which lets us adaptively select which layers contribute most to answering our specific biological question >

Ines: So it’s about making the model smarter about its own structure through this query-guided fusion and complementary training objectives > that’s what they show helps improve downstream RAG function descriptions for models like Qwen3-8B and DeepSeek-V4-Pro >

Yuki: It supports the idea that internal knowledge, when accessed correctly, can significantly improve our ability to predict biological functions from sequences > it’s about leveraging the structure of the model itself rather than just treating it as a black box >

Conclusion: Ines: So, we’ve seen how QProtFuse adapts protein model layers using queries to boost function prediction retrieval, right?

Marcus: Yeah, it’s about moving past just picking one layer and instead using that query to guide the whole fusion process between the different layers of the protein language model.

Yuki: From a population perspective, this suggests that different parts of the protein model might be specialized for different kinds of biological questions, which is interesting because we often treat them as a single entity.

Ines: Exactly. The authors show that this query-guided fusion helps them jointly learn how to retrieve both the protein and its biological annotations, using these two contrastive objectives they built in.

Marcus: And the results are pretty solid on Prot-Inst-OOD, where they got a Recall at one of sixteen point four percent with the reranking setup. That’s a real lift over just using the final layer alone.

Yuki: That sixteen point four percent recall, when you look at it through a population lens, it means we’re getting better at linking sequence features to actual known biological functions in a way that respects the complexity of the model structure.

Ines: But what does this actually mean for us? It means that for function prediction using large language models, you don't just rely on whatever layer happens to be best; you can dynamically adjust how those layers work together based on the specific question you’re asking.

Marcus: And when we look at the downstream LLM-as-a-judge scores, like Qwen3 and DeepSeek V4 Pro getting up to six point two and six point six eight, that tells us this retrieval improvement actually translates into better function descriptions for those bigger models.

Yuki: It suggests that exploiting the internal knowledge of a single protein language model in this adaptive way is a more effective strategy than just feeding it everything at once.

Ines: So, QProtFuse shows how leveraging the model's internal structure intelligently can give us much stronger results when we’re trying to predict function from an amino acid sequence.

Marcus: It opens up a new way to think about fine-tuning these models for biological tasks by considering their architecture dynamically instead of statically.

Yuki: Next, we have to look at how this adaptive fusion performs on different types of protein structures or maybe even different disease states, which is where we really test the robustness of this approach.