Finetuning Foundation Models for Joint Analysis Optimization

Author:

Matthias Vig, Nicole Hartman, Lukas Heinrich

Keyword:

High Energy Physics - Experiment, High Energy Physics - Experiment (hep-ex), Machine Learning (cs.LG), High Energy Physics - Phenomenology (hep-ph), Data Analysis, Statistics and Probability (physics.data-an)

journal:

date:

2024-01-24 00:00:00

Abstract

In this work we demonstrate that significant gains in performance and data efficiency can be achieved in High Energy Physics (HEP) by moving beyond the standard paradigm of sequential optimization or reconstruction and analysis components. We conceptually connect HEP reconstruction and analysis to modern machine learning workflows such as pretraining, finetuning, domain adaptation and high-dimensional embedding spaces and quantify the gains in the example usecase of searches of heavy resonances decaying via an intermediate di-Higgs system to four $b$-jets.

PDF: Finetuning Foundation Models for Joint Analysis Optimization.pdf