NEWS

The NHR centres NHR@FAU, NHR-Nord@Göttingen, PC2 and NHR@TUD together with GCS Centres LRZ, HLRS and HPC.nrw cordially invite you to attend the special focus talk

"Energy-Efficient Inference for Large Language Models in Information Extraction”

Thursday 10.09.26 at 2-3 pm (CEST)

https://veranstaltungen.hpc-in-deutschland.de/en-us/events/1894/

Using Large Language Models (LLMs) for Information Extraction (IE) inherently involves transforming diverse textual inputs into strictly formatted outputs. Guaranteeing this structural validity introduces a hidden energy tax driven by constrained decoding mechanisms, serialisation formats, and underlying serving configurations. Consequently, standard token-level metrics fail to capture the true energy cost of generative IE, which also cannot be predicted by model size alone. To address this, we introduce the first dedicated benchmark evaluating the energy-accuracy trade-offs of generative IE. Our framework establishes task-aligned energy metrics, including Energy per True Positive (J/TP) and the F1-Energy Ratio. Through comprehensive ablation across architectures, decoding regimes, and serving-layer limits, we demonstrate that efficiency is governed by complex parameter interactions. We translate these findings into actionable configuration guidelines, equipping practitioners to maximise predictive accuracy, optimise energy yield, or achieve a sustainable Pareto balance.

Speaker: Andrei Politov, Center for Interdisciplinary Digital Sciences, TUD Dresden University of Technology

Join the session: https://go-nhr.de/ai_on_hpc_vconf .

Free of charge. No registration required.

For general inquiries, please email aionsupercomputer@nhr-verein.de . 

Joint Initiative of NHR, GCS and HPC.nrw