Please visit Jefferson Lab Event Policies and Guidance before planning your next event: https://www.jlab.org/conference_planning.
May 8 – 12, 2023
Norfolk Waterside Marriott
US/Eastern timezone

Symbolic Regression on FPGAs for Fast Machine Learning Inference

May 11, 2023, 12:30 PM
15m
Hampton Roads VII (Norfolk Waterside Marriott)

Hampton Roads VII

Norfolk Waterside Marriott

235 East Main Street Norfolk, VA 23510
Oral Track 9 - Artificial Intelligence and Machine Learning Track 9 - Artificial Intelligence and Machine Learning

Speaker

Mr Tsoi, Ho Fung (University of Wisconsin Madison)

Description

The high-energy physics community is investigating the feasibility of deploying more machine-learning-based solutions on FPGAs to meet modern physics experiments' sensitivity and latency demands. In this contribution, we introduce a novel end-to-end procedure that utilises a forgotten method in machine learning, i.e. symbolic regression (SR). It searches equation space to discover algebraic relations approximating a dataset. We use PySR (software for uncovering these expressions based on evolutionary algorithms) and extend the functionality of hls4ml (a package for machine learning inference in FPGAs) to support PySR-generated expressions for resource-constrained production environments. Deep learning models often optimise the top metric by pinning the network size because vast hyperparameter space prevents extensive neural architecture search. Conversely, SR selects a set of models on the Pareto front, which allows for optimising the performance-resource tradeoff directly. By embedding symbolic forms, our implementation can dramatically reduce the computational resources needed to perform critical tasks. We validate our procedure on multiple physics benchmarks as an alternative to deep learning and decision tree models.

Consider for long presentation Yes

Primary authors

Dr Loncar, Vladimir (Massachusetts Inst. of Technology) Mr Tsoi, Ho Fung (University of Wisconsin Madison) Pol, Adrian Alan (Princeton University) Mr Cranmer, Miles (Princeton University) Prof. Dasu, Sridhara (University of Wisconsin Madison) Dr Elmer, Peter (Princeton University) Dr Govorkova, Ekaterina (Massachusetts Inst. of Technology) Prof. Harris, Philip (MIT) Prof. Ojalvo, Isobel (Princeton University) Dr Pierini, Maurizio (CERN)

Presentation materials

Peer reviewing

Paper