Skip to main navigation Skip to search Skip to main content

High-speed decision making on live petabyte data streams

  • William F. Badgett
  • , Kurt Biery
  • , Chris Green
  • , James B. Kowalkowski
  • , Kaori Maeshima
  • , Marc F. Paterno
  • , Robert M. Roser

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

High Energy Physics has a long history of coping with cutting-edge data rates in its efforts to extract meaning from experimental data. The quantity of data from planned future experiments that must be analyzed practically in real-time to enable efficient filtering and storage of the scientifically interesting data has driven the development of sophisticated techniques which leverage technologies such as MPI, OpenMP and Intel TBB. We show the evolution of data collection, triggering and filtering from the 1990s with TeVatron experiments into the future of Intensity Frontier and Cosmic Frontier experiments and show how the requirements of upcoming experiments lead us to the development of high-performance streaming triggerless DAQ systems.

Original languageEnglish
Title of host publicationProceedings - 2012 SC Companion
Subtitle of host publicationHigh Performance Computing, Networking Storage and Analysis, SCC 2012
PublisherIEEE Computer Society
Pages1404
Number of pages1
ISBN (Print)9780769549569
DOIs
StatePublished - 2012
Event2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012 - Salt Lake City, UT, United States
Duration: Nov 10 2012Nov 16 2012

Publication series

NameProceedings - 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012

Conference

Conference2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012
Country/TerritoryUnited States
CitySalt Lake City, UT
Period11/10/1211/16/12

Keywords

  • filtering
  • high energy physics
  • high-performance streaming triggerless DAQ systems
  • triggering

Fingerprint

Dive into the research topics of 'High-speed decision making on live petabyte data streams'. Together they form a unique fingerprint.

Cite this