Resources on Scikit-HEP

Table of contents

• Scikit-HEP tutorials
• Publications
• Conference proceedings
• Press articles
• Presentations

A collection of tutorials and presentations, videos and publications on, or related to, the Scikit-HEP project.

Scikit-HEP tutorials

• HSF Scikit-HEP tutorial
• WIP Scikit-HEP Jupyter Book
• HSF Uproot tutorial

Publications

• Fitting the BumpHunter test statistic distribution and global p-value estimation, L. Vaslin, S. Calvet, V. Barra, J. Donini, arXiv:2211.07446 [hep-ex]
• pyBumpHunter: A model independent bump hunting tool in Python for High Energy Physics analyses, L. Vaslin, S. Calvet, V. Barra, J. Donini, arXiv:2208.14760 [hep-ex]
• An array-oriented Python interface for FastJet, Aryan Roy, Jim Pivarski and Chad Freer, arXiv:2202.03911 [hep-ex]
• pyhf: pure-Python implementation of HistFactory statistical models, L. Heinrich, M. Feickert, G. Stark and K. Cranmer, J. Open Source Softw. 6 2823 (2021)
• Bayesian Block Histogramming for High Energy Physics, Brian Pollack, Saptaparna Bhattacharya, Michael Schmitt, arXiv:1708.00810 [physics.data-an]

Conference proceedings

• Bayesian Methodologies with pyhf, M. Feickert, L. Heinrich, M. Horstmann, CHEP 2023 Conference, Norfolk, USA; EPJ Web of Conferences 295, 06004 (2024); arXiv:2309.17005 [stat.CO]
• Awkward Just-In-Time (JIT) Compilation: A Developer’s Experience, I. Osborne, J. Pivarski, I. Ifrim, A. Hollands, H. Schreiner, CHEP 2023 Conference, Norfolk, USA; EPJ Web of Conferences 295, 06003 (2024)
• The Awkward World of Python and C++, M. Goyal, I. Osborne and J. Pivarski, ACAT 2022 Workshop, Bari, Italy; arXiv:2303.02205 [cs.MS]
• Distributed statistical inference with pyhf enabled through funcX, M. Feickert, L. Heinrich, G. Stark and B. Galewsky, virtual CHEP 2021 Conference; EPJ Web of Conferences 251, 02070 (2021)
• AwkwardForth: accelerating Uproot with an internal DSL, J. Pivarski, I. Osborne, P. Das, D. Lange and P. Elmer, virtual CHEP 2021 Conference; EPJ Web of Conferences 251, 03002 (2021); arXiv:2102.13516 [cs.PL]
• Awkward Array: JSON-like data, NumPy-like idioms, Jim Pivarski, Ianna Osborne, Pratyush Das, Anish Biswas and Peter Elmer, SciPy 2020 Conference, Online; 10.25080/Majora-342d178e-00b
• Boost-histogram: High-Performance Histograms as Objects, Henry Schreiner, Hans Dembinski, Shuo Liu, Jim Pivarski, SciPy 2020 Conference, Online; 10.25080/Majora-342d178e-009
• Recent developments in histogram libraries, H. Dembinski, J. Pivarski and H. Schreiner, CHEP 2019 Conference, Adelaide, Australia; EPJ Web of Conferences 245, 05014 (2020)
• Awkward Arrays in Python, C++, and Numba, J, Pivarski, P. Elmer and D. Lange, CHEP 2019 Conference, Adelaide, Australia; EPJ Web of Conferences 245, 05023 (2020); arXiv:2001.06307 [cs.MS]
• zfit: scalable pythonic fitting, Jonas Eschle, Albert Navarro Puig, Rafael Silva Coutinho and Nicola Serra, CHEP 2019 Conference, Adelaide, Australia; EPJ Web of Conferences 245, 06025 (2020)
• The Scikit HEP Project - overview and prospects, Eduardo Rodrigues et al., CHEP 2019 Conference, Adelaide, Australia; EPJ Web of Conferences 245, 06028 (2020); arXiv:2007.03577 [physics.comp-ph]
• Nested data structures in array frameworks, J, Pivarski, D. Lange and P. Elmer, ACAT 2019 Workshop, Saas Fee, Switzerland; J. Phys. Conf. Ser. 1525 (2020), 012053
• The Scikit-HEP project, Eduardo Rodrigues, CHEP 2018 Conference, Sofia, Bulgaria; EPJ Web of Conferences 214, 06005 (2019); arXiv:1905.00002 [physics.comp-ph]
• Columnar data processing for HEP analysis, Jim Pivarski, Jaydeep Nandi, David Lange and Peter Elmer, CHEP 2018 Conference, Sofia, Bulgaria; EPJ Web of Conferences 214, 06026 (2019)

Press articles

• Apr 2021: CERN Courier May/June 2021, LHC reinterpreters think long-term
• Jan 2021: Symmetry Magazine, ATLAS releases ‘full orchestra’ of analysis instruments
• Jan 2020: CERN News, New open release allows theorists to explore LHC data in a new way: The ATLAS collaboration releases full analysis likelihoods, a first for an LHC experiment

Presentations

• 19-25 October 2024: CHEP 2024 - 27th International Conference on Computing in High Energy and Nuclear Physics:

  • A new SymPy backend for vector: uniting experimental and theoretical physicists, Saransh Chopra [link]

• 1-4 July 2024: PyHEP 2024 Workshop:

  • A new SymPy backend for vector: uniting experimental and theoretical physicists, Saransh Chopra [Zenodo link]

• 9-12 October 2023: PyHEP 2023 Workshop:

  • What’s new with Vector? First major release is out!, Saransh Chopra [Zenodo link]

• 22-23 November 2022: Software Citation and Recognition in HEP Workshop:

  • Scikit-HEP project - On making our work citable, Eduardo Rodrigues [link]

• 25 October 2022: ACAT 2022 - 21st International Workshop on Advanced Computing and Analysis Techniques in Physics Research:

  • Awkward to RDataFrame and back, Ianna Osborne [link]

• 6 October 2022: 143rd ROOT Parallelism, Performance and Programming Model Meeting:

  • Awkward <–> RDataFrame Status, Ianna Osborne [link]

• 12-16 September 2022: PyHEP 2022 Workshop:

  • Histograms as Objects: Tools for Efficient Analysis and Interactivity, Aman Goel, Jay Gohil [Zenodo link]
  • Uproot, Awkward Array, hist, Vector: from basics to combinatorics, Jim Pivarski [Zenodo link]
  • iminuit: fitting models to data, Hans Peter Dembinski [Zenodo link]
  • The Particle & DecayLanguage packages, Eduardo Rodrigues [Zenodo link]
  • Constructing HEP vectors and analyzing HEP data using Vector, Saransh Chopra [Zenodo link]
  • pyhepmc: a Pythonic interface to HepMC3, Hans Peter Dembinski [Zenodo link]
  • Awkward RDataFrame Tutorial, Ianna Osborne [Zenodo link]
  • Uproot + Dask, Kush Kothari [Zenodo link]

• 6 September 2022: ATLAS HDBS Workshop 2022:

  • pyhf and analysis optimization with automatic differentiation, Matthew Feickert [link]

• 2 August 2022: CAMPFIRE 2022:

  • Uproot Tutorial, Mason Proffitt [link]

• 25 July 2022: NSF Cyberinfrastructure for Sustained Scientific Innovation (CSSI) Principal Investigator Meeting:

  • Awkward Arrays: Accelerating scientific data analysis on irregularly shaped data (poster), Jim Pivarski

• 14 July 2022: SciPy 2022:

  • Awkward Packaging: building Scikit-HEP, Henry Schreiner [link]

• 8 July 2022: ICHEP 2022 - International Conference on High Energy Physics:

  • pyhf: a pure-Python statistical fitting library with tensors and automatic differentiation, Matthew Feickert [link]

• 28 June 2022: Hybrid ATLAS Induction Day + Software Tutorial:

  • pyhf tutorial, Alexander Held [link]

• 9 June 2022: ATLAS Statistics Forum Meeting:

  • Introduction to pyhf and experience in the context of ATLAS, Alexander Held [link]

• 10 May 2022: ROOT Users Workshop:

  • Awkward Array to RDataFrame and back, Ianna Osborne [link]

• 30 April 2022: PyCon US 2022 Lightning talks:

  • Scikit-HEP Developer Pages: Guidelines for modern packaging, Henry Schreiner [link]

• 25 April 2022: IRIS-HEP AGC Tools 2022 Workshop:

  • Statistical inference: pyhf and cabinetry, Matthew Feickert [link]
  • Foundation libraries (uproot, awkward, hist, mplhep), Mason Proffitt [link]

• 6 April 2022: PyHEP WG Topical Meeting:

  • Awkward Array Updates, Jim Pivarski [link]

• 15 March 2022: ATLAS SUSY Background Forum:

  • Introduction to cabinetry, Alexander Held [link]

• 1 December 2021: ACAT 2021:

  • Python histogram developments (poster), Henry Schreiner [link]

• 1 December 2021: Analysis Tools Task Force OPEN Wednesday Meeting:

  • pyhf: pure-Python implementation of HistFactory with tensors and automatic differentiation, Matthew Feickert [PDF]

• 3 November 2021: IRIS-HEP AGC Tools 2021 Workshop:

  • Data handling: uproot, awkward & vector, Mason Proffitt [link]
  • From data delivery to statistical inference: ServiceX, coffea, cabinetry & pyhf, Alexander Held [link]

• 27 October 2021: Parsl & funcX Fest 2021:

  • Distributed statistical inference with pyhf powered by funcX, Matthew Feickert [PDF]

• 21 September 2021: ATLAS SUSY Workshop 2021:

  • pyhf and cabinetry, Alexander Held [link]

• 13 September 2021: STAR Junior’s meeting:

  • Uproot/Awkward Array tutorial for STAR, Jim Pivarski [GitHub repo.]

• 27 August 2021: HEP Software Foundation and IRIS-HEP Software Carpentry, virtual:

  • Uproot Tutorial, Mason Proffitt [link]

• 12-18 July 2021: SciPy 2021, 20th Python in Science Conference:

  • Distributed statistical inference with pyhf powered by funcX, Matthew Feickert [link\
  • Awkward Array 3-minute update, Jim Pivarski [YouTube]

• 5-9 July 2021: PyHEP 2021 Workshop:

  • High-Performance Histogramming for HEP Analysis, Henry Schreiner [link]
  • Distributed statistical inference with pyhf, Matthew Feickert [link]
  • Uproot and Awkward Array tutorial, Jim Pivarski [link]
  • Fastjet: Vectorizing Jet Finding, Aryan Roy [link]
  • High-Performance Histogramming for HEP Analysis, Aman Goel, Henry Schreiner and Shuo Liu [link]
  • Automating Awkward Array testing, Santam Choudhury [link]
  • mplhep, Andrzej Novak [link]
  • pyBumpHunter : A model agnostic bump hunting tool in python, Louis Vaslin [link]
  • Powerful Python Packaging for Scientific Codes, Henry Schreiner [link]

• 14 June 2021: Hands-on Advanced Tutorial Session at the Fermilab LPC:

  • Uproot Awkward Columnar HATS, Jim Pivarski [GitHub repo.]

• 7-18 June 2021: Lecture at ESCAPE Summer School 2021 - Data Science for Astronomers, Astroparticle and Particle Physics, Annecy, France (virtual event):

  • Introduction to the Scikit-HEP Big Data Python ecosystem for analysis in Particle Physics, Eduardo Rodrigues

• 26 May 2021: IRIS-HEP Analysis Systems biweekly meeting:

  • Refactoring Awkward Array, Jim Pivarski [PDF]

• 21 May 2021: Dask Distributed Summit:

  • New Dask collection type for Awkward Arrays, Jim Pivarski [link]

• 17-21 May 2021: virtual CHEP 2021 Conference:

  • AwkwardForth: accelerating Uproot with an internal DSL, Jim Pivarski [link]
  • Distributed statistical inference with pyhf enabled through funcX, Matthew Feickert [link]

• 7 April 2021: PyHEP WG Python Module of the Month Meeting:

  • pyhf Tutorial, Giordon Stark, Lukas Heinrich, Matthew Feickert [link]

• 8 December 2020: Argonne Lunch Seminar:

  • Steps Towards Differentiable and Scalable Physics Analyses at the LHC, Matthew Feickert [link]

• 4 December 2020: Mini-Workshop on Portable Inference:

  • Fitting and Statistical Inference as a Service, Matthew Feickert [PDF]

• 3 November 2020: TOOLS 2020, Tools for High Energy Physics and Cosmology Workshop:

  • pyhf: pure-Python implementation of HistFactory with tensors and automatic differentiation, Matthew Feickert [link]

• 26 October 2020: IRIS-HEP Future Analysis Systems and Facilities Blueprint Workshop:

  • Toward Fitting as a Service with pyhf, Matthew Feickert [PDF]
  • Lorentz Vector Manipulation and Histogram Handling, Henry Schreiner [PDF]
  • Access & Manipulation of Complex Data Structures: Uproot & Awkward Array, Jim Pivarski [PDF]

• 10 August 2020: Snowmass 2021 Computational Frontier Workshop:

  • Likelihood Publication and Preservation, Matthew Feickert [link]

• 13-17 July 2020: PyHEP 2020 Workshop, virtual:

  • Uproot and Awkward Array tutorial, Jim Pivarski [link]
  • The boost-histogram package, Hans Dembinski and Henry Schreiner [link]
  • Model building and statistical inference with zfit and hepstats, Jonas Eschle and Matthieu Marinangeli [link]
  • iminuit: Past and Future, Hans Dembinski [link]
  • zfit - TensorFlow 2.0: dynamic and compiled HPC, Jonas Eschle [link]
  • pyhf Tutorial: Accelerating analyses and preserving likelihoods, Matthew Feickert [link]
  • The boost-histogram package, Hans Dembinski and Henry Schreiner [link]
  • mplhep: bridging Matplotlib and HEP, Andrzej Novak [link]

• 6-12 July 2020: SciPy 2020 (19th Python in Science Conference):

  • Awkward Array: Manipulating JSON like Data with NumPy like Idioms, Jim Pivarski [YouTube]
  • Boost-histogram: High-Performance Histograms as Objects, Henry Schreiner, Hans Dembinski, Jim Pivarski, and Shuo Liu [link]
  • pyhf: a pure Python statistical fitting library with tensors and autograd, Matthew Feickert [link]

• 8 June 2020: LPC HATS: Hands-on Training for CMS:

  • Uproot Awkward columnar HATS, Jim Pivarski [GitHub repo.]

• 27 May 2020: 2020 IRIS-HEP Team Retreat:

  • pyhf Roadmap for IRIS-HEP Execution Phase, Matthew Feickert [PDF]

• 8 April 2020: Electron Ion Collider User’s meeting:

  • Uproot and Awkward Array tutorials for the Electron Ion Collider, Jim Pivarski [GitHub repo.]

• 3 March 2020: Seminar at DESY, Hamburg, Germany:

  • Introduction to the Scikit HEP project, Eduardo Rodrigues

• 27 February 2020: IRIS-HEP Poster Session:

  • Awkward Array for Analysis Systems (poster), Jim Pivarski [PDF]
  • Boost-Histogram for Analysis Systems (poster), Henry Schreiner [PDF]
  • pyhf: Pure Python Implementation of HistFactory (poster), Matthew Feickert [PDF]

• 27 February 2020: IRIS-HEP Postdoc Presentations:

  • pyhf: A Pure Python Statistical Fitting Library with Tensors and Autograd, Matthew Feickert [PDF]

• 29 November 2021: HEP Software Foundation and IRIS-HEP Software Carpentry:

  • Uproot Tutorial, Mason Proffitt [link]

• 25 November 2019: LHCb experiment Statistics Working Group meeting, CERN:

  • An introduction to pyhf and HistFactory likelihoods, Matthew Feickert [slides]

• 4-8 November 2019: CHEP 2019 conference:

  • The Scikit-HEP project - overview and prospects, Eduardo Rodrigues et al. [PDF]
  • Recent developments in histogram libraries, Henry Schreiner [PDF]
  • Ragged, jagged, nested, indirected, very awkward arrays, Jim Pivarski [PDF]

• 16-18 October 2019: PyHEP 2019 Workshop, Abingdon, U.K.:

  • The Scikit-HEP project, Eduardo Rodrigues [PDF]
  • Particles and decays, Eduardo Rodrigues [PDF]
  • Writing files with uproot, Pratyush Das [PDF]
  • Awkward 1.0, Jim Pivarski [PDF]
  • Histogramming, Henry Schreiner [PDF]
  • Introduction to iminuit, Hans Dembinski [PDF]

• 14 July 2019: Strange Loop 2019:

  • Jagged, ragged, awkward arrays, Jim Pivarski [link]
• 12-13 September 2019: 2019 IRIS-HEP Institute Retreat:
  • Histogramming and more, Henry Schreiner [PDF]

• Boost Histogram Roadmap, Henry Schreiner [PDF]

• 29 July 2019: 2019 Meeting of the Division of Particles & Fields of the American Physical Society:

  • IRIS-HEP Tutorial: Fast columnar data analysis with data science tools, Jim Pivarski [link]

• 10 July 2019: IRIS-HEP Analysis Systems Biweekly Meeting:

  • Motivation and requirements for awkward 1.0, Jim Pivarski [PDF]

• 19-20 June 2019: , IRIS-HEP Analysis Systems Topical Workshop

  • awkward, etc., Jim Pivarski [PDF]
  • Histograms, Henry Schreiner [PDF]
  • pyhf, Giordon Stark, Lukas Heinrich, Matthew Feickert [PDF]
  • AmpGen & Particle/DecayLanguage, Henry Schreiner [link]

• 18 June 2019: LHCb experiment Week, CERN:

  • Particles and decays in the Scikit-HEP project, Eduardo Rodrigues [PDF]

• 18 June 2019: 3rd CMS Machine Learning Workshop:

  • Uproot: accessing ROOT data in the scientific Python ecosystem, Jim Pivarski [link]

• 10 June 2019: U.S. ATLAS Software Training at Argonne National Lab:

  • NumPy, Pandas, PyROOT, and Uproot, Jim Pivarski [link]

• 29 May 2019: Hands-on Training for CMS at the Fermilab LPC:

  • Columnar Analysis Tools HATS, Jim Pivarski [link]

• 28 May 2019: Hands-on Training for CMS at the Fermilab LPC:

  • Scientific Python and Uproot HATS, Jim Pivarski [link]

• 21 May 2019: Belle II experiment Analysis Software Developers' Meeting

  • Particles and decays in the Scikit-HEP project, Eduardo Rodrigues, Henry Schreiner

• 13 May 2019: IRIS-HEP project topical meeting:

  • Particles and decays in the Scikit-HEP project, Eduardo Rodrigues, Henry Schreiner

• 17 April 2019: IRIS-HEP project topical meeting:

  • Awkward Array: Numba, Jim Pivarski
  • Awkward Array: Pandas, Michael Hedges

• 15 April 2019: IRIS-HEP project topical meeting:

  • boost-histogram and hist, Henry Schreiner [PDF]
  • Aghast, Jim Pivarski [PDF]

• 1 April 2019: Software Carpentry at Fermilab:

  • PyROOT, uproot, and awkward-arrays, Jim Pivarski [GitHub repo.]

• 21 March 2019: PyGamma19 Workshop, Heidelberg, Germany:

  • Python in High-Energy Physics, Hans Dembinski [PDF]

• 15 October 2018: DIANA/HEP project topical meeting:

  • I/O for uproot, Pratyush Das

• 10 September 2018: ROOT 2018 Users Workshop, Sarajevo , Bosnia and Herzegovina:

  • Writing ROOT files with uproot, Pratyush Das, Jim Pivarski

• 9 July 2018: CHEP 2018 Conference, Sofia, Bulgaria:

  • The Scikit-HEP project, Eduardo Rodrigues [PDF]

• 7 July 2018: PyHEP 2018 Workshop, Sofia, Bulgaria:

  • The Scikit-HEP project, Matthieu Marinangeli

• 28 February 2018: IML Meeting, CERN:

  • Uproot: rapidly moving data from ROOT to NumPy and Pandas, Jim Pivarski

• 23 October 2017: DIANA/HEP project topical meeting, CERN:

  • numpythia & pyjet - interfacing PYTHIA and FastJet with NumPy, Noel Dawe

• 11 September 2017: project status report, DIANA/HEP project topical meeting, CERN:

  • Scikit-HEP project status, Eduardo Rodrigues

• 6 April 2017: presentation of the project to the LHCb experiment, LHCb experiment Analysis & Software Week, CERN:

  • The Scikit-HEP project, Eduardo Rodrigues [PDF]
• 27 February 2017: first presentation of the project, DIANA/HEP project topical meeting, CERN:
  • The Scikit-HEP project, Eduardo Rodrigues
  • Ostap concepts in Scikit-HEP, Vanya Belyaev
  • Rootpy and root_numpy concepts in Scikit-HEP, Noel Dawe