loading page

Interactive Supercomputing with Jupyter
  • Rollin Thomas,
  • Shreyas Cholia
Rollin Thomas
Author Profile
Shreyas Cholia
Author Profile

Abstract

Rich user interfaces like Jupyter have the potential to make interacting with a supercomputer easier and more productive, consequently attracting new kinds of users and helping to expand the application of supercomputing to new science domains. For the scientist-user, the ideal rich user interface delivers a familiar, responsive, introspective, modular, and customizable platform upon which to build, run, capture, document, re-run, and share analysis workflows. From the provider or system administrator perspective, such a platform would also be easy to configure, deploy securely, update, customize, and support. Jupyter checks most if not all of these boxes. But from the perspective of leadership computing organizations that provide supercomputing power to users, such a platform should also make the unique features of a supercomputer center more accessible to users and more composable with high performance computing (HPC) workflows. Project Jupyter's core design philosophy of extensibility, abstraction, and agnostic deployment, has allowed HPC centers like NERSC to bring in advanced supercomputing capabilities that can extend the interactive notebook environment. This has enabled a rich scientific discovery platform, particularly for experimental facility data analysis and machine learning problems.  

Peer review status:Published

14 Jan 2021Submitted to Computing in Science and Engineering
14 Jan 2021Editor invited a reviewer
15 Jan 2021Review Report #1 received
01 Feb 2021Published in Computing in Science and Engineering
01 Mar 2021Published in Computing in Science & Engineering volume 23 issue 2 on pages 93-98. 10.1109/MCSE.2021.3059037
10.22541/au.161133668.88481894/v1
John Shalf posted a review
This is a review of the article "Interactive Supercomputing with Jupyter: Lessons Learned from the National Energy Research Scientific Computing Center," for the Leadership Computing department of Computing in Science and Engineering. The article was invited to complement a Special Issue on "Jupyter in Computational Science."CommentsIn the abstract, the last sentence capitalizes "Jupyter Project" but then later says "engage with the Project".  I think the second project should be lower case or you could have a capital "Jupyter", but project should not be capitalized.  Given this