• Docker
  • Charliecloud
  • Shifter
  • Singularity
  • Podman

Containerization

Includes 5 tools

Container technologies are usefor across all areas of Rse-ops, including distribution, testing, workflows, and supporting reproducibility.

Learn More containers
portability

  • git
  • subversion
  • mercurial

Version Control

Includes 3 tools

Version Control Systems (vcs) are a fundamental ingredient to working on and sharing source code.

Learn More scientific software

  • gcc
  • intel
  • cce
  • pgi
  • clang
  • mpicc

Compilers

Includes 6 tools

Compilers are the bread and butter of scientific software to turn human readable code into a machine-readable version.

Learn More scientific software

  • Python
  • R
  • Julia
  • Go

Programming Languages

Includes 4 tools

Programming languages are another cornerstone of of RSE-ops and scientific software. As programmers, we love and need them.

Learn More scientific software

  • MariaDB
  • PostgreSQL
  • MySQL
  • MongoDB
  • Sqlite
  • Redis
  • Hadoop
  • Neo4j
  • Cassandra
  • CouchDB

Database

Includes 10 tools

Databases are a subset of scientific software that allow us to save and query larger amounts of data in a systematic way.

Learn More scientific software

  • SLURM
  • Torque
  • Kubernetes
  • HTCondor

Orchestration and Scheduling

Includes 4 tools

Schedulers and orchestrator allow us to scale running workflows or analyses, regardless if we are on HPC or cloud.

Learn More scaling

  • CMake
  • Conda/Anaconda
  • Environment Modules
  • Lmod
  • PyPi (pip)
  • Spack

Building, Packaging, Application Delivery

Includes 6 tools

Package managers, or more generally, build tools and associated delivery mechanisms, are essential for building and getting software to where we need it.

Learn More continuous deployment
distribution
dependencies
distribution

  • Spark
  • openmpi
  • mvapich

Streaming and Messaging

Includes 3 tools

Streaming and Messaging tools are a common means in HPC to power large simulations and other analyses.

Learn More scaling

  • dmtcp
  • Prometheus
  • Grafana

Monitoring and Checkpointing

Includes 3 tools

Monitoring is essential not just for keeping track of service status, but also for security and understanding of large resources.

Learn More monitoring
security

  • Open OnDemand
  • Jupyter Notebooks

Web Interfaces

Includes 2 tools

Web interfaces open up portals to make interaction with scientific software and tools accessible and understandable.

Learn More accessibility

  • GitLab
  • CircleCI
  • GitHub Actions
  • Jenkins

Continuous Integration and Delivery

Includes 4 tools

Continous Integration services allow us to continually build, test, and deploy our scientific software.

Learn More continuous integration
testing