18-24 June 2017
Palacio de Congresos
Europe/Madrid timezone
Home > Timetable > Session details > Contribution details

Contribution Parallel

Seminarios 8
Software Development

Job Management and Task Bundling


  • Dr. Evan BERKOWITZ

Primary authors



High Performance Computing is often performed on scarce, shared computing resources. To ensure computers are used to their full capacity, administrators often incentivize large workloads that are not possible on smaller systems.

Measurements in Lattice QCD frequently do not scale to machine-size workloads. By bundling tasks together we can create large jobs suitable for gigantic partitions.

I will discuss METAQ and mpi_jm, software developed to dynamically group computational tasks together, that can intelligently backfill to consume idle time without substantial changes to users' current workflows or executables.

Preferred track (if multiple tracks have been selected)

Software Development