Job Performance (SUPReMM) Module for Open XDMoD 8.6.0 Release Candidate 4

Merge pull request #210 from jpwhite4/provider

Add GroupByProvider.

Job Performance (SUPReMM) Module for Open XDMoD 8.6.0 Release Candidate 2

Merge pull request #210 from jpwhite4/provider

Add GroupByProvider.

Job Performance (SUPReMM) Module for Open XDMoD 8.6.0

Merge pull request #209 from jpwhite4/optimizeflags

Add option to agg script to configure optimise table (backport to 8.6)

Job Performance (SUPReMM) Module for Open XDMoD 8.5.0

• Features

  • Add Job Efficiency reporting capability. This includes classification
    of jobs based on performance metrics and components for the new Dashboard
    tab that show the efficiency metrics by user.
  • Add ability to export Job Performance data via the new Data Export tab.
  • Added extra statistics for mounted filesystems /home, /projects and
    /util. The default source data for these statistics is from the
    nfs mounted filesystems.
  • Added ability to configure which devices are used for the various I/O
    metrics.

• Miscellaneous

  • Various updates to the module required to support XDMoD 8.5.
  • The automated CI testing now confirms that the software works with a
    password protected MongoDB database.
  • Add more automated CI tests.

• Bug Fixes

  • Jobs listed in the advance search results in the job viewer and in the show raw data
    dialog in the metric explorer are now guaranteed to be ordered based on the
    job end time.

Job Performance (SUPReMM) Module for Open XDMoD 8.5.0 Release Candidate 3

Merge pull request #196 from jpwhite4/job_search_realm

Add tests to confirm ubcc/xdmod#1092

Job Performance (SUPReMM) Module for Open XDMoD 8.5.0 Release Candidate 2

v8.5.0-rc.2

Ensure JobEfficiency realm is not shown in metric catalog (#195)

Job Performance (SUPReMM) Module for Open XDMoD 8.5.0 Release Candidate 1

Merge pull request #166 from jpwhite4/network

Added extra mappings

Job Performance (SUPReMM) Module for Open XDMoD 8.1.0

• Features

  • Add support for GPU metrics. If available, the GPU usage and GPU memory
    usage for job are shown in the Job Viewer. It is now possible to group
    and filter by GPU usage in the Metric and Usage Explorer tabs.
  • Add support for energy metrics. If available, energy metrics for a job
    are shown in the Job Viewer. Energy metrics are not available in the
    Metric or Usage Explorer tabs.
  • Improve the application identification algorithm and add more community
    applications to the database.
  • Add more command line options to the sharedjobs script to control which
    resources are scanned and the scan time range.
  • Improve performance of the sharedjobs script when processing large
    amounts of data (~millions of jobs at a time).

• Bug Fixes

  • The data mapping for InfiniBand metrics previously would only use data for the
    hardcoded mlx0 device. The mapping has been updated to default to the first
    available InfiniBand device.
  • Add job end time as an additional unique constraint on the jobhosts table.
  • Updated label for GPU usage displayed in the job viewer.

• Miscellaneous

  • Several updates required by internal API changes in xdmod 8.1. This
    includes updates to the internal API for the Job Viewer search and
    updates for the internal configuration file API.
  • The nodejs library dependencies are now packaged in the main xdmod and no
    longer need to be installed/updated as a separate step. Removed code
    associated with this install step.
  • The dynamically generated MySQL tables are now managed via the ETLv2
    framework.
  • Updates to the continuous integration (CI) scripts to add more tests.
  • Update mongodb driver version

Job Performance (SUPReMM) Module for Open XDMoD 8.1.0 Release Candidate 1

v8.1.0-rc.1

Update upgrade documentation and add required cmds.

Job Performance (SUPReMM) Module for Open XDMoD 8.0.0

• Features

  • Improved performance of aggregation process by switching to the ETLv2 framework.
  • Improved performance of shared jobs analysis script.

• Bug Fixes

  • Changed the database table that stores job scripts so that it can support job arrays and fixed
    missing unique key that resulted in redundant data storage.
  • Only show enabled resources in the Internal Dashboard dataflow diagram.

• Miscellaneous

  • Updated documentation and added troubleshooting information.
  • Added a xdmod-supremm-jobinfo script that prints information about individual
    jobs. This is intended to be used for troubleshooting purposes.