Proactive Data Containers (PDC)

Proactive Data Containers (PDC) software provides an object-centric API and a runtime system with a set of data object management services. These services allow placing data in the memory and storage hierarchy, performing data movement asynchronously, and providing scalable metadata operations to find data objects. PDC revolutionizes how data is stored and accessed by using object-centric abstractions to represent data that moves in the high-performance computing (HPC) memory and storage subsystems. PDC manages extensive metadata to describe data objects to find desired data efficiently as well as to store information in the data objects.

PDC API, data types, and developer notes are available in docs/readme.md

More information and publications of PDC is available at https://sdm.lbl.gov/pdc

If you use PDC in your research, please use the following citation:

Byna, Suren, Dong, Bin, Tang, Houjun, Koziol, Quincey, Mu, Jingqing, Soumagne, Jerome, Vishwanath, Venkat, Warren, Richard, and Tessier, François. Proactive Data Containers (PDC) v0.1. Computer Software. https://github.com/hpc-io/pdc. USDOE. 11 May. 2017. Web. doi:10.11578/dc.20210325.1.

Getting Started

• Getting Started
  • Dependencies
  • Installation
  • Running PDC
• Definitions
• Assumptions

Overview

• Introduction
• HDF5 VOL for PDC
• Performance

Resources

• Hello PDC Example
  • PDC Hello World
• API Documentation with Examples
  • PDC general APIs
  • PDC container APIs
  • PDC object APIs
  • PDC region APIs
  • PDC property APIs
  • PDC query APIs
  • PDC hist APIs
  • PDC Data types
  • Basic types
  • Histogram structure
  • Container info
  • Container life time
  • Object property public
  • Object property
  • Object info
  • Object structure
  • Region info
  • Access type
  • Query operators
  • Query structures
  • Selection structure
  • Developers notes
• In-flight Analysis
• Future Work

Indices and tables

• Index

• Module Index

• Search Page