Learn More
–Portals Direct I/O ("PDIO") is a special-purpose middleware infrastructure for writing data from compute processor memory on Portals-enabled compute nodes to remote agents anywhere on the WAN in real-time. The prototype implementation provided a means for aggregation of outgoing data through multiple load-balanced routing daemons, end-to-end parallel data(More)
PSC has architected and delivered the TCS-1 machine, a Terascale Computing System for use in unclassified research. PSC has enhanced the effective usability and utilization of this resource by providing custom I/O solutions in four key areas: high-performance communication, high-performance file migration, checkpoint/recovery and an updated hierarchical(More)
DMOVER is a combination of three highly portable scripts and a network optimization specific to the Pittsburgh Supercomputing Center (PSC). DMOVER provides users with a queue-oriented means for initiating large, parallel, inter-site data transfers that is expected to be familiar to all mainstream HPC users. Its flexibility enables users to effectively(More)
Traditionally, Hadoop is run on parallel machines with modest processing capabilities and large amounts of disk. A large shared-memory system may not, at first blush, seem a likely host for a Hadoop cluster, but when researchers asked to run Hadoop on our 16 TB shared memory system, Blacklight, we set out to determine how effectively Hadoop could work in(More)
" DMOVER " is a combination of three highly portable scripts and a network optimization specific to the Pittsburgh Supercomputing Center (PSC). DMOVER provides users with a queue-oriented means for initiating large, parallel, inter-site data transfers that is expected to be familiar to all mainstream high-performance computing users. Its flexibility enables(More)
The Pittsburgh Supercomputing Center has implemented a custom batch scheduler, Simon, to operate with PBS on one of its massively parallel systems. The design and implementation of an early custom scheduler on the XT3 as well as a functional overview and adaptation of Simon to the XT3 will be discussed. The Pittsburgh Supercomputing Center has implemented a(More)
  • 1