Learn More
The ever-increasing scale of scientific data has become a significant challenge for researchers that rely on networks to interact with remote computing systems and transfer results to collaborators worldwide. Despite the availability of high-capacity connections, scientists struggle with inadequate cyberinfrastructure that cripples data transfer(More)
Realizing operational analytics solutions where large and complex data must be analyzed in a time-critical fashion entails integrating many different types of technology. This paper focuses on an interdisciplinary combination of scientific data management and visualization/analysis technologies targeted at reducing the time required for data filtering,(More)
In widely distributed systems generally, and in science-oriented Grids in particular, software, CPU time, storage, etc., are treated as " services " – they can be allocated and used with service guarantees that allows them to be integrated into systems that perform complex tasks. Network communication is currently not a service – it is provided, in general,(More)
Modern forensic analytics applications, like network traffic analysis , perform high-performance hypothesis testing, knowledge discovery and data mining on very large datasets. One essential strategy to reduce the time required for these operations is to select only the most relevant data records for a given computation. In this paper, we present a set of(More)
Modern forensic analytics applications, like network traffic analysis, perform high-performance hypothesis testing, knowledge discovery and data mining on very large datasets. One essential strategy to reduce the time required for these operations is to select only the most relevant data records for a given computation. In this paper, we present a set of(More)
Today's large-scale science projects all involve worldwide collaborations that must routinely move 10s of petabytes per year between international sites in order to be successful. This is true for the two largest experiments at the Large Hadron Collider (LHC) at CERN – ATLAS and CMS – and for the climate science community. In the near future, experiments(More)
In preparation for the Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report, the climate community will run the Coupled Model Intercomparison Project phase 5 (CMIP-5) experiments, which are designed to answer crucial questions about future regional climate change and the results of carbon feedback for different mitigation scenarios. The(More)
Climate Change is one of the most pressing challenges facing humanity in the 21st century. Climate simulations provide us with a unique opportunity to examine effects of anthropogenic emissions. High-resolution climate simulations produce " Big Data " : contemporary climate archives are ≈ 5P B in size and we expect future archives to measure on the order of(More)