• Corpus ID: 240354766

Sustainable AI: Environmental Implications, Challenges and Opportunities

@article{Wu2021SustainableAE,
  title={Sustainable AI: Environmental Implications, Challenges and Opportunities},
  author={Carole-Jean Wu and Ramya Raghavendra and Udit Gupta and Bilge Acun and Newsha Ardalani and Kiwan Maeng and Gloria Chang and Fiona Aga Behram and James Huang and Charles Bai and Michael K. Gschwind and Anurag Gupta and Myle Ott and Anastasia Melnikov and Salvatore Candido and David Brooks and Geeta Chauhan and Benjamin Lee and Hsien-Hsin S. Lee and Bugra Akyildiz and Maximilian Balandat and Joe Spisak and Ravi Kumar Jain and Michael G. Rabbat and Kim M. Hazelwood},
  journal={ArXiv},
  year={2021},
  volume={abs/2111.00364}
}
This paper explores the environmental impact of the super-linear growth trends for AI from a holistic perspective, spanning Data, Algorithms, and System Hardware. We characterize the carbon footprint of AI computing by examining the model development cycle across industry-scale machine learning use cases and, at the same time, considering the life cycle of system hardware. Taking a step further, we capture the operational and manufacturing carbon footprint of AI computing and present an end-to… 

Unraveling the hidden environmental impacts of AI solutions for environment

The different types of AI impacts are reviewed, then the different methodologies used to assess those impacts are presented, and how to apply life cycle assessment to AI services is shown.

ACT: designing sustainable computer systems with an architectural carbon modeling tool

This work proposes ACT, an architectural carbon footprint modeling framework, to enable carbon characterization and sustainability-driven early design space exploration, and constructs use cases, based on the three tenets of sustainable design, to highlight future methods that enable strong performance and efficiency scaling in an environmentally sustainable manner.

Aligning artificial intelligence with climate change mitigation

A framework to assess how AI affects GHG emissions and proposes approaches to align the technology with climate change mitigation is presented.

Data-Centric Green AI: An Exploratory Empirical Study

Evidence is shown that, by exclusively conducting modifications on datasets, energy consumption can be drastically reduced, often at the cost of a negligible or even absent accuracy decline, which calls for a research agenda that focuses on data-centric techniques to improve AI energy efficiency.

Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Model

The carbon footprint of BLOOM, a 176-billion parameter language model, across its life cycle is quantified to estimate the energy requirements and carbon emissions of its deployment for inference via an API endpoint receiving user queries in real-time.

Looper: An End-to-End ML Platform for Product Decisions

Looper covers the end-to-end ML lifecycle from collecting training data and model training to deployment and inference, and extends support to personalization, causal evaluation with heterogenous treatment effects, and Bayesian tuning for product goals.

Sustainable Computing - Without the Hot Air

This paper distills the fundamental trends that determine computing’s carbon footprint and their implications for achieving sustainable computing.

A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model

A holistic assessment of the footprint of an extreme-scale language model, Noor, aiming to develop the largest multi-task Arabic language models–with up to 13B parameters–leveraging zero-shot generalisation to enable a wide range of downstream tasks via natural language instructions is proposed.

Carbon Explorer: A Holistic Framework for Designing Carbon Aware Datacenters

Technology companies have been leading the way to a renewable energy transformation, by investing in renewable energy sources to reduce the carbon footprint of their datacenters. In addition to

Data Centers on Wheels: Emissions From Computing Onboard Autonomous Vehicles

A framework to probabilistically model the emissions from computing onboard a global fleet of AVs and show that the emissions have the potential to make a non-negligible impact on global emissions, comparable to that of all data centers today is introduced.

References

SHOWING 1-10 OF 118 REFERENCES

Artificial intelligence for sustainability: Challenges, opportunities, and a research agenda

Chasing Carbon: The Elusive Environmental Footprint of Computing

This work quantifies the carbon output of computer systems to show that most emissions related to modern mobile and data-center equipment come from hardware manufacturing and infrastructure, and outlines future directions for minimizing the environmental impact of computing systems.

Quantifying the Carbon Emissions of Machine Learning

This work presents their Machine Learning Emissions Calculator, a tool for the community to better understand the environmental impact of training ML models and concrete actions that individual practitioners and organizations can take to mitigate their carbon emissions.

Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning

A framework is introduced that makes accounting easier by providing a simple interface for tracking realtime energy consumption and carbon emissions, as well as generating standardized online appendices, and creates a leaderboard for energy efficient reinforcement learning algorithms to incentivize responsible research.

A first look into the carbon footprint of federated learning

A rigorous model to quantify the carbon footprint of FL is proposed, hence facilitating the investigation of the relationship between FL design and carbon emissions, and an early-stage FL optimization problem is formalized enabling the community to consider the importance of optimizing the rate of CO2 emissions jointly to the accuracy of neural networks.

DTCO including Sustainability: Power-Performance-Area-Cost-Environmental score (PPACE) Analysis for Logic Technologies

This work evaluates the energy and water consumption as well as the greenhouse gas emissions trends from processing logic nodes from iN28 to iN3 with different scaling scenarios and finds environmental scores can be derived together with the established Power, Performance, Area, Cost metrics.

On the Opportunities and Risks of Foundation Models

This report provides a thorough account of the opportunities and risks of foundation models, ranging from their capabilities, to their applications, and what they are even capable of due to their emergent properties.

Challenges: environmental design for pervasive computing systems

It is argued that pervasive computing offers not only tremendous opportunities and exciting research challenges but also possible negative environmental impacts, particularly in terms of physical waste and energy consumption, and that an important challenge for pervasive computing is to develop research in new architectures, design methodologies, metrics, algorithms and operating systems to minimize these impacts.

AI for social good: unlocking the opportunity for positive impact

This work provides a set of guidelines for establishing successful long-term collaborations between AI researchers and application-domain experts, relate them to existing AI4SG projects and identify key opportunities for future AI applications targeted towards social good.

Green server design: beyond operational energy to sustainability

This paper argues that to understand the total impact, the entire lifecycle of the system needs to be examined, beyond operational energy to also include material use and manufacturing, and presents a methodology that allows such a lifecycle analysis.
...