# Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism

@article{McClenny2020SelfAdaptivePN, title={Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism}, author={Levi D. McClenny and U. Braga-Neto}, journal={ArXiv}, year={2020}, volume={abs/2009.04544} }

Physics-Informed Neural Networks (PINNs) have emerged recently as a promising application of deep neural networks to the numerical solution of nonlinear partial differential equations (PDEs). However, the original PINN algorithm is known to suffer from stability and accuracy problems in cases where the solution has sharp spatio-temporal transitions. These stiff PDEs require an unreasonably large number of collocation points to be solved accurately. It has been recognized that adaptive… Expand

#### 7 Citations

Optimal Transport Based Refinement of Physics-Informed Neural Networks

- Computer Science, Engineering
- ArXiv
- 2021

Learning the solution operator of parametric partial differential equations with physics-informed DeepOnets

- Computer Science, Mathematics
- ArXiv
- 2021

Long-time integration of parametric evolution equations with physics-informed DeepONets

- Computer Science, Physics
- ArXiv
- 2021

TensorDiffEq: Scalable Multi-GPU Forward and Inverse Solvers for Physics Informed Neural Networks

- Computer Science, Physics
- ArXiv
- 2021

Lagrangian dual framework for conservative neural network solutions of kinetic equations

- Computer Science, Mathematics
- ArXiv
- 2021

#### References

SHOWING 1-10 OF 30 REFERENCES

Understanding and mitigating gradient pathologies in physics-informed neural networks

- Computer Science, Mathematics
- ArXiv
- 2020

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

- Computer Science
- J. Comput. Phys.
- 2019

Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networks

- Computer Science, Mathematics
- ArXiv
- 2020

When and why PINNs fail to train: A neural tangent kernel perspective

- Computer Science, Mathematics
- ArXiv
- 2020

Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equations

- Mathematics, Computer Science
- ArXiv
- 2018

Solving high-dimensional partial differential equations using deep learning

- Mathematics, Computer Science
- Proceedings of the National Academy of Sciences
- 2018

Residual Attention Network for Image Classification

- Computer Science
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- 2017

On solving constrained optimization problems with neural networks: a penalty method approach

- Mathematics, Computer Science
- IEEE Trans. Neural Networks
- 1993