From big data to important information

@article{BarYam2016FromBD,
  title={From big data to important information},
  author={Yaneer Bar-Yam},
  journal={Complex.},
  year={2016},
  volume={21},
  pages={73-98}
}
  • Y. Bar-Yam
  • Published 4 April 2016
  • Computer Science
  • Complex.
Advances in science are being sought in newly available opportunities to collect massive quantities of data about complex systems. While key advances are being made in detailed mapping of systems, how to relate this data to solving many of the challenges facing humanity is unclear. The questions we often wish to address require identifying the impact of interventions on the system and that impact is not apparent in the detailed data that is available. Here we review key concepts and motivate a… 
View PDF on arXiv
39 Citations
Highly Influential Citations
1
Background Citations
17
Methods Citations
3

Figures from this paper

39 Citations

Opportunities and challenges for big data ornithology

In total, big data resources continue to add empirical breadth and detail to ornithology, but how the challenges underlying this approach can best be mitigated to maximize inferential quality and rigor needs to be carefully considered.

Introduction to special issue: models and tools for systems learning and instruction

The study of systems in natural and social sciences has become increasingly essential to understanding disciplinary and interdisciplinary content and practices (The National Academies 2009). The…

An Introduction to Complex Systems Science and Its Applications

Some of the basic principles of complex systems science are introduced, including complexity profiles, the tradeoff between efficiency and adaptability, the necessity of matching the complexity of systems to that of their environments, multi-scale analysis, and evolutionary processes.

Introduction to the strategy and methods of complex systems

The structure of scientific inquiry is being transformed by broad relevance of the strategies and methods of complex systems science for understanding physical, biological and social systems.…

Opinion: What models can and cannot tell us about COVID-19

Carefully delineating models’ strengths and shortcomings will not only clarify how they can help but also temper expectations among policymakers and members of the public looking to understand the full impact of the virus in the weeks and months ahead.

Toward a pluralistic conception of resilience

Cognitive science as complexity science.

  • Luis H. Favela
  • Psychology
    Wiley interdisciplinary reviews. Cognitive science
  • 2020
Cognitive science as complexity science is offered as an interdisciplinary framework for the investigation of cognition that can dissolve contradictions and tensions among many traditional commitments of its investigative approaches and the nature of cognitive systems.

US social fragmentation at multiple scales

This paper study the fragmented structure of American society using mobility and communication networks obtained from geo-located social media data to find self-organized patches with clear geographical borders that are consistent between physical and virtual spaces.

Multilevel Methods and Statistics: The Next Frontier

A basic overview of the history and progression of multilevel methods and statistics in the organizational sciences is provided, as well as a discussion of recent developments to summarize the current state of the science.

Social Fragmentation at Multiple Scales

Despite global connectivity, societies seem to be increasingly polarized and fragmented. This phenomenon is rooted in the underlying complex structure and dynamics of social systems. Far from…

References

SHOWING 1-10 OF 145 REFERENCES

Anticipating Critical Transitions

How previously isolated lines of work can be connected are reviewed, it is concluded that many critical transitions (such as escape from the poverty trap) can have positive outcomes, and how the new approaches to sensing fragility can help to detect both risks and opportunities for desired change.

Believe it or not: how much can we rely on published data on potential drug targets?

1. This indicates the limitations of the predictivity of disease models and also that the validity of the targets being investigated is frequently questionable, which is a crucial issue to address if…

Improving the effectiveness of health care and public health: a multiscale complex systems analysis.

  • Y. Bar-Yam
  • Medicine
    American journal of public health
  • 2006
Multiscale complex systems analysis suggests that the overall system can be dramatically improved by establishing 2 separate but linked systems with distinct organizational forms: a high-efficiency system performing large-scale repetitive tasks such as screening tests, inoculations, and generic health care, and an high-complexity system treating complex medical problems of individual patients.

A Survey on Data Reproducibility in Cancer Research Provides Insights into Our Limited Ability to Translate Findings from the Laboratory to the Clinic

The results suggest that the problem of data reproducibility is real and biomedical science needs to establish processes to decrease the problem and adjudicate discrepancies in findings when they are discovered.

When does conservation genetics matter?

The genetic threats facing declining populations are explored, focusing in particular on empirical studies and the emerging questions they raise, and several recent studies reveal subtle ways in which species are able to retain more useful genetic variability than they ‘should’.

An Information-Theoretic Formalism for Multiscale Structure in Complex Systems

This work develops a general formalism for representing and understanding structure in complex systems, and explores quantitative indices that summarize system structure, providing a new formal basis for the complexity profile and introducing a new index, the "marginal utility of information".

Preserving the Information Content of Species: Genetic Diversity, Phylogeny, and Conservation Worth

Gene number is an important component of assessing conservation value, and Phylogenetic measures are better indicators of conservation worth than species richness, and measures using branch-lengths are better than procedures relying solely on topology.

Statistical mechanics of complex networks

A simple model based on these two principles was able to reproduce the power-law degree distribution of real networks, indicating a heterogeneous topology in which the majority of the nodes have a small degree, but there is a significant fraction of highly connected nodes that play an important role in the connectivity of the network.

Why Most Published Research Findings Are False

Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true.

Dependency Network and Node Influence: Application to the Study of Financial Markets

A new approach to compute and investigate the mutual dependencies between network nodes from the matrices of node–node correlations is presented, and an example of its application to financial markets is presented.
...