UNLABELLED Early numerical proficiency lays the foundation for acquiring quantitative skills essential in today's technological society. Identification of cognitive and brain markers associated with long-term growth of children's basic numerical computation abilities is therefore of utmost importance. Previous attempts to relate brain structure and function to numerical competency have focused on behavioral measures from a single time point. Thus, little is known about the brain predictors of individual differences in growth trajectories of numerical abilities. Using a longitudinal design, with multimodal imaging and machine-learning algorithms, we investigated whether brain structure and intrinsic connectivity in early childhood are predictive of 6 year outcomes in numerical abilities spanning childhood and adolescence. Gray matter volume at age 8 in distributed brain regions, including the ventrotemporal occipital cortex (VTOC), the posterior parietal cortex, and the prefrontal cortex, predicted longitudinal gains in numerical, but not reading, abilities. Remarkably, intrinsic connectivity analysis revealed that the strength of functional coupling among these regions also predicted gains in numerical abilities, providing novel evidence for a network of brain regions that works in concert to promote numerical skill acquisition. VTOC connectivity with posterior parietal, anterior temporal, and dorsolateral prefrontal cortices emerged as the most extensive network predicting individual gains in numerical abilities. Crucially, behavioral measures of mathematics, IQ, working memory, and reading did not predict children's gains in numerical abilities. Our study identifies, for the first time, functional circuits in the human brain that scaffold the development of numerical skills, and highlights potential biomarkers for identifying children at risk for learning difficulties. SIGNIFICANCE STATEMENT Children show substantial individual differences in math abilities and ease of math learning. Early numerical abilities provide the foundation for future academic and professional success in an increasingly technological society. Understanding the early identification of poor math skills has therefore taken on great significance. This work provides important new insights into brain structure and connectivity measures that can predict longitudinal growth of children's math skills over a 6 year period, and may eventually aid in the early identification of children who might benefit from targeted interventions.