The main focus of this paper is the numerical solution of the Boltzmann transport equation for neutral particles through mixed material media in a spherically symmetric geometry. Standard solution strategies, like the Discrete Ordinates Method (DOM), may lead to nonphysical approximate solutions. In particular, a point source at the center of the sphere yields undesirable ray effects. Posing the problem in spherical coordinates avoids ray effects and other non-physical numerical artifacts in the simulation process, at the cost of coupling all angles in the PDE setting. In addition, traditional finite element or finite difference techniques for spherical coordinates often yield incorrect scalar flux at the center of the sphere, known as flux dip, and oscillations near steep gradients. In this paper, a least-squares finite element method with adaptive mesh refinement is used to approximate solutions to the non-scattering one-dimensional neutron transport equation in spherically symmetric geometry. It is shown that the resulting numerical approximations avoid flux dip and oscillations. The least-squares discretization yields a symmetric positive definite linear system which shares many characteristics with systems obtained from Galerkin finite element discretization of totally anisotropic elliptic PDEs. In general, standard Algebraic Multigrid (AMG) techniques fail to scale on non-grid-aligned anisotropies. In this paper, a new variation of Smoothed Aggregation (SA) is employed and shown to be essentially scalable. The effectiveness of the method is demonstrated on several mixed-media model problems.