This paper analyzes the passivity and feedback passivity of discrete-time switched nonlinear systems with both passive and nonpassive modes that are affine in the control input. When a nonpassive mode is active, the increase in storage function is not necessarily bounded by the energy supplied to the switched system at every time step. Therefore, a switched system with at least one nonpassive mode is defined to be nonpassive in the classical passivity theory. In this paper, we propose a framework to analyze the passivity of such switched systems in a more general sense. We consider switched nonlinear systems which are affine in the control input and may consist of passive, feedback passive modes and modes which can not be rendered passive using feedback. In the proposed framework, we prove that a switched nonlinear system is locally feedback passive if and only if its zero dynamics are locally passive. A lower bound on the ratio of total activation time between (feedback) passive and nonfeedback passive modes is obtained to guarantee passive zero dynamics. Finally, we prove that two important properties of classical passivity still hold for the proposed passivity definition. That is, 1) output feedback control can be used to stabilize the switched system, and 2) parallel and negative feedback interconnections of two such passive systems are also passive.