The performance of hybrid organic-inorganic metal halide perovskite solar cells is investigated using one-dimensional drift-diffusion device simulations. We study the effects of interfacial defect density, doping concentration, and electronic level positions of the charge transport layer (CTL). Choosing CTLs with a favorable band alignment, rather than passivating CTL-perovskite interfacial defects, is shown to be beneficial for maintaining high power-conversion efficiency, due to reduced minority carrier density arising from a favorable local electric field profile. Insights from this study provide theoretical guidance on practical selection of CTL materials for achieving high-performance perovskite solar cells.