Membrane trafficking from endosomes to the trans-Golgi network or the plasma membrane is driven by the retromer complex. Through structural analysis of the cargo-bound complex, Lucas et al. describe a mechanism by which endosomal membrane recruitment and cargo recognition are integrated through cooperative interactions between retromer subunits.