Exploring non-equilibrium phases of matter using controlled small quantum systems