The last two decades have seen the emergence of stunning interconnections among various previously remotely related disciplines such as condensed matter, nuclear physics, gravity and quantum information, fueled both by experimental advances and new powerful theoretical methods brought by holographic duality. In this non-technical review we sample some recent developments in holographic duality in connection with quantum many-body dynamics. These include insights into strongly correlated phases without quasiparticles and their transport properties, quantum many-body chaos, and scrambling of quantum information. We also discuss recent progress in understanding the structure of holographic duality itself using quantum information, including a "local" version of the duality as well as the quantum error correction interpretation of quantum many-body states with a gravity dual, and how such notions help demonstrate the unitarity of black hole evaporation.