Tensor networks provide an efficient classical representation of certain strongly correlated quantum many-body systems. We present a general lifting method to ascribe quantum states to the network structure itself that reveals important new physical features. To illustrate, we focus on the multiscale entanglement renormalization ansatz (MERA) tensor network for 1D critical ground states on a lattice. The MERA representation of the said state can be lifted to a 2D quantum dual in a way that is suggestive of a lattice version of the holographic correspondence from string theory. The bulk 2D state has an efficient quantum circuit construction and exhibits several features of holography, including the appearance of horizon-like holographic screens, short-ranged correlations described via a strange correlator and bulk gauging of global on-site symmetries at the boundary. Notably, the lifting provides a way to calculate a quantum-corrected Ryu–Takayanagi formula, and map bulk operators to boundary operators and vice versa.