In this thesis, we examine an extension of circuit quantum electrodynamics (QED), cavity QED using superconducting circuits, that utilizes multimode cavities as a resource for quantum information processing. We focus on the issue of qubit connectivity in the processors, with an ideal processor having random access -- the ability of arbitrary qubit pairs to interact directly. Here, we implement a random access superconducting quantum information processor, demonstrating universal operations on a nine-qubit memory, with a Josephson junction transmon circuit serving as the central processor. The quantum memory is a multimode cavity, using the eigenmodes of a linear array of coupled superconducting resonators. We selectively stimulate vacuum Rabi oscillations between the transmon and individual eigenmodes through parametric flux modulation of the transmon frequency. Utilizing these oscillations, we perform a universal set of quantum gates on 38 arbitrary pairs of modes and prepare multimode entangled states, all using only two control lines. We thus achieve hardware-efficient random access multi-qubit control. We also explore a novel design for creating long-lived 3D cavity memories compatible with this processor. Dubbed the ``quantum flute'', this design is monolithic, avoiding the loss suffered by cavities with a seam between multiple parts. We demonstrate the ability to manipulate the spectrum of a multimode cavity and also measure photon lifetimes of 0.5-1.3 ms for 21 modes. The combination of long-lived quantum memories with random access makes for a promising architecture for quantum computing moving forward.