The combination of photoacoustic (PA) imaging and ultrasound localization microscopy (ULM) with microbubbles has great potential in various fields such as oncology, neuroscience, nephrology, and immunology. Here we developed an interleaved PA/fast ULM imaging technique that enables super-resolution vascular and physiological imaging in less than 2 seconds per frame in vivo. By using sparsity-constrained (SC) optimization, we accelerated the frame rate of ULM up to 37 times with synthetic data and 28 times with in vivo data. This allows for the development of a 3D dual imaging sequence with a commonly used linear array imaging system, without the need for complicated motion correction. Using the dual imaging scheme, we demonstrated two in vivo scenarios challenging to image with either technique alone: the visualization of a dye-labeled mouse lymph node showing nearby microvasculature, and a mouse kidney microangiography with tissue oxygenation. This technique offers a powerful tool for mapping tissue physiological conditions and tracking the contrast agent biodistribution non-invasively.