The Foo Fighters shut down a street in New Orleans’ French Quarter when they took over the famed Preservation Hall for a surprise performance on Saturday night. The alternative rockers—who were in town recording a song for their forthcoming eighth album/HBO series—tweeted a photo of the band with the message “So…NOLA, what’re you guys up to tonight?” earlier in the day, which was evidently enough to draw a sizable crowd outside to the area outside the venue on St. Peter Street. However, only special guests like reporter Anderson Cooper and Arcade Fire’s Win Butler and Regine Chassagne were allowed inside.

Fans were treated to a two-set show that saw the Foo Fighters team up with the Preservation Hall Jazz Band for songs like “My Hero,” “Cold Day in the Sun,” “Learn How to Fly” and “Times Like These.“Instead of performing for the folks inside Preservation Hall itself, the musicians geared their music toward the crowd that gathered outside. Grohl even invited Trombone Shorty, who had just been watching the show the street, to borrow a horn from the Preservational Hall guys so he could join the group for their “This Is A Call” finale.

As previously reported, The Foo Fighters are currently making their way across the country as they record their new album (and film an HBO series) in eight different musically rich cities. The album/series will find the band recording a one song at an iconic recording studio in each town. While Preservation Hall technically isn’t a studio, the Foo Fighters rented the space and converted it into a temporary studio with Nevermind producer/Garbage drummer Butch Vig.