Warren Haynes has a busy weekend at the New Orleans Jazz & Heritage Festival. The guitarist and his Warren Haynes Band were last minute additions to the festival’s lineup following the passing of Levon Helm.

Haynes invited out a number of New Orleans musicians during his set on Saturday. Keyboardist Ivan Neville—who performed on Haynes’ recent Man in Motion release—joined Haynes for a portion of his set while Dirty Dozen Brass Band’s Roger Lewis, Kevin Harris and Efrem Towns sat in for various songs throughout the afternoon performance, including Steely Dan’s “Pretzel Logic.” Previous confirmed guest Dr. John—who will tour with Haynes’ Gov’t Mule in June—also joined Warren Haynes Band and the Dirty Dozen Horns for a few songs: “I Walk On Gilded Splinters”, “Such a Night” “Big Chief” and a medley of The Band’s “The Weight” and “It makes No Difference.” “Such a Night” was also a tribute to Helm since Dr. John performed the number in the classic Band film The Last Waltz. Dr. John also led Helm and his band through the song at JazzFest in 2010.

As previously reported, Haynes joined Grace Potter at the House of Blues on Friday night for a cover of ZZ Top’s “Tush.” After that cameo, Haynes made his way over to the Republic to perform “Bird Song” with 7 Walkers.

Haynes returned to the Republic on Saturday night for an extended guest spot with Anders Osborne. The guitarist sat in on a few improv-heavy numbers, including Little Feat’s “Spanish Moon” and Osborne’s “Stoned Drunk and Naked.” Osborne’s special guests also included Karl Denson and Luther Dickinson, among others.

Haynes will perform with Gov’t Mule in Little Rock, AR on May 25.