CBS has unveiled the guest list for the final 28 shows of The Late Show with David Letterman, as the host prepares to retire and give way to new host Stephen Colbert. The final broadcast is scheduled to take place on May 20.

According to TVLine, some of the musical talent that will grace the stage on Letterman’s final run include Dave Matthews Band, Mumford & Sons, The Avett Brothers and Brandi Carlile, Elvis Costello, Emmylou Harris, Norah Jones, Ralph Stanley with Amos Lee, John Mayer and Tom Waits.

Among those, DMB especially has had a deep connection to the show over its run, as the band has taken the Late Show stage during almost every one of their album cycles.