Over the weekend, Deer Tick followed up each night at Newport Folk Festival in Rhode Island with late-night performances that were packed with special guests, cover tunes and more.

On Friday night, the band kicked off the weekend of late-night shows with guests like Elvis Perkins, City of Sin, Brett Dennen, who joined them on Paul Simon’s “Late in the Evening,” and opener Vanessa Carlton, who sang on “In Our Time.” Carlton, who is married to Deer Tick singer John McCauley, sang on the album version of the tune. The night also included a cover of Merle Haggard’s “Today I Started Loving You Again” and a finale of Prince’s “1999” with Lucius, Jenny Lewis and Rafay Rashid.

For night two, Deer Tick brought out Ruby Amanfu for “I Put a Spell On You” and The Cranberries’ “Zombie,” while Spencer Swain joined in on “Thyme” and a cover of Ewan MacColl’s “Dirty Old Town.” Delta Spirit’s Matthew Logan Vasquez, who also played with McCauley in Middle Brother, helped out the band for “Everything I Do” and Nirvana’s “Negative Creep.”

On Sunday night, things opened up with Dawes welcoming frontman Taylor Goldsmith’s father Lenny for a cover of James Brown’s “Get Up.” The elder Goldsmith used to perform with Tower of Power. The show continued with a few songs from Middle Brother, which also features Goldsmith, before Deer Tick took over with more guests, including The Suffers’ Kam Franklin joining in on Sam Cooke’s “Bring It On Home.” Carlton and Sharon Van Etten would later come up for a cover of Neil Young’s “Only Love Can Break Your Heart,” and Van Etten stayed on for Radiohead’s “Creep.” After a cover of Bruce Springsteen’s “Glory Days,” Swain returned to the stage for “Ashamed,” and the weekend was rounded out with a “Goodnight Irene” that featured Franklin, Carlton, Van Etten, Swain, John McCauley Jr., Jay Sweet, Bryan Minto and opening acts Son Little and Huntress & the Holder of Hands.