Tom Petty and the Heartbreakers brought more covers and bust outs during the last two shows of their five-night run at the Beacon Theatre in New York City on Saturday and Sunday night.

The band busted out a cover of Joe Williams’ Washboard Blues Singers’ “Baby, Please Don’t Go,” which they hadn’t played since 2008, early on Saturday night. The song was soon followed by a rare performance of “Takin My Time” off the band’s 2010 release Mojo, as well as their second-ever take Paul Revere and The Raiders’ “(I’m Not Your) Steppin’ Stone,” which they debuted on the first night of the Beacon run.

The next half of Saturday’s set included takes on J.J. Cale’s “I’d Like to Have You Baby,” the Traveling Wilbury’s “Tweeter and The Monkey Man” (a song they’ve performed every night of this tour) and—for the third time on this tour—the Grateful Dead’s “Friend of the Devil.” The show also featured the first-ever performance of the Southern Accents B-side “The Image of Me,” as well as the first “Two Gusnlingers” since 2003.

Tom Petty and The Heartbreakers closed out their run last night with another bust-out and cover-filled show. Thing started getting interested by the third song, when the band played the Wildflowers tune “Honey Bee” for the first time since 2010, which was followed by their second-ever rendition of Nick Gravenites’ “Born In Chicago” and a rare take on J.J. Cale’s “13 Days,” both songs that were last played in 2005.

The next half of last night’s show saw a bust out of “Down South” from 2006’s Highway Companion, followed by the band’s first take on the 1994 Wildflowers B-side “Girl On LSD” since 2008. The show also included a take on Little Feat’s “Willin’,” which they’ve now covered twice since debuting it on the first night of the Beacon Run, and wrapped up with a number of standards like “Refugee,” “Runnin’ Down a Dream” and an encore “American Girl.”

Here’s a look at Saturday and Sunday’s Tom Petty and the Heartbreakers setlists via setlist.fm

Saturday, May 25, 2013, Tom Petty and the Heartbreakers, Beacon Theatre, New York, NY

So You Want to Be a Rock ‘n’ Roll Star (The Byrds cover)
Love Is a Long Road
Listen to Her Heart
Baby, Please Don’t Go (Joe Williams’ Washboard Blues Singers cover)
The Damage That You Done
Takin’ My Time
(I’m Not Your) Steppin’ Stone (Paul Revere and The Raiders cover)
A Woman in Love (It’s Not Me)
Saving Grace
I’d Like to Love You Baby (J.J. Cale cover)
Tweeter and the Monkey Man (Traveling Wilburys cover)
Rebels
Two Gunslingers
Wildflowers
The Image of Me
Friend of the Devil (Grateful Dead cover)
Melinda
I Should Have Known It
Refugee
Runnin’ Down a Dream

Encore:
You Wreck Me
American Girl

Sunday, May 26, 2013, Tom Petty and the Heartbreakers, Beacon Theatre, New York, NY

So You Want to Be a Rock ‘n’ Roll Star (The Byrds cover)
Love Is a Long Road
Honey Bee
Born in Chicago (Nick Gravenites cover)
13 Days (J.J. Cale cover)
The Best Of Everything
Cabin Down Below
A Woman in Love (It’s Not Me)
Spike
Tweeter and the Monkey Man (Traveling Wilburys cover)
Rebels
Time To Move On
Down South
Girl On LSD
Willin’ (Little Feat cover)
It’s Good to Be King
I Should Have Known It
Refugee
Runnin’ Down a Dream

Encore:
Listen to Her Heart
American Girl