After recently being inducted into the Rock and Roll Hall of Fame, Steve Miller had some choice words about the ceremony and the Hall of Fame itself, and now the two men who inducted Miller, better known at The Black Keys, are saying the experience was a regrettable one.

In an interview with Rolling Stone, Black Keys singer and guitarist Dan Auerbach says he had “had a couple sleepless nights” since the ceremony and that Miller “really disappointed” him and bandmate Patrick Carney.

Auerbach recounts meeting Miller and realizing the inductee hadn’t taken the time to find out who The Black Keys were. “He said, ‘The whole process was unpleasant,’” Auerbach says. “And for Pat and I, honestly, the most unpleasant part was being around him.” He also tells Rolling Stone that he and Carney left the ceremony halfway through Miller’s performance.

“Pat and I both regret it,” Auerbach says. “It’s unfortunate. Of course there are problems in the music industry. Of course. But we were there, unpaid, on our own free will, to come celebrate his achievements and spread the joy of rock & roll. To inspire kids to pick up guitars. To play music. And it felt like we were doing the opposite.”

“There’s a time and a place to stand up and be angry. But when people are honoring you for how great you are, that’s not the fucking time or place.”

Watch a video of the original induction speech from The Black Keys below, and read the full interview here.