Fleet Foxes dropped by The Late Show with Stephen Colbert Thursday night to perform “Can I Believe You,” from their new album Shore.

Joining forces with Resistance Revival Chorus, the band’s live rendition of “Can I Believe You” shifted scenes, between being elevated by the acoustics in the Brooklyn church