Jack Johnson joined Milky Chance last night for an at-home performance of “Don’t Let Me Down” on The Late Show with Stephen Colbert.