An aging eccentric—who has for decades occupied a dubious place on the fringes of New York’s musical life—today saw a lifelong dream fulfilled.