Before publishing, you can type a text caption in the "Write something..." field. On the right panel, select your post visibility:

Captions appear below your audio waveform on the feed, giving your listeners context about the audio note.