WABetaInfo, a Whats App news and information website, reports that the new functionality was developed last week and is already being rolled out to some users.
If it is, a new message box will appear at the bottom of the image, from which you can also remove the caption by tapping the dismiss icon within the caption view.