Yes. Just Press Record will automatically interpret punctuation commands, e.g. "Full Stop" or "New Paragraph". Without punctuation commands, unpunctuated text will appear.
A list of spoken commands that can be dictated to insert punctuation and symbols within a Just Press Record transcription can be found here.