Can I use Just Press Record without iCloud Drive?

Yes. You can choose to opt out of iCloud Drive syncing and store your recordings locally on your iOS device.  To do this, go to Just Press Record’s Settings.