You can record to your computer fairly inexpensively. You would need a microphone, a digital interface and some recording software. If you aren’t doing antyhing fancy then there is actually some decent free software out there, like audacity, that works really well.
The fancier you get the more expensive it gets. I do most of my recording on a mac using Logic Studio, which is a very comprehensive piece of recording software. I use condenser mics for recording as they are more sensitive (and fragile unfortunately), but for simple stuff you can get a cheap dynamic mic that doesn’t require phantom power and is virtually indestructible (Shure dynamic mics are great and reasonably priced).
So it all really depends on what you are interested in.
There are stand alone records, and I have a