Mike the Health Ranger suggested on a podcast using a cheap PC for a hardware crypto wallet.

Cheaper, or even free - install a virtual machine on your computer. The software is free - Oracle Virtual Box. And the operating system can be free, or you can buy a Windows licence for around $20 online.

Once installed and configured you can move it to a USB stick, encrypt it - whatever you like. It's also portable and can be used on any computer you later install Virtual Box on, too.