if your coin is supported by Ledger/Trezor (hardware wallet), go for hardware. Otherwise, you have to write the privatekey somewhere or keep keystore file which is a potential security issue.
For practical usage, I use Mycrypto for ETH, NeonWallet for NEO.