Like everyone mentioned, there is no problem even if you destroy the hardware wallet as long as you have the seeds. That's why we need to take care of our seeds because that is the purpoes of it. So, what you have to take care for is with how you keep the seeds so that you'll have something for yourself just in case. And also, seeds can be used to recover our wallets through electrum and other wallets that support the same derivation path.