Your funds remain safe. Once you reinstall the wallet on your new smartphone, you’ll be able to import your seed phrase. Then, you’ll be asked to sign a transaction called ‘Remove Hardware Signer’ and enable the Hardware Signer on your new phone.