Your funds remain safe.
Once you reinstall the wallet on your new smartphone, you’ll be able to import your seed phrase. Then, you’ll be asked to sign a transaction called ‘Remove Hardware Signer’ and enable the Hardware Signer on your new phone.
Finally, you can re-enable the Daily Spending Limit.