Can I lose the money?

No. The money in your HSA will roll over from year to year and is yours to keep.