I’ve stupidly been using tap water, will my plant die?

I don't know, possibly. The best thing for you to do is remove your plant from it's medium being very careful with the roots. Repot it and flush the soil and plant with fresh rainwater.

It may still die due to the high mineral content in the tap water, however there's a good chance it will survive.