Yes, page speed is important, and your website should load in under a few seconds.
But, don’t try to spend lots of time and money just to improve your page speed by 0.2s.
In reality, users will stay on a website that loads relatively quickly **and** provides them with what they are looking for.
For SEO reasons, a fast loading website will mitigate the chances of people exiting your website before it has fully loaded. People, in this scenario, could be a potential customer.