Do you plan to sell products or services? If so, you'll want to invest in a web hosting service that offers Secure Sockets Layer (SSL). An SSL connection encrypts the financial information that shuttles between users' web browsers and your website, thus safeguarding the transmission of the purchasing information. Some hosting companies include a free SSL certificate when you sign up for a web hosting plan, while others charge close to $100. You can save some money by shopping around for services that offer the cheaper SSL plans.
A VPS runs its own copy of an operating system (OS), and customers may have superuser-level access to that operating system instance, so they can install almost any software that runs on that OS. For many purposes they are functionally equivalent to a dedicated physical server, and being software-defined, are able to be much more easily created and configured. They are priced much lower than an equivalent physical server. However, as they share the underlying physical hardware with other VPSes, performance may be lower, depending on the workload of any other executing virtual machines.