Variable Annuities with embedded guarantees are very popular in the US market. There exists a great variety of products with both, guaranteed minimum death benefits (GMDB) and guaranteed minimum living benefits (GMLB). Although several approaches for pricing some of the corresponding guarantees have been proposed in the academic literature, there is no general framework in which the existing variety of such guarantees can be priced consistently. The present paper fills this gap by introducing a model, which permits a consistent and extensive analysis of all types of guarantees currently offered within Variable Annuity contracts. Besides a valuation assuming that the policyholder follows a given strategy with respect to surrender and withdrawals, we are able to price the contract under optimal policyholder behavior. Using both, Monte-Carlo methods and a generalization of a finite mesh discretization approach, we find that some guarantees are overpriced, whereas others, e.g. guaranteed annuities within guaranteed minimum income benefits (GMIB), are offered significantly below their risk-neutral value.