I came across Wordpress Automatic Upgrade which as the name implies automatically upgrades your wordpress blog to the latest version available. Not only does it backup your existing database, but also lets you download it to your disk ( in case anything goes wrong ) .

With this plugin I have started liking Wordpress even more.