It is not an easy decision but I finally switch over to WordPress. For the last 3 years, I run my blog on a customized Drupal called Drupal 4 Bloggers. It has sentimental values for me since, well, I coded it.
But Drupal 4 Blogger is more like a personal project. It was great 3 years ago, with all the bells and whistle I need but compared to wordpress today, it is a farcry. I have no choice but to admit that wordpress is a much better platform.
Of course, I could stick to Drupal, take the latest version and try to customize it again. But being there done that, I think I will stick to the best tool of the time now.
