Ubuntu always keeps the old kernel even after installing a new kernel. This is done just in case the new one doesn’t work well for you.
Now if you don’t want the old kernels anymore then use the command below to remove the old kernel which you wish to remove.
$ sudo apt-get remove --purge 2.6.28-11*
replace 2.6.28-11 with the version you wish to remove.
Hope this helps…
OLDKERNELS=$(dpkg -l|awk ‘{print $2}’|grep -E $LINUXPKG |grep -vE $METALINUXPKG|grep -v $CURKERNEL)
sudo aptitude purge $OLDKERNELS
see http://blog.dipinkrishna.info/2009/08/kernelcheck-kernel-compiling-process-as.html for an easy and graphical interface to install kernels.
how to install a new kernal