I think it's more a question of whether it is fair to you.
Maybe I'm biased because I'm a lady and most of my friends are ladies, but this seems like an incredibly common refrain (from my friends, from my mom and her friends). Massive generalization, but it seems like women get more invested in relationships. I know some people will disagree with me, but women are socialized from a young age to put others in front of themself, to be considerate and thoughtful and giving. It's not that there aren't kind caring guys out there, but on average, they don't seem to be as good with compliments/birthdays/doing nice spontaneous things.
If you've told him how you feel and he is making genuine efforts to make you happy, he may be worth it. But it sounds like you're kind of over him and just sticking around because it's comfortable. Do you want to spend the rest of your life with this guy?