Don't ever feel bad for making a decision about your own life that upsets other people. You are not responsible for their happiness. You're responsible for your own happiness. Anyone who wants you to live in misery for their happiness should not be in your life to begin with.