Quietly seek time with more serious minded people. You said that they don't consider you a good friend anyway, so perhaps you'll be able to tolerate them and their "humor" in smaller doses.
You have the right to feel what you feel and if there is something you don't like, say so in a nice way and if they ignored you, say it louder and clearer. I know it's hard sticking up for yourself but you gotta try and keep trying. Start small if you can.
Don't take ribbing if it is mean-spirited