Do whatever you want to do. If you want to leave, take this as an oppurtunity. Maybe if you're feeling like you just want a break, then just break a way for a little while. If you really still enjoy the fandom and show, then fight it. Keep watching the show and keep enjoying us, the fandom. I can't tell you how to live your life. That's a choice you have to make for yourself.
Do you know who Edward Snowden is?