If he's a young guy, and he doesn't have a whole lot of responsibilities he should or
needs to be engaging in, I don't necessarily think him wiling his time away with television is really a bad thing. He's just wasting time in his own way, you can't fault him for not having a bunch of various hobbies and interests. Sure, he'd probably be a more well-rounded person if he did engage in other things, but if he doesn't, you really can't force him to. Lead a horse to water, and all that.
However, the key word in your situation is balance. If you've expressed obvious displeasure with his newfound hobby/obsession, he should at least make an effort to curb the anime a bit. If he doesn't make any motions to do so, and only half listens to you on the phone, that's pretty disrespectful to you.
So, I guess what I am saying is, someone having a pointless hobby that they're pretty focused on isn't always a bad thing (see : makeup

), but the second it started effecting you two's relationship he should've taken a step back, and listened to you. If my interest in makeup ever made someone I cared for feel uncomfortable, I'd take their feelings into consideration and do a little reflecting on my actions.
Maybe, the next time you see him face-to-face, tell him how you feel, very calmly. Hanging up on him is probably just making him feel like he's being the rational one, it almost never works. Just explain that you are sick of hearing about anime, and that you feel you're being disrespected...or you know, however YOU actually feel, not just some internet forum reader's words in your mouth!