I am concerned about a guy friend. Is there something going on?

I have two best friends, a girl and boy, who are a couple. I am actually the one who got Girl and Boy together. I've known Girl for 7 years, and Boy for 4 years. Girl and I had a falling out about 3 years ago and didn't talk for about a year. I received a couple of drunken calls from Boy during that period. One of which I asked what he wanted, and he responded with "You, is that okay?". I told him no, that even though Girl and I weren't friends I would never do that to her. He hung up on me. About 6 months after is when Girl and I reunited and became best friends again. It's been about 3 years since then. I didn't get to best friends status with Boy until about 6 months ago. Now to the dilemma. The three of us hang out, A LOT. Whenever I go to their house, I'm there for at least 5 hours. Lately, whenever boy drinks (which is almost every time I go over) he gets very subtly touchy with me. He's not stupidly drunk ever, but he probably has a good buzz going. For example: We were all three sitting on the couch, Boy between me and Girl, watching a movie. We had a big blanket across all of us with our feet on the coffee table. He very lightly rubs his feet against mine and his hand is always touching the side of my thigh. A flag goes up for me. I'm not a very touchy person, so it's really unusual when either of them gives me a hug, rubs my back, etc... This isn't the first occasion that this has happened. At least twice before. I just get weird vibes when stuff like this happens. Another example, pretty much the same instance described above, but his hand is ON my thigh. Yes, we are pretty cramped on the couch, but not that cramped. He isn't rubbing my thigh or anything, his hand is just sitting there. I know this seems stupid and I may be reading into it too much, but I want to know what other people have to say about it. I think it all goes back to that drunken phone call. It shows that there was a time that he felt some sort of attraction to me and I can't shake that off when he gets "touchy" with me. The reason the phone call threw me off is because we were not friends before the falling out, we were just co-workers. I try my best to avoid the above situations. I don't put my feet next to his and I try not to sit too close to him. It wouldn't be a big deal if his girlfriend wasn't my best friend. Remember though, Boy is my best friend too. There are some other thinks too, I just can't think of them. It's all about the energy I get from hims. I don't know. Thoughts?