It looks more like you are reading things different from normal. If you assume a smile, a wink, a word or action is influenced by things that you are doing, then the likelihood is that you are actually kind of hypnotising yourself into believing it.
While indeed you wander through life with the potential of five senses at your disposal, your brain does some nifty things with the information it receives. While some things are quite straight forwards like the different in the colours Black and White, there are other less obvious, more subliminal queues that we don't take in at face value.
While you sit watching a sports presenter on the television, due to anticipating that you are somehow having a factor on them, you'll be looking for those queues. Those queues actually come from the brains capacity to try and interpret potential scenarios, we all do that.
For instance if we have to go to an office to talk to someone for an official reason, we'll visualise the encounter beforehand and play out scenarios. When we actual sit in front of the person to talk to them, our entire experience has already had an evaluated path drawn as to what we expect to be said and what we expect as an outcome, our overall happiness and mood is effected by how far the real world follows that projected outcome, if it deviates too far we might get depressed, if it goes better than planned then we'll likely be elated.
How we identify whether those moments plot to the projection isn't always down to words or actions, but actually down to very small gestures, a raised eyebrow, a wink, a smile, even someone blushing. All those things can add to a reading in those situations and that's where those queue observations originate from.
In your case though there is a problem with them, for instance in the previous scenario depicted, you'd likely be trying to appraise how a meeting goes and evidently by the end of the meeting you'd know an answer.
While dealing with observing someone on a television screen however you are not actually dealing with both Positive and Negative influences. While a person might smile, wink, nod their head or a myriad of other things that you'll suggest they are doing in response to you (giving you a positive taxis), you're not actually taking in the myriad of things they aren't doing (The negative taxis's)
After all they aren't wagging their finger at the screen saying "Shame on you trying to manipulate me!" (although that would have to counter of being both positive and negative since it would enforce in your psyche that you were capable of doing something, rather than taking into consideration that it was actually a general broadcast for all those people like yourself misguided in your reasoning. Incidentally, how do you know the sports presenters haven't got involved in a large conspiracy where they smile, wink or shuffle papers in an evocative manner with the intention of making people like yourself believe your responsible, perhaps they sat their once like yourself thinking the same things and thought it would fun fulfilling it for someone).