There's more to video games than pressing buttons at random.
Successfully defeating an opponent in Street Fighter also involves skillful eye work, as evidenced in this video. 4Gamer.net, a Japanese gaming website, hooked up an eye-tracking device called SteelSeries Sentry Gaming Eye Tracker on to the prized player Sako to track his focus.
He's the fighter on the right. The grey dot is where his eyes are looking.
As you can see, his view doesn't go back-and-forth between him and his opponent, but rather it's an area in the middle. He's likely scanning that area to monitor for incoming attacks and figure out his next attack.
So, if you're failing at winning, just look (literally) at what the pros are doing.