The Swans drew 0-0 with the Terriers at John Smith's Stadium but finished the match with ten men after the Ghana worldwide was dismissed.
"It was right in front of me", he said.
"After the red card we knew how the game would go".
"I saw two players try to win the ball with exactly the same movements", he said.
"If it's a red card to one then it should be a red card to both of them". They were like two bulls colliding.
Ayew, whose contribution to the Swans attack has been terrific since manager Carlos Carvalhal took over from Paul Clement in December past year, was given his marching orders by referee Michael Oliver following a horror tackle on Jonathan Hogg in the 10th minute of the game.
Here's the incident in question - Ayew and Jonathan Hogg were both going in for a challenge; Hogg got the worse of the exchange, clearly, but you could argue that both were reckless tackles.
"We will analyse it and see if we have reason to appeal".
It was the quickest sending off of the season and the Ghana forward could have no complaints, having nearly caught Jonathan Hogg on the knee in a reckless attempt to win the ball.
His loss for those three games would be a major blow, but Carvalhal is confident his team would find a way to cope.
The dismissal of their top scorer Jordan Ayew saw the remainder of the game played nearly exclusively in the visitors' half. We lost Renato Sanches who would be in the 11 and we then lost Wilfried Bony. We just had to do our best to keep them out and get something from the game.