Brighton dominated the match pretty much from start to finish but classy finishes from Palace in each half sealed all three points and relieved some pressure on boss Roy Hodgson.
Mateta put the visitors ahead on 28 minutes with a very clever back heel after great work down the right from Jordan Ayew.
Brighton continued to push forward and finally got the equaliser they deserved in the second half when Joel Veltman smashed home with his left foot.
Adam Lallana, Leo Trossard and Ali Jahanbakhsh all missed chances to win the game but it was Benteke who struck with an excellent volley on 95 minutes.
Scroll down and click through to see Sam Morton's player ratings
1. Robert Sanchez 6
Outwitted by Mateta's brilliant back-heel and couldn't have done anything to stop Benteke's late winner. Had little else to do. Positioned almost as a centre half when Brighton had the ball, which was most of the game.
2. Ben White 6
Failed to stop Mateta for opener but had little else to do defensively. Played a couple of dangerous cross-field balls to no avail. Took some blame for late Palace winner after playing a loose ball in the build-up
3. Lewis Dunk 7
Played some great long passes to the forwards and looked a threat from corners. Didn't have a lot of defensive work to do as Palace were rarely a threat. Unable to stop either goal.
4. Dan Burn 6
Was beaten for pace by Jordan Ayew, who set up Mateta's skilful opener against the run of play. Looked to redeem himself in second half with a couple of brilliant crosses which should have led to goals. Lost Benteke at the back post late on which proved to be fatal.