The Blues have dropped points against Everton, Southampton and Middlesbrough at the Etihad in recent weeks, results which have seen them lose top spot in the table.
But Caballero believes there are plenty of positives. City have controlled each game, dominating possession and creating an abundance of chances, which he feels is a good sign.
“This is the most important thing and it is the most difficult thing to achieve,” he said. “Even with Manuel [Pellegrini] we played with a lot of possession of the ball. Now with Pep we are trying to do our best performance from the first minute, trying to keep the ball and play the most time possible with the ball.
“We have high possession all the time, every single game, but the way to win the game is by scoring goals. In the last game, we had five or six situations to score and we must keep clean sheets at home.
“In the three games, one we played perfect against Everton, another one maybe we couldn’t give our best performance – but in the last game we did everything to win but couldn’t close the game.”
Caballero says Guardiola’s technical staff are examining each game in detail in order to keep improving.
The Argentine wants his team-mates to forget the run of draws and focus on winning at Crystal Palace in their next match.
“We analyse every single game,” he said. “The most important thing now is we must keep a clean sheet at home and we must win the next game at home because we are able to do it. We did it against Barcelona, and these points we lose at home they don’t return.
“We have to go to Palace now, to play well and go for the three points.”