The teams have played each other four times in the FA Cup with the Blues never losing against the Terriers.
View the match highlights from Crystal Palace v Man City.
The first time the teams clashed was in 1926 in the fourth round, with City winning 4-0 at Maine Road.
It would be 62 years before the teams met again, with City relying on a goal from John Gidman deep into injury time to rescue a 2-2 draw at Leeds Road.
The replay ended 0-0 at Maine Road - this after Huddersfield had lost 10-1 just two months earlier in the Division Two clash - meaning yet another replay at Huddersfield.
This time the Blues eased through, winning 3-0 at a sodden Leeds Road.
The teams haven’t met since the Division One 1-1 draw at what was then the McAlpine Stadium in 2000.
Now named the John Smith’s Stadium, the ground has a 24,500 capacity and Aaron Mooy is currently on loan with the West Yorkshire side.
Both remaining non-League clubs were rewarded with Premier League opposition with Sutton hosting Arsenal and Burnley drawn at home to Lincoln City.
Ticket details will be released in due course.
The fifth round ties will be played from 17-20 February.
Draw in full:
Burnley v Lincoln City
Fulham v Tottenham Hotspur
Blackburn Rovers v Manchester United
Sutton United v Arsenal
Middlesbrough v Oxford United
Wolverhampton Wanderers v Chelsea
Huddersfield Town v Manchester City
Millwall v Derby County/Leicester City