If I recall correctly, the Color on the objectives filter doesn't show current ownership. This is shown by the flag on the city.
The color red mean the city is an objective of the reds and the white Color that'it is an objective of the whites. Bear in mind each factions can have a different sets of objectives.
I have no idea what colour is shown if a city is an objective for both reds and whites!