Selected recent examples of coordination polymers (CPs) or metal-organic frameworks (MOFs) constructed from different multifunctional carboxylic acids with phenyl-pyridine or biphenyl cores have been discussed. Despite being still little explored in crystal engineering research, such types of semi-rigid, thermally stable, multifunctional and versatile carboxylic acid building blocks have become very promising toward the hydrothermal synthesis of metal-organic architectures possessing distinct structural features, topologies, and functional properties. Thus, the main aim of this mini-review has been to motivate further research toward the synthesis and application of coordination polymers assembled from polycarboxylic acids with phenyl-pyridine or biphenyl cores. The importance of different reaction parameters and hydrothermal conditions on the generation and structural types of CPs or MOFs has also been highlighted. The influence of the type of main di- or tricarboxylate ligand, nature of metal node, stoichiometry and molar ratio of reagents, temperature, and presence of auxiliary ligands or templates has been showcased. Selected examples of highly porous or luminescent CPs, compounds with unusual magnetic properties, and frameworks for selective sensing applications have been described.