I know that I can just read off the phase diagram for water (for the surface atmospheric pressure on each object). But could there possibly be some nuances that someone might miss just from viewing the diagram?
Water does not form a liquid at very low pressure. Here is the this phase diagram:
(image from http://www.lsbu.ac.uk/water/phase.html and appears to be under the creative commons non-commercial no-derivatives)
The lowest pressure at which water is liquid is that of the triple point: 273.15 K and 611.73 Pa. That pressure is about 0.006 atmospheres.
Wikipedia puts the surface pressure on Mars at around 636 Pa, from which we conclude that there is just barely room for water to be a liquid in a very narrow temperature band above the Earthly freezing temperature (and even this relies on getting the full pressure quoted above which won't be true except at the lowest elevations).
No asteroid has sufficient atmosphere to maintain liquid water. If you have ice and heat it, it will sublime (convert directly to vapor).