Upon close examination of one particular hi-res photo of these "caves", the supposed over-hang appears to be a shoreline. Black areas can be seen between the wall and the "Abyss".
Black Crude or Texas Tea? Oil companies got dibs on Mars too I guess............