The care of new mothers at a major hospital has been hampered by workforce stress, skill levels and the layout of its maternity unit, a review has found.