Justin Baldoni has become the center of the controversy at the time, having both directed and acted alongside Lively in the movie It Ends With Us