Floors above a Japanese restaurant in Fareham town centre will be turned into a five-bedroom house despite concerns over parking, noise and antisocial behaviour.