A community bank based in Swindon has appointed its first chief executive officer as it looks to continue to expand.