A man accused of killing a pedestrian on a motorbike has narrowly avoided being attacked in the queue at Swindon Crown Court.