A Gavin and Stacey star has addressed complaints from fans that they still don't know what happened on the fishing trip