A new policy in Rotherham could see residents issued fines if they repeatedly fail to sort their recycling into the right bins.