Anna Maria College last month withdrew an invitation to Victoria Kennedy, the widow of Senator Ted Kennedy, to deliver a commencement speech, citing opposition from the local bishop, who said that some of Kennedy's views conflict with Roman Catholic teachings. Now it turns out that the bishop won't be attending commencement either. A spokesman for the Rev. Robert J. McManus, bishop of Worcester, told The Boston Globe that college officials "felt the bishop would be a distraction to the event,’’ and so asked him not to attend. "He was going to attend, but that’s not going to happen now," the spokesman said.