If they were using the same jury for both cases that would be a conflict, but the judge is there to be a referee between the two sides so that the jury only hears what it should in a particular case. As long as the judge is fair to both sides in each case, I don't see that as a conflict.
Now if the judge, rather than a jury, were deciding the case, that would be different.