Semme's Brigade was not in Pennsylvania on 7/10/63. In fact the entire Confederate Army had left the state by then; except for perhaps some cavalry units.
So if he was in fact killed in Pennsylvania, he was not with his unit. That would be highly unusual, assuming he hadn't deserted.