Unfortunately, if I'm any other GM and Trae Young is sitting there, I'm not sure why I'd give that up for Rozier. While there's of course a chance Young is never be as good as Rozier, he also might be substantially better, and the draft is usually the time to indulge in visions of upside. Not to mention he's younger and has more years of (~cheap) control. Unless the other asset coming with Rozier is substantial (i.e., the SAC or MEM pick), I don't see it.
I think when you get outside the top 10 that starts becoming more likely. Using Rozier plus their own pick to get a pick in that 11-15 range seems feasible to me. Ironically enough, I'd actually think if Philly ends up with the 10-11 pick, that might be a good landing spot. Rozier could replace Reddick as a swing guard who could handle the ball, but wouldn't have to be their primary distributor with Simmons there.