Society is LONG overdue for some updates to harassment laws for online spaces. Generative AI makes it that much easier to produce porn with someone's likeness without their consent and obviously it can all be very harmful.
It's kind of crazy how easy it is now. A few years ago when Deep Fakes were all the rage I looked into it a bit and downloaded Facelap App or whatever it's called and all the results were super duper dodgy.
More recently I wanted to see how the process for video was these days and found an app, I forget the name now, but you just, open a source photo, and a target photo/video, adjust a few fine tuning bits, process it and it's much better. It still often looks a little jank around the edges but wait another two years and that will probably all be ironed out.
Also, this was with long videos. I wanted to really test it, I think one of the videos I threw at it was like 20-30 minutes long.
And this is just be, barely trying, just to learn the process and tools mostly. Replace me with someone putting any level of effort into it and it's already a recipie for bad stuff.