After reading this story recently of a women deciding to get married to an AI personality she built using ChatGPT one thing that was surprising was how there are apparently companies there that specialize in these kinds of virtual weddings. While I would think people are doing it for fun, it seemed like this lady was dead serious as she recently had an engagement break off which caused her emotional distress and to latch on to chatting with AI programs. As you know, those programs can pretty much tell you what you want to hear if you tell it to do so.
This is a little unhealthy of course and this generated conversation on whether or not all these companies should be shamed for supporting and enabling these kinds of things for people who are suffering from mental health. The other argument is they are just offering a service of course and make no real discrimination on who wants it.
Would you tend to agree as you are just a business offering a solution? Or would you refrain from say serving people who clearly need help in other ways?