Established in 2021, the center uses artificial intelligence (AI) for comprehensive emergency response, monitoring 900 CCTV cameras across 17 of Seoul’s 21 pedestrian-accessible Han River bridges. Beyond suicide prevention, its most frequent task, the center also handles criminal tracking, traffic accidents and drug enforcement.
…
Much of that credit goes to AI, which triggers an alarm if an object identified as a person remains for more than 300 seconds in a bridge’s “loitering zones,” sections where people are able to stand for extended periods.
No, this is not a good use for AI. First, the concept here is to treat symptoms instead of the actual issue, second, stopping suicide attempts from happening isn’t the only thing AI is used for here and third, in the context of second, a 15% hallucination rate means a lot of innocent people are harassed for doing nothing wrong.
Edit, because according to the votes and both answers many people seem to have misunderstand this: the 15% false positive means too many innocent people harassed when this surveillance system is used against crime.
On the suicide issues, the AI just doesn’t solve the issue sustainably.
When it comes to suicide prevention, I’d prefer having a few false positives than any false negatives.
Stopping people from dying is good.
That’s not the issue where I criticised the false positive rate though, if you read my comment carefully. I hope I made it clearer with my edit.
people only said suicide detection was a good use of AI, not crime surveillance. and nobody’s pretending stopping a suicide attempt treats the underlying issues either, and that’s still better than not stopping it
But you don’t get one without the other. This does not exist in a vacuum.
Oh no someone might ask the victim of a false positive if they’re okay. The horror.
I guess you never have been targeted by unfounded police action. I hope you never will. It is fucking scary and traumatising.
American police is in its own category when it comes to cruelty in “police action”.
Don’t generalise it to other countries where becoming a police officer isn’t a 3 week online course.
I am not talking american police. I’m talking about experience with german police. You know, where you have to go to university for three years.
The training doesn’t matter when several armed officers are applying forceful measures against you, you have no idea why, are panicing and your panic reaction is read as resisting police officers. Because that is standard procedure.
That’s a good point. Good thing the area is very highly surveilled and recorded.
Unfortunately, being surveilled and recorded is not a reliable deterrent against unwarranted polive actions, especially when the executing officers thought they acted justified.
I don’t know how the AI can hallucinates in such scenario, but it’s better to harass some people to prevent some other people from committing suicide on those bridges.
That is how it hallucinates.
Besides that, you unfortunately also did not read my comment completely. I specifically pointed out the other instances this AI surveillance system is used on, the article brings up crime as an example. That is where 15 percent hallucination rate means a damn lot of innocent people get harassed by police.
Oops, my bad for didn’t read the whole article.
The AI only flagged the people (or the objects it misidentified as people), but the human still decides whether those people are worth checking on. I think it still the human’s fault if a lot of innocent people get harrassed by the police.
Why is AI necessary for that? I’m not a programmer, but that seems like a simple if/then statement
Sure, but you need a way to identify whether an object is a person. That’s a lot less simple.
Still don’t need AI for that
There are very few things we as humans “need”.
But a ton of things that make stuff easier. Like using “AI” to detect humans in this case
Wow, you’ve convinced me
Cool, what made you change your mind?
Yes you do, because an object on camera can look a lot of different ways. This is very different from LLMs like ChatGPT. It trains on different images like a Captcha and gets positive reinforcement if it identifies something correctly and negative if it is incorrect.
Machine Learning like this has been in use since the days of early digital computing. There isn’t a more efficient way to achieve something like this.
I certainly agree this does not address the root issue, and it does normalize this technology for adresssing social issues and can then be applied to places where its more harmful like crime- And also I think taken on its own merits this is a good intervention to exist for suicide prevention specifically (though I think its valid to not take it purely on its own merits if one is concerned about the adoption of surveillance tech)
I do want structural solutions though. But that requires rebuilding society in the image of treating humans better, better work and environmental conditions, rethinking healthcare (at least here in the US, no idea how things are in Korea), and about a million other things
And I do think the normalization of surveillance infrastructure should be taken seriously. Especially with the present global rise of authoritarianism
Damn, I cant solve societal problems, might as well just let them jump!
Youre a fucking moron.
Well, if you choose to misread my comment like that, AI can’t stop you.