State of technology
🤖 More AI chatbot misadventures, providing hard truths for politicians who might like to believe that tech will save them from doing the hard work of fixing services. This time it was a New York City business chatbot which advised citizens to break the law. At Services Week 2024 GDS’ Josh Davey shared how gov.uk have been experimenting with a similar chatbot and what they’ve learned about accuracy and user trust. It’s a thoughtful approach and well worth a listen. Their testing revealed that “71% of users trusted the answers that were given even if the answers that we gave were incorrect”. It chimes with a warning that scientists are showing too much trust in AI, with troubling implications for their research.
💣 Will the AI bubble pop? This unforgiving takedown of the AI boom by Ed Zitron makes a compelling case in the affirmative. “If you stop saying things like "AI could do" or "AI will do," you have to start asking what AI can do, and the answer is...not that much, and not much more in the future.” It attacks both the fanciful sales pitches of AI’s proponents, and the media who so often fail to properly interrogate them. Adds credence to Rachel Coldicutt’s succinct argument for why we must resist the AI hype.
👁️🗨️ A long read by Rest of World about the spread of facial recognition software and its implications for public dissent. It takes a deep dive into the rise in facial recognition technology by law enforcement across Russia, India and Iran, and the new danger it brings to participation in mass demonstrations, a form of protest which used to offer dissenters anonymity.
🌐 Insightful stuff to be found in this webinar on digital public infrastructure (DPI) as a tool for gender equality, organised as part of the 68th Session of the Commission on the Status of Women. As outlined in this report by UCL’s IIPP, infrastructure is never politically neutral: Its success relies on conscious efforts at maximising value for everyone.
🛒 On the topic of tech hype, Amazon announced that it is ditching ‘Just Walk Out’ technology in Amazon Fresh stores. This technology which allowed shoppers to skip check-out appeared futuristically seamless but actually relied on remote Amazon employees using live data from cameras and sensors to ensure accurate checkouts - a system which presumably cost more than the hype was worth. |