Algorithms may never really figure us out thank goodness – The Boston Globe
Posted: September 20, 2020 at 10:56 pm
An unlikely scandal engulfed the British government last month. After COVID-19 forced the government to cancel the A-level exams that help determine university admission, the British education regulator used an algorithm to predict what score each student would have received on their exam. The algorithm relied in part on how the schools students had historically fared on the exam. Schools with richer children tended to have better track records, so the algorithm gave affluent students even those on track for the same grades as poor students much higher predicted scores. High-achieving, low-income pupils whose schools had not previously performed well were hit particularly hard. After threats of legal action and widespread demonstrations, the government backed down and scrapped the algorithmic grading process entirely. This wasnt an isolated incident: In the United States, similar issues plagued the International Baccalaureate exam, which used an opaque artificial intelligence system to set students' scores, prompting protests from thousands of students and parents.
These episodes highlight some of the pitfalls of algorithmic decision-making. As technology advances, companies, governments, and other organizations are increasingly relying on algorithms to predict important social outcomes, using them to allocate jobs, forecast crime, and even try to prevent child abuse. These technologies promise to increase efficiency, enable more targeted policy interventions, and eliminate human imperfections from decision-making processes. But critics worry that opaque machine learning systems will in fact reflect and further perpetuate shortcomings in how organizations typically function including by entrenching the racial, class, and gender biases of the societies that develop these systems. When courts and parole boards have used algorithms to forecast criminal behavior, for example, they have inaccurately identified Black defendants as future criminals more often than their white counterparts. Predictive policing systems, meanwhile, have led the police to unfairly target neighborhoods with a high proportion of non-white people, regardless of the true crime rate in those areas. Companies that have used recruitment algorithms have found that they amplify bias against women.
But there is an even more basic concern about algorithmic decision-making. Even in the absence of systematic class or racial bias, what if algorithms struggle to make even remotely accurate predictions about the trajectories of individuals' lives? That concern gains new support in a recent paper published in the Proceedings of the National Academy of Sciences. The paper describes a challenge, organized by a group of sociologists at Princeton University, involving 160 research teams from universities across the country and hundreds of researchers in total, including one of the authors of this article. These teams were tasked with analyzing data from the Fragile Families and Child Wellbeing Study, an ongoing study that measures various life outcomes for thousands of families who gave birth to children in large American cities around 2000. It is one of the richest data sets available to researchers: It tracks thousands of families over time, and has been used in more than 750 scientific papers.
The task for the teams was simple. They were given access to almost all of this data and asked to predict several important life outcomes for a sample of families. Those outcomes included the childs grade point average, their grit (a commonly used measure of passion and perseverance), whether the household would be evicted, the material hardship of the household, and whether the parent would lose their job.
The teams could draw on almost 13,000 predictor variables for each family, covering areas such as education, employment, income, family relationships, environmental factors, and child health and development. The researchers were also given access to the outcomes for half of the sample, and they could use this data to hone advanced machine-learning algorithms to predict each of the outcomes for the other half of the sample, which the organizers withheld. At the end of the challenge, the organizers scored the 160 submissions based on how well the algorithms predicted what actually happened in these peoples lives.
The results were disappointing. Even the best performing prediction models were only marginally better than random guesses. The models were rarely able to predict a students GPA, for example, and they were even worse at predicting whether a family would get evicted, experience unemployment, or face material hardship. And the models gave almost no insight into how resilient a child would become.
In other words, even having access to incredibly detailed data and modern machine learning methods designed for prediction did not enable the researchers to make accurate forecasts. The results of the Fragile Families Challenge, the authors conclude, with notable understatement, raise questions about the absolute level of predictive performance that is possible for some life outcomes, even with a rich data set.
Of course, machine learning systems may be much more accurate in other domains; this paper studied the predictability of life outcomes in only one setting. But the failure to make accurate predictions cannot be blamed on the failings of any particular analyst or method. Hundreds of researchers attempted the challenge, using a wide range of statistical techniques, and they all failed.
These findings suggest that we should doubt that big data can ever perfectly predict human behavior and that policymakers working in criminal justice policy and child-protective services should be especially cautious. Even with detailed data and sophisticated prediction techniques, there may be fundamental limitations on researchers' ability to make accurate predictions. Human behavior is inherently unpredictable, social systems are complex, and the actions of individuals often defy expectations.
And yet disappointing as this may be for technocrats and data scientists, it also suggests something reassuring about human potential. If life outcomes are not firmly pre-determined if an algorithm, given a set of past data points, cannot predict a persons trajectory then the algorithms limitations ultimately reflect the richness of humanitys possibilities.
Bryan Schonfeld and Sam Winter-Levy are PhD candidates in politics at Princeton University.
Read more here:
Algorithms may never really figure us out thank goodness - The Boston Globe
- Getting Started With Machine Learning: Definition and Applications - CMSWire - February 20th, 2021
- This Biotech Company Combines Single Cell Genomics with Machine Learning (ML) Algorithms To Enable High Resolution Profiling of the Immune System -... - February 20th, 2021
- Immunai Raises $60M to Decode the Immune System with Machine Learning and AI - AlleyWatch - February 20th, 2021
- Cloud Machine Learning Market: Indoor Applications Projected to be the Most Attractive Segment during 2021-2029 KSU | The Sentinel Newspaper - KSU |... - February 20th, 2021
- Machine Learning in Insurance Market: Indoor Applications Projected to be the Most Attractive Segment during 2021-2029 KSU | The Sentinel Newspaper -... - February 20th, 2021
- Carin Meier Using Machine Learning to Combat Major Illness, such as the Coronavirus - InfoQ.com - February 20th, 2021
- Moffitt Cancer Center: Why we are building the first machine learning department in oncology - The Cancer Letter - February 20th, 2021
- Machine Learning and where is it used? - Tech Guide - February 20th, 2021
- Artificial Intelligence and Machine Learning for Insurance Technology from Johnson Controls Available on the Ocean Tomo Bid-Ask Market - Yahoo Finance - February 20th, 2021
- Identifying COVID-19 Therapy Candidates With Machine Learning - Contagionlive.com - February 20th, 2021
- Machine Learning in Tax and Accounting Market gigantic revenues by 2028 with Amazon Web Services, Baidu Inc, Google, Intel, IBM, Hewlett Packard,... - February 20th, 2021
- Using AI and Machine Learning will increase in horti industry - hortidaily.com - February 13th, 2021
- The head of JPMorgan's machine learning platform explained what it's like to work there - eFinancialCareers - February 13th, 2021
- If you know nothing about deep learning with Python, start here - TechTalks - February 13th, 2021
- Mental health diagnoses and the role of machine learning - Health Europa - February 13th, 2021
- 5 Ways the IoT and Machine Learning Improve Operations - BOSS Magazine - February 13th, 2021
- There Is No Silver Bullet Machine Learning Solution - Analytics India Magazine - February 13th, 2021
- Postdoctoral Research Associate in Digital Humanities and Machine Learning job with DURHAM UNIVERSITY | 246392 - Times Higher Education (THE) - February 13th, 2021
- The Collision of AI's Machine Learning and Manipulation: Deepfake Litigation Risks to Companies from a Product Liability, Privacy, and Cyber... - February 13th, 2021
- Parascript and SFORCE Partner to Leverage Machine Learning Eliminating Barriers to Automation - GlobeNewswire - February 13th, 2021
- Rackspace Technology Study uncovers AI and Machine Learning knowledge gap in the UAE - Intelligent CIO ME - February 13th, 2021
- How Blockchain and Machine Learning Impact on education system - ABCmoney.co.uk - February 13th, 2021
- Mission Healthcare of San Diego Adopts Muse Healthcare's Machine Learning Tool - Southernminn.com - January 19th, 2021
- Deep Learning Outperforms Standard Machine Learning in Biomedical Research Applications, Research Shows - Georgia State University News - January 19th, 2021
- Project MEDAL to apply machine learning to aero innovation - The Engineer - January 19th, 2021
- Forecast On Machine Learning (ML) Intelligent Process Automation Market Witness the Growth of Great Billion by 2027 With Top Companies Like Automation... - January 19th, 2021
- Machine Learning Shown to Identify Patient Response to Sarilumab in Rheumatoid Arthritis - AJMC.com Managed Markets Network - January 19th, 2021
- Bangalore based Great Learning can help you unleash the potential of an M-Tech in Data Science & Machine - Times of India - January 19th, 2021
- CERC plans to embrace AI, machine learning to improve functioning - Business Standard - January 19th, 2021
- NTT Co-authored Papers at NeurIPS to Advance Machine Learning Efficiency and Performance - Business Wire - December 7th, 2020
- Why Intel believes confidential computing will boost AI and machine learning - VentureBeat - December 3rd, 2020
- Machine Learning Market to Grow Notably Attributed to Increasing Adoption of Analytics-driven Solutions by Developing Economies, says Fortune Business... - December 3rd, 2020
- Machine learning: The new language of data and analytics - ITProPortal - December 3rd, 2020
- Injecting Machine Learning And Bayesian Optimization Into HPC - The Next Platform - December 3rd, 2020
- QA Increasingly Benefits from AI and Machine Learning - RTInsights - December 3rd, 2020
- Everything to Know About Machine Learning as a Service (MLaaS) - Analytics Insight - December 3rd, 2020
- How the Food and Beverage Industry is Affected by Machine Learning and AI - IoT For All - December 3rd, 2020
- Amazon announces new machine learning tools to help customers monitor machines and worker safety - www.computing.co.uk - December 3rd, 2020
- Machine Learning and Location Data Applications Market 2020 Top Companies report covers, Industry Outlook, Top Countries Analysis & Top... - December 3rd, 2020
- Commentary: Chain of Demand applies AI, machine learning to retail supply chain profitability - FreightWaves - December 3rd, 2020
- Machine learning - it's all about the data - KHL Group - December 3rd, 2020
- Product Portfolio Analysis and Technological Development of Machine Learning in Medical Imaging Market during the forecasted period - Murphy's Hockey... - December 3rd, 2020
- Imaging AI and Machine Learning Beyond the Hype, Upcoming Webinar Hosted by Xtalks - PR Web - December 3rd, 2020
- Veritone aiWARE Now Supports NVIDIA CUDA for GPU-based AI and Machine Learning - Business Wire - December 3rd, 2020
- Exactech Launches Predict+, First Machine Learning-Based Software that Informs Surgeons with Patient-Specific Outcomes Predictions After Shoulder... - December 3rd, 2020
- How To Choose The Best Machine Learning Algorithm For A Particular Problem? - Analytics India Magazine - October 19th, 2020
- Lantronix Brings Advanced AI and Machine Learning to Smart Cameras With New Open-Q 610 SOM Based on the Powerful Qualcomm QCS610 System on Chip (SOC)... - October 19th, 2020
- AI and Machine Learning Technologies Expected to Play a Key Role in Expanding Multi Billion Dollar Digital Banking Sector: Report - Crowdfund Insider - October 19th, 2020
- AutoML Alleviates the Process of Machine Learning Analysis - Analytics Insight - October 19th, 2020
- Futurism Reinforces Its Next-Gen Business Commerce Platform With Advanced Machine Learning and Artificial Intelligence Capabilities - Yahoo Finance - October 19th, 2020
- Purebase Enhances Its Board of Advisors with An Expert on Machine Learning and Cheminformatics - GlobeNewswire - October 19th, 2020
- COVID-19 And The Role Of AI, Machine Learning In Logistics: A Conversation With Delhivery CTO Kapil Bharati - Mashable India - October 19th, 2020
- How to Beat Analysts and the Stock Market with Machine Learning - Knowledge@Wharton - October 19th, 2020
- AI and Machine Learning Can Help Fintechs if We Focus on Practical Implementation and Move Away from Overhyped Narratives, Researcher Says - Crowdfund... - October 19th, 2020
- Proximity matters: Using machine learning and geospatial analytics to reduce COVID-19 exposure risk - Healthcare IT News - September 20th, 2020
- PREDICTING THE OPTIMUM PATH - Port Strategy - September 20th, 2020
- What is 'custom machine learning' and why is it important for programmatic optimisation? - The Drum - September 20th, 2020
- How Machine Learning is Set to Transform the Online Gaming Community - Techiexpert.com - TechiExpert.com - September 20th, 2020
- Current and future regulatory landscape for AI and machine learning in the investment management sector - Lexology - September 20th, 2020
- Global Machine Learning Courses Market Research Report 2015-2027 of Major Types, Applications and Competitive Vendors in Top Regions and Countries -... - September 20th, 2020
- When AI in healthcare goes wrong, who is responsible? - Quartz - September 20th, 2020
- Is Wide-Spread Use of AI & Machine Intelligence in Manufacturing Still Years Away? - Automation World - September 20th, 2020
- How do we know AI is ready to be in the wild? Maybe a critic is needed - ZDNet - September 20th, 2020
- Solving the crux behind Apple's Silicon Strategy - Medium - September 20th, 2020
- Boost Your Animation To 60 FPS Using AI - Hackaday - September 20th, 2020
- 50 Latest Data Science And Analytics Jobs That Opened Last Week - Analytics India Magazine - September 20th, 2020
- Why Deep Learning DevCon Comes At The Right Time - Analytics India Magazine - September 20th, 2020
- Six notable benefits of AI in finance, and what they mean for humans - Daily Maverick - September 20th, 2020
- Twitter is looking into why its photo preview appears to favor white faces over Black faces - The Verge - September 20th, 2020
- 8 Trending skills you need to be a good Python Developer - iLounge - September 20th, 2020
- Automation Continuum - Leveraging AI and ML to Optimise RPA - Analytics Insight - September 20th, 2020
- UT Austin Selected as Home of National AI Institute Focused on Machine Learning - UT News | The University of Texas at Austin - August 27th, 2020
- Participation-washing could be the next dangerous fad in machine learning - MIT Technology Review - August 27th, 2020
- Getting to the heart of machine learning and complex humans - The Irish Times - August 27th, 2020
- Air Force Taps Machine Learning to Speed Up Flight Certifications - Nextgov - August 27th, 2020
- The Role of Artificial Intelligence and Machine Learning in the... - Insurance CIO Outlook - August 27th, 2020
- AI and Machine Learning Network Fetch.ai Partners Open-Source Blockchain Protocol Waves to Conduct R&D on DLT - Crowdfund Insider - August 27th, 2020
- AI may not predict the next pandemic, but big data and machine learning can fight this one - ZDNet - August 27th, 2020
- Machine Learning Artificial intelligence Market Size and Growth By Leading Vendors, By Types and Application, By End Users and Forecast to 2020-2027 -... - August 27th, 2020
- Explainable AI: From the peak of inflated expectations to the pitfalls of interpreting machine learning models - ZDNet - August 27th, 2020