publication of the International Legal Technology Association
Issue link: https://epubs.iltanet.org/i/1193169
I L T A S U R V E Y R E S U L T S | A R T I F I C I A L I N T E L L I G E N C E & M A C H I N E L E A R N I N G 8 2 0 1 9 A R T I F I C I A L I N T E L L I G E N C E & M A C H I N E L E A R N I N G S U R V E Y R E S U L T S What roles are/will be involved in any AI- powered software purchase, development, training and deployment? 34.23% 38 16.22% 18 36.04% 40 1.80% 2 2.70% 3 0.00% 0 0.90% 1 8.11% 9 Q17 How broad is the use of legal AI-powered software by your organization? Answered: 111 Skipped: 6 TOTAL 111 TBD Single Department/P... Multiple Departments/... Regional Americas EMEA Asia Global/Organiza tion-wide 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% ANSWER CHOICES RESPONSES TBD Single Department/Practice Multiple Departments/Practices Regional Americas EMEA Asia Global/Organization-wide ILTA Artificial Intelligence and Machine Learning Survey How broad is the use of legal AI-powered software by your organization? — 34% — 16% —2% — 36% What do you believe is the biggest challenge with the available current data set for the AI-powered software(s) you are developing or purchasing? What do you believe is the biggest challenge with training AI-powered software? What three elements of quality assurance do you incorporate in your AI projects? Is it important for law firms and law departments to lead the adoption of AI-powered software through collboration fellowship or through a exclusivity agreements by one party leading the other? — 3% 57.55% 61 19.81% 21 5.66% 6 1.89% 2 3.77% 4 11.32% 12 Q19 What do you believe is the biggest challenge with the available current Data Set for the AI-powered software(s) you are developing or purchasing? Answered: 106 Skipped: 11 TOTAL 106 Data not cleansed or... Insufficient data Incorrect data Biased data Data not available No data challenges 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% ANSWER CHOICES RESPONSES Data not cleansed or normalized Insufficient data Incorrect data Biased data Data not available No data challenges ILTA Artificial Intelligence and Machine Learning Survey — 57% — 20% Data not cleansed or normalized — 2% — 6% — 4% 13.08% 14 23.36% 25 17.76% 19 5.61% 6 Q20 What do you believe is the biggest challenge with training AI- powered software? Answered: 107 Skipped: 10 Inability to get good... Unavailability of skilled... Insufficient knowledge of... Unpredictable results Analysis Time for training... Data viability for usage Biased training... 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% ANSWER CHOICES RESPONSES Inability to get good training data Unavailability of skilled personnel to do the training Insufficient knowledge of data for training Unpredictable results ILTA Artificial Intelligence and Machine Learning Survey — 13% — 23% Inability to get good training data — 18% — 6% Unavailability of skilled personnel to do the training Insufficient knowledge of data for training Analysis Time for training and validation of results 59.57% 46.81% 44.68% 60.64% 36.17% Q21 What three elements of quality assurance do you incorporate AI projects? Answered: 94 Skipped: 23 Total Respondents: 94 Documented Requirements Validation Documentation Documented Success Metrics Full POC Run Dual projects... 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% ANSWER CHOICES RESPONSES Documented Requirements Validation Documentation Documented Success Metrics Full POC Run Dual projects (Manual alongside AI) ILTA Artificial Intelligence and Machine Learning Survey — 60% — 47% — 45% 74.51% 15.69% 9.80% Q22 Is it important for law firms and law departments to lead the of AI-powered software through collboration fellowship or through exclusivity agreements by one party leading the other? Answered: 102 Skipped: 15 TOTAL Yes - Mutual collaboratio... Adoption by law firms fi... Law Department adoption fir... 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% ANSWER CHOICES RESPONSES Yes - Mutual collaboration between law firm and law departments Adoption by law firms first followed by law departments Law Department adoption first requesting law firm acceptance ILTA Artificial Intelligence and Machine Learning Survey — 74% — 16% — 10% Adoption by law firms first followed by law departments — 1% — 8% — 0% Single Department/ Practice Multiple Departments/ Practices Global/ Organization- wide — 11% Biased training methods competing for attention — 25% — 12% — 3% — 61% — 36% Run Dual projects (Manual alongside AI) Yes - Mutual collaboration between law firm and law departments Law Department adoption first requesting law firm acceptance 17.24% 20 Q9 What is the biggest challenge in advancing adoption of AI in your organization? Answered: 116 Skipped: 1 Cost of Product Integrations Good Data Sets Skilled resources Training the tool Change Management Understanding the Tools Understanding the Need for... Creating the Urgency and... 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% ANSWER CHOICES RESPONSES ILTA Artificial Intelligence and Machine Learning Survey — 80% Understanding the Need for the Tools Creating the Urgency and Need Internally CIO/IT Director Attorney Innovation Team Knowledge Manager Legal Operations Team Project Manager Data Science Team Paralegal Legal Assistant — 62% — 42% — 35% — 33% —25% — 11% — 2% — 10%