An AI Evaluation Framework

Join the Aspen Policy Academy mailing list to learn more about us and our fellows (you’ll receive one email a week).

{"action":"swipe","clientId":"ac5a79b3-027f-4735-ad6e-8ed9a01adc94","controls":["submits"],"property":"newsletter","recipients":"","receipts":"","rules":[],"subject":""}

{"type":"email","format":[{"label":"month"},{"label":"day"},{"label":"year"},{"label":"hour"},{"label":"minute"}],"filetypes":[],"options":[],"title":"Email Address","description":" ","placeholder":"","helper":false,"abilities":["required"],"beacons":[],"preset":"","identifier":"email_address","evaluate":[],"minimum":0,"maximum":200,"expression":"^[a-zA-Z0-9.]{2,}@[a-zA-Z0-9]{3,}\\.[A-Za-z]{2,}$","count":1}

Email Address

{"type":"input","format":[{"label":"month"},{"label":"day"},{"label":"year"},{"label":"hour"},{"label":"minute"}],"filetypes":[],"options":[],"title":"First Name","description":" ","placeholder":"","helper":false,"abilities":["required"],"beacons":[],"preset":"","identifier":"first_name","evaluate":[],"minimum":0,"maximum":200,"expression":"(.|\\n){1,}?","count":1}

First Name

{"type":"input","format":[{"label":"month"},{"label":"day"},{"label":"year"},{"label":"hour"},{"label":"minute"}],"filetypes":[],"options":[],"title":"Last Name","description":" ","placeholder":"","helper":false,"abilities":[],"beacons":[],"preset":"","identifier":"last_name","evaluate":[],"minimum":0,"maximum":200,"expression":"(.|\\n){1,}?","count":1}

Last Name

{"type":"check","format":[{"label":"month"},{"label":"day"},{"label":"year"},{"label":"hour"},{"label":"minute"}],"filetypes":[],"options":[{"label":"I want to learn how to change policy"},{"label":"I am a journalist"}],"title":"Focus","description":"Description of field","placeholder":"","helper":false,"abilities":["multiple"],"beacons":[],"preset":[],"identifier":243442156,"evaluate":[],"minimum":0,"maximum":200,"expression":"(.|\\n){1,}?","count":1}

Focus

Description of field

{"type":"check","format":[{"label":"month"},{"label":"day"},{"label":"year"},{"label":"hour"},{"label":"minute"}],"filetypes":[],"options":[{"label":"Washington DC area"},{"label":"New York City area"},{"label":"San Francisco Bay area"},{"label":"Los Angeles area"},{"label":"I'm in another location"}],"title":"Select your location","description":"Description of field","placeholder":"","helper":false,"abilities":[],"beacons":[],"preset":[],"identifier":233425307,"evaluate":[],"minimum":0,"maximum":200,"expression":"(.|\\n){1,}?","count":1}

Select your location

Description of field

By submitting this form, I agree that the Aspen Institute can collect, process, and retain limited personal information for administrative purposes; and that the Institute can share this limited personal information with its trusted service providers for program administration purposes. I consent to receiving email communications from the Aspen Policy Academy. I understand I can withdraw my consent at any time by contacting DataPrivacyLegal@aspeninstitute.org.

I agree to the Aspen Institute’s Terms of Use Agreement and acknowledge that I have read and understand the Aspen Institute Privacy Policy which provides additional information about how the Institute processes personal information, as well as rights I may have regarding the personal information the Institute maintains about me.

Thank you for signing up! Keep an eye on your inbox for our next weekly newsletter!

{"abilities":[],"action":"stack","className":"","columns":3,"controls":[],"exclude":[],"include":[{"custom.menu":"header-menu"}],"maximum":6,"property":"header","orders":["date","title","menu_order","post_type","post__in"]}

{"abilities":[],"action":"stack","className":"","columns":3,"controls":[],"exclude":[],"include":[{"custom.menu":"header-menu"}],"maximum":6,"property":"mobile","orders":["date","title","menu_order","post_type","post__in"]}

By Jordan Loewen-Colón, Ayodele Odubela, and Jeanette Jordan

As artificial intelligence (AI) tools proliferate across governments and institutions, the United States is experiencing a simultaneous AI public trust crisis. These trends necessitate the Utah Office of Artificial Intelligence Policy (OAIP) to establish transparent processes that encourage public understanding of AI regulatory mitigation. This project recommends that the OAIP adopt a standardized evaluation framework for its partners, then publicize these criteria and a running list of its AI Learning Lab participants. These transparent steps would help Utah build public trust in AI innovation, modeling responsible AI development for other states.

This project was completed as part of the 2024 Science and Technology Policy Fellowship, an Aspen Policy Academy program to teach science and technology experts how to impact policy.

Download the Executive Summary

{"abilities":[],"action":"swipe","className":"wide","columns":3,"controls":["arrows"],"exclude":[{"starter.postid":"26521"},{"default.postid":"26818"},{"starter.termid":"109"}],"filters":[],"include":[{"starter.termid":"106"},{"starter.termid":"93"},{"starter.termid":"90"},{"starter.termid":"143"},{"starter.termid":"126"},{"starter.termid":"88"}],"maximum":6,"meta":[],"property":"box","searching":"","sorts":[{"ordering.label":"date","evaluation.label":"\u2193","display":"Most Recent","label":"date \u2193 Most Recent"}],"sorting":[{"ordering.label":"date","evaluation.label":"\u2193","display":"Most Recent","label":"date \u2193 Most Recent"}],"orders":["date","title","menu_order","post_type","post__in","relevance"],"filtering":"","refiner":false,"total":96}

Aspen Policy Academy

Browse Related Projects

Tech

Data-Sharing to Increase Young Mothers’ Benefits Enrollment in Central California

Tech

Supporting Medi-Cal Recipients by Screening for Employment Eligibility in San Francisco

Tech

Digitizing the JobsNOW! Intake Process for Medi-Cal Clients in San Francisco