Implementing an AI Evaluation Framework

Join the Aspen Policy Academy mailing list to learn more about us and our fellows (you’ll receive one email a week).

{"action":"swipe","clientId":"d86babba-dc52-40eb-9ec9-7dff058f458a","controls":["submits"],"property":"newsletter","recipients":"","receipts":"","rules":[],"subject":""}

{"type":"email","format":[{"label":"month"},{"label":"day"},{"label":"year"},{"label":"hour"},{"label":"minute"}],"filetypes":[],"options":[],"title":"Email Address","description":" ","placeholder":"","helper":false,"abilities":["required"],"beacons":[],"preset":"","identifier":"email_address","evaluate":[],"minimum":0,"maximum":200,"expression":"^[a-zA-Z0-9.]{2,}@[a-zA-Z0-9]{3,}\\.[A-Za-z]{2,}$","count":1}

Email Address

{"type":"input","format":[{"label":"month"},{"label":"day"},{"label":"year"},{"label":"hour"},{"label":"minute"}],"filetypes":[],"options":[],"title":"First Name","description":" ","placeholder":"","helper":false,"abilities":["required"],"beacons":[],"preset":"","identifier":"first_name","evaluate":[],"minimum":0,"maximum":200,"expression":"(.|\\n){1,}?","count":1}

First Name

{"type":"input","format":[{"label":"month"},{"label":"day"},{"label":"year"},{"label":"hour"},{"label":"minute"}],"filetypes":[],"options":[],"title":"Last Name","description":" ","placeholder":"","helper":false,"abilities":[],"beacons":[],"preset":"","identifier":"last_name","evaluate":[],"minimum":0,"maximum":200,"expression":"(.|\\n){1,}?","count":1}

Last Name

{"type":"check","format":[{"label":"month"},{"label":"day"},{"label":"year"},{"label":"hour"},{"label":"minute"}],"filetypes":[],"options":[{"label":"I want to learn how to change policy"},{"label":"I am a journalist"}],"title":"Focus","description":"Description of field","placeholder":"","helper":false,"abilities":["multiple"],"beacons":[],"preset":[],"identifier":959882290,"evaluate":[],"minimum":0,"maximum":200,"expression":"(.|\\n){1,}?","count":1}

Focus

Description of field

{"type":"check","format":[{"label":"month"},{"label":"day"},{"label":"year"},{"label":"hour"},{"label":"minute"}],"filetypes":[],"options":[{"label":"Washington DC area"},{"label":"New York City area"},{"label":"San Francisco Bay area"},{"label":"Los Angeles area"},{"label":"I'm in another location"}],"title":"Select your location","description":"Description of field","placeholder":"","helper":false,"abilities":[],"beacons":[],"preset":[],"identifier":553921101,"evaluate":[],"minimum":0,"maximum":200,"expression":"(.|\\n){1,}?","count":1}

Select your location

Description of field

Thank you for signing up! Keep an eye on your inbox for our next weekly newsletter!

{"abilities":[],"action":"stack","className":"","columns":3,"controls":[],"exclude":[],"include":[{"custom.menu":"header-menu"}],"maximum":6,"property":"header","orders":["date","title","menu_order","post_type","post__in"]}

{"abilities":[],"action":"stack","className":"","columns":3,"controls":[],"exclude":[],"include":[{"custom.menu":"header-menu"}],"maximum":6,"property":"mobile","orders":["date","title","menu_order","post_type","post__in"]}

Implementing an AI Evaluation Framework

By Jordan Loewen-Colón, Ayodele Odubela, and Jeanette Jordan

As artificial intelligence (AI) tools proliferate across governments and institutions, the United States is experiencing a simultaneous AI public trust crisis. These trends necessitate the Utah Office of Artificial Intelligence Policy (OAIP) to establish transparent processes that encourage public understanding of AI regulatory mitigation. This project recommends that the OAIP adopt a standardized evaluation framework for its partners, then publicize these criteria and a running list of its AI Learning Lab participants. These transparent steps would help Utah build public trust in AI innovation, modeling responsible AI development for other states.

This brief was completed as part of a project for the 2024 Science and Technology Fellowship, an Aspen Tech Policy Hub program to teach science and technology experts how to impact policy.

See the Project