Resources for Measure what Matters: Psychometric Evaluation of AI with Situational Judgment Tests)(https://arxiv.org/abs/2510.22170)
AI & ML interests
We work with you to develop a high impact AI strategy for your industry, refine your data foundations and design meaningful human-AI interactions. We also empower you to develop, integrate and test the latest AI technologies responsibly.
Recent Activity
View all activity
models 17
thoughtworks/coding-sorl
4B • Updated • 18
thoughtworks/arithmetic-sorl
Updated • 2
thoughtworks/Qwen3-Coder-Next-Eagle3
Text Generation • 0.1B • Updated • 53 • 1
thoughtworks/GLM-4.7-FP8-Eagle3
Text Generation • 0.6B • Updated • 17 • 1
thoughtworks/MiniMax-M2.5-Eagle3
Text Generation • 0.2B • Updated • 2.61k • 6
thoughtworks/GLM-4.7-Flash-Eagle3
Text Generation • 0.1B • Updated • 75 • 2
thoughtworks/Gemma-4-31B-Eagle3
Text Generation • 0.6B • Updated • 215 • 5
thoughtworks/arithmetic-sorl-saes
Updated
thoughtworks/DeepSeek-R1-Distill-Qwen-14B-Eagle3
Text Generation • 0.6B • Updated • 13
thoughtworks/DeepSeek-R1-Distill-Qwen-7B-Eagle3
Text Generation • 0.4B • Updated • 15
datasets 14
thoughtworks/document-processing-benchmark
Viewer • Updated • 15.7k • 12
thoughtworks/CulturalCounterfactuals
Viewer • Updated • 7.5k • 4.3k
thoughtworks/psychometric_personas_responses
Viewer • Updated • 6.85M • 11k
thoughtworks/agentic-coding-trajectories
Viewer • Updated • 15k • 379
thoughtworks/psychometric_personas
Viewer • Updated • 23.9k • 205
thoughtworks/gemma_psychometrics_personas_responses
Viewer • Updated • 5.59M • 4.78k • 1
thoughtworks/ablation_psychometrics_personas
Viewer • Updated • 500 • 154
thoughtworks/psychometric_human_annotations
Viewer • Updated • 55 • 28
thoughtworks/parliamentary_personas
Viewer • Updated • 2.2k • 170
thoughtworks/psychometric_SJTs
Viewer • Updated • 4k • 34