Most cyber-physical human systems (CPHS) rely on users learning how to interact with the system. Rather, a collaborative CPHS should learn from the user and adapt to them in a way that improves holistic system performance. Accomplishing this requires collaboration between the human-robot/human-computer interaction and the cyber-physical system communities in order to feed back knowledge about users into the design of the CPHS. The requisite user studies, however, are difficult, time consuming, and must be carefully designed. Furthermore, as humans are complex in their interactions with autonomy it is difficult to know, a priori, how many users must participate to attain conclusive results. In this project we are working toward a new strategy that augments current shared control, and provide a mechanism to directly feed back results from the HRI community into autonomy design.