The viability of Unmanned Systems as tools is increasingly recognized in many domains. As technology advances, the autonomy on board these systems also advances. In order to evaluate the systems in terms of their levels of autonomy, it is critical to have a set of standard definitions that support a set of metrics. As autonomy cannot be evaluated quantitatively without sound and thorough technical basis, the development of autonomy levels for unmanned systems must take into account many factors such as task complexity, human interaction, and environmental difficulty. An ad hoc working group assembled by government practitioners has been formed to address these issues. The ultimate objectives for the working group are: (1) To determine the requirements for metrics for autonomy levels of unmanned systems. (2) To devise methods for establishing metrics of autonomy for unmanned systems. (3) To develop a set of widely recognized standard definitions for the levels of autonomy for unmanned systems. This paper describes the interim results that the group has accomplished through the first four workshops that the group held. We report on the initial findings of the workshops toward developing a generic framework for the Autonomy Levels for Unmanned Systems (ALFUS).