Funded by the William T. Grant Foundation and Virginia B. Toulmin Foundation in two phases, they describe APT's strengths as an evaluation and program quality measure for out-of-school (OST) programs, a tool that is critical for program directors and policymakers who need to identify where to improve and how to support those improvements within OST programs. In addition, the online, video-based training developed in the second phase to increase reliability of APT raters showed promise, such that the most high priority APT quality areas were found to be the most improved (i.e., most accurate) scores post training.