The Evaluation and Training institute (ETI) partnered with National Geographic Society’s Educational Programs (NGEP) to develop a comprehensive evaluation strategy for their fledgling Massive Open Online Course (MOOC), Water: The Essential Resource. Through course participation, teachers will learn how to develop lesson plans that integrate environmental principles and concepts from the California Education and the Environment Initiative (EEI). In addition, teachers will learn how to reach students using innovative, modern environmental education instructional practices. As a new technology, very little is known about the measures of success within MOOC platforms, including how to evaluate program success. The first evaluation goal is to design an evaluation process that can be flexible enough to capture information across a wide variety of MOOC specific features (i.e. online communities, user behaviors, active vs. lurker characteristics, etc.) and powerful enough to inform instructional designers as they continue to improve the MOOC course. Finally, a long-term evaluation goal is to develop a set of outcome metrics to evaluate the impact of the MOOC in a summative fashion.