BACKGROUND AND OBJECTIVES: Online modules offer an opportunity to overcome barriers to educational delivery. Such approaches can require significant investment dependent on the development model used. There is little in the literature on the formative assessment of design and development. Better understanding is needed to determine effective methods of training and supporting faculty authors. METHODS: The purpose of this study was to examine the effectiveness of Web-based modules developed by a Department of Family Medicine in delivering instruction to resident learners and to examine perceptions of the design and development process. Participants included 49 resident learners and 28 faculty and staff members as the development team. Data collection involved use of Web-based surveys, participant observation focus groups, and pretesting/posttesting. Frequency distributions and mean comparisons were used to analyze quantitative data. Participant comments were thematically analyzed. RESULTS: Residents felt that modules met their educational goals and contributed to understanding of core content. Pretest/posttest data showed statistical improvement for a majority of modules. The use of Web authoring software for Web-based learning and scheduling time to work on the modules posed the greatest challenges to module authors. CONCLUSIONS: Formative assessment methods can provide important information to module developers and support staff to shape training, content development, and improve module ease of use, navigation, and content for resident learners.