---
title: "The content improvement service: An adaptive system for continuous improvement at scale"
description: Adaptive Instructional Systems, HCII 2022
---

< Back to Publications

# The content improvement service: An adaptive system for continuous improvement at scale

## Abstract

Advances in artificial intelligence and automatic question generation have made it possible to create millions of questions to apply an evidence-based learn by doing method to thousands of e-textbooks, an unprecedented scale. Yet the scaling of this learning method presents a new challenge: how to monitor the quality of these automatically generated questions and take action as needed when human review is not feasible. To address this issue, an adaptive system called the Content Improvement Service was developed to become an automated part of the platform architecture. Rather than adapting content or a learning path based on student mastery, this adaptive system uses student data to evaluate question quality to optimize the learning environment in real time. In this paper, we will address the theoretical context for a platform-level adaptive system, describe the methods by which the Content Improvement Service functions, and provide examples of questions identified and removed through these methods. Future research applications are also discussed. 

[Read Publication](https://doi.org/10.1007/978-3-031-22131-6_22)

##### Date

November 25, 2022

##### Authors

- Bill Jerome
- Rachel Van Campenhout
- Jeffrey S. Dittel
- Rich Benton
- Scott Greenburg
- Benny G. Johnson

##### Research Areas

[Adaptivity](https://research.vitalsource.com/publications/tag/adaptivity) [Learning Engineering](https://research.vitalsource.com/publications/tag/learning-engineering)

##### Venue

 24th International Conference on Human-Computer Interaction, HCII 2022

##### Citation

 Jerome, B., Van Campenhout, R., Dittel, J. S., Benton, R., Greenberg, S., & Johnson, B. G. (2022). The Content Improvement Service: An adaptive system for continuous improvement at scale. *Interaction in new media, learning and games. HCII 2022. Lecture Notes in Computer Science, Vol. 13517*, 286–296. Springer.   
[https://doi.org/10.1007/978-3-031-22131-6_22](https://doi.org/10.1007/978-3-031-22131-6_22)

##### Share

[![](https://research.vitalsource.com/hubfs/2021_Research/Social%20-%20Facebook.svg)](https://www.facebook.com/sharer/sharer.php?u=https://research.vitalsource.com/publications/the-content-improvement-service-an-adaptive-system-for-continuous-improvement-at-scale) [![](https://research.vitalsource.com/hubfs/2021_Research/Social%20-%20LinkedIn.svg)](https://www.linkedin.com/shareArticle?mini=true&url=https://research.vitalsource.com/publications/the-content-improvement-service-an-adaptive-system-for-continuous-improvement-at-scale) [![](https://research.vitalsource.com/hubfs/2021_Research/Social%20-%20Twitter.svg)](https://twitter.com/intent/tweet?url=https://research.vitalsource.com/publications/the-content-improvement-service-an-adaptive-system-for-continuous-improvement-at-scale&text=)

### Related Publications

#### Search our catalog of recent publications authored by our team.

**2023**

##### [Iterative improvement of automatically generated practice with the Content Improvement Service](https://research.vitalsource.com/publications/iterative-improvement-of-automatically-generated-practice-with-the-content-improvement-service)

**Adaptive Instructional Systems, HCII 2023**

![profile](https://research.vitalsource.com/hubfs/2021_Research/Home/profile.svg) Bill Jerome, Rachel Van Campenhout, Jeffrey S. Dittel, Rich Benton, Benny G. Johnson (2023)

[Automatic Question Generation](https://research.vitalsource.com/publications/tag/automatic-question-generation) [Adaptivity](https://research.vitalsource.com/publications/tag/adaptivity) [Learning Engineering](https://research.vitalsource.com/publications/tag/learning-engineering)

**2022**

##### [The content improvement service: An adaptive system for continuous improvement at scale](https://research.vitalsource.com/publications/the-content-improvement-service-an-adaptive-system-for-continuous-improvement-at-scale)

**Adaptive Instructional Systems, HCII 2022 **

![profile](https://research.vitalsource.com/hubfs/2021_Research/Home/profile.svg) Bill Jerome, Rachel Van Campenhout, Jeffrey S. Dittel, Rich Benton, Scott Greenburg, Benny G. Johnson (2022)

[Adaptivity](https://research.vitalsource.com/publications/tag/adaptivity) [Learning Engineering](https://research.vitalsource.com/publications/tag/learning-engineering)

**2021**

##### [Investigating adaptive activity effectiveness across domains: Insights into design best practices](https://research.vitalsource.com/publications/investigating-adaptive-activity-effectiveness-across-domains-insights-into-design-best-practices)

**Sottilare R.A., Schwarz J. (eds) Adaptive Instructional Systems. Design and Evaluation. HCII 2021**

![profile](https://research.vitalsource.com/hubfs/2021_Research/Home/profile.svg) Rachel Van Campenhout, Bill Jerome, Jeffrey S. Dittel, & Benny G. Johnson (2021)

[Adaptivity](https://research.vitalsource.com/publications/tag/adaptivity) [Learning Engineering](https://research.vitalsource.com/publications/tag/learning-engineering)

**2020**

##### [The impact of adaptive activities in Acrobatiq courseware: Investigating the efficacy of formative adaptive activities on learning estimates and summative assessment scores](https://research.vitalsource.com/publications/the-impact-of-adaptive-activities-in-acrobatiq-courseware)

**Sottilare R., Schwarz J. (eds) Adaptive Instructional Systems. HCII 2020. LNCS, vol 12214. Springer. pp 543–554.**

![profile](https://research.vitalsource.com/hubfs/2021_Research/Home/profile.svg) Rachel Van Campenhout, Bill Jerome, & Benny G. Johnson (2020)

[Adaptivity](https://research.vitalsource.com/publications/tag/adaptivity)

[See all publications](https://research.vitalsource.com/publications)