Empowering Financial Management: CMS Harnesses AI to Preserve Institutional Knowledge

  • CMS utilizes LLM pilot to retain institutional knowledge and expedite onboarding.
  • Joe Hong highlights the importance of generative AI in providing precise, contextual answers swiftly.
  • The Office of Financial Management plays a critical role in supporting CMS operations by delivering timely and accurate data reports.
  • Leveraging large language models aids financial management staff in interpreting complex documentation.
  • Meta’s Llama 2 emerges as a successful solution for CMS’s pilot project.
  • The Office of Financial Management encourages innovation and problem-solving among its workforce.
  • AI and automation are seen as creating job opportunities rather than eliminating roles.

Main AI News:

As a federal agency responsible for managing health insurance programs, ensuring quality standards in facilities, and enforcing numerous intricate regulations, the Centers for Medicare & Medicaid Services heavily rely on institutional knowledge. However, faced with an aging workforce, sporadic hiring freezes, and an incessant workload, CMS’s financial leaders are turning to artificial intelligence to maintain efficiency.

During a recent UiPath public sector event produced by Scoop News Group, Joe Hong, director of CMS’s Division of Program and Data Management within its Financial Management Systems Group, disclosed that their office is conducting a significant pilot project utilizing a large language model. The objective? To “mitigate the loss of institutional knowledge” and expedite the onboarding process for new personnel.

Hong emphasized the potential of generative AI and knowledge management in providing precise, context-based answers swiftly. He highlighted the importance of acquiring credible and reliable information promptly, underscoring the pilot’s role in achieving this objective.

In an interview following the panel discussion, Hong stressed the pivotal role of the Office of Financial Management in supporting CMS’s operations, despite not being directly involved in administering Medicare. By delivering accurate data reports in a timely manner, the office facilitates informed decision-making and ensures the efficient processing of claims and distribution of benefits.

Hong pointed out the complexity of tasks such as deciphering documentation on federally facilitated marketplaces and translating it into actionable insights for the accounting system. Leveraging large language models aids financial management staff, particularly those new to the field, in bridging these gaps.

The pilot project, currently underway in Hong’s division, features Meta’s Llama 2, touted as the “next generation” of open-source large language models. Hong emphasized an “LLM-agnostic” approach, recognizing the evolving nature of these systems and the need for flexibility. Nonetheless, Llama 2 has proven successful, thanks to collaborative efforts with CMS partners.

The Office of Financial Management workforce has shown eagerness to embrace the technology, with Hong’s division encouraging innovation and problem-solving. Hong believes that understanding how to leverage AI systems effectively will be paramount for federal financial staffers in the future.

Reflecting on the impact of AI and automation on job roles, Hong remains optimistic, emphasizing that these technologies will create opportunities rather than eliminate jobs. As the complexity of challenges grows, so too will the demand for skilled professionals to address them effectively.


CMS’s adoption of AI to bolster financial management processes signifies a significant shift towards leveraging technology to address challenges such as retaining institutional knowledge and enhancing operational efficiency. As organizations across various sectors observe this trend, there’s an increasing recognition of the transformative potential of AI in optimizing workflows and empowering personnel to tackle complex tasks more effectively. This indicates a growing demand for AI-driven solutions in the market, with implications for both technology providers and businesses seeking to stay competitive in an increasingly digital landscape.