How generative AI is transforming state government IT modernization

Generative AI is significantly impacting IT modernization in the public sector. In an interview with Scoop News Group SVP of Modernization Jake Williams, Chris Hein, director of customer engineering for the Public Sector SLED Team at Google, discusses how this moment marks a turning point as generative AI evolves from a novelty to a practical tool that addresses longstanding challenges in state government IT.

Hein explains how AI’s ability to analyze legacy systems changes modernization efforts. “A lot of mainframe systems have been running on code written a generation ago,” he says. “Generative AI can translate that code into project requirements documents that define what the system does.” This shift enables agencies to address technical debt effectively and plan replacements with greater precision.

Generative AI’s role in augmenting development teams is another major advancement. Hein shared that 25% of the code deployed in Google’s core systems is now AI-generated, even by some of the world’s best software engineers. For public sector IT teams, this represents an opportunity to amplify productivity without compromising quality. “It’s about empowering teams to do more with less, leveraging AI to handle repetitive tasks and free up resources for strategic innovation,” says Hein.

In addition, constituent engagement benefits from AI’s capabilities. Hein described tools that can quickly understand agency-specific data, providing meaningful interactions within weeks rather than months or years. This accelerates digital transformation and enhances service delivery. “Generative AI makes tools accessible and effective without requiring a Ph.D. in machine learning,” he says.

For state CIOs and IT leaders, Hein emphasizes the importance of integrating AI into workflows and strategies. “Don’t just modernize systems to look like slightly improved versions of the old ones,” he says. “Think about how these new tools can fundamentally rethink processes, much like spreadsheets redefined calculations.”

Looking ahead, Hein highlighted advancements in reducing AI “hallucination” and creating agentic workflows — systems of AI agents collaborating to handle complex tasks. “These workflows break problems into pieces, with each agent solving its part, enabling solutions to previously insurmountable challenges,” he says.

As generative AI matures, Hein remains optimistic about its role in state government IT. “This technology is going to make CIOs’ lives considerably easier,” he says, envisioning a future where modernized systems and enhanced engagement redefine public sector IT.

Learn more about how Google Cloud is helping state and local governments transform their modernization efforts.

This video panel discussion was produced by Scoop News Group, for StateScoop and EdScoop, and underwritten by Google Cloud.