Data Teams Embrace GenAI Technology with High Expectations and Ambitious Goals

The Rise of GenAI in Data Teams

GenAI technology is making significant strides within enterprise data teams, with remarkable expectations stemming from its capabilities. A survey conducted by Wakefield Research for Prophecy, a company specializing in data solutions, highlights the quick adoption and impressive results among data and analytics executives. Approximately 64% of data teams have already integrated GenAI processes into their operations, reflecting a significant trend toward modernization in the industry.

Productivity Gains Unveiled

The survey revealed that early adopters of GenAI are witnessing notable increases in productivity. Almost half of the data teams utilizing GenAI reported enhancements in data delivery efficiency, with 41% experiencing growth ranging from 15% to 30%, while an impressive 46% reported increases between 31% to 50%. This data suggests that GenAI could provide equal or even greater productivity improvements compared to other departments, highlighting its profound impact on data operations.

The most common application of GenAI technology among these teams is automatic data curation, utilized by 58% of respondents. Conversational analytics and data quality testing closely follow, with both applications being employed by 51% of the teams surveyed. This versatility showcases GenAI's capability to address various challenges within data operations and analytics.

Leadership Support and Investment

Interestingly, executive support appears crucial in this transition. Approximately 25% of higher management indicated their willingness to approve any projects that integrate AI, while the majority (44%) recognized the importance of AI investments but stressed the need for cautious implementation. This strong backing from leadership ensures that data teams can pursue GenAI initiatives robustly.

Challenges Facing Data Teams

Despite the enthusiasm surrounding GenAI, data executives face several barriers in full-scale adoption. The primary concern, noted by 36% of respondents, is the necessity for improved data governance. Furthermore, 24% highlighted the need for faster access to data as a significant impediment. Additionally, a noteworthy portion (36%) indicated that GenAI projects require reviews at a company-wide level, which can hinder rapid innovation and development.

Staffing challenges also loom large. Many organizations manage between 100 and 1,000 data sources while supplying data to a similar number of downstream users. Consequently, finding and hiring skilled data engineers has proven difficult for more than half (53%) of organizations. Onboarding and training new employees present further complications, as 50% of respondents feel this aspect is challenging, and 53% experience difficulty in scaling team capabilities to meet escalating data requirements.

Future Outlook and Transformation

Prophecy's CEO, Raj Bains, articulated a strong belief in GenAI’s potential to revolutionize data operations across various stages, from management to transformation and integration. He emphasized the importance of capturing the benefits of GenAI while adhering to high standards of security and governance, especially considering the global talent shortage in this sector. Rather than embarking on extensive in-house developments, Bains encourages organizations to leverage proven, commercial data solutions powered by GenAI, known for their efficacy in Fortune 500 companies.

As GenAI continues to evolve, its integration into data teams will shape the future of analytics and data management. Ongoing developments and sessions like Prophecy's upcoming presentation at the Gartner Data Analytics Summit 2025 will undoubtedly shed further light on the profound implications of this technology. To delve deeper into the findings of the survey, find the full report on Prophecy's website.