AI-powered big data platforms for enterprise analytics

Authors

  • Karthikeyan Selvarajan University of Illinois Urbana-Champaign, USA Author

DOI:

https://doi.org/10.15680/bt384c82

Keywords:

Ai-Powered Big Data Platforms, Enterprise Analytics Architecture, Lakehouse Storage Optimization, Multi-Cloud Data Federation, Real-Time Decision Intelligence

Abstract

This article presents a comprehensive analysis of AI-powered big data platforms that are revolutionizing enterprise- scale analytics across industries. The article examines the architectural evolution from traditional data warehouses to modern lakehouse paradigms, detailing how artificial intelligence integration transforms core data platform capabilities, including ingestion, storage, processing, and security. The article demonstrates quantifiable performance improvements, with organizations achieving reductions in processing time and cost efficiency gains compared to conventional systems. Through detailed case studies spanning cybersecurity, cloud cost optimization, IT infrastructure observability, and financial intelligence applications, the article illustrates how these platforms enable real-time decision-making, automated anomaly detection, and predictive insights that were previously unattainable. The article provides empirical performance analyses across varying workloads and implementation environments, documenting both technical metrics and strategic business impacts. The article concludes by identifying emerging research directions, including self-learning AI models, ultra-low-latency processing architectures, and federated analytics paradigms that will shape the next generation of enterprise data platforms. This article contributes a holistic framework for understanding how AI-integrated data platforms are transforming enterprise operations from reactive cost centers into proactive engines of innovation and competitive advantage.

26 36

References

[1] Thomas H. Davenport, Tim Smith ET AL., "Analytics and AI-driven enterprises thrive in the Age of With. The culture catalyst," Deloitte Insights, 25 July 2019. https://www2.deloitte.com/us/en/insights/topics/analytics/insight-driven-organization.html

[2] Matei Zaharia, Reynold S. Xin, et al. "Apache Spark: A Unified Engine for Big Data Processing," Communications of the ACM, Nov 1, 2016. https://cacm.acm.org/magazines/2016/11/209116-apache-spark/fulltext

[3] Martin Kleppmann., "Designing Data-Intensive Applications," O'Reilly Media, 2017. https://dataintensive.net/

[4] Sivarajah, U., Kamal, M.M., Irani, Z., et al. "Critical analysis of Big Data challenges and analytical methods," Journal of Business Research, 2017. https://www.sciencedirect.com/science/article/pii/S014829631630488X

[5] Will Forrest et al., McKinsey & Company, "Cloud's trillion-dollar prize is up for grabs," February 26, 2021. https://www.mckinsey.com/capabilities/mckinsey-digital/our-insights/clouds-trillion-dollar-prize-is-up-for- grabs

[6] Ali Davoudian, Liu Chen, et al. "A Survey on NoSQL Stores," ACM Computing Surveys, 17 April 2018. https://dl.acm.org/doi/10.1145/3158661

[7] Thomas H. Davenport and Randy Bean. "How Big Data and AI are Accelerating Business Transformation.” NewVantage Partners LLC, 2019. https://www.the-digital-insurer.com/wp-content/uploads/2019/02/1418-Big-Data-Executive-Survey-2019-Findings-122718.pdf

[8] Susan Moore, "How to Create a Business Case for Data Quality Improvement," Gartner, June 19, 2018. https://www.gartner.com/smarterwithgartner/how-to-create-a-business-case-for-data-quality-improvement

[9] Qiang Yang, Yang Liu, et al. "Federated Machine Learning: Concept and Applications," ACM Transactions on Intelligent Systems and Technology, 28 January 2019. https://dl.acm.org/doi/10.1145/3298981

Downloads

Published

2025-04-29

How to Cite

AI-powered big data platforms for enterprise analytics. (2025). International Journal of Computer Technology and Electronics Communication, 8(2), 10490-10496. https://doi.org/10.15680/bt384c82

Most read articles by the same author(s)