Optimized Healthcare Data Processing Using Genetic Algorithms and Machine Learning on Apache Cloud Infrastructure

Authors

  • Shiva Kumar C Senior Cloud Engineer, Rialtic, USA Author

DOI:

https://doi.org/10.15680/IJCTECE.2024.0704011

Keywords:

Healthcare Data Processing, Genetic Algorithms, Machine Learning, Apache Hadoop, Apache Spark, Cloud Computing, Big Data Analytics, Feature Selection, Predictive Modeling, Distributed Systems, Clinical Decision Support Systems

Abstract

The exponential growth of healthcare data from electronic health records, wearable devices, medical imaging, and genomic sequencing has created significant challenges in efficient data processing and decision-making. Traditional analytical approaches often struggle with scalability, optimization, and real-time performance requirements. This study proposes an optimized healthcare data processing framework that integrates Genetic Algorithms (GA) with Machine Learning (ML) techniques deployed on Apache cloud infrastructure, particularly leveraging Apache Hadoop and Apache Spark. Genetic Algorithms are employed for feature selection, hyperparameter optimization, and resource allocation, while Machine Learning models such as supervised and ensemble methods are used for predictive analytics and disease classification. The Apache ecosystem ensures distributed storage and parallel processing, enabling scalable and fault-tolerant computation across large healthcare datasets. Experimental evaluation demonstrates improved prediction accuracy, reduced computational overhead, and enhanced system scalability compared to traditional optimization approaches. The proposed framework supports real-time healthcare analytics, efficient clinical decision support systems, and intelligent hospital resource management. The integration of evolutionary computation with distributed machine learning presents a robust solution for next-generation healthcare data processing systems in cloud environments.

References

1. Poornima, G., & Anand, L. (2024, April). Effective Machine Learning Methods for the Detection of Pulmonary Carcinoma. In 2024 Ninth International Conference on Science Technology Engineering and Mathematics (ICONSTEM) (pp. 1-7). IEEE.

2. Madheswaran, M., Dhanalakshmi, R., Ramasubramanian, G., Aghalya, S., Raju, S., & Thirumaraiselvan, P. (2024, April). Advancements in immunization management for personalized vaccine scheduling with IoT and machine learning. In 2024 10th International Conference on Communication and Signal Processing (ICCSP) (pp. 1566-1570). IEEE.

3. Inbavalli, M., & Arasu, T. (2015). Efficient Analysis of Frequent Item Set Association Rule Mining Methods. International Journal of Scientific & Engineering Research, 6(4).

4. Garg, V. K., Soundappan, S. J., & Kaur, E. M. (2020). Enhancement in intrusion detection system for WLAN using genetic algorithms. South Asian Research Journal of Engineering and Technology, 2(6), 62–64. https://doi.org/10.36346/sarjet.2020.v02i06.003

5. Kamadi, S. (2024). Multi-cloud ETL automation and rollback strategies: An empirical study for distributed workload orchestration system. International Journal for Multidisciplinary Research, 6(2).

6. Ande, B. R. (2024). A Unified Optimization Framework for Large Language Models in Enterprise Applications Using Python. J. Comput. Anal. Appl, 33(6), 2111-2122.

7. Inampudi, R. K., Surampudi, Y., & Kondaveeti, D. (2023). AI-driven real-time risk assessment for financial transactions: leveraging deep learning models to minimize fraud and improve payment compliance. Journal of Artificial Intelligence Research and Applications, 3(1), 716-758.

8. Ravi Kumar Ireddy, "AI Driven Predictive Vulnerability Intelligence for Cloud-Native Ecosystems" International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 9, Issue 2, pp.894-903, March-April-2023. Available at doi : https://doi.org/10.32628/CSEIT2342438

9. Suddala, V. R. A. K. (2024). Driving Innovation and Compliance in Global Payment Platforms through Predictive Analytics and DevOps Automation. International Journal of Advanced Research in Computer Science & Technology (IJARCST), 7(4), 10662-10672.

10. Panda, S. S. (2024). Managing BSL Implementation A TPM’s Guide to Robust Data centers. International Journal of Technology, Management and Humanities, 10(01), 33-38.

11. Konda, S. K. (2024). Carbon-native DCIM architectures for AI data centers: Autonomous infrastructure control via smart grid intelligence. World Journal of Advanced Research and Reviews, 21(1), 3008–3318. https://doi.org/10.30574/wjarr.2024.21.1.0095

12. Ambati, K. C. (2024). Enterprise-wide procurement consolidation: Ivalua-SAP-EDW integration architecture for global supply chain excellence. International Journal of Research Publications in Engineering, Technology and Management (IJRPETM), 7(4), 14309–14318.

13. Adari, V. K. (2024). APIs and open banking: Driving interoperability in the financial sector. International Journal of Research in Computer Applications and Information Technology (IJRCAIT), 7(2), 2015–2024.

14. Selvi, C. P., Muneeshwari, P., Selvasheela, K., & Prasanna, D. (2023). Twitter Media Sentiment Analysis to Convert Non-Informative to Informative Using QER. Intelligent Automation & Soft Computing, 35(3).

15. Sarraf, G. (2023). Autonomous Ransomware Forensics: Advanced ML Techniques for Attack Attribution and Recovery. Int. J. Adv. Res. Sci. Commun. Technol., 3(3), 1377–1390.

16. Gowda, M. K. S. (2024). Leveraging Machine Learning to Enhance Accuracy and Efficiency in Regulatory Compliance. International Journal of Advanced Research in Computer Science & Technology (IJARCST), 7(4), 10683-10692.

17. Sarwar, J. (2021). Hybrid neural network models for intelligent threat detection in resource constrained IoT networks. Journal of Innovative Computing and Emerging Technologies, 2(1).

18. Ramanathan, U., & Rajendran, S. (2023). Weighted particle swarm optimization algorithms and power management strategies for grid hybrid energy systems. Engineering Proceedings, 59(1), 123.

19. Mathur, T., Muthusamy, P., & Mohammed, A. S. (2019). Federated Learning for Performance Anomaly Detection in Distributed Data Centers. European Journal of Quantum Computing and Intelligent Agents, 3, 33-66.

20. Jagadeesh, S., & Sugumar, R. (2017). Optimal knowledge extraction system based on GSA and AANN. International Journal of Control Theory and Applications, 10(12), 153–162.

21. Ramidi, M. (2024). Securing Mobile App Development with Compliance Aware CI/CD Pipelines in Government. International Journal of Computer Technology and Electronics Communication, 7(3), 8824-8825.

22. Sheta, S. V. (2023). The role of test-driven development in enhancing software reliability and maintainability. Journal of Software Engineering (JSE), 1(1), 13–21.

23. Balamuralidhar, S. V. (2018). Dual access control with effective cross-tenant revocation in cloud computing. IOSR Journal of Engineering (IOSRJEN), 8(9), 51–54.

24. Devarajan, R., et al. (2023, August). IoT Based Under Ground Cable Fault Detection with Cloud Storage. In 2023 Second International Conference on Augmented Intelligence and Sustainable Systems (ICAISS) (pp. 1580-1583). IEEE.

25. Vimal Raja, G. (2024). Intelligent Data Transition in Automotive Manufacturing Systems Using Machine Learning. International Journal of Multidisciplinary and Scientific Emerging Research, 12(2), 515-518.

26. Uttama Reddy Sanepalli (2022). Adaptive Intelligence Framework for Retirement Portfolio Management. IJSRCSEIT, 8(6), 769-780.

27. Madhurya, J. A. (2017). A survey on preserving the data privacy and copyrights during image retrieval in cloud. IRJET, 04(05).

28. Jagadeesh, S., & Soundappan, R. S. (2014). Survey on knowledge discovery in speech emotion detection. IJIRCCE, 2(5), 4476–4481.

29. Vimal Raja, G. (2022). Leveraging Machine Learning for Real-Time Short-Term Snowfall Forecasting Using MultiSource Atmospheric and Terrain Data Integration. IJMRSET, 5(8), 1336-1339.

30. Anand, P. V., & Anand, L. (2023, December). An Enhanced Breast Cancer Diagnosis using RESNET50. In 2023 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems (ICSES) (pp. 1-5). IEEE.

31. Vijayaboopathy, V., & Ponnoju, S. C. (2021). Optimizing Client Interaction via Angular-Based A/B Testing. Essex Journal of AI Ethics and Responsible Innovation, 1, 151-186.

32. Jovith, A. A., et al. (2024). Industrial IoT Sensor Networks and Cloud Analytics for Monitoring Equipment Insights and Operational Data. ICCSP.

33. Genne, S. (2023). Improving enterprise web responsiveness through server-side rendering in Next. js. International Journal of Computer Technology and Electronics Communication, 6(4), 7313-7323.

34. Yashwanth, K., et al. (2021). Design and Development of Pipelined Computational Unit for High-Speed Processors. ICCCNT.

35. Sudhan, S. K. H. H., & Kumar, S. S. (2016). Gallant Use of Cloud by a Novel Framework of Encrypted Biometric Authentication and Multi Level Data Protection. Indian Journal of Science and Technology, 9, 44.

36. Mohana, P., et al. (2022). Automation using Artificial intelligence based Natural Language processing. ICCMC.

37. Mudunuri, P. R. (2024). Scalable secrets governance models for high-sensitivity biomedical systems. International Journal of Computer Technology and Electronics Communication (IJCTEC), 7(1), 8220–8232.

Downloads

Published

2024-08-15

How to Cite

Optimized Healthcare Data Processing Using Genetic Algorithms and Machine Learning on Apache Cloud Infrastructure. (2024). International Journal of Computer Technology and Electronics Communication, 7(4), 9172-9180. https://doi.org/10.15680/IJCTECE.2024.0704011