Designing Agentic AI for Perpetual Process Improvement
Keywords:
Agentic Enterprise Optimization, Cognitive Service Operations, Real-Time Process Adaptation, Autonomous Resource Management, AI-Augmented Enterprise Governance, Online Learning Decision Models, Intelligent Process Automation, Continuous Operational Optimization, Adaptive Workflow Intelligence, Self-Optimizing Business Processes.Abstract
Enterprise resource management faces persistent inefficiencies, bottlenecks, and missed opportunities within business processes, limiting the potential for continuous optimization. This paper investigates the viability of agentic AI for identifying and addressing such shortcomings in cognitive service operations. Agentic AI systems use decision models refined through online learning to respond in real time to observed performance gaps, either adjusting the current system configuration or selecting an alternative from a set of feasible processes. We analyze both the operational performance gains achieved through agentic architectures and their broader implications for enterprise governance. To this end, we introduce an abstract modeling paradigm that captures the interplay of agentic decision-making, learning, and governance loops alongside general-purpose process-facilitation AI assistants. Results from three case studies illustrate the potential of agentic AI to support and enhance these domains. We conclude by outlining directions for future research aimed at advancing the continuous, AI-augmented evolution of enterprise operations.
References
1. Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., ... Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901.
2. Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., Riedel, S., & Kiela, D. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks. Advances in Neural Information Processing Systems, 33, 9459–9474.
3. Kolla, S. H., & Mattaparthi, R. (2025). Hybrid Gen AI Systems: Integrating Small LMs with Large Language Models for Cost-Efficient Enterprise Automation and Decision Intelligence. International Journal of Research Publications in Engineering, Technology and Management (IJRPETM), 8(6), 13345-13357.
4. Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., Brynjolfsson, E., Buch, S., Card, D., Castellon, R., Chatterji, N., Chen, A., Creel, K., Davis, J. Q., Demszky, D., ... Liang, P. (2021). On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258.
5. Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022). Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35, 24824–24837.
6. Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R. (2022). Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35, 27730–27744.
7. Penaka, B. (2025). Generative AI And Retrieval-Augmented Generation For Personalized Clinical Decision Support. The Review of Diabetic Studies, 1081-1090.
8. Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K. R., & Cao, Y. (2023). ReAct: Synergizing reasoning and acting in language models. International Conference on Learning Representations.
9. Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Hambro, E., Zettlemoyer, L., Cancedda, N., & Scialom, T. (2023). Toolformer: Language models can teach themselves to use tools. Advances in Neural Information Processing Systems, 36.
10. Shinn, N., Cassano, F., Gopinath, A., Narasimhan, K., & Yao, S. (2023). Reflexion: Language agents with verbal reinforcement learning. Advances in Neural Information Processing Systems, 36.
11. Madaan, A., Tandon, N., Gupta, P., Hallinan, S., Gao, L., Wiegreffe, S., Alon, U., Dziri, N., Prabhumoye, S., Yang, Y., Gupta, S., Majumder, B. P., Hermann, K., Welleck, S., Yazdanbakhsh, A., & Clark, P. (2023). Self-Refine: Iterative refinement with self-feedback. Advances in Neural Information Processing Systems, 36.
12. Mattaparthi, R. (2025). GenAI-Augmented Diagnostic Reasoning for Diesel Engine Fault Triage: A Large Language Model Framework for Technician Decision Support at Scale. Journal of Material Sciences & Manufacturing Research, 6(12), 1. https://doi.org/10.47363/jmsmr/2025(6)226
13. Park, J. S., O'Brien, J. C., Cai, C., Morris, M. R., Liang, P., & Bernstein, M. S. (2023). Generative agents: Interactive simulacra of human behavior. Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 1–22.
14. Wu, Q., Bansal, G., Zhang, J., Wu, Y., Li, B., Zhu, E., Jiang, L., Zhang, X., Zhang, S., Liu, J., Awadallah, A. H., White, R. W., Burger, D., & Wang, C. (2023). AutoGen: Enabling next-gen LLM applications via multi-agent conversation. arXiv preprint arXiv:2308.08155.
15. Patil, S. G., Zhang, T., Wang, X., & Gonzalez, J. E. (2023). Gorilla: Large language model connected with massive APIs. Advances in Neural Information Processing Systems, 36.
16. Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Qin, S., Li, Z., Dai, J., Sun, Y., Chen, R., Shen, L., Zhou, X., Wang, X., Zhang, C., Li, X., Wang, Q., Xue, Z., ... Zhou, Y. (2023). The rise and potential of large language model based agents: A survey. arXiv preprint arXiv:2309.07864.
17. Potturi, P. (2025). UNIFIED CLOUD ANALYTICS FABRIC FOR REAL-TIME BUSINESS INTELLIGENCE, SEMANTIC GOVERNANCE, AND CROSS-ENTERPRISE DECISION SUPPORT. International Journal of Applied Mathematics, 38(11s), 3757-3765.
18. Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Lin, Y., Zhao, W. X., Wei, Z., & Wen, J. (2024). A survey on large language model based autonomous agents. Frontiers of Computer Science, 18, 186345.
19. Huang, X., Liu, W., Chen, X., Wang, X., Wang, H., Lian, D., Wang, Y., Tang, R., & Chen, E. (2024). Understanding the planning of LLM agents: A survey. arXiv preprint arXiv:2402.02716.
20. Qin, Y., Liang, S., Ye, Y., Zhu, K., Yan, L., Lu, Y., Lin, Y., Cong, X., Tang, X., Qian, B., Hong, S., Chen, R., Zhang, Y., Li, Z., Xiao, J., & Han, J. (2024). ToolLLM: Facilitating large language models to master 16000+ real-world APIs. International Conference on Learning Representations.
21. Hong, S., Zhuge, M., Chen, J., Zheng, X., Cheng, Y., Zhang, C., Wang, J., Wang, Z., Yau, S. K. S., Lin, Z., Zhou, B., & Wu, C. (2024). MetaGPT: Meta programming for multi-agent collaborative framework. International Conference on Learning Representations.
22. Zhang, W., Tang, K., Wu, H., Wang, M., Shen, Y., Hou, G., Tan, Z., Li, P., Zhuang, Y., & Lu, W. (2024). Agent-Pro: Learning to evolve via policy-level reflection and optimization. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, 5348–5375.
23. Yang, J., Jimenez, C. E., Wettig, A., Lieret, K., Yao, S., Narasimhan, K., & Press, O. (2024). SWE-agent: Agent-computer interfaces enable automated software engineering. arXiv preprint arXiv:2405.15793.
24. Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T. L., Cao, Y., & Narasimhan, K. (2023). Tree of thoughts: Deliberate problem solving with large language models. Advances in Neural Information Processing Systems, 36.
25. Wang, G., Cheng, S., Zhan, X., Li, X., Song, Z., & Liu, Y. (2023). Voyager: An open-ended embodied agent with large language models. arXiv preprint arXiv:2305.16291.
26. Liu, X., Yu, H., Zhang, H., Xu, Y., Lei, X., Lai, H., Gu, Y., Ding, H., Men, K., Yang, K., Zhang, M., Su, Y., & Wang, H. (2023). AgentBench: Evaluating LLMs as agents. International Conference on Learning Representations.
27. Mialon, G., Dessì, R., Lomeli, M., Nalmpantis, C., Pasunuru, R., Raileanu, R., Rozière, B., Schick, T., Dwivedi-Yu, J., & Scialom, T. (2023). GAIA: A benchmark for general AI assistants. International Conference on Learning Representations.
28. Zhou, S., Xu, F. F., Zhu, H., Zhou, X., Lo, R., Srivatsan, R., Cheng, X., Bisk, Y., Fried, D., Alon, U., & Neubig, G. (2024). WebArena: A realistic web environment for building autonomous agents. International Conference on Learning Representations.
29. Khattab, O., Singhvi, A., Maheshwari, P., Zhang, Z., Santhanam, K., Vardhamanan, S., Haq, S., Sharma, A., Joshi, T. T., Moazam, H., Miller, H., Zaharia, M., & Potts, C. (2024). DSPy: Compiling declarative language model calls into self-improving pipelines. International Conference on Learning Representations.
30. Mondeddula, S. R. (2025). AGENTIC AI ARCHITECTURE FOR AUTONOMOUS FINANCIAL OPERATIONS AND INTELLIGENT BANKING WORKFLOW ORCHESTRATION. International Journal of Applied Mathematics, 38(5s), 1603-1615.
31. Gou, Z., Shao, Z., Gong, Y., Shen, Y., Zhao, Y., Wang, Y., & Duan, N. (2024). CRITIC: Large language models can self-correct with tool-interactive critiquing. International Conference on Learning Representations.
32. Ruan, J., Chen, Y., Zhang, B., Xu, Z., Bao, T., Du, G., Shi, S., Mao, H., Zeng, X., & Zhao, R. (2023). TPTU: Task planning and tool usage of large language model-based AI agents. arXiv preprint arXiv:2308.03427.
33. Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., & Liu, T. (2024). A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions. ACM Transactions on Information Systems, 42(2), 1–54.
34. Chowa, S. S., Alvi, R., Rahman, S. S., Raiaan, M. A. K., Khan, M. A., Islam, M. R., Hussain, M., & Azam, S. (2025). From language to action: A review of large language models as autonomous agents and tool users. Artificial Intelligence Review.
35. Kolla, S. K., & Reddy, V. A. R. (2024). Evaluating Cloud-Native vs. Hybrid Architectures for Health Benefit Administration Systems. International Journal of Medical Toxicology and Legal Medicine, 27(5), 1042-1053.
36. Apaydin, K., & Zisgen, Y. (2025). Local large language models for business process modeling. In Proceedings of the International Conference on Process Mining Workshops (pp. 605–609). Springer.
