Daniel Masamba
Exploring Learning, Cooperation, Scalability and Decision-Making in Multi-Agent Systems.
About Me
Introduction
I am a PhD student at the University of Texas Rio Grande Valley (UTRGV) with a passion for research and a deep interest in how intelligent machines can contribute to a better world. My work focuses on learning, cooperation, scalability, and decision-making in multi-agent systems. I am interested in developing algorithms and frameworks that enable autonomous agents to collaborate effectively, adapt to complex environments, and make intelligent decisions that benefit both individuals and the collective system.
Through my research, I aim to advance our understanding of how intelligent systems can cooperate, adapt, and evolve to address real-world challenges. I believe the future of artificial intelligence lies not only in building systems that excel at individual tasks, but also in creating communities of intelligent agents that work together harmoniously to achieve greater shared goals.
Education
PhD in Computer Science with Interdisciplinary Applications
University of Texas Rio Grande Valley (UTRGV)
August 2024 - Present
Focusing on multi-agent systems, machine learning, and artificial intelligence. Research areas include learning algorithms, cooperation mechanisms, scalability solutions, and decision-making processes in distributed intelligent systems.
Bachelor of Science in Computer Science
University of Texas Rio Grande Valley (UTRGV)
January 2021 - May 2024
Comprehensive undergraduate education in computer science fundamentals including programming, software engineering, computer systems, and mathematical foundations of computing.
Curriculum Vitae
Education
PhD in Computer Science with Interdisciplinary Applications
University of Texas Rio Grande Valley (UTRGV), Edinburg, TX
August 2024 - Present (Anticipated graduation Fall 2029)
Current GPA: 4.0
Focusing on multi-agent systems, machine learning, and artificial intelligence. Research areas include learning algorithms, cooperation mechanisms, scalability solutions, and decision-making processes in distributed intelligent systems.
Bachelor of Science in Computer Science
University of Texas Rio Grande Valley (UTRGV), Edinburg, TX
January 2021 - May 2024
GPA: 4.0
Honors: UTRGV President's Honor List Spring 2021 – Spring 2024
2024 College of Engineering & Computer Science Outstanding Undergraduate Student
Comprehensive undergraduate education in computer science fundamentals including programming, software engineering, computer systems, and mathematical foundations of computing.
Research Experience
Machine Intelligence Research Assistant
University of Texas Rio Grande Valley
April 2022 - Present
Assist in research on various topics of machine intelligence such as Reinforcement Learning, Machine Learning, and Bioinformatics.
Multiple Autonomous Robot Systems Research Assistant
University of Texas Rio Grande Valley
April 2023 - June 2024
Assist in research on Swarm Robotics intelligence more specifically Scalable Foraging Swarm Robotics.
Work Experience
Math Tutor
University of Texas Rio Grande Valley
June 2023 - July 2024
Assist students improve their knowledge in different Math topics such as College Algebra, Pre-Calculus, Calculus I, Calculus II, Linear Algebra.
Data Analyst Intern
University of Texas Rio Grande Valley
September 2021 - May 2022
Participate in conducting high-quality, timely research to assess program operations and their impact on improving Hispanic students' retention and graduation rates at a Hispanic Serving Institution.
Technical Skills
Programming Languages
- Python (Proficient)
- C++ (Proficient)
- HTML/CSS (Intermediate)
- Java (Basic)
- JavaScript (Basic)
- C# (Unity ML-Agents)
Languages
- English (Fluent)
- French (Fluent)
- Lingala (Fluent)
- Spanish (Basic)
Research Areas
- Reinforcement Learning
- Multi-Agent Systems
- Machine Learning
- Deep Learning
- Swarm Robotics
Notable Projects
Multi-Environment AI Agent Training
Trained AI agents to successfully navigate various environments, including Frozen Lake, Cart Pole, Atari Breakout, and Box2D Car Racing, using different Reinforcement Learning algorithms such as PPO, A2C, and DQN.
Multi-Agent Volleyball Game
Developed a volleyball game with Multi-Agent Reinforcement Learning using Unity ML-Agents and C#.
Robotic Target Retrieval System
Implemented a Reinforcement Learning solution on e-puck robot for locating and retrieving randomly spawned targets in an unknown environment on Webots with Python.
Cooperative Multi-Robot Systems
Employed diverse control strategies for cooperative multi-robot tasks using multi-agent reinforcement learning on PyBullet in conjunction with Gymnasium.
Current Research: Transformer-based MARL
Currently working on developing a Multi-Agent System algorithm with Transformer architecture.
Research
Highlight my research projects.
Publications
Offline Reinforcement Learning Approaches for Safe and Effective Smart Grid Control
A. Peredo, H. Lugo, C. Narcia-Macias, J. Espinoza, D. Masamba, A. Gandarilla, E. Enriquez, D. Kim
10th International Congress on Information and Communication Technology 2025
Personalized Chemotherapy Dosing through Offline Reinforcement Learning
H. Lugo, A. Peredo, C. Narcia-Macias, J. Espinoza, D. Masamba, A. Gandarilla, E. Enriquez, D. Kim
10th International Congress on Information and Communication Technology 2025
Contact
I'm always open to discussing research opportunities, collaborations, or any questions about my work in multi-agent systems and machine learning. Feel free to reach out!
