M.Sc. Researcher in Mechatronics & AI

Mehdi Sadeghian

Autonomous Systems & Deep Reinforcement Learning Researcher

I am a graduate researcher with a strong background in Mechatronics and Control Theory. My research focuses on developing intelligent, provably safe decision-making algorithms for autonomous vehicle navigation, multi-agent trajectory forecasting, and deep generative computer vision in dynamic urban environments.

TMU Logo
IUT Logo
Research Profile
Open to Ph.D. Positions & Research Collaborations
M.Sc. in Mechatronics Engineering Tarbiat Modares University • 2024 – Present
B.Sc. in Electrical Engineering (Control) Isfahan University of Technology • 2018 – 2023
Core Research Focus
Safe Autonomous Navigation & Control
Hybrid Reinforcement & Imitation Learning
Multi-Agent Trajectory Forecasting
Computer Vision (ViTs & YOLOv11)

Academic Background

Formal academic training in Mechatronics Engineering, Control Theory, and Machine Learning.

Tarbiat Modares University Logo

M.Sc. in Mechatronics Engineering

2024 — Present
Tarbiat Modares University, Tehran, Iran
Thesis Proposal: "Safe Navigation and Control of Autonomous Vehicles in Dynamic Urban Environments Based on a Hybrid Reinforcement Learning and Imitation Learning Approach"
Supervisor: Prof. Vahid Johari Majd
Graduate Coursework
Advanced Robotics Reinforcement Learning Neural Networks Sensors & Actuators
Isfahan University of Technology Logo

B.Sc. in Electrical Engineering (Control Theory)

2018 — 2023
Isfahan University of Technology (IUT), Isfahan, Iran
B.Sc. Dissertation: "Autonomous Driving Control Using End-to-End Deep Learning"
Supervisor: Prof. Maryam Zekri
Core Disciplines
Intelligent Control Modern Control Theory Linear Algebra Computational Methods Signal Processing

Research Areas & Expertise

Developing robust algorithms for perception, multi-agent forecasting, and optimal decision-making in dynamic environments.

Safe Autonomous Navigation & Control

Designing hybrid Reinforcement Learning (RL) and Imitation Learning formulations with safety guarantees for vehicle motion planning and obstacle avoidance in unstructured dynamic urban traffic.

Multi-Agent Trajectory Forecasting

Modeling crowd interactions and social dynamics using Spatio-Temporal Graph Convolutions (ST-GCNN) paired with Conditional VAEs and Gaussian Mixture Model latent spaces.

Computer Vision & Generative AI

Real-time multi-class object detection (YOLOv11), Unpaired Image-to-Image translation with CycleGAN, and multimodal generative Text-to-Video diffusion pipelines.

Medical Image Analysis & ViTs

High-accuracy diagnostic classification on histopathological biopsies using Vision Transformers (ViT) and Deep Residual Networks (ResNet) achieving >99.9% clinical accuracy.

Featured Research & Engineering Repositories

Fully documented, reproducible open-source implementations, benchmarks, and quantitative reports in PyTorch.

DQN Prompt Optimization on Frozen LLM Flagship Deep RL

DQN for Dynamic Prompt Optimization on LLMs

Reinforcement Learning agent (DQN) trained to dynamically inject prompt modifiers into a frozen LLM (TinyLlama-1.1B) on the BoolQ dataset, outperforming zero-shot and Chain-of-Thought while minimizing answer length.

PyTorch DQN TinyLlama HuggingFace Reward: 1.403
SCARA Manipulator Dynamics & Simscape Control Simscape & Robotics

SCARA Manipulator: Dynamics & Simscape Control

Physics-based multi-body modeling, Lagrangian dynamic formulation, and computed torque trajectory tracking control for a 4-DOF SCARA industrial manipulator in MATLAB/Simulink Simscape.

Simulink Simscape MATLAB Computed Torque SolidWorks
Pedestrian Trajectory Prediction with Social-STGCNN ETH / UCY Benchmark

Pedestrian Trajectory Prediction (ST-GCNN)

Multi-agent trajectory forecasting using Spatio-Temporal Graph Convolutions and CVAE-GMM multimodal latent space sampling for anticipating diverse human navigation choices in autonomous driving.

PyTorch ST-GCNN CVAE-GMM minADE: 1.03m
Real-Time Helmet Detection and Text-to-Video YOLOv11 & GenAI

Real-Time Helmet Detection & Video Generation

Industrial safety computer vision system featuring fine-tuned YOLOv11 for multi-class worker PPE compliance detection combined with a text-to-video generative pipeline for synthetic site monitoring.

YOLOv11 PyTorch Diffusion mAP50: 92.4%
Function Approximation and Deep Q-Networks in RL Deep RL

Function Approximation & Deep Q-Networks

Bridging classical tabular methods to continuous state spaces via Linear Semi-Gradient TD(0), Tile Coding, and Deep Q-Networks (DQN) with experience replay and target networks.

PyTorch DQN Tile Coding Semi-Gradient TD
Dyna-Q and Dyna-Q+ Planning in Reinforcement Learning Model-Based RL

Model-Based Planning with Dyna-Q & Dyna-Q+

Unified integration of direct reinforcement learning and internal environment model simulation across stationary and dynamically altering blocking/shortcut maze environments.

Dyna-Q Dyna-Q+ Model-Based RL Planning
GridWorld Exploration Policies Benchmark Exploration Benchmark

GridWorld Exploration Dynamics & Policies

Comprehensive empirical evaluation of ε-Greedy, Upper Confidence Bound (UCB), and Stochastic Gradient exploration strategies on custom obstacle GridWorld MDPs.

UCB Gradient Bandit Epsilon-Greedy Heatmaps
Jack's Car Rental Dynamic Programming MDP Dynamic Programming

Jack's Car Rental: Dynamic Programming & MDPs

Exact Markov Decision Process resolution via Policy Iteration, Policy Evaluation, and Value Iteration for Poisson-distributed resource allocation and inventory management.

Policy Iteration Value Iteration MDP Poisson Dist.
Unpaired Image-to-Image Translation with CycleGAN Generative Vision

Unpaired Image Translation with CycleGAN

Deep generative image-to-image translation pipeline implementing dual PatchGAN discriminators with ResNet-based cycle-consistency and identity loss constraints on Horse2Zebra.

PyTorch CycleGAN PatchGAN ResNet Generator
Cancer Histopathology Classification Medical AI

Cancer Histopathology Classification

Clinical digital pathology diagnostic framework benchmarking Vision Transformers (ViT-B/16) against deep residual networks (ResNet-50) for fine-grained tumor subtyping.

Vision Transformer ResNet-50 F1-Score: 94.6% AUC: 0.982
Real-Time Face Mask Detection Edge Vision

Real-Time Face Mask Detection (MaskCNN)

Edge-deployable lightweight Convolutional Neural Network architecture engineered for real-time edge classification of properly masked, incorrectly masked, and unmasked individuals.

Custom CNN OpenCV Accuracy: 98.7% 30+ FPS
Tabular Reinforcement Learning Methods Core RL

Tabular RL Methods Suite (SARSA / Q-Learning)

Complete implementation and comparative study of On-Policy SARSA, Off-Policy Q-Learning, Expected SARSA, and Monte Carlo Control in Cliff Walking and GridWorld domains.

Q-Learning SARSA Expected SARSA Monte Carlo
Non-Stationary Multi-Armed Bandits Bandit Algorithms

Non-Stationary Multi-Armed Bandits

Comparative study analyzing constant step-size parameter (exponential recency-weighted average) versus standard sample-average tracking in non-stationary reward distributions.

Multi-Armed Bandit Step-Size α Sample-Average
Amazon Fashion Sentiment Classification NLP & Text

Amazon Fashion Sentiment Classification

End-to-end natural language processing pipeline implementing TF-IDF vectorization, dense embedding representations, and ensemble classifiers for high-throughput customer review sentiment analysis.

Scikit-Learn TF-IDF Accuracy: 91.2%
Credit Card Fraud Detection Financial AI

Credit Card Fraud Detection & Risk Profiling

Imbalanced tabular classification pipeline utilizing SMOTE oversampling, Cost-Sensitive XGBoost, and precision-recall threshold optimization across 284k transactions.

XGBoost SMOTE PR-AUC: 0.88
U.S. Medical Cost Regression Analysis Health Analytics

U.S. Medical Cost & Insurance Risk Modeling

Predictive healthcare actuarial modeling using Polynomial Ridge Regression, Random Forests, and Gradient Boosting with SHAP value interpretability for demographic risk stratification.

Random Forest SHAP R²: 0.87

Technical Skills & Frameworks

Proficiency in deep learning libraries, robotics tools, software engineering, and mathematical foundations.

Deep Learning & AI

PyTorch Reinforcement Learning (DQN / PG) Gymnasium / OpenAI Gym Model-Based RL (Dyna-Q) LLM Prompt Optimization Graph Neural Networks (GNNs) Computer Vision (OpenCV) YOLOv11 Vision Transformers (ViT) Generative AI (GANs / Diffusion)

Robotics & Control

Autonomous Navigation Control Theory (Modern & Optimal) Trajectory Planning MATLAB / Simulink Sensors & Actuators

Engineering & Deployment

Docker Containerization Linux / Bash Git / GitHub SQL / PostgreSQL Data Pipelines

Languages & Mathematics

Python C / C++ Linear Algebra Probability & Statistics C#

Teaching & Industry Experience

Academic teaching assistantships and machine learning engineering experience.

Isfahan University of Technology Logo

Teaching Assistant

2021 — 2023
Isfahan University of Technology (IUT)
Conducted recitation sessions, problem-solving workshops, and lab instruction across multiple core courses:
Intelligent Control (Prof. Zekri) Modern Control (Prof. Izadi) Industrial Process Control (Prof. Ghaisari) Applied Linear Algebra (Prof. Mojiri) Computational Methods in EE (Prof. Izadi) Fundamentals of Programming (C/C++) (Prof. Zahabi)
PayamPardaz Logo

Machine Learning Engineer Intern

Summer 2022
PayamPardaz • Isfahan, Iran
Researched sandbox automation and engineered machine learning classification pipelines (Random Forest, SVM, MLP, Decision Trees) for automated behavioral malware detection and threat analysis.
Behavioral ML Classification Sandbox Automation Python Pipelines

Research & Academic Inquiries

I am always open to discussing novel research directions, exchanging ideas on Autonomous Systems & Deep Learning, and actively exploring prospective Ph.D. positions and academic collaboration opportunities.