Q-Learning-Based Energy-Aware Route Planning for Electric Vehicles on Real Road Networks with Charging Constraints

Basit Öğe Kaydı
dc.contributor.authorMetin, Ahmet
dc.contributor.authorDikici, Sena
dc.date.accessioned2026-02-08T15:11:12Z
dc.date.available2026-02-08T15:11:12Z
dc.date.issued2025
dc.departmentBursa Teknik Üniversitesi
dc.description2025 Innovations in Intelligent Systems and Applications Conference, ASYU 2025 -- 2025-09-10 through 2025-09-12 -- Bursa -- 214381
dc.description.abstractThe electric vehicle (EV) routing problem requires not only minimizing the travel distance but also considering energy constraints and the spatial distribution of charging stations. In this work, we propose Q-learning and hierarchical Q-learning (HRL) based agents trained to generate energy-aware routes on real road networks. The environment is modeled as graph structures obtained from Berlin, Istanbul, and Ankara cities using OpenStreetMap data. Each state is represented by a 16-dimensional vector that includes distance to the destination, battery level, number of neighbors, nearby charging stations, and final reward dynamics. The reward function is a multi-component structure that incentivizes approaching the destination, penalizes unnecessary loops and backtracking, and rewards smart charging decisions. Experimental results show that HRL demonstrates superiority up to 25% in compact cities (Berlin), while Q-learning performs better in large areas and resource-constrained environments. Both approaches deviate from the shortest path only when necessary due to energy constraints and their performance is evaluated by metrics such as total reward, route length and number of charges. © 2025 IEEE.
dc.identifier.doi10.1109/ASYU67174.2025.11208423
dc.identifier.isbn9798331597276
dc.identifier.scopus2-s2.0-105022479454
dc.identifier.scopusqualityN/A
dc.identifier.urihttps://doi.org/10.1109/ASYU67174.2025.11208423
dc.identifier.urihttps://hdl.handle.net/20.500.12885/5302
dc.indekslendigikaynakScopus
dc.language.isotr
dc.publisherInstitute of Electrical and Electronics Engineers Inc.
dc.relation.publicationcategoryKonferans Öğesi - Uluslararası - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/closedAccess
dc.snmzScopus_KA_20260207
dc.subjectElectric Vehicle Routing
dc.subjectEnergy-Aware Path Planning
dc.subjectQ-Learning
dc.subjectReinforcement Learning
dc.titleQ-Learning-Based Energy-Aware Route Planning for Electric Vehicles on Real Road Networks with Charging Constraints
dc.title.alternativeElektrikli Ara lar I in Ger ek Yol Aglarinda Sarj Kisitli, Enerji Farkindalikli Q- grenme Tabanli Rota Planlama
dc.typeConference Object

Dosyalar

Koleksiyon

Scopus İndeksli Yayınlar Koleksiyonu