The joint optimization problem of energy procure-ment and retail pricing for an electricity retailer is converted into separately determining the optimal procurement strategy and optimal pricing strategy,under the"price-taker"assumption.The aggregate energy consumption of end use customers(EUCs)is predicted to solve for the optimal procurement strategy vis a long short-term memory(LSTM)-based supervised learning method.The optimal retail pricing problem is formulated as a Markov decision process(MDP),which can be solved by using deep reinforcement learning(DRL)algorithms.However,the performance of existing DRL approaches may deteriorate due to their insufficient ability to extract discriminative features from the time-series vectors in the environmental states.We propose a novel deep deterministic policy gradient(DDPG)network structure with a shared LSTM-based representation network that fully exploits the Actor's and Critic's losses.The designed shared representation network and the joint loss function can enhance the environment perception capability of the proposed approach and further improve the optimization performance,resulting in a more profitable pricing strategy.Numerical simulations demonstrate the effectiveness of the proposed approach.

Hongsheng Xu;Jinyu Wen;Qinran Hu;Jiao Shu;Jixiang Lu;Zhihong Yang

State Key Laboratory of Advanced Electromagnetic Engineering and Technology,School of Electrical and Electronic Engineering,Huazhong University of Science and Technology,Wuhan 430074,China;NARI Group Corporation,Nanjing 211106,China;School of Electrical Engineering,Southeast University,Nanjing 210096,China;State Key Laboratory of Smart Grid Protection and Control,Nanjing 211106,China

中国电机工程学会电力与能源系统学报（英文版）

[1]Hongsheng Xu;Jinyu Wen;Qinran Hu;Jiao Shu;Jixiang Lu;Zhihong Yang-.Energy Procurement and Retail Pricing for Electricity Retailers via Deep Reinforcement Learning with Long Short-term Memory)[J].中国电机工程学会电力与能源系统学报（英文版）,2022(05):1338-1351

Retail,Retailers,taker,EUCs

Energy,Procurement,Pricing,Electricity,via,Deep,Reinforcement,Learning,Long,Short,Memory,joint,optimization,problem,energy,pricing,electricity,retailer,converted,into,separately,determining,optimal,procurement,strategy,under,price,assumption,aggregate,consumption,end,use,customers,predicted,long,short,memory,supervised,learning,method,formulated,Markov,decision,process,MDP,which,can,be,solved,by,using,deep,reinforcement,DRL,algorithms,However,performance,existing,approaches,may,deteriorate,due,their,insufficient,extract,discriminative,features,from,series,vectors,environmental,states,We,novel,deterministic,policy,gradient,DDPG,network,structure,shared,representation,that,fully,exploits,Actor,Critic,losses,designed,function,enhance,perception,capability,proposed,further,improve,resulting,more,profitable,Numerical,simulations,demonstrate,effectiveness

0.595195