ExperienceBufferLength in Reinforcement Learning Toolbox
Hello, everyone,
I found a problem with the ‘ExperienceBufferLength’ property in ‘rlDDPGAgentOptions’ when specifying options for rl agents.
Usually this property is set as 1e6 in the examples of the Help documentation, such as here.
In this example, every episode has 600 (60/0.1) steps. Does the agent start to train when the experience buffer is filled up with the experiences (S,A,R,S’). If so, it would take at least 1667 (1000000/600 ) episodes before the agent starts to improve.
So I want to know how to determine this value.Hello, everyone,
I found a problem with the ‘ExperienceBufferLength’ property in ‘rlDDPGAgentOptions’ when specifying options for rl agents.
Usually this property is set as 1e6 in the examples of the Help documentation, such as here.
In this example, every episode has 600 (60/0.1) steps. Does the agent start to train when the experience buffer is filled up with the experiences (S,A,R,S’). If so, it would take at least 1667 (1000000/600 ) episodes before the agent starts to improve.
So I want to know how to determine this value. Hello, everyone,
I found a problem with the ‘ExperienceBufferLength’ property in ‘rlDDPGAgentOptions’ when specifying options for rl agents.
Usually this property is set as 1e6 in the examples of the Help documentation, such as here.
In this example, every episode has 600 (60/0.1) steps. Does the agent start to train when the experience buffer is filled up with the experiences (S,A,R,S’). If so, it would take at least 1667 (1000000/600 ) episodes before the agent starts to improve.
So I want to know how to determine this value. reinforcement learning, ddpg, experiencebufferlength MATLAB Answers — New Questions