Natural Evolution Strategies



I’m interested in Evolution Strategies and I have a question regarding the openAI article (also see

In NES, they represent population with a distribution over parameters
pψ(θ), this distribution being parametrized by ψ and they seek to maximize the objective value

The update rule is given by:
ψ𝔼θpψF(θ) = 𝔼θpψ[F(θ)∇ψlog pψ(θ)]

In Evolution strategies, what I understand from the text is that you have to remember the noise parameters used to generate each individual and then, given their reward, move the θ toward (or away if the reward is negative) the individual that scored the most. But I’m kinda lost in the NES case, I don’t really understand the update rule. How can I take the log probability of the population distribution ?

Could anyone shed some more lights please ?

Thanks !