TABLE 1

Design parameters of proposed NES machine learning method

Parameter DescriptionValue
Gaussian proposal variance (σ2)0.1
learning rate (for ℓ < 500)10−4
learning rate (for ℓ > 500)5 · 10−5
hidden layer size2K ℓ
number hidden layers2
output activationtanh
network optimizerAdam (Kingma & Ba, 2015)
batch size (N)100
number iterations10,000