tf.keras.experimental.NoisyLinearCosineDecay

View source on GitHub

A LearningRateSchedule that uses a noisy linear cosine decay schedule.

Inherits From: LearningRateSchedule

Args
initial_learning_rate A scalar float32 or float64 Tensor or a Python number. The initial learning rate.
decay_steps A scalar int32 or int64 Tensor or a Python number. Number of steps to decay over.
initial_variance initial variance for the noise. See computation above.
variance_decay decay for the noise's variance. See computation above.
num_periods Number of periods in the cosine part of the decay. See computation above.
alpha See computation above.
beta See computation above.
name String. Optional name of the operation. Defaults to 'NoisyLinearCosineDecay'.

Methods

from_config

View source

Instantiates a LearningRateSchedule from its config.

Args
config Output of get_config().
Returns
A LearningRateSchedule instance.

get_config

View source

__call__

View source

Call self as a function.

© 2020 The TensorFlow Authors. All rights reserved.
Licensed under the Creative Commons Attribution License 3.0.
Code samples licensed under the Apache 2.0 License.
https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/keras/experimental/NoisyLinearCosineDecay