Subscribe to DSC Newsletter

L.V.'s Blog – October 2018 Archive (1)

Deep Learning Networks: Advantages of ReLU over Sigmoid Function

This was posted as a question on StackExchange. The state of the art of non-linearity is to use rectified linear units (ReLU) instead of sigmoid function in deep neural network. What are the advantages? I know that training a network when ReLU is used would be faster, and it is more biological inspired, what are the other advantages? (That is, any disadvantages of using sigmoid)?…

Continue

Added by L.V. on October 11, 2018 at 6:00pm — No Comments

Videos

  • Add Videos
  • View All

© 2020   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service