Post Profile

Contouring learning rate to optimize neural nets

Tips and tricks for treating learning rate as a hyperparameter, and using visualizations to see what’s really going on. Learning rate is the rate at which the accumulation of information in a neural network progresses over time. The learning rate determines how quickly (and whether at all) the network reaches the optimum, most conducive location in the network for the specific output desired.
read more


Related Posts

How Google Uses Machine Learning And Neural Networks To Optimize Data Centers

Technology : TechCrunch: Enterprise

Google has released some new research about it efforts to maximize performance and minimize energy use at data centers through machine learning today. Long story short: Google is building superintelligent server farms that can learn...

The APIs for neural networks in TensorFlow

Technology : O'Reilly Radar

A look at the Layer API, TFLearn, and Keras. TensorFlow has gathered quite a bit of attention as the new hot toolkit for building neural networks. To the beginner, it may seem the only thing that rivals this interest is the number o...

Analysis software uses algorithms to visualize complex learning processes

Technology : Physorg: Technology news

Neural networks are commonly used today to analyze complex data – for instance to find clues to illnesses in genetic information. Ultimately, though, no one knows how these networks actually work exactly. That is why Fraunhofer rese...

Finding meaning in generative adversarial networks

Technology : O'Reilly Radar

Artificial intelligence is emerging as a creative force; in the process, it reveals something of itself. If you ask a child to draw a cat, you’ll learn more about the child than you will about cats. In the same way, asking neural ne...

The hard thing about deep learning

Technology : O'Reilly Radar

Deeper neural nets often yield harder optimization problems. At the heart of deep learning lies a hard optimization problem. So hard that for several decades after the introduction of neural networks, the difficulty of optimization ...


Copyright © 2016 Regator, LLC