Digital Reasoning, a cognitive computing company based in Franklin, Tenn., recently announced that it has trained a neural network consisting of 160 billion parameters—more than 10 times larger than previous neural networks.
The Digital Reasoning neural network easily surpassed previous records held by Google’s 11.2-billion parameter system and Lawrence Livermore National Laboratory’s 15-billion parameter system. But it also showed improved accuracy over previous neural networks in tackling an “industry-standard dataset” consisting of 20,000 word analogies. Digital Reasoning’s model achieved an accuracy of almost 86 percent; significantly higher than Google’s previous record of just over 76 percent and Stanford University’s 75 percent.
Deep learning” involves the building of learning machines from five or more layers of artificial neural networks. (“Deep” refers to the depth of the layers, rather than any depth of knowledge.) Yann LeCun, head of the Artificial Intelligence Research Lab at Facebook, has described the idea of deep learning as “machines that learn to represent the world.”
Read the full article on IEEE Spectrum.