<?xml version="1.0" encoding="UTF-8"?><rss
version="2.0"
xmlns:content="http://purl.org/rss/1.0/modules/content/"
xmlns:wfw="http://wellformedweb.org/CommentAPI/"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:atom="http://www.w3.org/2005/Atom"
xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
><channel><title>backprpagation Archives - Francesco Lelli %</title> <atom:link href="https://francescolelli.info/tag/backprpagation/feed/" rel="self" type="application/rss+xml" /><link>https://francescolelli.info/tag/backprpagation/</link> <description>Information Management, Computer Science,  Economics, Finance and more</description> <lastBuildDate>Tue, 25 Feb 2020 10:19:26 +0000</lastBuildDate> <language>en-US</language> <sy:updatePeriod> hourly </sy:updatePeriod> <sy:updateFrequency> 1 </sy:updateFrequency> <generator>https://wordpress.org/?v=6.8.5</generator><image> <url>https://francescolelli.info/wp-content/uploads/2018/11/cropped-InstrumentElement-32x32.jpg</url><title>backprpagation Archives - Francesco Lelli %</title><link>https://francescolelli.info/tag/backprpagation/</link> <width>32</width> <height>32</height> </image> <site
xmlns="com-wordpress:feed-additions:1">156264324</site> <item><title>Neural Networks: The Basics and a Collection of YouTube Videos</title><link>https://francescolelli.info/tutorial/neural-networks-a-collection-of-youtube-videos-for-learning-the-basics/</link> <comments>https://francescolelli.info/tutorial/neural-networks-a-collection-of-youtube-videos-for-learning-the-basics/#respond</comments> <dc:creator><![CDATA[Francesco Lelli]]></dc:creator> <pubDate>Thu, 30 May 2019 11:34:19 +0000</pubDate> <category><![CDATA[Machine Learning]]></category> <category><![CDATA[Tutorial]]></category> <category><![CDATA[backprpagation]]></category> <category><![CDATA[Collection of Videos]]></category> <category><![CDATA[gradient]]></category> <category><![CDATA[hidden layer]]></category> <category><![CDATA[input layer]]></category> <category><![CDATA[neural network hello world]]></category> <category><![CDATA[Neural Networks]]></category> <category><![CDATA[output layer]]></category> <guid
isPermaLink="false">https://francescolelli.info/?p=1409</guid><description><![CDATA[<p>Artificial neural networks&#160;(ANN) or simply &#8220;neural networks&#8221; are computing systems inspired by &#8220;classical biological&#8221; neural networks that are in animal brains. Typically an ANN &#8220;learn&#8221; to perform tasks by considering examples, without being programmed with task-specific rules. Image recognition is a classical example where neural networks are used; in particular they learn to identify images [&#8230;]</p><p>The post <a
href="https://francescolelli.info/tutorial/neural-networks-a-collection-of-youtube-videos-for-learning-the-basics/">Neural Networks: The Basics and a Collection of YouTube Videos</a> appeared first on <a
href="https://francescolelli.info">Francesco Lelli</a>.</p> ]]></description> <content:encoded><![CDATA[<p><strong>Artificial neural networks</strong>&nbsp;(<strong>ANN</strong>) or simply &#8220;neural networks&#8221; are computing systems inspired by &#8220;classical biological&#8221; neural networks that are in animal brains. Typically an ANN &#8220;learn&#8221; to perform tasks by considering examples, without being programmed with task-specific rules.</p><div
class="wp-block-image"><figure
class="alignright is-resized"><img
fetchpriority="high" decoding="async" data-attachment-id="1411" data-permalink="https://francescolelli.info/tutorial/neural-networks-a-collection-of-youtube-videos-for-learning-the-basics/attachment/neuralnetworks-input-layer-hidden-layer-output-layer/" data-orig-file="https://francescolelli.info/wp-content/uploads/2019/05/NeuralNetworks-input-layer-hidden-layer-output-layer.png" data-orig-size="1318,862" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="NeuralNetworks-input-layer-hidden-layer-output-layer" data-image-description="" data-image-caption="" data-medium-file="https://francescolelli.info/wp-content/uploads/2019/05/NeuralNetworks-input-layer-hidden-layer-output-layer-300x196.png" data-large-file="https://francescolelli.info/wp-content/uploads/2019/05/NeuralNetworks-input-layer-hidden-layer-output-layer-1024x670.png" src="https://francescolelli.info/wp-content/uploads/2019/05/NeuralNetworks-input-layer-hidden-layer-output-layer-1024x670.png?8011c3&amp;8011c3" alt="Neural Networks, machine learning" class="wp-image-1411" width="448" height="293" srcset="https://francescolelli.info/wp-content/uploads/2019/05/NeuralNetworks-input-layer-hidden-layer-output-layer-1024x670.png 1024w, https://francescolelli.info/wp-content/uploads/2019/05/NeuralNetworks-input-layer-hidden-layer-output-layer-300x196.png 300w, https://francescolelli.info/wp-content/uploads/2019/05/NeuralNetworks-input-layer-hidden-layer-output-layer-768x502.png 768w, https://francescolelli.info/wp-content/uploads/2019/05/NeuralNetworks-input-layer-hidden-layer-output-layer-600x392.png 600w, https://francescolelli.info/wp-content/uploads/2019/05/NeuralNetworks-input-layer-hidden-layer-output-layer.png 1318w" sizes="(max-width: 448px) 100vw, 448px" /><figcaption>Example of Neural Network</figcaption></figure></div><p>Image recognition is a classical example where neural networks are used; in particular they learn to identify images that contain dogs by analyzing example images that have been manually categorized (labelled) as &#8220;dog&#8221; or &#8220;no dog&#8221;. Once the system &#8220;learn&#8221; the difference it can be used for identifying dogs in other images.</p><p>An ANN does not use conceptual reasoning, for example is not capable to devise that &#8220;all dogs have 4 legs&#8221;, or &#8220;a dog must have a nose&#8221; etc.  Instead, they hide the features of a dog into their data structure and they &#8220;internally learn these characteristics&#8221; from the examples that are used for training them.</p><p>These 4 YouTube videos below can kick start your journey in learning about this technology or simply satisfy your curiosity.</p><p>Practical applications are more complex that the classical example mentioned in these videos. Nevertheless, learning how to recognize hand-written digits is always a good place to start.  In other words you can consider this example as the &#8220;hello world&#8221; example for learning the basics of Neural Networks.</p><p>Modern tools for developing Neural networks such as Tensor-flow hide many of the complexities mentioned in these videos. Nevertheless a basic foundation of the concepts mentioned will speed up your developments and will foster an  actual understanding of what you are doing.</p><figure
class="wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio"><div
class="wp-block-embed__wrapper"> <iframe
title="But what is a neural network? | Deep learning chapter 1" width="800" height="450" src="https://www.youtube.com/embed/aircAruvnKk?feature=oembed&#038;enablejsapi=1&#038;origin=https://francescolelli.info" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe></div><figcaption> <br>But what *is* a Neural Network?&nbsp; <br></figcaption></figure><figure
class="wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio"><div
class="wp-block-embed__wrapper"> <iframe
title="Gradient descent, how neural networks learn | Deep Learning Chapter 2" width="800" height="450" src="https://www.youtube.com/embed/IHZwWFHWa-w?feature=oembed&#038;enablejsapi=1&#038;origin=https://francescolelli.info" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe></div><figcaption> <br>Gradient descent, how neural networks learn </figcaption></figure><figure
class="wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio"><div
class="wp-block-embed__wrapper"> <iframe
title="Backpropagation, intuitively | Deep Learning Chapter 3" width="800" height="450" src="https://www.youtube.com/embed/Ilg3gGewQ5U?feature=oembed&#038;enablejsapi=1&#038;origin=https://francescolelli.info" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe></div><figcaption> <br>What is backpropagation really doing? </figcaption></figure><figure
class="wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio"><div
class="wp-block-embed__wrapper"> <iframe
title="Backpropagation calculus | Deep Learning Chapter 4" width="800" height="450" src="https://www.youtube.com/embed/tIeHLnjs5U8?feature=oembed&#038;enablejsapi=1&#038;origin=https://francescolelli.info" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe></div><figcaption> <br>Back-propagation calculus&nbsp; </figcaption></figure><p>The code mentioned in the videos is also available at this link:</p><ul
class="wp-block-list"><li> <a
href="https://github.com/mnielsen/neural-networks-and-deep-learning">https://github.com/mnielsen/neural-networks-and-deep-learning</a></li></ul><p>In the case you would like to replicate the example you can access the database of hand-written digits at this link:</p><ul
class="wp-block-list"><li><a
href="http://yann.lecun.com/exdb/mnist/">http://yann.lecun.com/exdb/mnist/</a></li></ul><p>And, in the case you would like to learn about Artificial Neural Networks in details I would recommend this open book:</p><ul
class="wp-block-list"><li> <a
href="http://neuralnetworksanddeeplearning.com/">http://neuralnetworksanddeeplearning.com/</a></li></ul><p>In thinking to what is missing in these video I would say that an introduction to genetic algorithms is probably the most important part. In a nutshell is a technique for optimizing a particular model that is inspired by biological evolution theories. When we design a neural network we usually  make a lot of assumption on its characteristics such as, for example, type of activation of the neurons, hidden layers, type of connections, way of back-propagate the feedback etc. As these aspects could be considered features of a particular network, a genetic algorithm approach could help in finding the optimal configuration of these parameters.</p><p>A second aspect that is missing is the notion of &#8220;deep learning&#8221; that is a particular way of dealing with backprogation of a neural network without the need of having a train dataset and using a larger set of layers.</p><p>Anyway, this set of resources represents a good starting point for learning the basic of neural networks.</p><p>Why you do not let your friends know what you are learning? Consider tweeting something like what follows!</p><hr
/><p><em>A Collection of YouTube Videos around Neural Networks. #Python example for #CodeNewbie included in the links </em><br
/><a
href='https://twitter.com/intent/tweet?url=https%3A%2F%2Ffrancescolelli.info%2Ftutorial%2Fneural-networks-a-collection-of-youtube-videos-for-learning-the-basics%2F&#038;text=A%20Collection%20of%20YouTube%20Videos%20around%20Neural%20Networks.%20%23Python%20example%20for%20%23CodeNewbie%20included%20in%20the%20links%20%20&#038;related' target='_blank' rel="noopener noreferrer" >Share on X</a><br
/><hr
/><p>I occasionally have some thesis related to Neural Networks, in case you are a student and you are considering learning more about that I encourage you in checking the <a
href="https://francescolelli.info/thesis/">available thesis</a></p><p>The post <a
href="https://francescolelli.info/tutorial/neural-networks-a-collection-of-youtube-videos-for-learning-the-basics/">Neural Networks: The Basics and a Collection of YouTube Videos</a> appeared first on <a
href="https://francescolelli.info">Francesco Lelli</a>.</p> ]]></content:encoded> <wfw:commentRss>https://francescolelli.info/tutorial/neural-networks-a-collection-of-youtube-videos-for-learning-the-basics/feed/</wfw:commentRss> <slash:comments>0</slash:comments> <post-id
xmlns="com-wordpress:feed-additions:1">1409</post-id> </item> </channel> </rss>