1.1 - DL Overview
Contents
1.1 - DL Overview¶
!wget -nc --no-cache -O init.py -q https://raw.githubusercontent.com/rramosp/2021.deeplearning/main/content/init.py
import init; init.init(force_download=False);
from IPython.display import Image
Image(filename='local/imgs/ai_ml_dl.jpeg')
Image(filename='local/imgs/DL_timeline.png')
Some types of Neural Networks¶
http://www.asimovinstitute.org/neural-network-zoo/
Image(filename='local/imgs/nntypes.png')
Why DL now?¶
A “weird” introduction to Deep Learning
As I said before, until the late 2000s, we were still missing a reliable way to train
very deep neural networks. Nowadays, with the development of several simple but important
theoretical and algorithmic improvements, the advances in hardware (mostly GPUs, now TPUs),
and the exponential generation and accumulation of data, DL came naturally to fit this
missing spot to transform the way we do machine learning.
Feature learning¶
Image(filename='local/imgs/feature_learning_ml_dl.png')
DL is suited for large datasets with highly dimensional input variables¶
Image(filename='local/imgs/cnn_feature_hierarchy.png')