-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy paththe-effects-of-convolutional-neural-networks-on-a-hot-summer-night.html
165 lines (142 loc) · 8.09 KB
/
the-effects-of-convolutional-neural-networks-on-a-hot-summer-night.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>The effects of Convolutional Neural Networks on a Hot Summer Night</title>
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<meta name="description" content="">
<meta name="author" content="Marina von Steinkirch">
<!-- Le styles -->
<link rel="stylesheet" href="./theme/css/bootstrap.dark.css" type="text/css" />
<style type="text/css">
body {
padding-top: 60px;
padding-bottom: 40px;
}
.tag-1 {
font-size: 13pt;
}
.tag-2 {
font-size: 11pt;
}
.tag-2 {
font-size: 10pt;
}
.tag-4 {
font-size: 8pt;
}
</style>
<link href="./theme/css/bootstrap-responsive.dark.css" rel="stylesheet">
<link href="./theme/css/font-awesome.css" rel="stylesheet">
<link href="./theme/css/pygments.css" rel="stylesheet">
<!-- Le fav and touch icons -->
<link rel="shortcut icon" href="./theme/images/favicon.ico">
<link rel="apple-touch-icon" href="./theme/images/apple-touch-icon.png">
<link rel="apple-touch-icon" sizes="72x72" href="./theme/images/apple-touch-icon-72x72.png">
<link rel="apple-touch-icon" sizes="114x114" href="./theme/images/apple-touch-icon-114x114.png">
<link href="./feeds/all.atom.xml" type="application/atom+xml" rel="alternate" title="chmod +x singularity.sh ATOM Feed" />
</head>
<body>
<div class="navbar navbar-fixed-top">
<div class="navbar-inner">
<div class="container-fluid">
<a class="btn btn-navbar" data-toggle="collapse" data-target=".nav-collapse">
<span class="icon-bar"></span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
</a>
<a class="brand" href="./index.html">chmod +x singularity.sh </a>
<div class="nav-collapse">
<ul class="nav">
<li class="divider-vertical"></li>
<ul class="nav pull-right">
<li><a href="./authors.html">About</a></li>
<li><a href="./archives.html"><b>Archives</b></a></li>
<li>
<a href="https://github.com/bt3gl">github
<!--<i class="icon-github-sign icon-large" ></i>-->
</a></li>
<li>
<a href="https://twitter.com/1bt337">
<!--<i class="icon-twitter-sign icon-large"></i> -->
twitter
</a></li>
<li><a href="http://bt3gl.github.io/projects_page/index.html">Bygone Playful Times
</a></li>
</ul>
</ul>
<!--<p class="navbar-text pull-right">Logged in as <a href="#">username</a></p>-->
</div><!--/.nav-collapse -->
</div>
</div>
</div>
<div class="container-fluid">
<div class="row">
<div class="span9" id="content">
<section id="content">
<article>
<header>
<h1>
<a href=""
rel="bookmark"
title="Permalink to The effects of Convolutional Neural Networks on a Hot Summer Night">
The effects of Convolutional Neural Networks on a Hot Summer Night
</a>
</h1>
</header>
<div class="entry-content">
<div class="well">
<footer class="post-info">
<abbr class="published" title="2016-08-01T00:00:00">
Mon 01 August 2016 </abbr>
<span class="label"> Category</span>
<a href="./category/ai-ml.html"><i class="icon-folder-open"></i>AI & ML</a>
</footer><!-- /.post-info --> </div>
<p><img alt="dream" height="300px" src="./dream/d1.jpg" width="400px" /></p>
<p>About an year ago, Google published a seminal paper named <a href="https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf">ImageNet Classification with Deep Convolutional Neural Networks</a>, together with a <a href="https://research.googleblog.com/2015/07/deepdream-code-example-for-visualizing.html">blog post</a>, which became known as <strong>Inceptionism</strong>. This work unveiled not only a new way of composing hallucinating artistic pictures, but astonishing new insights on <strong>how convolutional neural networks work</strong>. Now we are able to see what each hidden layer in the net has learned, or in a more philosophical explanation, what the <strong>machine sees</strong>.</p>
<p>Convolutional Neural Networks take an image (a vector of pixels) as input, and transform the image through several layers of nonlinear functions (kind of how <a href="https://en.wikipedia.org/wiki/Kernel_(image_processing)">kernels</a> work). The <strong>dream images</strong> are just a <strong>gradient ascent process</strong> that minimizes the <strong>L2 norm</strong> of activation functions of some deep neural network layer. </p>
<p>More specifically, in the task of image classification, the neurons have the follow functions:</p>
<ul>
<li><strong>lower levels</strong> reveal edge-like regions in the images (such as corners, lines),</li>
<li><strong>intermediate layers</strong> represent basic shapes and components of objects (such as eyes, boxes),</li>
<li><strong>the final layers</strong> compose the complete interpretation (such as dog), but in a <a href="https://www.reddit.com/r/deepdream/comments/3cawxb/what_are_deepdream_images_how_do_i_make_my_own/">psychedelic way</a>. </li>
</ul>
<p>Google released the code of its <a href="https://github.com/BVLC/caffe/tree/master/models/bvlc_googlenet">GoogLeNet model</a>, which is trained trained on <a href="http://www.image-net.org/">ImageNet dataset</a>. I slightly adapted it <a href="https://github.com/bt3gl/Machine-Learning-Resources/tree/master/Deep_Art/deepdream">here</a>, adding some instructions on how one can play with it in a AWS GPU instance.</p>
<p>Examples of <strong>deep dream</strong> with the following layers:</p>
<h4><em>inception_3b/5x5_reduce</em> (lower levels):</h4>
<p><img alt="dream" height="450px" src="./dream/d12.jpeg" width="550px" /></p>
<h4><em>inception_4c/output</em> (higher levels):</h4>
<p><img alt="dream" height="450px" src="./dream/d11.jpeg" width="550px" /></p>
<h4><em>inception_3b/output</em> (controlled dreams):</h4>
<p><img alt="dream" height="450px" src="./dream/d3.jpg" width="550px" />
<img alt="dream" height="450px" src="./dream/d13.jpeg" width="550px" /></p>
<h3>Enjoy!</h3>
<p><img alt="dream" height="300px" src="./dream/1.jpg" width="400px" /></p>
</div><!-- /.entry-content -->
<div class="comments">
<h2>Comments !</h2>
<div id="disqus_thread"></div>
<script type="text/javascript">
var disqus_identifier = "the-effects-of-convolutional-neural-networks-on-a-hot-summer-night.html";
(function() {
var dsq = document.createElement('script');
dsq.type = 'text/javascript'; dsq.async = true;
dsq.src = 'http://bt3gl.disqus.com/embed.js';
(document.getElementsByTagName('head')[0] ||
document.getElementsByTagName('body')[0]).appendChild(dsq);
})();
</script>
</div>
</article>
</section>
</div><!--/span-->
</div><!--/row-->
<footer>
<address id="about">
</address><!-- /#about -->
</footer>
</div><!--/.fluid-container-->
<script src="./theme/js/jquery-1.7.2.min.js"></script>
<script src="./theme/js/bootstrap.min.js"></script>
</body>
</html>