CS224d Assignment1 答案, Part(2/4)
来源:互联网 发布:英格拉姆弹跳数据 编辑:程序博客网 时间:2024/06/08 15:04
Assignment1的答案一共被我分成了4部分,分别包含第1,2,3,4题。这部分包含第2题的答案。
2. Neural Network Basics (30 points)
(a). (3 points) Derive the gradients of the sigmoid function and show that it can be rewritten as a function of the function value (i.e. in some expression where only
解:
(b). (3 points) Derive the gradient with regard to the inputs of a softmax function when cross entropy loss is used for evaluation, i.e. find the gradients with respect to the softmax input vector
where
解:根据提示,假设
对于
所以
(c). (6 points) Derive the gradients with respect to the inputs
Recall that the forward propagation is as follows
Note that here we’re assuming that the input vector (thus the hidden variables and output probabilities) is a row vector to be consistent with the programming assignment. When we apply the sigmoid function to a vector, we are applying it to each of the elements of that vector.
解:设
记
其中
记
同时有:
其中
(d). (2 points) How many parameters are there in this neural network, assuming the input is
解:
(e)(f)(g). 见代码,略
- CS224d Assignment1 答案, Part(2/4)
- CS224d Assignment1 答案, Part(1/4)
- CS224d Assignment1 答案, Part(3/4)
- CS224d-Assignment1
- CS224D Lecture 4 札记
- CS224d Problem set 2作业
- My solution to cs224n assignment1(3-4)
- CS231n——Assignment1--2-layer-network
- My solution to cs224n assignment1(1-2)
- CS224d笔记2——word2vec
- CS224d-Day 2:TensorFlow 入门
- 20170228#cs231n#5.Neural Networks Part 1神经网络1 /Assignment1-NeuralNetwork
- 第一部分 第二章 答案合集(part 2)1024-1038
- 图像与机器学习-2-基础知识及cs231n/assignment1
- udacity assignment1
- cs231n assignment1
- CS231n-assignment1
- CS224d-Day 2:深度学习与自然语言处理
- 详细分析stm32f10x.h
- VC++ 如何实现程序启动后最小化到托盘
- uitableview contentview 添加子view出现约束错误
- html中img图片路径src不对的问题
- EA&UML日拱一卒--活动图::入门
- CS224d Assignment1 答案, Part(2/4)
- 在邻接矩阵中的DFS与BFS的实现
- Leetcode 360 Sort Transformed Array
- vim安装插件YouCompleteMe,出错,YouCompleteMe unavailable: requires Vim compiled with Python 2.x support
- 编译防火墙——C++的Pimpl惯用法解析
- socket学习
- linux线程系列(5)线程清理和控制函数
- SVM简单代码实现MATLAB
- CS224d Assignment1 答案, Part(3/4)