UFLDL Exercise: Self-Taught Learning
来源:互联网 发布:域名备案掉了怎么办 编辑:程序博客网 时间:2024/06/06 08:50
这是无监督特征学习和深度学习(UFLDL)的作业题。
本次练习在基于以往练习的基础需要完成stlExercise.m和feedForwardAutodecoder.m的部分内容。
stlExercise.m
%% CS294A/CS294W Self-taught Learning Exercise% Instructions% ------------% % This file contains code that helps you get started on the% self-taught learning. You will need to complete code in feedForwardAutoencoder.m% You will also need to have implemented sparseAutoencoderCost.m and % softmaxCost.m from previous exercises.%%% ======================================================================% STEP 0: Here we provide the relevant parameters values that will% allow your sparse autoencoder to get good filters; you do not need to % change the parameters below.inputSize = 28 * 28;numLabels = 5;hiddenSize = 200;sparsityParam = 0.1; % desired average activation of the hidden units. % (This was denoted by the Greek alphabet rho, which looks like a lower-case "p", % in the lecture notes). lambda = 3e-3; % weight decay parameter beta = 3; % weight of sparsity penalty term maxIter = 400;%% ======================================================================% STEP 1: Load data from the MNIST database%% This loads our training and test data from the MNIST database files.% We have sorted the data for you in this so that you will not have to% change it.% Load MNIST database filesmnistData = loadMNISTImages('mnist/train-images-idx3-ubyte');mnistLabels = loadMNISTLabels('mnist/train-labels-idx1-ubyte');% Set Unlabeled Set (All Images)% Simulate a Labeled and Unlabeled setlabeledSet = find(mnistLabels >= 0 & mnistLabels <= 4);unlabeledSet = find(mnistLabels >= 5);numTrain = round(numel(labeledSet)/2);trainSet = labeledSet(1:numTrain);testSet = labeledSet(numTrain+1:end);unlabeledData = mnistData(:, unlabeledSet);trainData = mnistData(:, trainSet);trainLabels = mnistLabels(trainSet)' + 1; % Shift Labels to the Range 1-5testData = mnistData(:, testSet);testLabels = mnistLabels(testSet)' + 1; % Shift Labels to the Range 1-5% Output Some Statisticsfprintf('# examples in unlabeled set: %d\n', size(unlabeledData, 2));fprintf('# examples in supervised training set: %d\n\n', size(trainData, 2));fprintf('# examples in supervised testing set: %d\n\n', size(testData, 2));%% ======================================================================% STEP 2: Train the sparse autoencoder% This trains the sparse autoencoder on the unlabeled training% images. % Randomly initialize the parameterstheta = initializeParameters(hiddenSize, inputSize);%% ----------------- YOUR CODE HERE ----------------------% Find opttheta by running the sparse autoencoder on% unlabeledTrainingImages%opttheta = theta; addpath minFunc/options.Method = 'lbfgs';options.maxIter = maxIter;options.diaplay = 'on';[opttheta, cost] = minFunc( @(p) sparseAutoencoderCost(p, ... inputSize, hiddenSize, ... lambda, sparsityParam, ... beta, unlabeledData), ... theta, options);%% ----------------------------------------------------- % Visualize weightsW1 = reshape(opttheta(1:hiddenSize * inputSize), hiddenSize, inputSize);display_network(W1');%%======================================================================%% STEP 3: Extract Features from the Supervised Dataset% % You need to complete the code in feedForwardAutoencoder.m so that the % following command will extract features from the data.trainFeatures = feedForwardAutoencoder(opttheta, hiddenSize, inputSize, ... trainData);testFeatures = feedForwardAutoencoder(opttheta, hiddenSize, inputSize, ... testData);%%======================================================================%% STEP 4: Train the softmax classifiersoftmaxModel = struct; %% ----------------- YOUR CODE HERE ----------------------% Use softmaxTrain.m from the previous exercise to train a multi-class% classifier. % Use lambda = 1e-4 for the weight regularization for softmax% You need to compute softmaxModel using softmaxTrain on trainFeatures and% trainLabelsoptions.maxIter = 100;softmaxModel = softmaxTrain(hiddenSize, numLabels, 1e-4, ... trainFeatures, trainLabels, options);%% -----------------------------------------------------%%======================================================================%% STEP 5: Testing %% ----------------- YOUR CODE HERE ----------------------% Compute Predictions on the test set (testFeatures) using softmaxPredict% and softmaxModel[pred] = softmaxPredict(softmaxModel, testFeatures);%% -----------------------------------------------------% Classification Scorefprintf('Test Accuracy: %f%%\n', 100*mean(pred(:) == testLabels(:)));% (note that we shift the labels by 1, so that digit 0 now corresponds to% label 1)%% Accuracy is the proportion of correctly classified images% The results for our implementation was:%% Accuracy: 98.3%%%
feedForwardAutodecoder.m
function [activation] = feedForwardAutoencoder(theta, hiddenSize, visibleSize, data)% theta: trained weights from the autoencoder% visibleSize: the number of input units (probably 64) % hiddenSize: the number of hidden units (probably 25) % data: Our matrix containing the training data as columns. So, data(:,i) is the i-th training example. % We first convert theta to the (W1, W2, b1, b2) matrix/vector format, so that this % follows the notation convention of the lecture notes. W1 = reshape(theta(1:hiddenSize*visibleSize), hiddenSize, visibleSize);b1 = theta(2*hiddenSize*visibleSize+1:2*hiddenSize*visibleSize+hiddenSize);%% ---------- YOUR CODE HERE --------------------------------------% Instructions: Compute the activation of the hidden layer for the Sparse Autoencoder.activation = sigmoid(W1*data + repmat(b1,1,size(data,2)));%-------------------------------------------------------------------end%-------------------------------------------------------------------% Here's an implementation of the sigmoid function, which you may find useful% in your computation of the costs and the gradients. This inputs a (row or% column) vector (say (z1, z2, z3)) and returns (f(z1), f(z2), f(z3)). function sigm = sigmoid(x) sigm = 1 ./ (1 + exp(-x));end
在64位win10专业版,8G内存,corei5-4590@3.3Ghz上跑一次需要20分钟左右,准确率98.1958%【奇了怪了,昨晚跑了还98.3+的】
【更新】
1)又跑了一次,准确率98.320042%;
2)自动编码机隐层最大响应时对输入的要求是:
3)从下图可以看出,总耗时1012秒。
参考资料:
[1]http://deeplearning.stanford.edu/wiki/index.php/Exercise:Self-Taught_Learning
[2]http://deeplearning.stanford.edu/wiki/index.php/自我学习
0 0
- UFLDL Exercise:Self-Taught Learning
- UFLDL Exercise:Self-Taught Learning
- UFLDL Exercise: Self-Taught Learning
- Ufldl Exercise:Self-Taught Learning
- Stanford UFLDL教程 Exercise:Self-Taught Learning
- UFLDL教程: Exercise:Self-Taught Learning
- UFLDL——Exercise:Self-Taught Learning 自我学习
- UFLDL教程答案(5):Exercise:Self-Taught Learning
- 【UFLDL-exercise6- Self-Taught Learning】
- UFLFL Exercise:Self-Taught Learning
- Exercise:Self-Taught Learning 代码示例
- UFLDL 09 自我学习 Self-Taught Learning Unsupervised Feature Learning
- UFLDL教程(五)之self-taught learning
- Convolutional neural networks(CNN) (八) Self-Taught Learning Exercise
- Self-Taught Learning
- UFLDL学习笔记4(Self-Taught Learning and Unsupervised Feature Learning)
- Deep learning----------Self-taught learning
- UFLDL self-taught自我学习编程答案
- 安装sass
- JVM内幕
- 大众点评订单系统分库分表实践
- TR069 Http Digest 验证流程
- 栈练习自然数的拆分
- UFLDL Exercise: Self-Taught Learning
- vim入门教程(2)
- 冒泡排序 C语言版
- lightoj1006
- HDU2052 Picture
- java作业 猜花名程序
- 100条经典C++语言笔试题目-前50题
- 暗色梦境
- struts2总结