机器学习概要提纲

ML

Toolbox

java

- Mahout- Weka- Mallet- JSAT

Python

- Scikit-learn- PyBrain- nltk- Theano- Pylearn2- MDP- Orange- milk- pyml- Numpy

Matlab

Real-time Computation Paltform

Spark

- MLlib

Hurricane

- SewedBIAS

Storm

Heron

Algorithms

Supervised Learning

Regression

- Generalized Linear Regression- Gaussian Processes- Isotonic Regression

Classification

- Support Vector Machines (SVM)- Linear and Quadratic Discriminant Analysis- Decision Trees- K Nearest Neighbors- Naive Bayes- Neural Networks- Ensemble Methods- Kernel Approximation- Adaboost

Unsupervised Learning

Clustering

- K-Means- Gaussian Mixture Models- Spectral Clustering- Manifold Learning- Hierarchical Clustering- Affinity Propagation- DBSCAN- Birch

Dimensionality Reduction

- Principal Component Analysis- Linear Discriminant Analysis- Locally linear embedding- Laplacian Eigenmaps- Isomap- Spectral Embedding- Feature Agglomeration

Reinforcement Learning

- Markov Decision Processes- Q-Learning- Sarsa- A-Learning

Deep Learning

- Convolutional Neural Network (CNN)- Restricted Boltzmann Machines- Recurrent Neural Network (RNN)    - Long Short Term Memory

Model Selection and Evaluation

Cross-validation

Grid Search

Model Evaluation

Model Persistence

Validation Curves

Frameworks

TensorFlow

Caffe2/Caffe

Theano

Torch

Chainer

OpenBLAS

CUDA

CUDNN