2017年8月9日水曜日

OpenCV 3.1.0 install

$ sudo apt-get install build-essential cmake git
$ sudo apt-get install ffmpeg libopencv-dev libgtk-3-dev python-numpy python3-numpy libdc1394-22 libdc1394-22-dev libjpeg-dev libpng12-dev libtiff5-dev libjasper-dev libavcodec-dev libavformat-dev libswscale-dev libxine2-dev libgstreamer1.0-dev libgstreamer-plugins-base1.0-dev libv4l-dev libtbb-dev qtbase5-dev libfaac-dev libmp3lame-dev libopencore-amrnb-dev libopencore-amrwb-dev libtheora-dev libvorbis-dev libxvidcore-dev x264 v4l-utils unzip

$ wget https://github.com/Itseez/opencv/archive/3.1.0.zip
$ cd opencv-3.1.0
$ mkdir build
$ cd build
$ cmake -D CMAKE_BUILD_TYPE=RELEASE -D CMAKE_INSTALL_PREFIX=/usr/local -D WITH_TBB=ON -D WITH_V4L=ON -D WITH_QT=ON -D WITH_OPENGL=ON ..
$ make
$ sudo make install
$ sudo /bin/bash -c 'echo "/usr/local/lib" > /etc/ld.so.conf.d/opencv.conf'
$ sudo ldconfig

$ sudo pip3 install opencv-python

2017年8月7日月曜日

Machine learning self-made machine starting with low budget

◼️Hardware
GPU: 1050Ti ( CUDA core:678 , Memory : 4GB, Compute Capability : 6.1 )
PCI Express 3.0

◼️Software
(1) Ubuntu 16.04 install
(2) GPU Check
$ lspci | grep NVIDIA
(3) CUDA install
https://developer.nvidia.com/cuda-downloads
$ nvidia-smi
(4) cuDNN Install
https://developer.nvidia.com/rdp/cudnn-download
cuDNN v5.1 Runtime Lirary for Ubuntu 14.04(Deb)
(5) TensorFlow Install
$ pip install tensorflow-gpu
$ pip install keras
$ pip install h5py

2017年8月5日土曜日

Best Practices for ML Engineering


◼️Rules of Machine Learning: Best Practices for ML Enginnering
http://martin.zinkevich.org/rules_of_ml/rules_of_ml.pdf


The first rule states "Do not be afraid to launch a product without machine learning". It is suggested that it is better to write the rules yourself, especially when there are few data available for machine learning.
Being able to understand and use machine learning is a necessary condition as a machine learning engineer, but be careful that it is not sufficient condition. The truly important thing is that you can select the optimal method including the heuristic rule base as well.

Character-level CNN

Morphological analysis is used to decompose sentences in Japanese into words. Tools for morphological analysis, such as MeCab, can be used to break sentences into words. However, this morpheme analysis has weaknesses. That means that it can not be used for unknown words.

So there is Character - level CNN. (https://arxiv.org/abs/1509.01626)
Character-level CNN is a method that began to be seen around 2015. One of the features is that no morphological analysis is necessary. Enter the sentences in CNN in character units, put them in the feature map, and pour them into the entire tie layer to learn the classification.

CNN and RNN in natural language processing

In deep learning, RNN (Recurrent Neural Network) is often used for natural language processing. RNN is good at handling sequential inputs. However, in general, RNN learns slower than CNN. Therefore, papers using CNN for natural language processing came out frequently from around last year. For example, recently, the topic that Facebook implements machine translation with CNN came out on 2017/5.

https://code.facebook.com/posts/1978007565818999/a-novel-approach-to-neural-machine-translation/

Cloud service for Deep Learning

Amazon EC2 P2 Instance
 ・Choose a Virginia northern region
 ・AMI(Amazon Machine Image)
Deep Learning AMI Ubuntu Version

Google Cloud Platform

2017年5月9日火曜日

Ruby on Rails ver 5.1.0 Release

http://weblog.rubyonrails.org/2017/4/27/Rails-5-1-final/


When 5.1 is released, bug fixes apply only to 5.1.x.
Normal security fixes apply to 5.1.x and 5.0.x.
Serious security fixes apply to 5.1.x, 5.0.x and 4.2.x.
That is, 4.x is basically not supported.

fd-find

 $ sudo apt install fd-find $ fdfind 石