Gradient Descent
Gradient Descent is an optimization algorithm. The general idea of Gradient Descent is to tweak parameters $latex \theta$ iteratively in order to minimize a cost function by measuring the gradient … Read More
Category: Machine Learning
Batch vs. Online Learning
Machine learning algorithms can be classified into batch or online methods by whether or not the algorithms can learn incrementally as new data arrive. Batch Learning Batch learning methods are … Read More
What are Embeddings?
Recently, embedding models have been gaining considerable attention in various areas such as natural language processing (NLP), recommender system, knowledge graph completion, etc. This is due to their high accuracy … Read More
Gradient Boosting
Gradient boosting is one of popular boosting technique, especially with decision trees, for regression and classification problems. Like other boosting methods, gradient boosting adds predictors sequentially to an ensemble that … Read More
The Normal Equation
When we train a linear regression model (i.e., $latex \hat{y} = \theta^T \cdot \textbf{x}$), we might consider two different ways to train it: Using a “closed-form” solution that directly computes … Read More
Handling Categorical Values
In this post, we will look at a common way to deal with categorical values (e.g., small, medium, large). Most machine learning algorithms work with numerical values, so we need … Read More
How to Deal with Missing Values
One of data cleaning processes is about dealing with missing values. It is very common to find missing values in your datasets. To train your model better, you need to … Read More
Underfitting vs. Overfitting
We can determine if the performance of a model is poor by looking at prediction errors on the training set and the evaluation set. The model might be too simple … Read More
Tutorial: Doc2Vec and t-SNE
This post shows a tutorial of using doc2vec and the t-SNE visualization in Python for disease clustering. Of course, these tutorial codes can be used for any other types of … Read More
Feature Scaling
Feature scaling is one of most important feature engineerings for many machine learning algorithms (Decision trees don’t need feature scaling necessarily). Most of the algorithms require similar scales for numerical … Read More