[RL] MR.Q: Model-based Representations for Q-Learning
Category: reinforcement-learning
Posted: December 02, 2024
Towards General-Purpose Model-Free Reinforcement Learning
[RL] Data-Augmented Visual RL
Category: reinforcement-learning
Posted: October 30, 2024
RAD, DrQ, and DrQ-v2
[RL] Contrastive Visual RL
Category: reinforcement-learning
Posted: October 28, 2024
CURL, ATC, SPR, and TACO
[RL] Feature Discretization for RL
Category: reinforcement-learning
Posted: October 20, 2024
[RL] TD7
Category: reinforcement-learning
Posted: October 14, 2024
The Great Mind of Scott Fujimoto
[RL] Self-Predictive RL
Category: reinforcement-learning
Posted: October 12, 2024
[RL] Implicit World Model
Category: reinforcement-learning
Posted: October 07, 2024
TD-MPC & TD-MPC2
[Generative Model] Preference Optimization for Diffusion Models
Category: generative-model
Posted: August 28, 2024
[Generative Model] Personalization with Selectively Informative Description (SID)
Category: generative-model
Posted: August 16, 2024
[RL] Adversarial Inverse RL
Category: reinforcement-learning
Posted: July 31, 2024
[RL] Inverse Reinforcement Learning (IRL)
Category: reinforcement-learning
Posted: July 17, 2024
[RL] Offline-Boosted Actor-Critic (OBAC)
Category: reinforcement-learning
Posted: July 17, 2024
[Generative Model] Diffusion Transformer (DiT)
Category: generative-model
Posted: July 01, 2024
Scalable Diffusion Models with Transformers
[CV] Scaling Vision Models by Image Scales
Category: computer-vision
Posted: June 28, 2024
Extending pre-trained vision model to multiple image scales
[Representation Learning] Explainability of CLIP
Category: representation-learning
Posted: June 22, 2024
[Representation Learning] What Do Self-Supervised ViTs Learn?
Category: representation-learning
Posted: June 08, 2024
Contrastive Learning v.s. Masked Image Modeling of ViT
[Graphics] Vast 3D Gaussian
Category: computer-graphics
Posted: May 06, 2024
Vast 3D Gaussians for Large Scene Reconstruction
[DB] Big Data
Category: database-system
Posted: May 05, 2024
[DB] Vector Databases
Category: database-system
Posted: May 01, 2024
[DB] Complex Data Types
Category: database-system
Posted: April 28, 2024
[RL] Offline Model-Based RL
Category: reinforcement-learning
Posted: April 25, 2024
MOReL, MOPO, and COMBO
[RL] Implicit Q-Learning (IQL)
Category: reinforcement-learning
Posted: April 23, 2024
[DB] Normal Forms
Category: database-system
Posted: April 23, 2024
[DB] Normalization
Category: database-system
Posted: April 22, 2024
[RL] Conservative Q-Learning (CQL)
Category: reinforcement-learning
Posted: April 21, 2024
[CV] Resolution-Free ViT
Category: computer-vision
Posted: April 20, 2024
[Graphics] Gaussian Splatting
Category: computer-graphics
Posted: April 09, 2024
Efficient alternative 3D representation of NeRFs
[DB] E-R Model
Category: database-system
Posted: April 01, 2024
[Graphics] Volume Rendering
Category: computer-graphics
Posted: March 28, 2024
[DB] Advanced SQL
Category: database-system
Posted: March 27, 2024
[Graphics] Local Illumination (Reflection) Model
Category: computer-graphics
Posted: March 22, 2024
[Graphics] Monte-Carlo Rendering
Category: computer-graphics
Posted: March 18, 2024
Monte-Carlo Integration for rendering
[DB] Intermediate SQL
Category: database-system
Posted: March 14, 2024
[Graphics] Radiometry & Photometry
Category: computer-graphics
Posted: March 13, 2024
[DB] Introduction to SQL
Category: database-system
Posted: March 11, 2024
[Graphics] 3D Rotation via Quaternion
Category: computer-graphics
Posted: March 04, 2024
[RL] Offline Reinforcement Learning
Category: reinforcement-learning
Posted: March 03, 2024
[DB] Relational Language
Category: database-system
Posted: February 29, 2024
[Graphics] Rendering Pipeline
Category: computer-graphics
Posted: February 29, 2024
[RL] Deep Actor Critic
Category: reinforcement-learning
Posted: February 28, 2024
[RL] Deep Q-Learning: DQN Extensions
Category: reinforcement-learning
Posted: February 26, 2024
DQN to Rainbow
[DB] Introduction to Database System
Category: database-system
Posted: February 26, 2024
[RL] Imitation Learning with Behavior Cloning (BC)
Category: reinforcement-learning
Posted: February 20, 2024
Learning a behavior policy from expert demonstrations
[RL] Deep Distributional RL
Category: reinforcement-learning
Posted: February 08, 2024
C51, QR-DQN, IQN
[CV] Camera View Adjustment
Category: computer-vision
Posted: February 05, 2024
[RL] Distributional Control
Category: reinforcement-learning
Posted: February 04, 2024
Distributional Value Iteration and Q-Learning
[DL] Mamba
Category: deep-learning
Posted: February 04, 2024
Linear-Time Sequence Modeling with Selective State Spaces
[RL] Distributional Dynamic Programming
Category: reinforcement-learning
Posted: February 01, 2024
Distributional Policy Evaluation
[DL] Natural Gradient
Category: deep-learning
Posted: February 01, 2024
The Steepest Descent in Riemannian Space
[RL] Distributional RL
Category: reinforcement-learning
Posted: January 31, 2024
Introduction to Distributional RL
[DL] Knowledge Distillation
Category: deep-learning
Posted: January 21, 2024
Distilling the Knowledge in a Neural Network
[NLP] LoRA
Category: natural-language-processing
Posted: January 09, 2024
Low-Rank Adaptation of Large Language Models
[CV] 3D Photography
Category: computer-vision
Posted: December 31, 2023
[Generative Model] Wasserstein GAN
Category: generative-model
Posted: December 21, 2023
[Measure Theory] Lp Space
Category: measure-theory
Posted: December 04, 2023
[Representation Learning] Masked Image Modeling (MIM)
Category: representation-learning
Posted: November 27, 2023
[Generative Model] 2D Prior-based 3D Generation
Category: generative-model
Posted: November 17, 2023
[Generative Model] Conditioned Diffusion Models
Category: generative-model
Posted: November 15, 2023
Zero-shot Applications/Few-shot Adaptations of Diffusion
[Measure Theory] Differentiation
Category: measure-theory
Posted: November 13, 2023
[Generative Model] Guided Diffusion
Category: generative-model
Posted: November 13, 2023
for improving sampling quality of diffusion
[Measure Theory] Radon-Nikodym Theorem
Category: measure-theory
Posted: November 06, 2023
[Generative Model] Latent Diffusion Model
Category: generative-model
Posted: November 03, 2023
A.K.A. Stable Diffusion
[Generative Model] Score Matching via SDEs
Category: generative-model
Posted: November 03, 2023
[Generative Model] Diffusion Probabilistic Models
Category: generative-model
Posted: November 03, 2023
The fundamentals of diffusion probabilistic model
[Generative Model] Score-based Generative Models
Category: generative-model
Posted: November 02, 2023
[Measure Theory] Signed Measure
Category: measure-theory
Posted: October 29, 2023
[Measure Theory] Product Measure
Category: measure-theory
Posted: October 23, 2023
[Measure Theory] Modes of convergence
Category: measure-theory
Posted: October 09, 2023
[Measure Theory] Limit Theorems
Category: measure-theory
Posted: September 29, 2023
[Measure Theory] The Lebesgue Integral
Category: measure-theory
Posted: September 27, 2023
[Measure Theory] Measurable Functions
Category: measure-theory
Posted: September 18, 2023
[Measure Theory] Cantor Set
Category: measure-theory
Posted: September 10, 2023
The standara example of Lebesgue null sets
[Measure Theory] Construction of measures
Category: measure-theory
Posted: September 09, 2023
[Measure Theory] Measures
Category: measure-theory
Posted: September 05, 2023
[Graphics] 3D Representation
Category: computer-graphics
Posted: September 04, 2023
Various ways to represent 3D structures
[Generative Model] VQ-VAE
Category: generative-model
Posted: September 02, 2023
VAE with discrete latent representations
[Generative Model] CycleGAN
Category: generative-model
Posted: September 02, 2023
Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
[Generative Model] Normalizing Flow
Category: generative-model
Posted: September 01, 2023
[NLP] BERT
Category: natural-language-processing
Posted: August 30, 2023
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
[NLP] ELMo
Category: natural-language-processing
Posted: August 29, 2023
Embeddings from Language Models
[NLP] Word2vec
Category: natural-language-processing
Posted: August 28, 2023
[Measure Theory] Algebras and Monotone class theorem
Category: measure-theory
Posted: August 28, 2023
[CV] Neural Style Transfer
Category: computer-vision
Posted: August 11, 2023
Review of the paper [CVPR 16] “A Neural Algorithm of Artistic Style” by Leon Gatys et al.
[Analysis] Neighborhoods and Limit points
Category: analysis
Posted: August 11, 2023
Before we dive into real analysis in earnest, we will go over the important and basic properties of $\mathbb{R}$ in this post so as to understand about $\mat...
[Analysis] Completeness of Real Numbers
Category: analysis
Posted: July 25, 2023
Before we dive into real analysis in earnest, we will go over the important and basic properties of $\mathbb{R}$ in this post so as to understand about $\mat...
[DL] Transposed Convolution
Category: deep-learning
Posted: July 23, 2023
Convolution for upsampling
[CV] Transformers in Vision
Category: computer-vision
Posted: May 31, 2023
Vision Transformers: ViT, Swin
[CV] CNNs for Video Classification
Category: computer-vision
Posted: May 24, 2023
[CV] CNNs for Visual Object Tracking
Category: computer-vision
Posted: May 22, 2023
SiamFC, SiamRPN, SiamRPN++, and SiamMask
[RL] Model-Based RL from Pixels
Category: reinforcement-learning
Posted: May 18, 2023
PlaNet and the Dreamer family
[RL] Model-Based Reinforcement Learning (MBRL)
Category: reinforcement-learning
Posted: May 18, 2023
Model-based approach of reinforcement learning
[CV] Visual Object Tracking
Category: computer-vision
Posted: May 15, 2023
[CV] Motion and Optical Flow
Category: computer-vision
Posted: May 10, 2023
[RL] Deep Policy Gradient
Category: reinforcement-learning
Posted: April 30, 2023
[RL] Policy Gradient
Category: reinforcement-learning
Posted: April 25, 2023
Policy-based RL
[RL] Value Function Approximation
Category: reinforcement-learning
Posted: April 14, 2023
RL combined with function approximation
[CV] Understanding of CNN via visualization
Category: computer-vision
Posted: April 10, 2023
[RL] Model-Free Control
Category: reinforcement-learning
Posted: April 04, 2023
Monte-Carlo and Temporal-Difference Control, Off-Policy Learning
[CV] Deep Learning for Image Classification
Category: computer-vision
Posted: April 03, 2023
[RL] Model-Free Prediction
Category: reinforcement-learning
Posted: March 31, 2023
Monte-Carlo Prediction, Temporal-Difference Prediction
[RL] Convergence of DP
Category: reinforcement-learning
Posted: March 25, 2023
Brief proof of convergence of DP
[RL] Dynamic Programming
Category: reinforcement-learning
Posted: March 22, 2023
Iterative algorithms for computing value functions
[CV] Image Representation using Local Features
Category: computer-vision
Posted: March 15, 2023
[CV] Blob detection and SIFT
Category: computer-vision
Posted: March 13, 2023
[Statistics] Expectation Inequalities
Category: Statistics
Posted: March 09, 2023
Expectation Inequalities
[RL] Markov Decision Process
Category: reinforcement-learning
Posted: March 08, 2023
[Linear Algebra] Sherman-Morrison and Woodbury Formulas
Category: linear-algebra
Posted: March 08, 2023
[CV] Linear Filtering and Detection
Category: computer-vision
Posted: March 08, 2023
[Generative Model] Generative Adversarial Networks
Category: generative-model
Posted: February 18, 2023
Generative models via an adversarial process
[Generative Model] Variational Autoencoder
Category: generative-model
Posted: February 15, 2023
[Generative Model] Autoregressive Models
Category: generative-model
Posted: February 14, 2023
[Linear Algebra] Matrix Calculus
Category: linear-algebra
Posted: February 09, 2023
Differentiation of matrices
[Representation Learning] CLIP
Category: representation-learning
Posted: January 27, 2023
Learning Transferable Visual Models From Natural Language Supervision
[Representation Learning] Clustering Visual Features
Category: representation-learning
Posted: January 22, 2023
Representation learning through clustering: DeepCluster, DeeperCluster, SeLa, and SwAV
[Representation Learning] DINO
Category: representation-learning
Posted: January 20, 2023
Emerging Properties in Self-Supervised ViTs
[Representation Learning] SimSiam: BYOL without the momentum encoder
Category: representation-learning
Posted: January 18, 2023
Simple Siamese Representation Learning
[Representation Learning] BYOL
Category: representation-learning
Posted: January 18, 2023
Bootstrap Your Own Latent
[Representation Learning] Contrastive Multiview Coding (CMC)
Category: representation-learning
Posted: January 16, 2023
[Representation Learning] Supervised Contrastive Learning (SupCon)
Category: representation-learning
Posted: January 16, 2023
[Representation Learning] The SimCLR Family
Category: representation-learning
Posted: January 15, 2023
SimCLR: Simple Framework for Contrastive Learning
[Representation Learning] The MoCo Family
Category: representation-learning
Posted: January 13, 2023
Momentum Contrast for Unsupervised Visual Representation Learning
[ML] Bayes Classifier
Category: machine-learning
Posted: December 27, 2022
Bayes Classifier
[ML] EM Algorithm
Category: machine-learning
Posted: December 20, 2022
Iterative method for finding MLE
[ML] Variational Inference
Category: machine-learning
Posted: December 19, 2022
Variational Inference
[Statistics] Maximum Likelihood Method - Part II
Category: Statistics
Posted: November 20, 2022
Consistency of MLE
[Statistics] Maximum Likelihood Method - Part I
Category: Statistics
Posted: November 17, 2022
Maximum Likelihood Method - Part I
[DL] Transformer
Category: deep-learning
Posted: November 16, 2022
Attention is all you need
[DL] Layer Normalization
Category: deep-learning
Posted: November 10, 2022
Attention, Self-Attention, and Multi-head Self-Attention
[DL] Attention Mechanisms
Category: deep-learning
Posted: November 10, 2022
Attention, Self-Attention, and Multi-head Self-Attention
[DL] Seq2Seq
Category: deep-learning
Posted: November 01, 2022
Sequence-to-sequence problem in machine learning
[DL] LSTM & GRU
Category: deep-learning
Posted: November 01, 2022
Gating and long term memory
[DL] Recurrent Neural Network
Category: deep-learning
Posted: October 31, 2022
Neural Networks for Sequences
[DL] Convolutional Neural Network
Category: deep-learning
Posted: October 28, 2022
Neural Networks for Images
[Statistics] Convergence of random variables
Category: Statistics
Posted: October 25, 2022
Convergence in probability and distribution
[ML] Principal Component Analysis (PCA)
Category: machine-learning
Posted: October 20, 2022
Principal Component Analysis
[Statistics] Order Statistics
Category: Statistics
Posted: October 15, 2022
Ordering random samples
[ML] Gaussian Mixture Model (GMM)
Category: machine-learning
Posted: October 14, 2022
Gaussian Mixture Model (GMM)
[ML] K-Means Clustering
Category: machine-learning
Posted: October 07, 2022
K-Means Clustering
[ML] K-Nearest Neighbors (KNN)
Category: machine-learning
Posted: October 06, 2022
K Nearest Neighbors; KNN
[Statistics] Gaussian Distribution
Category: Statistics
Posted: October 03, 2022
Univariate and Multivariate Normal Distributions
[Statistics] Gamma and Related Distributions
Category: Statistics
Posted: October 01, 2022
Gamma, Chi-squared, Beta, and Dirichlet distributions
[Statistics] Poisson Distribution
Category: Statistics
Posted: September 30, 2022
A probability distribution proposed by Siméon Denis Poisson
[Statistics] Binomial and Related Distributions
Category: Statistics
Posted: September 29, 2022
Bernoulli, Binomial, Negative binomial, Multinomial, Hypergeometric Distribution
[ML] Support Vector Machine (SVM)
Category: machine-learning
Posted: September 29, 2022
Linear SVM
[Statistics] Multivariate Distributions - Part II
Category: Statistics
Posted: September 22, 2022
The probability distributions of multi random variables
[Statistics] Multivariate Distributions - Part I
Category: Statistics
Posted: September 22, 2022
The probability distributions of multi random variables
[DL] Dropout
Category: deep-learning
Posted: September 22, 2022
Ensemble Learning and Dropout
[DL] Network Initialization
Category: deep-learning
Posted: September 22, 2022
[Statistics] Probability and Distributions - Part II
Category: Statistics
Posted: September 21, 2022
Introduction of probability and distributions
[Statistics] Probability and Distributions - Part I
Category: Statistics
Posted: September 21, 2022
Introduction of probability and distributions
[DL] Batch Normalization
Category: deep-learning
Posted: September 19, 2022
Batch Normalization, one of the most frequently used techniques in training neural networks
[ML] Logistic Regression
Category: machine-learning
Posted: September 15, 2022
Regression for Classification problem
[ML] Probabilistic Linear Regression
Category: machine-learning
Posted: September 14, 2022
Probabilistic view of linear regression
[ML] Regression Model - Part II
Category: machine-learning
Posted: September 13, 2022
Regularization & Kernel Trick of Regression Model
[ML] Regression Model - Part I
Category: machine-learning
Posted: September 13, 2022
Basic concept of Regression Model
[ML] Evaluation Methods
Category: machine-learning
Posted: August 29, 2022
Evaluation Metrics in Machine Learning
[ML] Information Theory and Entropy
Category: machine-learning
Posted: August 28, 2022
Brief Summary & Introduction to Information Theory
[ML] Bias and Variance Tradeoff
Category: machine-learning
Posted: August 21, 2022
Bias and Variance Tradeoff in machine learning
[ML] Introduction to ML
Category: machine-learning
Posted: August 21, 2022
Introduction to Machine Learning
[Linear Algebra] Pseudoinverse
Category: linear-algebra
Posted: April 16, 2022
Generalization of inverse matrix
[Linear Algebra] Low Rank Approximations
Category: linear-algebra
Posted: April 13, 2022
Application of SVD
[Linear Algebra] Singular Value Decomposition
Category: linear-algebra
Posted: April 12, 2022
Singular Value Decomposition (SVD)
[Linear Algebra] Definiteness
Category: linear-algebra
Posted: March 29, 2022
Definiteness of matrix plays an instrumental role in various areas of mathematics, such as convex optimization. It also even comes a lot in statistics, espec...
[Linear Algebra] Eigenvalue Decomposition
Category: linear-algebra
Posted: March 27, 2022
Eigenvalue Decomposition
[Linear Algebra] Coordinates and Change of Basis
Category: linear-algebra
Posted: March 24, 2022
Coordinates and Change of Bases
[Linear Algebra] Norm
Category: linear-algebra
Posted: March 21, 2022
Norm
[Linear Algebra] QR Factorization
Category: linear-algebra
Posted: March 20, 2022
QR Fatorization via Gram-Schmidt process
[Linear Algebra] Projection
Category: linear-algebra
Posted: March 19, 2022
[Linear Algebra] Determinants - Part II
Category: linear-algebra
Posted: March 19, 2022
Cramer’s rule: Formula for inverse
[Linear Algebra] Determinants - Part I
Category: linear-algebra
Posted: March 18, 2022
Basic Introduction of Determinants
[Linear Algebra] Linear Transformation
Category: linear-algebra
Posted: March 17, 2022
A linear map defined by matrix
[Linear Algebra] Row & Column Space
Category: linear-algebra
Posted: March 16, 2022
Fundamental space generated by a matrix (WIP)
[Linear Algebra] Basis and Dimension
Category: linear-algebra
Posted: March 15, 2022
Basis and Dimension of vector spaces
[Linear Algebra] Subspace
Category: linear-algebra
Posted: March 14, 2022
Subspace