Monte Carlo Simulation of Risk

An interesting method in simulation and modeling is the Monte Carlo simulation. Wikipedia describes them best: Monte Carlo methods can be used to solve any problem having a probabilistic interpretation. Methods vary, but tend to follow a particular pattern: 1. Define a domain of possible inputs2. Generate inputs randomly from a probability distribution over the domain3….

Detecting Feature Interaction Using Machine Learning

On a previous post I suggested it is important to be able to detect interaction in regression analysis in order to create a better model of a dependent variable. I showed that by creating a new feature (column) in my dataset that represented the known relationship between two other features, a much better multiple linear regression…

Interaction Terms in Regression Analysis

Introduction and Example I have recently run into a feature engineering problem with regression analysis I have been doing at work. The issue is that not all independent variables that may be good predictors for a dependent variable are additive. Some might need to be multiplied together with some constant, or manipulated together before being…