feature engineering
Transforming raw data into inputs a model can use effectively, including selecting, cleaning, and reshaping data, and in finance also designing output labels.
As defined in Machine Learning in Investing
Where it comes up · 2
- Machine Learning in Investing7 claims
- How to Build a Great Product2 claims
Most important claims · 9 of 9Search all claims for “feature engineering” →
- When ML teams chase accuracy by adding features, they drift into a long tail of weak features such as camera direction or weather, which may show short-term predictive power but overfit the data and produce downstream distortions.How to Build a Great Product
- Before throwing data into a prediction system, you need a reasonable hypothesis about why the data should yield a useful prediction; otherwise teams end up adding ever more features from a long tail of weak signals that overfit the data.How to Build a Great Product
- Unsupervised clustering such as K-means can be used as a pre-processing step on high-dimensional data, producing centroids that become new features for a downstream model when the useful structure is unknown.Machine Learning in Investing
- In finance the output label is not obvious, so defining what counts as a good outcome is a massive cross-temporal credit assignment problem, and choosing a predictable proxy such as earnings or a cash flow forecast can be as important as feature engineering.Machine Learning in Investing
- The most successful practitioners use their own behavior, trades, research, and errors as inputs to their models, creating a feedback loop that has proven effective in some cases.Machine Learning in Investing
- The three classic sources of investment edge, informational, analytical, and behavioral, map in ML terms to features as information edge and feature engineering, and features and data construction are increasingly almost all of the game.Machine Learning in Investing
- Data acquisition and metadata are the most valuable edge in ML investing, and a dataset everyone can buy for 250 dollars is unlikely to contain more than 250 dollars of value, so curated, transformed, and clean data matters far more than model choice.Machine Learning in Investing
- Feature engineering in finance involves more than checking data quality; data must be transformed to fit the model, such as from log to linear scale, properly sanitized, and acquired with statistical best practice.Machine Learning in Investing
- Data that is logarithmically or exponentially distributed, such as GDP that scales with country size, should be transformed back into a linear space before building a model on it.Machine Learning in Investing