# Difference between revisions of "Pair Trading Models"

Line 137: | Line 137: | ||

* we exit short position when ''Z(t)'' <= E<sub>x</sub> | * we exit short position when ''Z(t)'' <= E<sub>x</sub> | ||

* we exit long position when ''Z(t)'' >= -E<sub>x</sub> | * we exit long position when ''Z(t)'' >= -E<sub>x</sub> | ||

− | |||

− | |||

== Kalman Model == | == Kalman Model == | ||

Line 165: | Line 163: | ||

'''This model is provided for education purposes only.''' | '''This model is provided for education purposes only.''' | ||

+ | |||

+ | == Kalman-grid Model (v2) == | ||

+ | After one year of experience of testing the [[Pair Trading Models#Kalman-grid Model (v1)|Kalman-grid Model (v1)]] and researching [https://en.wikipedia.org/wiki/Machine_learning machine learning principles], we have spent few weeks of work on developing new version of Kalman Grid model, redesigned from scratch. | ||

+ | |||

+ | This model brings the superior performance of Kalman filter design, but it also dealt with all the flaws: | ||

+ | * all parameters of Kalman filter eliminated (&delta, V<sub>e</sub>) - they are auto-estimated by the grid logic on every step | ||

+ | * increased average performance compared to old version | ||

+ | * fixed issues of old version which prevented model to trade too often | ||

+ | |||

+ | How does it work? Instead of single strategy (and single Kalman filter), the whole grid of Kalman filters is evaluated by a proprietary system at the same time. Then, machine learning principles are applied to rank particular Kalman filter performance. Another algorithm is then used to figure filter outputs (slope, intercept, standard deviation) from the whole grid. The whole grid actually behaves like a single Kalman filter, but with no need to provide any parameters. | ||

+ | |||

+ | As a side effect, the entry threshold is also auto-optimized by the grid system itself. | ||

+ | |||

+ | === Model Support === | ||

+ | * in PTL backtester: '''yes''' | ||

+ | * in PTL portfolio backtester: '''planned Dec 2016''' | ||

+ | * in PTL Trader: '''planned Dec 2016''' | ||

+ | |||

+ | === Model Neutrality === | ||

+ | For Kalman Grid Model, we support both '''dollar neutral''' (equal dollar amount invested to each leg) and '''beta neutral''' regimes. | ||

+ | |||

+ | === Model Parameters === | ||

+ | * exit threshold E<sub>x</sub> for Z-score, allowed value is <-1, 0> - this is the only parameter left to fine-tune. It determines how aggressively the model will trade: 0 means that trades are closed each time the forecast error crosses zero point (most aggressive mode, many trades), -1 means that trades are closed when the opposite band is crossed (less aggressive, less trades). -1 is recommended as it is more robust, 0 can boost performance at some well cointegrated pairs. | ||

= Deprecated Models = | = Deprecated Models = |

## Revision as of 12:32, 15 September 2016

Pair Trading Lab offers pair trading algorithms based on various mathematical models. These are models currently supported in PTL:

## Contents |

## Ratio Model

This is one of the standard pair trading models described in literature. It is based in ratio of instrument prices, moving average and standard deviation. In other words, it is based on Bollinger Bands indicator.

Since Nov 27th 2014, this model also supports additional RSI filter you can use in addition to Bollinger Bands method.

### Model Support

- in PTL backtester:
**yes**(max Z-score not supported) - in PTL portfolio backtester:
**yes** - in PTL Trader:
**yes**(RSI supported since v1.2.0)

### Model Neutrality

We currently support only dollar-neutral version of this model, which means we allocate same amounts of margin to both legs based on current prices at the time of opening the position.

### Model Parameters

- entry threshold E
_{n}for Z-score, typical value range is <1.5, 2.5>, 2.0 is used most often - exit threshold E
_{x}for Z-score, typical value is <-0.5, 0.5>, 0 is used most often...we allow positive values only for now - max Z-score E
_{max}(optional, to filter out extremes, typical value is >4 if used) - moving average period P
_{m}(typical range <10, 100>), default = 15 - moving average type T (algorithm), default = exponential
- standard deviation period P
_{s}(typical range <10, 100>), default = 15 - entry mode (simple, uptick, downtick)
- RSI period and threshold (optional RSI filtering)

### Description

- we trade pair of stocks A, B, having price series
*A(t)*,*B(t)* - we need to calculate ratio time series
*R(t)*=*A(t)*/*B(t)* - let's apply moving average of type T with period P
_{m}on*R(t)*to get time series*M(t)* - let's apply standard deviation with period P
_{s}on*R(t)*to get time series*S(t)* - now we can create Z-score series
*Z(t)*as*Z(t)*= (*R(t)*-*M(t)*) /*S(t)*, this time series can give us z-score to signal trading decision directly - another common approach (to visualize) is to create bands and put it above the moving average
*M(t)*:- upper entry band
*U*=_{n}(t)*M(t)*+*S(t)** E_{n} - lower entry band
*L*=_{n}(t)*M(t)*-*S(t)** E_{n} - upper exit band
*U*=_{x}(t)*M(t)*+*S(t)** E_{x} - lower exit band
*L*=_{x}(t)*M(t)*-*S(t)** E_{x} - these bands are actually the same bands as in Bollinger Bands indicator and we can use crossing of
*R(t)*and bands as trade signals

- upper entry band

### Entering Position

There are certain possible approaches how to interpret model statistics in order to make trading decisions. For entering position, we used to call them **entry modes**. This is the list of them and description how they work:

- entry mode =
**simple**:- to open short pair position, it is simple enough if the Z-score
*Z(t)*>= E_{n}(equivalent to*R(t)*>=*U*)_{n}(t) - to open long pair position, it is simple enough if the Z-score
*Z(t)*<= -E_{n}(equivalent to*R(t)*<=*L*)_{n}(t)

- to open short pair position, it is simple enough if the Z-score
- entry mode =
**uptick**: same as simple, but in addition, previous Z-score must be below the entry band (so we cross the band from inside to outside):- to open short pair position, we require
*Z(t)*>= E_{n}(equivalent to*R(t)*>=*U*)_{n}(t)**and***Z(t-1)*< E_{n}(same as*R(t-1)*<*U*)_{n}(t-1) - to open long pair position, we require
*Z(t)*<= -E_{n}(equivalent to*R(t)*<=*L*)_{n}(t)**and***Z(t-1)*> -E_{n}(same as*R(t-1)*>*L*)_{n}(t-1)

- to open short pair position, we require
- entry mode =
**downtick**: we wait for the Z-score crossing back the band from outside to inside:- to open short pair position, we require
*Z(t)*< E_{n}**and***Z(t-1)*>= E_{n}**and***Z(t)*> E_{x} - when using bands, it is the same as having
*R(t)*<*U*_{n}(t)**and***R(t-1)*>=*U*_{n}(t-1)**and***R(t)*>*U*_{x}(t) - to open long pair position, we require
*Z(t)*> -E_{n}**and***Z(t-1)*<= -E_{n}**and***Z(t)*< -E_{x} - when using bands, it is the same as having
*R(t)*>*L*_{n}(t)**and***R(t-1)*<=*L*_{n}(t-1)**and***R(t)*<*L*_{x}(t)

- to open short pair position, we require

Why do we have the **simple entry mode**? In normal situations and backtests, it gives same results as the **uptick mode**. But the difference comes up while trading multiple pairs in portfolio. The simple mode allows you to jump in the position immediately after a new slot is freed, regardless of the previous Z-scores.

**Which entry mode is better?** Hard to tell, sometimes the uptick, sometimes the downtick. You have to do your homework and decide, which idea suits your trading style better. In general, uptick/simple mode is more aggressive, as it does not wait for first signs of spread mean reversion.

### Exiting Position

For exiting position, we always use only these simple rules:

- we exit short position when
*Z(t)*<= E_{x}(equivalent to*R(t)*<=*U*)_{x}(t) - we exit long position when
*Z(t)*>= -E_{x}(equivalent to*R(t)*>=*L*)_{x}(t)

### Moving Average Types

You can choose from these moving average algorithms:

- Simple Moving Average (SMA)
- Exponential Moving Average (EMA)
- Weighted Moving Average (WMA)
- Double Exponential Moving Average (DEMA)
- Triple Exponential Moving Average (TEMA)
- Triangular Moving Average (TMA)
- Kaufman Adaptive Moving Average (KAMA)
- MESA Adaptive Moving Average (MAMA)
- Triple Exponential T3 Moving Average

Which one is the best? It depends, you have to test for yourself. They mostly differ in the term of memory and how fast they react to changes. Industry standard and the default is EMA. We suggest to try all of them on some sample pair to see how they work.

### RSI Filtering

You can combine the Z-score/Bollinger Band model with RSI indicator applied on the ratio *R(t)*. RSI filter will be automatically enabled if you set RSI threshold to other value than zero. RSI filter is combined with the Z-score rules using **AND** operator (**both** entry rule and RSI entry rule must be true to open a position).

You can also change the RSI period if you want (default period = 15).

RSI Threshold is value between 0 and 50. Because RSI indicator value oscillates between 0 and 100 (where 50 = mean), your threshold value is just used to set real thresholds for RSI:

- let's assume RSI Period P
_{r}was entered - effective RSI value threshold is then 50+P
_{r}(upper) and 50-P_{r}(lower) - you can see both thresholds in the example image at the right side

Example:

- RSI Threshold entered is 15
- then, short positions are only opened, if RSI >= 65 (50+15)
- long positions are only opened, if RSI <=35 (50-15)

Useful hint: if you want to control entry rules just by RSI, you can set Entry Mode to simple and Entry Threshold to some low value.

## Residual Model

Residual mode is based on linear regression. In literature it has been also referred to as the **cointegration approach**. Linear regression of both stocks is constructed in order to fit a linear relationship between both instruments and estimate its best parameters using the OLS method (Ordinary Least Squares). Then, standard deviation is applied on the regression residuals to estimate its statistical properties and calculate Z-scores.

This particular implementation is very simple. The regression is constructed using floating window of a fixed period, the same period is used for calculating the standard deviation.

### Model Support

- in PTL backtester:
**yes**(max Z-score not supported) - in PTL portfolio backtester:
**yes** - in PTL Trader:
**yes**(uptick and downtick modes are supported since v1.2.0)

### Model Neutrality

We currently support only dollar-neutral version of this model, which means we allocate same amounts of margin to both legs based on current prices at the time of opening the position.

### Model Parameters

- entry threshold E
_{n}for Z-score, typical value range is <1.2, 2.5>, 1.5 is used most often - exit threshold E
_{x}for Z-score, typical value is <-0.5, 0.5>, 0 is used most often...we allow positive values only for now - max Z-score E
_{max}(optional, to filter out extremes, typical value is >4 if used) - linear regression period P (floating window is used), typical range <15, 300>
- entry mode (simple, uptick, downtick)

### Description

- we trade pair of stocks A, B, having price series
*A(t)*,*B(t)* - first we need to construct a linear regression between
*A(t)*,*B(t)*using OLS, where*A(t)*=*β***B(t)*+*α*+*R(t)* - because we use floating window of period P (we calculate new regression each day), we actually get new series
*β(t)*,*α(t)*,*R(t)*, where*β(t)*,*α(t)*are series of regression coefficients and*R(t)*are residuals (prediction errors) -
*R(t)*=*A(t)*- (*β(t)***B(t)*+*α(t)*) - then we apply standard deviation of period P on residuals
*R(t)*and we put it to*S(t)* - now we can create Z-score series
*Z(t)*as*Z(t)*=*R(t)*/*S(t)*, this time series can give us z-score to signal trading decision directly

### Entering Position

There are certain possible approaches how to interpret model statistics in order to make trading decisions. For entering position, we used to call them **entry modes**. This is the list of them and description how they work:

- entry mode =
**simple**:- to open short pair position, it is simple enough if the Z-score
*Z(t)*>= E_{n} - to open long pair position, it is simple enough if the Z-score
*Z(t)*<= -E_{n}

- to open short pair position, it is simple enough if the Z-score
- entry mode =
**uptick**: same as simple, but in addition, previous Z-score must be below the entry band (so we cross the band from inside to outside):- to open short pair position, we require
*Z(t)*>= E_{n}**and***Z(t-1)*< E_{n} - to open long pair position, we require
*Z(t)*<= -E_{n}**and***Z(t-1)*> -E_{n}

- to open short pair position, we require
- entry mode =
**downtick**: we wait for the Z-score crossing back the band from outside to inside:- to open short pair position, we require
*Z(t)*< E_{n}**and***Z(t-1)*>= E_{n}**and***Z(t)*> E_{x} - to open long pair position, we require
*Z(t)*> -E_{n}**and***Z(t-1)*<= -E_{n}**and***Z(t)*< -E_{x}

- to open short pair position, we require

### Exiting Position

For exiting position, we always use only these simple rules:

- we exit short position when
*Z(t)*<= E_{x} - we exit long position when
*Z(t)*>= -E_{x}

## Kalman Model

This model is based on Kalman Filter. In this case, the filter is used here instead of linear regression to determine proper hedge ratio, deviation from the mean and the standard deviation of the spread. The advantage is that this filter is superior when dealing with noise compared to OLS or TLS methods, also it does not have any lookback period to optimize. The disadvantage is that is has another parameters (like δ) to find out.

We strongly recommend to read more details about Kalman filter applications in pair trading in this book.

While Kalman Filter also estimates the standard deviation on the fly, our implementation also supports a possibility of having an auxiliary standard deviation indicator applied directly on the forecast error time series. The advantage is that you get less sensitivity on the δ parameter, but on the other hand a new lookback parameter is introduced.

**Kalman Model has too sensitive parameters which prevents it to be traded in reality. This model is provided only for education purposes - to be able to see how parameters affects its performance. Use Kalman Grid model for any serious trading.**

### Model Support

- in PTL backtester:
**yes**(max Z-score not supported) - in PTL portfolio backtester:
**not planned** - in PTL Trader:
**not planned**

### Model Neutrality

For Kalman Model, we support both **dollar neutral** (equal dollar amount invested to each leg) and **beta neutral** regimes.

### Model Parameters

- Kalman filter transition covariance δ, typical value is 0.0001 -
**unfortunately this model is very sensitive to this parameter especially when using standard deviation estimate coming from the Kalman filter itself** - Kalman filter observation covariance V
_{e}, typical value is 0.001 - Auxiliary standard deviation period - if equal to zero, Kalman filter is used to estimate standard deviation, if non-zero, auxiliary standard deviation indicator with this period is used (an the estimate from Kalman filter is ignored)
- Unstable period = how many Kalman filter observations are ignored at the beginning (first observations are quite unstable)

**This model is provided for education purposes only.**

## Kalman-grid Model (v2)

After one year of experience of testing the Kalman-grid Model (v1) and researching machine learning principles, we have spent few weeks of work on developing new version of Kalman Grid model, redesigned from scratch.

This model brings the superior performance of Kalman filter design, but it also dealt with all the flaws:

- all parameters of Kalman filter eliminated (&delta, V
_{e}) - they are auto-estimated by the grid logic on every step - increased average performance compared to old version
- fixed issues of old version which prevented model to trade too often

How does it work? Instead of single strategy (and single Kalman filter), the whole grid of Kalman filters is evaluated by a proprietary system at the same time. Then, machine learning principles are applied to rank particular Kalman filter performance. Another algorithm is then used to figure filter outputs (slope, intercept, standard deviation) from the whole grid. The whole grid actually behaves like a single Kalman filter, but with no need to provide any parameters.

As a side effect, the entry threshold is also auto-optimized by the grid system itself.

### Model Support

- in PTL backtester:
**yes** - in PTL portfolio backtester:
**planned Dec 2016** - in PTL Trader:
**planned Dec 2016**

### Model Neutrality

For Kalman Grid Model, we support both **dollar neutral** (equal dollar amount invested to each leg) and **beta neutral** regimes.

### Model Parameters

- exit threshold E
_{x}for Z-score, allowed value is <-1, 0> - this is the only parameter left to fine-tune. It determines how aggressively the model will trade: 0 means that trades are closed each time the forecast error crosses zero point (most aggressive mode, many trades), -1 means that trades are closed when the opposite band is crossed (less aggressive, less trades). -1 is recommended as it is more robust, 0 can boost performance at some well cointegrated pairs.

# Deprecated Models

These models are deprecated and no longer supported:

## Orthogonal Model

This model is similar to Residual model, but it uses orthogonal regression/total least squares instead of OLS. In addition, it has some extra features. Linear regression of both stocks is constructed in order to fit a linear relationship between both instruments and estimate its best parameters using the TLS method (Total Least Squares). Then, standard deviation is applied on the regression residuals to estimate its statistical properties and calculate Z-scores.

The regression is constructed using floating window of a fixed period. Standard deviation indicator is then applied to regression residuals (it can have a different period).

### Model Support

- no longer supported

### Model Neutrality

We support both **dollar neutral** (equal dollar amount invested to each leg) and **beta neutral** regimes. In beta neutral mode, we determine the hedge ratio from TLS regression too, but using significantly longer floating period (240 or more).

### Model Parameters

- entry threshold E
_{n}for Z-score, typical value range is <1.2, 2.5>, 1.5 is used most often - entry threshold E
_{nd}for Z-score, typical value range is slightly less than E_{n}- used as another band for downtick mode only - exit threshold E
_{x}for Z-score, typical value is <-0.5, 0.5>, 0 is used most often...we allow positive values only for now - max Z-score E
_{max}(optional, to filter out extremes, typical value is >4 if used) - linear regression period P (floating window is used), typical range <50, 300>
- standard deviation period, typical range <25, 100>
- entry mode (simple, uptick, downtick)

(section still under construction)

**Important: TLS is numerically far less stable than OLS, especially for floating-window case with short periods. For this model, you should use periods of 40 or more. But even in case that TLS provides unstable results (you can see it as spikes in β), residuals are still stable.**

### Description

- see the math behind the regression itself here (Deming regression is a 2D case of TLS)
- from the regression, we get coefficients
*β*,*α*and orthogonal residuals*R(t)* - then we apply standard deviation of period P on residuals
*R(t)*and we put it to*S(t)* - now we can create Z-score series
*Z(t)*as*Z(t)*=*R(t)*/*S(t)*, this time series can give us z-score to signal trading decision directly

### Entering Position

There are certain possible approaches how to interpret model statistics in order to make trading decisions. For entering position, we used to call them **entry modes**. This is the list of them and description how they work:

- entry mode =
**simple**:- to open short pair position, it is simple enough if the Z-score
*Z(t)*>= E_{n} - to open long pair position, it is simple enough if the Z-score
*Z(t)*<= -E_{n}

- to open short pair position, it is simple enough if the Z-score
- entry mode =
**uptick**: same as simple, but in addition, previous Z-score must be below the entry band (so we cross the band from inside to outside):- to open short pair position, we require
*Z(t)*>= E_{n}**and***Z(t-1)*< E_{n} - to open long pair position, we require
*Z(t)*<= -E_{n}**and***Z(t-1)*> -E_{n}

- to open short pair position, we require
- entry mode =
**downtick**: we wait for the Z-score crossing back the band from outside to inside:- to open short pair position, we require
*Z(t)*< E_{n}**and***Z(t-1)*>= E_{n}**and***Z(t)*> E_{nd} - to open long pair position, we require
*Z(t)*> -E_{n}**and***Z(t-1)*<= -E_{n}**and***Z(t)*< -E_{nd}

- to open short pair position, we require

### Exiting Position

For exiting position, we always use only these simple rules:

- we exit short position when
*Z(t)*<= E_{x} - we exit long position when
*Z(t)*>= -E_{x}

## Kalman-grid Model (v1)

This model follows up on the Kalman model and it tries to fix its biggest flaw - sensitivity to δ parameter. How? By executing **whole grid** of Kalman filters with different δ settings at the same time.

Then it evaluates separate backtests of underlying Kalman strategies and from their measures it creates weights for calculating α, β and standard deviation. This process goes on incrementally (at each price observation!).

**This model has been deprecated in favor of Kalman Grid V2**

### Model Support

- no longer supported

### Model Neutrality

For Kalman Grid Model, we support both **dollar neutral** (equal dollar amount invested to each leg) and **beta neutral** regimes.

### Model Parameters

- Kalman Grid filter observation covariance V
_{e}, typical value is 0.001