Skip to content

Making it easy to backtest and create trading bots

License

Notifications You must be signed in to change notification settings

avineshpvs/lumibot

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

README

Quickstart

Currently only alpaca is available as a brokerage service. This quickstart is about using Alpaca services.

  1. Install the package on your computer
pip install lumibot
  1. Create an alpaca paper trading account: https://app.alpaca.markets/paper/dashboard/overview
  2. Copy your API_KEY and API_SECRET from alpaca dashboard and create a credentials.py file in the root directory of this project with the following class:
class AlpacaConfig:
    API_KEY = "YOUR ALPACA API KEY"
    API_SECRET = "YOUR ALPACA API SECRET"

API_KEY and API_SECRET are obtained from alpaca paper trading dashboard: https://app.alpaca.markets/paper/dashboard/overview

  1. Create your own strategy class (See strategy section) e.g. class MyStrategy(Startegy) or import an example from our libraries
from lumibot.strategies.examples import Momentum
  1. Create another file meant to be the entrypoint of your code e.g. main.py
  2. import the following modules in your main.py:
# importing the trader class
from lumibot.traders import Trader
# importing the alpaca broker class
from lumibot.brokers import Alpaca
# importing the credential class created in step 2
from credentials import AlpacaConfig
# importing the strategy class created in step 3
from lumibot.strategies.examples import Momentum
  1. In your main.py, define variables for the budget allocated to your strategy. Additionally, define the destination of the logfile.
budget = 40000
logfile = "logs/test.log"
  1. Instantiate the Trader class and the Alpaca class like so:
trader = Trader(logfile=logfile)
broker = Alpaca(AlpacaConfig)

The Alpaca broker class needs your credentials created in step 3 to loging to your paper trading account.

  1. Instantiate your strategy class like so:
strategy = Momentum(name="momentum", budget=budget, broker=broker)
  1. Register the strategy within the trader
trader.add_strategy(strategy)
  1. Run the trader
trader.run_all()

Below an example of main.py:

# main.py
from lumibot.traders import Trader
from lumibot.brokers import Alpaca
from lumibot.strategies.examples import Momentum
from credentials import AlpacaConfig

budget = 40000
logfile = "logs/test.log"

trader = Trader(logfile=logfile)
broker = Alpaca(AlpacaConfig)

strategy = Momentum(name="momentum", budget=budget, broker=broker)
trader.add_strategy(strategy)
trader.run_all()

Backtesting

You can also run backtests very easily on any of your strategies, you do not have to modify anything in your strategies. Simply call the backtest() function on your strategy class. You will also have the details of your backtest (the portfolio value each day, unspent money, etc) put into a CSV file in the location of stats_file.

from lumibot.backtesting import YahooDataBacktesting
from my_strategy import MyStrategy

from datetime import datetime

# Pick the dates that you want to start and end your backtest
# and the allocated budget
backtesting_start = datetime(2020, 1, 1)
backtesting_end = datetime(2020, 12, 31)
budget = 100000

# Run the backtest
stats_file = "logs/my_strategy_backtest.csv"
MyStrategy.backtest(
    "my_strategy",
    budget,
    YahooDataBacktesting,
    backtesting_start,
    backtesting_end,
    stats_file=stats_file,
)

Example Strategies

We have provided a set of several example strategies that you can copy to create your own, they are located in lumibot->strategies->examples. Here is a breakdown of each example strategy:

Diversification

Allocates the budget between self.portfolio and rebalances every self.period days. For example, if there is a budget of $100,000 then we will buy $30,000 SPY, $40,000 TLT, etc. We will then buy/sell assets every day depending on self.portfolio_value (the amount of money we have in this strategy) so that we match the percentages laid out in self.portfolio.

Intraday Momentum

Buys the best performing asset from self.symbols over self.momentum_length number of minutes. For example, if TSLA increased 0.03% in the past two minutes, but SPY, GLD, TLT and MSFT only increased 0.01% in the past two minutes, then we will buy TSLA.

Momentum

Buys the best performing asset from self.symbols over self.period number of days. For example, if SPY increased 2% yesterday, but VEU and AGG only increased 1% yesterday, then we will buy SPY.

Simple

Buys and sells 10 of self.buy_symbol every day (not meant to make money, just an example). For example, Day 1 it will buy 10 shares, Day 2 it will sell all of them, Day 3 it will buy 10 shares again, etc.

Entities

bars

This object is a wrapper around pandas dataframe and contains bars data. The raw pandas dataframe object corresponds to bars.df. The dataframe has the following columns

  • open
  • high
  • low
  • close
  • volume
  • dividend
  • stock_splits

The dataframe index is of type pd.Timestamp localized at the timezone America/New_York.

Bars objects has the following fields:

  • source: the source of the data e.g. (yahoo, alpaca, ...)
  • symbol: the symbol of the bars
  • df: the pandas dataframe containing all the datas

Bars objects has the following helper methods:

  • get_last_price(): returns the closing price of the last dataframe row
  • get_last_dividend(): returns the dividend per share value of the last dataframe row
  • get_momentum(start=None, end=None): calculates the global price momentum of the dataframe. When specified, start and end will be used to filter the daterange for the momentum calculation. If none of start or end are specified the momentum will be calculated from the first row untill the last row of the dataframe.
  • get_total_volume(start=None, end=None): returns the sum of the volume column. When start and/or end is/are specified use them to filter for that given daterange before returning the total volume
  • filter(start=None, end=None): Filter the bars dataframe. When start and/or end is/are specified use them to filter for that given daterange before returning the total volume

order

This object represents an order. Each order belongs to a specific strategy. Order object has the following properties

  • strategy (str): the strategy name that this order belongs to
  • symbol (str): the string representation of the asset e.g. "GOOG" for Google
  • quantity (int): the number of shares to buy/sell
  • side (str): must be either "buy"" for buying order or "sell"" for selling order
  • limit_price (float): The limit price of the transaction. If the price becomes greater than the limit_ price after submitting the order and before being filled, the order is canceled.
  • stop_price (float): This option is for buying orders. Triggers a selling order when the asset price becomes lower and reach this value.
  • time_in_force (str): "day" by default. For more information, check this link: https://alpaca.markets/docs/trading-on-alpaca/orders/#time-in-force

Order objects have also the following helper methods

  • to_position(): convert an order to a position belonging to the same strategy with order.quantity amount of shares.
  • get_increment(): for selling orders returns - order.quantity, for buying orders returns order.quantity

*** NOTE: Limit and stop orders work as normal in live trading, but will be ignored in backtesting. Meaning that a backtest will assume limit and stop orders were never executed.

position

This object represents a position. Each position belongs to a specific strategy. Position object has the following properties

  • strategy (str): the strategy name that this order belongs to
  • symbol (str): the string representation of the asset e.g. "GOOG" for Google
  • quantity (int): the number of shares held
  • orders (list(order)): a list of orders objects that leds to the current state of the position

Position objects have also the following helper methods

  • get_selling_order(): returns an order for selling all the shares attached to this position.

Strategies

Strategy

All user defined strategies should inherit from the Strategy class.

from strategies import Strategy

class MyStrategy(Strategy):
    pass

The abstract class Strategy has global parameters with default values, and some properties that can be used as helpers to build trading logic.

The methods of this class can be split into several categories:

Lifecycle Methods These are executed at different times during the execution of the bot. These represent the main flow of a strategy, some are mandatory.

Strategy Methods These are strategy helper methods.

Broker Methods How to interact with the broker (buy, sell, get positions, etc)

Data Methods How to get price data easily

All the methods in each of these categories are described below.

Lifecycle Methods

The abstract class Strategy define a design pattern that needs to be followed by user-defined strategies. The design pattern was greatly influenced by React.js components and their lifecycle methods.

When building strategies, lifecycle methods needs to be overloaded. Trading logics should be implemented in these methods.

lifecycle methods

initialize

This lifecycle methods is executed only once, when the strategy execution starts. Use this lifecycle method to initialize parameters like:

  • self.sleeptime: the sleeptime duration between each trading iteration in minutes
  • self.minutes_before_closing: number of minutes before the market closes to stop trading
class MyStrategy(Strategy):
    def initialize(self, my_custom_parameter=True):
        self.sleeptime = 5
        self.minutes_before_closing = 15
        self.my_custom_parameter = my_custom_parameter

You can also use the initialize method to define custom parameters like my_custom_parameter in the example above. You can name these parameters however you'd like, and add as many as you'd like.

These parameters can easily be set using the strategy constructor later on.

strategy_1 = MyStrategy(
  name="strategy_1",
  budget=budget,
  broker=broker,
  my_custom_parameter=False,
  my_other_parameter=50
)

strategy_2 = MyStrategy(
  name="strategy_2",
  budget=budget,
  broker=broker,
  my_custom_parameter=True,
  my_last_parameter="SPY"
)

or just for backtesting

options = [True, False]
for option in options:
    MyStrategy.backtest(
        "my_strategy",
        budget,
        YahooDataBacktesting,
        backtesting_start,
        backtesting_end,
        stats_file=stats_file,
        my_custom_parameter=option,
        my_last_parameter="SPY"
    )

before_market_opens

This lifecycle method is executed each day before market opens. If the strategy is first run when the market is already open, this method will be skipped the first day. Use this lifecycle methods to execute business logic before starting trading like canceling all open orders.

class MyStrategy(Strategy):
    def before_market_opens(self):
        self.cancel_open_orders()

before_starting_trading

This lifecycle method is similar to before_market_opens. However, unlike before_market_opens, this method will always be executed before starting trading even if the market is already open when the strategy was first launched. After the first execution, both methods will be executed in the following order

  1. before_market_opens
  2. before_starting_trading.

Use this lifecycle method to reinitialize variables for day trading like resetting the list of blacklisted shares.

class MyStrategy(Strategy):
    def before_starting_trading(self):
        self.blacklist = []

on_trading_iteration

This lifecycle method contains the main trading logic. When the market opens, it will be executed in a loop. After each iteration, the strategy will sleep for self.sleeptime minutes. If no crash or interuption, the loop will be stopped self.minutes_before_closing minutes before market closes and will restart on the next day when market opens again.

class MyStrategy(Strategy):
    def on_trading_iteration(self):
        # pull data
        # check if should buy an asset based on data
        # if condition, buy/sell asset
        pass

before_market_closes

This lifecycle method is executed self.minutes_before_closing minutes before the market closes. Use this lifecycle method to execute business logic like selling shares and closing open orders.

class MyStrategy(Strategy):
    def before_market_closes(self):
        self.sell_all()

after_market_closes

This lifecycle method is executed right after the market closes.

class MyStrategy(Strategy):
    def after_market_closes(self):
        pass

trace_stats

Lifecycle method that will be executed after on_trading_iteration. context is a dictionary containing the result of locals() of on_trading_iteration() at the end of its execution.

locals() returns a dictionary of the variables defined in the scope where it is called.

Use this method to dump stats

import random
class MyStrategy(Strategy):
   def on_trading_iteration(self):
       google_symbol = "GOOG"
  
   def trace_stats(self, context, snapshot_before):
       print(context)
       # printing
       # { "google_symbol":"GOOG"}
       random_number = random.randint(0, 100)
       row = {"my_custom_stat": random_number}

       return row

on_abrupt_closing

This lifecycle method is called when the strategy execution was interrupted. Use this lifecycle method to execute code to stop trading gracefully like selling all assets

class MyStrategy(Strategy):
    def on_abrupt_closing(self):
        self.sell_all()

on_bot_crash

This lifecycle method is called when the strategy crashes. By default, if not overloaded, it calls on_abrupt_closing.

class MyStrategy(Strategy):
    def on_bot_crash(self, error):
        self.on_abrupt_closing()

on_new_order

This lifecycle method is called when a new order has been successfully submitted to the broker. Use this lifecycle event to execute code when a new order is being processed by the broker

Parameters:

  • order (Order): The corresponding order object being processed
class MyStrategy(Strategy):
    def on_new_order(self, order):
        self.log_message("%r is currently being processed by the broker" % order)

on_canceled_order

This lifecycle method is called when an order has been successfully canceled by the broker. Use this lifecycle event to execute code when an order has been canceled by the broker

Parameters:

  • order (Order): The corresponding order object that has been canceled
class MyStrategy(Strategy):
    def on_canceled_order(self, order):
        self.log_message("%r has been canceled by the broker" % order)

on_partially_filled_order

This lifecycle method is called when an order has been partially filled by the broker. Use this lifecycle event to execute code when an order has been partially filled by the broker.

Parameters:

  • order (Order): The order object that is being processed by the broker
  • price (float): The filled price
  • quantity (int): The filled quantity
class MyStrategy(Strategy):
    def on_partially_filled_order(self, order, price, quantity):
        missing = order.quantity - quantity
        self.log_message(f"{quantity} has been filled")
        self.log_message(f"{quantity} waiting for the remaining {missing}")

on_filled_order

This lifecycle method is called when an order has been successfully filled by the broker. Use this lifecycle event to execute code when an order has been filled by the broker

Parameters:

  • position (Position): The updated position object related to the order symbol. If the strategy already holds 200 shares of SPY and 300 has just been filled, then position.quantity will be 500 shares otherwise if it is a new position, a new position object will be created and passed to this method.
  • order (Order): The corresponding order object that has been filled
  • price (float): The filled price
  • quantity (int): The filled quantity
class MyStrategy(Strategy):
    def on_filled_order(self, position, order, price, quantity):
        if order.side == "sell":
            self.log_message(f"{quantity} shares of {order.symbol} has been sold at {price}$")
        elif order.side == "buy":
            self.log_message(f"{quantity} shares of {order.symbol} has been bought at {price}$")

        self.log_message(f"Currently holding {position.quantity} of {position.symbol}")

Strategy Methods

log_message

Logs an info message prefixed with the strategy name

Broker Methods

When a strategy is instantiated, a broker object is passed to it (Check Quickstart). The strategy is run with the passed broker object. The following shortcuts executes broker methods within the strategy.

await_market_to_open

If the market is closed, pauses code execution until market opens again. This means that on_trading_iteration will stop being called until the market opens again.

Return type: None

await_market_to_close

If the market is open, pauses code execution until market closes. This means that on_trading_iteration will stop being called until the market closes.

Return type: None

get_tracked_position

Return the strategy tracked position for a given symbol if found else None.

Parameters:

  • symbol (str): The share/asset string representation (e.g AAPL, GOOG, ...)

Return type: position

get_tracked_positions

Return all the strategy tracked positions.

Return type: list(position)

get_tracked_order

Return the strategy tracked order with the specified identifier if found else None.

Parameters:

  • identifier (str): The broker order identifier

Return type: order

get_tracked_orders

Return all the strategy tracked orders.

Return type: list(order)

get_tracked_assets

Return the strategy list of symbols for all tracked positions and orders.

Return type: list(str)

get_asset_potential_total

Check the ongoing positions and the tracked orders of the strategy and returns the total number of shares provided all orders went through. In other words, add all outstanding orders and the total value of the position for an asset.

For example, if you own 100 SPY and have an outstanding limit order of 10 shares, we will count all 110 shares.

Parameters:

  • symbol (str): the string representation of the asset/share

Return type: int

create_order

Create an order object attached to this strategy (Check the Entities, order section)

Required Parameters:

  • symbol (str): representation of the asset to buy
  • quantity (int): the quantity of the asset to buy
  • side (str): either "buy" or "sell"

Optional Parameters:

  • limit_price (default = None)
  • stop_price (default = None)
  • time_in_force (default = "day")

*** NOTE: Limit and stop orders work as normal in live trading, but will be ignored in backtesting. Meaning that a backtest will assume limit and stop orders were never executed.

Return type: order

class MyStrategy(Strategy):
    def on_trading_iteration(self):
      # Buy 100 shares of SPY
      order = self.create_order("SPY", 100, "buy")
      self.submit_order(order)

For a limit order:

class MyStrategy(Strategy):
    def on_trading_iteration(self):
      # Buy 100 shares of SPY
      order = self.create_order("SPY", 100, "buy", limit_price=100)
      self.submit_order(order)

submit_order

Submit an order. Returns the processed order.

Parameters:

  • order (order): the order object

Return type: order

class MyStrategy(Strategy):
    def my_function(self):
      # Sell 100 shares of TLT
      order = self.create_order("TLT", 100, "sell")
      self.submit_order(order)

submit_orders

Submit a list of orders

Parameters:

  • orders (list(order)): the list of orders

Return type: list(order)

cancel_order

Cancel an order.

Parameters:

  • order (order): the order to cancel

Return type: None

cancel_orders

Cancel a list of orders

Parameters:

  • orders (list(order)): the list of orders to cancel

Return type: None

cancel_open_orders

Cancel all the strategy open orders

Return type: None

sell_all

Sell all strategy current positions

Return type: None

class MyStrategy(Strategy):
   # Will sell all shares that the strategy is tracking on Ctrl + C
   def on_abrupt_closing(self):
        self.sell_all()

get_last_price

Return the last known price for a given symbol

Parameters:

  • symbol (str): the string representation of the asset/share

Return type: float

symbol = "SPY"
current_price = self.get_last_price(symbol)
logging.info(f"The current price of {symbol} is {current_price}")

get_last_prices

Return the last known prices for a list symbols

Parameters:

  • symbols (list(str)): list of asset/share representations

Return type: dict of str:float

get_tradable_assets

Return the list of tradable assets for the used broker

Return type: list(str)

Data Source Methods

When a strategy is instantiated, a broker object is passed to it (Check Quickstart). A data_source object can also be passed. When passed, the data_source will be used for extracting bars and data. If not specified, the strategy will use the broker passed as the default data source.

The following shortcuts executes data sources methods within the strategy.

get_datetime

Return the current datetime localized the datasource timezone e.g. America/New_York. During backtesting this will be the time that the strategy thinks that it is.

Return type: datetime

print(f"The current time is {self.get_datetime()}")

get_timestamp

Return the current UNIX timestamp. During backtesting this will be the UNIX timestamp that the strategy thinks that it is.

Return type: float

print(f"The current time is {self.get_timestamp()}")

get_round_minute

Returns a minute rounded datetime object.

Optional Parameters:

  • timeshift (int): a timeshift in minutes from the present.

Example:

import timedelta
# Return a midnight rounded datetime object of three minutes ago 
dt =  self.get_round_minute(timeshift=3)
print(dt)
# datetime.datetime(2021, 2, 21, 9, 17, tzinfo=<DstTzInfo 'America/New_York' EST-1 day, 19:00:00 STD>)

Return type: datetime

get_last_minute

Returns the last minute rounded datetime object. Shortcut to straregy.get_round_minute(timeshift=1)

Return type datetime.

get_round_day

Returns a day rounded datetime object.

Optional Parameters:

  • timeshift (int): a timeshift in days from the present.

Example:

import timedelta
# Return a midnight rounded datetime object of three days ago 
dt =  self.get_round_day(timeshift=3)
print(dt)
# datetime.datetime(2021, 2, 21, 0, 0, tzinfo=<DstTzInfo 'America/New_York' EST-1 day, 19:00:00 STD>)

Return type datetime

get_last_day

Returns the last day rounded datetime object. Shortcut to straregy.get_round_day(timeshift=1)

Return type datetime.

get_datetime_range

Takes as input length, timestep and timeshift and returns a tuple of datetime representing the start date and end date.

Parameters:

  • length (int): represents the number of bars required
  • timestep (str): represents the timestep, either minute (default value) or day.
  • timeshift (timedelta): None by default. If specified indicates the time shift from the present.

Return type datetime

localize_datetime

Converts an unaware datetime object (datetime object without a timezone) to an aware datetime object. The default timezone is America/New_York.

Parameter:

  • dt (datetime): the datetime object to convert.

Example:

from datetime import datetime
dt =  datetime(2021, 2, 21)
print(dt)
# datetime.datetime(2021, 2, 21, 0, 0)
dt_aware = self.localize_datetime(dt)
print(dt_aware)
# datetime.datetime(2021, 2, 21, 0, 0, tzinfo=<DstTzInfo 'America/New_York' EST-1 day, 19:00:00 STD>)

Return type: datetime

to_default_timezone

Transpose an aware datetime object to the default timezone America/New_York.

Parameter:

  • dt (datetime): the datetime object to convert.

Return type: datetime

get_symbol_bars

Return bars for a given symbol.

Parameters:

  • symbol (str): The share/asset string representation (e.g AAPL, GOOG, ...)
  • length (int): The number of rows (number of timestamps)
  • timestep (str): Either "minute"" for minutes data or "day"" for days data default value depends on the data_source (minute for alpaca, day for yahoo, ...)
  • timeshift (timedelta): None by default. If specified indicates the time shift from the present.

Example:

import timedelta
#...

# Extract 10 rows of SPY data with one minute timestep between each row
# with the latest data being 24h ago (timedelta(days=1))
bars =  self.get_symbol_bars("SPY",10,"minute",timedelta(days=1))

Return type: bars

get_bars

Return a dictionary of bars for a given list of symbols. Works the same as get_symbol_bars but take as first parameter a list of symbols.

Parameters:

  • symbol (list(str)): A list of share/asset string representations (e.g AAPL, GOOG, ...)
  • length (int): The number of rows (number of timestamps)
  • timestep (str): Either "minute"" for minutes data or "day"" for days data default value depends on the data_source (minute for alpaca, day for yahoo, ...)
  • timeshift (timedelta): None by default. If specified indicates the time shift from the present.

Return type: dict of str:bars

get_yesterday_dividend

Return dividend per share for the day before for a given symbol

Parameters:

  • symbol (str): The share/asset string representation (e.g AAPL, GOOG, ...)

Return type: float

get_yesterday_dividends

Return dividend per share for the day before for a given list of symbols. Works the same as get_yesterday_dividend but take as parameter a list of symbols.

Parameters:

  • symbol (list(str)): A list of share/asset string representations (e.g AAPL, GOOG, ...)

Return type: dict of str:float

Properties and Parameters

A strategy object has the following properties:

  • name: indicates the name of the strategy.
  • initial budget: indicates the initial budget
  • minutes_before_closing. The lifecycle method on_trading_iteration is executed inside a loop that stops only when there is only minutes_before_closing minutes remaining before market closes. By default equals to 5 minutes. This value can be overloaded when creating a strategy class in order to change the default behaviour. Another option is to specify it when instanciation the strategy class
    my_strategy = MyStrategy("my_strategy", budget, broker, minutes_before_closing=15)
  • sleeptime: Sleeptime in minute after executing the lifecycle method on_trading_iteration. By default equals to 1 minute. This value can be overloaded when creating a strategy class in order to change the default behaviour. Another option is to specify it when instanciation the strategy class
    my_strategy = MyStrategy("my_strategy", budget, broker, sleeptime=2)
  • parameters: a dictionary that contains keyword arguments passed to the constructor. These keyords arguments will be passed to the self.initialize() lifecycle method
  • is_backtesting: A boolean that indicates whether the strategy is run in live trading or in backtesting mode.
  • portfolio_value: indicates the actual values of shares held by the current strategy plus the total unspent money.
  • unspent_money: indicates the amount of unspent money from the initial budget allocated to the strategy. This property is updated whenever a transaction was filled by the broker or when dividends are paid.
  • timezone: The string representation of the timezone used by the trading data_source. By default America/New_York.
  • pytz: the pytz object representation of the timezone property.

About

Making it easy to backtest and create trading bots

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%