Skip to content

BakuCity/gtfsdb

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

GTFSDB

Join the chat at https://gitter.im/OpenTransitTools/gtfsdb

Supported Databases

  • PostgreSQL (PostGIS for Geo tables) - preferred
  • Oracle - tested
  • MySQL - tested
  • SQLite - tested

GTFS (General Transit Feed Specification) Database

Python code that will load GTFS data into a relational database, and SQLAlchemy ORM bindings to the GTFS tables in the gtfsdb.

The gtfsdb project's focus is on making GTFS data available in a programmatic context for software developers. The need for the gtfsdb project comes from the fact that a lot of developers start out a GTFS-related effort by first building some amount of code to read GTFS data (whether that's an in-memory loader, a database loader, etc...); GTFSDB can hopefully reduce the need for such drudgery, and give developers a starting point beyond the first step of dealing with GTFS in .csv file format.

Available on pypi: https://pypi.python.org/pypi/gtfsdb

Install and use via the gtfsdb source tree:

  1. Install Python 2.7, easy_install (https://pypi.python.org/pypi/setuptools) and zc.buildout (https://pypi.python.org/pypi/zc.buildout/2.5.2) on your system...
  2. git clone https://github.com/OpenTransitTools/gtfsdb.git
  3. cd gtfsdb
  4. buildout install prod NOTE: if you're using postgres, do a 'buildout install prod postgresql'
  5. bin/gtfsdb-load --database_url <db url> <gtfs file | url> examples: - bin/gtfsdb-load --database_url sqlite:https:///gtfs.db gtfsdb/tests/large-sample-feed.zip - bin/gtfsdb-load --database_url sqlite:https:///gtfs.db https://developer.trimet.org/schedule/gtfs.zip - bin/gtfsdb-load --database_url postgresql:https://postgres@localhost:5432 --is_geospatial https://developer.trimet.org/schedule/gtfs.zip NOTE: using the is_geospatial arg will take much longer to load...

The best way to get gtfsbd up and running is via the python 'buildout' and 'easy_install' tools. Highly recommended to first install easy_install (setup tools) and buildout (e.g., easy_install zc.buildout) before doing anything else.

Postgres users, gtfsdb requires the psycopg2 database driver. If you are on linux / mac, buildout will install the necessary dependencies (or re-use whatever you have in your system site-lib). If you are on windows, you most likely have to find and install a pre-compiled version (see below).

Install Steps (on Windows):

  1. Have a db - docs and examples assume Postgres/PostGIS installed https://www.postgresql.org/download/windows https://postgis.refractions.net/download/windows/
  2. Python2.7 - https://www.python.org/download/releases/2.7.6/ (python-2.7.6.msi) NOTE: see this for setting env variables correctly: https://docs.python.org/3/using/windows.html#excursus-setting-environment-variables

2a. Install Setup Tools (easy_install) https://pypi.python.org/pypi/setuptools#windows-8-powershell 2b. easy_install zc.buildout

  1. Install Psygopg2 (from binary): https://www.stickpeople.com/projects/python/win-psycopg/
  2. Check out gtfsdb from trunk with Git - see: git clone https://github.com/OpenTransitTools/gtfsdb.git
  3. cd top level of gtfsdb tree
  4. buildout install prod
  5. bin/gtfsdb-load --database_url <db url> <gtfs file | url>

NEWS:


NOTE: May 2016 ... for folks with legacy gtfsdb databases, two new columns were recently added. These two statements will keep you running against the new code w/out having to fully recreate your database from scratch:
  • ALTER TABLE routes ADD COLUMN min_headway_minutes integer;
  • ALTER TABLE calendar ADD COLUMN service_desc character varying(255);

Example Query:

-- get first stop time of each trip for route_id 1 select * from trips t, stop_times st where t.route_id = '1' and t.trip_id = st.trip_id and st.stop_sequence = 1

-- get agency name and number of routes select a.agency_name, a.agency_id, count(r.route_id) from routes r, agency a where r.agency_id = a.agency_id group by a.agency_id, a.agency_name order by 3 desc

About

GTFS ORM using SQLAlchemy

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 100.0%