- PostgreSQL (PostGIS for Geo tables) - preferred
- Oracle - tested
- MySQL - tested
- SQLite - tested
Python code that will load GTFS data into a relational database, and SQLAlchemy ORM bindings to the GTFS tables in the gtfsdb.
The gtfsdb project's focus is on making GTFS data available in a programmatic context for software developers. The need for the gtfsdb project comes from the fact that a lot of developers start out a GTFS-related effort by first building some amount of code to read GTFS data (whether that's an in-memory loader, a database loader, etc...); GTFSDB can hopefully reduce the need for such drudgery, and give developers a starting point beyond the first step of dealing with GTFS in .csv file format.
Available on pypi: https://pypi.python.org/pypi/gtfsdb
- Install Python 2.7, easy_install (https://pypi.python.org/pypi/setuptools) and zc.buildout (https://pypi.python.org/pypi/zc.buildout/2.5.2) on your system...
- git clone https://github.com/OpenTransitTools/gtfsdb.git
- cd gtfsdb
- buildout install prod NOTE: if you're using postgres, do a 'buildout install prod postgresql'
- bin/gtfsdb-load --database_url <db url> <gtfs file | url> examples: - bin/gtfsdb-load --database_url sqlite:https:///gtfs.db gtfsdb/tests/large-sample-feed.zip - bin/gtfsdb-load --database_url sqlite:https:///gtfs.db https://developer.trimet.org/schedule/gtfs.zip - bin/gtfsdb-load --database_url postgresql:https://postgres@localhost:5432 --is_geospatial https://developer.trimet.org/schedule/gtfs.zip NOTE: using the is_geospatial arg will take much longer to load...
The best way to get gtfsbd up and running is via the python 'buildout' and 'easy_install' tools. Highly recommended to first install easy_install (setup tools) and buildout (e.g., easy_install zc.buildout) before doing anything else.
Postgres users, gtfsdb requires the psycopg2 database driver. If you are on linux / mac, buildout will install the necessary dependencies (or re-use whatever you have in your system site-lib). If you are on windows, you most likely have to find and install a pre-compiled version (see below).
- Have a db - docs and examples assume Postgres/PostGIS installed https://www.postgresql.org/download/windows https://postgis.refractions.net/download/windows/
- Python2.7 - https://www.python.org/download/releases/2.7.6/ (python-2.7.6.msi) NOTE: see this for setting env variables correctly: https://docs.python.org/3/using/windows.html#excursus-setting-environment-variables
2a. Install Setup Tools (easy_install) https://pypi.python.org/pypi/setuptools#windows-8-powershell 2b. easy_install zc.buildout
- Install Psygopg2 (from binary): https://www.stickpeople.com/projects/python/win-psycopg/
- Check out gtfsdb from trunk with Git - see: git clone https://github.com/OpenTransitTools/gtfsdb.git
- cd top level of gtfsdb tree
- buildout install prod
- bin/gtfsdb-load --database_url <db url> <gtfs file | url>
- NOTE: May 2016 ... for folks with legacy gtfsdb databases, two new columns were recently added. These two statements will keep you running against the new code w/out having to fully recreate your database from scratch:
- ALTER TABLE routes ADD COLUMN min_headway_minutes integer;
- ALTER TABLE calendar ADD COLUMN service_desc character varying(255);
-- get first stop time of each trip for route_id 1 select * from trips t, stop_times st where t.route_id = '1' and t.trip_id = st.trip_id and st.stop_sequence = 1
-- get agency name and number of routes select a.agency_name, a.agency_id, count(r.route_id) from routes r, agency a where r.agency_id = a.agency_id group by a.agency_id, a.agency_name order by 3 desc