Skip to content

Latest commit

 

History

History

usecase10

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Readme

This documentation describes how to access external SQL databases with JDBC.

Greenplum provides capability to read data from external databases including Greenplum, Postgresql, MySQL, Oracle and others.

Table of Contents

  1. Pre-requisites
  2. Run this example
  3. Configure Greenplum
  4. Configure Postgresql

Pre-requisites:

Run this example

You can use this script 'runDocker.sh' to run these use Cases

For example, you can use this example ./runDocker.sh -t usecase3 -c up

$ ./runDocker.sh -t usecase3 -c up
Creating network "usecase3_mynetwork" with driver "bridge"
Creating gpdb5a ... done
Creating gpdb5b ... done
Attaching to gpdb5b, gpdb5a
gpdb5b    | /etc/sysconfig/run-parts
gpdb5a    | /etc/sysconfig/run-parts
gpdb5b    | /usr/bin/run-parts
gpdb5a    | /usr/bin/run-parts
gpdb5b    | Running /docker-entrypoint.d
gpdb5b    | /usr/bin/run-parts /docker-entrypoint.d
gpdb5a    | Running /docker-entrypoint.d
gpdb5a    | /usr/bin/run-parts /docker-entrypoint.d
gpdb5a    | /docker-entrypoint.d/startInit.sh:

Configure Greenplum

  1. You can access this Greenplum docker instance (gpdb5a)
$ docker exec -it gpdb5a bin/bash
[root@gpdbsne /]#
[root@gpdbsne /]#

Or access Greenplum docker instance (gpdb5b)

$ docker exec -it gpdb5b bin/bash
[root@gpdbsne /]#
[root@gpdbsne /]#
  1. Next, you can run GPDB by using this command startGPDB.sh
[root@gpdbsne /]# startGPDB.sh
SSHD is running
SSHD is running...
20180508:23:38:58:000150 gpstart:gpdbsne:gpadmin-[INFO]:-Starting gpstart with args: -a
20180508:23:38:58:000150 gpstart:gpdbsne:gpadmin-[INFO]:-Gathering information and validating the environment...
...
20180508:23:39:11:000370 gpstart:gpdbsne:gpadmin-[ERROR]:-gpstart error: Master instance process running
[root@gpdbsne /]#
  1. You can use gpadmin account to create sample database and table. The following example uses setupDB.sh under /code/usecase2/PXFExamples/.
# su - gpadmin
Last login: Tue May  8 23:39:11 UTC 2018 on pts/1
[gpadmin@gpdbsne ~]$ cd /code/usecase2/PXFExamples/
[gpadmin@gpdbsne PXFExamples]$ ./setupDB.sh
CREATE EXTENSION
GRANT
GRANT
psql:./gpdb_sample.sql:5: NOTICE:  table "pxf_jdbc_postgres_table1" does not exist, skipping
DROP EXTERNAL TABLE
CREATE EXTERNAL TABLE
psql:./gpdb_sample.sql:13: NOTICE:  table "pxf_jdbc_postgres_testpxf" does not exist, skipping
DROP EXTERNAL TABLE
CREATE EXTERNAL TABLE
[gpadmin@gpdbsne PXFExamples]$

Configure Postgresql

  1. You can access this Postgresql docker instance
$ docker exec -it postgresql bin/bash
root@postgresql:/#
  1. Next, you can use postgres user by using su postgres.

This example shows how to use psql to login to the postgres database.

root@postgresql:/# su postgres
postgres@postgresql:/$ psql -d postgres
Welcome to psql 8.3.23, the PostgreSQL interactive terminal.

Type:  \copyright for distribution terms
       \h for help with SQL commands
       \? for help with psql commands
       \g or terminate with semicolon to execute query
       \q to quit

postgres=#

Reference:

Greenplum - PXF

Pivotal Greenplum

The Pivotal Greenplum Database (GPDB) is an advanced, fully featured, open source data warehouse. It provides powerful and rapid analytics on petabyte scale data volumes. Uniquely geared toward big data analytics, Greenplum Database is powered by the world’s most advanced cost-based query optimizer delivering high analytical query performance on large data volumes. https://pivotal.io/pivotal-greenplum