Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

We need to install packages for handling parquet_fdw #460

Closed
NyakudyaA opened this issue Oct 27, 2023 · 1 comment
Closed

We need to install packages for handling parquet_fdw #460

NyakudyaA opened this issue Oct 27, 2023 · 1 comment

Comments

@NyakudyaA
Copy link
Collaborator

Feature description

We need to handle https://github.com/adjust/parquet_fdw, Currently, the blocker for this is adjust/parquet_fdw#73

A work around would be to add this locally as a script in

#!/usr/bin/env bash
apt-get update \
    && apt-get -y --no-install-recommends install git python3-pip unzip
pip install pyarrow==13.0.* --break-system-packages
wget https://apache.jfrog.io/artifactory/arrow/$(lsb_release --id --short | tr 'A-Z' 'a-z')/apache-arrow-apt-source-latest-$(lsb_release --codename --short).deb
apt install -y -V ./apache-arrow-apt-source-latest-$(lsb_release --codename --short).deb && rm ./apache-arrow-apt-source-latest-bookworm.deb
apt update
apt install -y -V  libarrow-dev 
apt install -y -V libarrow-glib-dev 
apt install -y -V libarrow-dataset-dev 
apt install -y -V libarrow-dataset-glib-dev 
apt install -y -V libarrow-acero-dev 
apt install -y -V libarrow-flight-dev 
apt install -y -V libarrow-flight-glib-dev 
apt install -y -V libarrow-flight-sql-dev 
apt install -y -V libarrow-flight-sql-glib-dev 
apt install -y -V libparquet-dev 
apt install -y -V libparquet-glib-dev 


wget https://github.com/adjust/parquet_fdw/archive/refs/heads/master.zip
unzip master.zip && rm master.zip
cd parquet_fdw-master
wget https://github.com/adjust/parquet_fdw/files/12667231/parquet_fdw_16.diff.zip
unzip parquet_fdw_16.diff.zip && rm parquet_fdw_16.diff.zip
git apply -v parquet_fdw_16.diff
make install -j 6

apt get purge git unzip

Additional context

Fix when a PR is merged

@NyakudyaA
Copy link
Collaborator Author

Seems upstream repo is not that active, closing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant