-
Notifications
You must be signed in to change notification settings - Fork 380
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[VL] Fix for centos9 build of Gluten #6183
base: main
Are you sure you want to change the base?
[VL] Fix for centos9 build of Gluten #6183
Conversation
Thanks for opening a pull request! Could you open an issue for this pull request on Github Issues? https://github.com/apache/incubator-gluten/issues Then could you also rename commit message and pull request title in the following format?
See also: |
…pache#6130 What changes were proposed in this pull request? Fix crash when driver send shutdown command to executor (Fixes: apache#6122)
…ache#6192 What changes were proposed in this pull request? (Please fill in changes proposed in this fix) (Fixes: apache#6178) How was this patch tested? Test by ut
[VL] Support KnownNullable for Spark 3.5.
f45966f17 by Deepak Majeti, Use separate headers for DWRF Reader Writer registration API (10132) 00485536f by Zac Wen, Switch to storage read if SSD cache load fails (10256) 3c2cc4b26 by Bikramjeet Vig, Fix NaN handling for in-predicate (10115) 18c4d5e2b by Kevin Wilfong, Capture MemoryArbitrationContext and ThreadDebugInfo in AsyncSource and restore them when invoking make (10186) 171174833 by Jimmy Lu, Count IO execution time in ExponentialBackoff retry policy (10286) 24f5aed63 by zhli1142015, Add support for DECIMAL input to greatest and least Spark functions (10195) 8faac7bf2 by zhli1142015, Add log Spark function (10243) c97e7fcc8 by Kevin Wilfong, Fix parallel spills lead to crashes in approx_percentile (10268) 54b2ce9a5 by Reetika Agrawal, Add benchmark for IcebergSplitReader (9849) dcd49ca38 by Krishna Pai, Restrict CAST of string to boolean (9833) ca5e409aa by xiaoxmeng, Only load stripe footer in buffer input support sync load (10276) 652cf372e by Zac Wen, Fix memory cache hit underreporting in ioStats (10272) a2366523d by yanngyoung, Add order by plan for memory arbitration fuzzer (10255) a5b443a70 by Wei He, Update header guards in files in velox/external/date to avoid collision (10269)
… for supporting sink transform (apache#6197) [CH] [Part 2] Support CH backend with Spark3.5 - Prepare for supporting sink transform * [Refactor] remove duplicate codes * Add NativeWriteChecker * [Prepare to commit] getExtendedColumnarPostRules from Spark shim
* Support aggreate avg return decimal * update version * fix rebase * add ut
Add more configs for AWS s3 spark.gluten.velox.fs.s3a.retry.mode spark.gluten.velox.fs.s3a.connect.timeout spark.hadoop.fs.s3a.retry.limit spark.hadoop.fs.s3a.connection.maximum
[CH] Support flatten Co-authored-by: liuneng1994 <[email protected]>
[VL] Fix greatest and least function tests.
[VL] Daily Update Velox Version (2024_06_25) (apache#6204) Velox main changes: ``` 1225f773f by joey.ljy, Add session timezone to Parquet PageReader (#9781) 33cdf0a97 by Wei He, Add custom input generator for lead, lag, nth_value, and ntile in WindowFuzzerTest (#8360) 82a12e165 by Deepak Majeti, Remove setup-centos8.sh (#10249) 7be328cac by Zhenyuan Zhao, Make dwrf support taking custom column reader factory (#10267) 1f981ae8f by Orri Erling, Add more size classes (#10139) dc533655f by Masha Basmanova, Add from_unixtime(epoch, hours, minutes) Presto function (#10215) 7f547dbca by Wei He, Add custom result verifiers for min_by and max_by (#9070) 9974a3339 by Wei He, Allow logging input vectors in aggregation fuzzer (#10229) ```
…scala (apache#6220) Co-authored-by: James Xu <[email protected]>
What changes were proposed in this pull request? (Please fill in changes proposed in this fix) (Fixes: apache#6124) How was this patch tested? TEST BY UT
What changes were proposed in this pull request? (Please fill in changes proposed in this fix) (Fixes: apache#6156) How was this patch tested? test by ut
* fix udf library path failed to get resolved on yarn-cluster * fix signature * Revert "fix udf library path failed to get resolved on yarn-cluster" This reverts commit 11f774a.
Run Gluten Clickhouse CI |
@FelixYBW - I am able to build Gluten on Centos9 with these changes. Have got the jar generated, now have to consume the jar and test it.
|
@zhztheplayer - Could you please check on this PR if there is some pending action from me ? |
centos 9 or centos stream 9? |
@wanglinsong - Yes, I am using |
What changes were proposed in this pull request?
TO support building Gluten on Centos9
How was this patch tested?
I am trying to build Gluten on Centos9. Will update here once I am able to build successfully.