Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

qsv 0.124.1 #166288

Merged
merged 2 commits into from
Mar 16, 2024
Merged

qsv 0.124.1 #166288

merged 2 commits into from
Mar 16, 2024

Conversation

BrewTestBot
Copy link
Member

Created by brew bump


Created with brew bump-formula-pr.

release notes
# [Datapusher+](https://github.com/dathere/datapusher-plushttps://github.com/dathere/datapusher-plus) "_[Speed of Insight](https://dathere.com/2024/03/the-speed-of-insight/)_" Release! 馃殌馃殌馃殌

This release is all about speed, speed, speed! We've made qsv even faster by leveraging Polars' multithreaded, mem-mapped CSV reader to get near-instant row counts of large CSV files, and near instant SQL queries and aggregations with Datapusher+ - automagically inferring metadata and giving you quick insights into your data in seconds!

We're demoing our qsv-powered Datapusher+ at the March 2024 installment of CKAN Montly Live on March 20, 2024, 13:00-14:00 UTC. Join us!

Beyond pushing data reliably at speed into your CKAN Datastore (it pushes real good! 馃槈), DP+ does some extended analysis, processing and enrichment of the data so it can be readily Used.

Both fetch and fetchpost commands now also have a --disk-cache option and are fully synched - forming the foundation for high-speed data enrichment from Web Services - including datHere's forthcoming, fully-integrated Data Enrichment Service.

馃弴馃徑 Hi-ho Quicksilver, away! 馃弴馃徑


Added

Changed

Fixed

  • dedup: fixed #1665 dedup not handling numeric values properly by adding a --numeric option dedup: add --numeric option聽jqnatividad/qsv#1666
  • joinp: reenable join validation tests now that Polars 0.38.2 join validation is working again jqnatividad/qsv@5faf90e and jqnatividad/qsv@fcfc75b
  • count: broken in unreleased 0.124.0. Polars-powered count require a "clean" CSV file as it infers the schema based on the first 1000 rows of a CSV. This will sometimes result in an invalid "error" (e.g. it infers a column is a number column, when its not). 0.124.1 fixes this by adding a fallback to the "regular" CSV reader if a Polars error occurs jqnatividad/qsv@a2c0869

Removed

Full Changelog: jqnatividad/qsv@0.123.0...0.124.1

@github-actions github-actions bot added rust Rust use is a significant feature of the PR or issue bump-formula-pr PR was created using `brew bump-formula-pr` labels Mar 16, 2024
Copy link
Contributor

馃 An automated task has requested bottles to be published to this PR.

@github-actions github-actions bot added the CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. label Mar 16, 2024
@BrewTestBot BrewTestBot added this pull request to the merge queue Mar 16, 2024
Merged via the queue into master with commit fef7f2d Mar 16, 2024
13 checks passed
@BrewTestBot BrewTestBot deleted the bump-qsv-0.124.1 branch March 16, 2024 02:03
@github-actions github-actions bot added the outdated PR was locked due to age label Apr 15, 2024
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Apr 15, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bump-formula-pr PR was created using `brew bump-formula-pr` CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. outdated PR was locked due to age rust Rust use is a significant feature of the PR or issue
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants