Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

qsv 0.126.0 #169762

Merged
merged 2 commits into from
Apr 22, 2024
Merged

qsv 0.126.0 #169762

merged 2 commits into from
Apr 22, 2024

Conversation

BrewTestBot
Copy link
Member

Created by brew bump

Created with brew bump-formula-pr.

release notes 
# 馃 Expanded Metadata Inferencing 馃 #

describegpt headlines this release, with its new ability to support other local Large Language Models (LLMs) such as Ollama and Jan. This broadens the tool's utility in diverse AI environments and unlocks expanded metadata inferencing capabilities in qsv-pro.


Several commands got additional options: cat with --no-headers support in the rowskey subcommand; excel with new options like --error-format and short --metadata mode; and foreach with a --dry-run option. frequency also got new options, including --unq-limit for limiting unique counts, support for negative limits, and a --lmt-threshold option for compiling comprehensive frequencies below a threshold. slice now supports negative indices and new JSON output options, providing more flexibility in data slicing.


This is all rounded out with sqlp improvements, including support for single-line comments in SQL scripts and a special SKIP_INPUT value for more efficient data loading - all while increasing performance thanks to the Polars engine being upgraded to 0.39.2.




New Features


    

  • cat: Added --no-headers support to the rowskey subcommand, allowing for more versatile manipulation of CSV data.
    • 

  • describegpt: Added compatibility for other local Large Language Models (LLMs) such as Ollama and Jan, broadening the tool's utility in diverse AI environments.
    • 

  • excel: Introduced new options in the excel command: --error-format for better error handling and --metadata for short JSON mode, enhancing data parsing and metadata management capabilities.
    • 

  • foreach: added a --dry-run option, allowing users to preview the results of scripts without executing them.
    • 

  • frequency: New options added such as --unq-limit for limiting unique counts; support for negative limits to only show frequencies >= abs(negative limit); and a --lmt-threshold option to allow the compilation of comprehensive frequencies below the threshold - all providing more detailed control over frequency analysis.
    • 

  • slice: Support for negative indices to slice from the end and new JSON output options, offering more flexibility in data slicing.
    • 

  • sqlp: sqlp now supports single-line comments and includes a special SKIP_INPUT value for more efficient data loading. The Polars engine has also been upgraded to 0.39.2, providing enhanced performance and stability.
    • 



Changes and Optimizations


    

  • Performance Enhancements: Microoptimizations in datefmt and validate functions, and increased default length for --infer-len in sqlp for improved performance.
    • 

  • Dependency Updates: Numerous updates including bumping Luau, jql-runner, pyo3, and other dependencies to enhance stability and security.
    • 

  • Benchmarks Added: New performance benchmarks for sqlp vs duckdb included, showcasing the efficiency gains through Polars integration.
    • 



Security and Robustness


    

  • Security Fixes: Updated rustls to fix a specific CVE, and other minor fixes to enhance the security and robustness of network and data processing features.
    • 

  • Bug Fixes: Various bug fixes including improvements in error formatting in excel and robustness in fetch and fetchpost commands.
    • 



Deprecated Features


    

  • fetch & fetchpost: Removal of the jsonxf crate from these commands to streamline JSON processing
    • 

  • reverse: Eliminate kludgy buffer expansions.
    • 



This release not only enhances existing functionalities with added options and support for additional models and formats but also emphasizes performance improvements and robustness with critical updates and optimizations.




Added



Changed



Fixed



Removed



Full Changelog: jqnatividad/qsv@0.125.0...0.126.0

@github-actions github-actions bot added rust Rust use is a significant feature of the PR or issue bump-formula-pr PR was created using `brew bump-formula-pr` labels Apr 22, 2024
@github-actions GitHub Actions
Copy link
Contributor

馃 An automated task has requested bottles to be published to this PR.

@github-actions github-actions bot added the CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. label Apr 22, 2024
@BrewTestBot BrewTestBot added this pull request to the merge queue Apr 22, 2024
Merged via the queue into master with commit cc72606 Apr 22, 2024
14 checks passed
@BrewTestBot BrewTestBot deleted the bump-qsv-0.126.0 branch April 22, 2024 16:59
@github-actions github-actions bot added the outdated PR was locked due to age label May 23, 2024
@github-actions github-actions bot locked as resolved and limited conversation to collaborators May 23, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@fxcoudert fxcoudert fxcoudert approved these changes

@github-actions github-actions[bot] github-actions approved these changes

Assignees
No one assigned
Labels
bump-formula-pr PR was created using `brew bump-formula-pr` CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. outdated PR was locked due to age rust Rust use is a significant feature of the PR or issue
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@BrewTestBot @fxcoudert