Skip to content

Releases: FINRAOS/herd

Release 0.51.0

28 Aug 19:47
Compare
Choose a tag to compare

This release includes features and defect fixes from releases 0.35.0 through 0.39.0. Consolidated release notes below.

For more details, see our GitHub issues which are organized by milestone corresponding to the release.

Search:
Return facet info with Global Search results
Exclude BDefs with specific Tags from BDef Index Search
Search across multiple tags with boolean logic in Global Search
Perform indexed searches even as infrastructure changes
BDef - Tag associations not removed from index when Tag deleted
Can't retrieve description in TagType Search
Exclude results with specific Tags from Global Search
Validate any Search Index
Return Global Search hits based on fewer fields
Return hit highlight information in Global Search
Require more characters for a Global Search match
Ensure Global Search utilizes ES Rest Client
Ensure BDef Index Search utilizes ES Rest Client
View Global Search results with Data Entities and Categories weighted equally
Consider Tag importance in Global Search result ranking
Ensure Index management endpoints utilize ES Rest Client
BDef index counts do not match BDef count
Perform index checks without full index validation
Create new Elastic Search index with no downtime

Infrastructure:
Delete Format without having to remove DescriptiveFormat from BDef
Bad inputs on BData Search from Activiti results in JPA error
Manage Lists of valid items for global Attributes
Perform LFS S3 Delete outside of transaction
Manage valid items for Attribute Values
Manage global Attribute Definitions
Update Attributes on Business Object Format
Enforce global Attribute Definitions on Formats
Enforce Allowed Attribute Values against Valid List
Publish notification messages to multiple queues
Restore BData with Bulk tier to save cost
Consume notifications from ESMP queues with ESMP format
Return Role information in Current User endpoint
Update whole list of BData Attributes with a single request

Archive:
Transition from S3 to Glacier without copy and delete
Restore Data from Glacier Lifecycle to S3
Receive appropriate message when attempting to modify ARCHIVED BData
Ensure restored data is handled properly when it expires

Cluster:
Utilize InstanceFleet features in EMR Cluster Mgmt
Receive InstanceFleet information with EMR Cluster Get
EBS volume in EMR Cluster Definition
Choose EMR Cluster scale down behavior
EMR spot fleet fails when multiple subnets are passed
Override default Security Groups in EMR cluster management endpoints

Release 0.39.0

14 Mar 21:21
Compare
Choose a tag to compare

This release includes features and defect fixes from releases 0.35.0 through 0.39.0. Consolidated release notes below.

For more details, see our GitHub issues which are organized by milestone corresponding to the release.

Data Catalog

  • Retrieve DDL without checking for non-registered sub-partitions (0.36.0)
  • Search BData by Attribute name and value (0.37.0)
  • Manage TagType description (0.38.0)
  • Receive unfiltered BData list results with minimal delay (0.39.0)
  • Filter BData Search to contain only latest VALID results (0.39.0)

Workflow / Jobs / Cluster

  • Manage cluster in a different account than Herd (0.36.0)
  • Access environment as global variable in all workflows (0.36.0)
  • Launch cluster in different account than Herd (0.36.0)
  • Define security configuration for EMR cluster (0.37.0)
  • Perform BData Search from Activiti (0.38.0)

Infrastructure

  • Factory CQ - modify YAML for swagger codegen (0.37.0)

Release 0.34.0

03 Jan 15:28
Compare
Choose a tag to compare

Data Catalog

  • Retrieve SME Contact Details

Workflow / Jobs / Cluster

  • Access environment identifier from workflow variable

Release 0.33.0

20 Dec 03:08
Compare
Choose a tag to compare

Storage

  • Utilize storage policy based on Partition Date
  • Retry archiving from S3 to Glacier
    Workflow/Jobs/Cluster
  • Receive details of EMR Cluster status

Release 0.32.0

09 Dec 17:49
Compare
Choose a tag to compare
  • Data Catalog
    • Manage association between SME and BDef
  • Workflow/Jobs/Cluster
    • Terminating long-running workflow impacted health of system

Release 0.31.0

23 Nov 14:25
Compare
Choose a tag to compare
  • Data Catalog
    • Store long BDef column descriptions
    • Manage Descriptive Format field for Data Entities
    • Manage BDef columns according to Descriptive Format
    • Retrieve Sample Data file list with Bdef Descriptive Info
    • Retrieve all BDef children of a Tag
    • Receive additional fields with lists of Tags and TagTypes
    • Receive additional fields with list of BDef
    • Receive additional fields with list of BDef Columns
    • Receive responses from search endpoints that are consistent with other responses
    • Retrieve list of Data Entities and descriptions associated with a tag hierarchy
    • Defect - Optional Tag element is Required in XSD
  • Workflow / Jobs / Cluster
    • Use any Subnet in cluster definition without impact if spot prices not available

Release 0.29.0

01 Nov 15:16
Compare
Choose a tag to compare
  • Data Catalog
    • Retrieve DDL DROP TABLE statements for all objects
    • Edit Business Object Definition Metadata
    • Manage Tag Types
    • Manage Tags
    • Manage taxonomy of hierarchical Tags
    • Manage association between Tag and BDef
  • Infrastructure
    • Call AWS with cached credentials
    • OSS - Initial functional tests execute during Herd demo stack build
    • Factory CQ - Split out AbstractServiceTest Java Class

Release 0.27.0

28 Sep 19:39
Compare
Choose a tag to compare
  • Data Catalog
    • Receive notification when Storage Unit status changes
    • Generate DDL for archived BData
    • Retrieve BData search results with default sort by partition value descending
  • Workflow / Jobs / Cluster
    • Suspend and Resume an Activiti job
    • Defect - Notification-based Job fails with permission errors
  • Infrastructure
    • Factory Disable/Enable queue listener
    • Factory CQ - remove unused stats endpoints
    • Factory CQ - Mechanical refactoring for UI code
    • Defect - Storage configured by CloudFormation does not have template configured

Release 0.26.0

14 Sep 18:00
Compare
Choose a tag to compare
  • Data Catalog
    • Receive notification when Storage Unit status changes
  • Workflow / Jobs / Cluster
    • Storage configured by CloudFormation does not have template configured
    • Notification-based Job fails with permission errors
  • Infrastructure
    • Factory CQ - remove unused stats endpoints

For more details, see our GitHub issues for the 0.26.0 milestone

Release 0.25.0

30 Aug 13:16
Compare
Choose a tag to compare
  • Data Catalog
    • Filter BData search results by Partition Value
  • Infrastructure
    • Factory CQ - add DAO "Operations" Method Invocation Logging