This release takes v0.2.0 out of beta, and makes some minor changes:

Added

• minor test for Datura::Helpers.date_standardize
• documentation for web scraping
• documentation for CsvToEs (transforming CSV files and posting to elasticsearch)
• instructions for installing Javascript Runtime files for Saxon

Changed

• date_standardize now relies on strftime instead of manual zero padding for month, day
• minor corrections to documentation
• XPath: "text" is now ingested as an array and will be displayed delimitted by spaces

Migration

• check to make sure "text" xpath is doing desired behavior

This is considered a beta release and it is expected that there may be some issues which come up

Added

• Fields (and therefore methods) for ES JSON, such as extent, alternative, spatial, etc
• Methods to xToES format fields to accommodate default behavior
• ES JSON uri now populated using default Orchid item path
• Tests and fixtures for all supported formats except CustomToEs
• get_elements returns nodeset given xpath arguments
• spatial nested fields spatial.type and spatial.title

Changed

• Arguments for get_text, get_list, and get_xpaths
• XPaths for VRA and TEI to Elasticsearch
• Default behavior for CsvToEs for some fields
• Documentation updated
• Changed Install instructions to include RVM and gemset naming conventions
• API field coverage_spatial is now just spatial

Migration

• Change coverage_spatial nested field to spatial
• get_text, get_list, and get_xpaths require changing arguments to keyword (like xml and keep_tags)
• Recommend checking xpaths and behavior of fields after updating to this version, as some defaults have changed
• Possible to refactor previous FileCsv overrides to use new CsvToEs abilities, but not necessary

Added

• CsvToEs class added which imitates style of other XToEs classes for easier overriding / maintenance
• Custom formats now supported, although no functionality provided since the type of format cannot be predicted
• Adds documentation for custom format setup

Changed

• CSV to ES transformation no longer accepts default column names, but instead looks for columns matching ES fields to use
• FileType elasticsearch transform now has swappable component when reading XML-type files. Webscraping script altered to manipulate HTML instead of XML object type

Removed

• CSV to ES transformation used to automatically assume columns as ES fields, this functionality has been removed

Minimal fixes and alterations to fields in VRA to Solr XSLT transformation.

Changed

• Removed match on pb/@xml:id for tei-to-html

Added

• IIIF output format and documentation
• Changelog

Changed

• nokogiri gem restricted to moving minor version instead of patch

Removed

• pkg builds of gem
• outdated comment line

Added webs format for minimal support of web scraping by specific apps

• currently collections using this feature will need to write all of their own code for process
• no defaults or recommendations about config settings implemented at this time

Fixed --update flag, which was broken

• added "today" shortcut for those who don't wish to type in the entire date

Misc other typo fixes, etc

Adds ability to manipulate files before and after transformation
Accommodates ruby 2.6.x

Implements previous "data" repository functionality as a ruby gem, "datura"

This release contains code as the data repository used to be when it was a collection of scripts. After this point, it will be a gem named datura.