Use the local SQLite database program to import a CSV file. This enables using SQL to explore CSV data.

Syntax:

sqlite-import-csv <data-file-name> [data-table-name]

Parameters:

• data-file-name: the file on the system to import, such as "songs.csv"

• data-table-name: the SQLite table name to be created, such as "songs". The default is the data file name basename without any extensions. For example a data file name "~/a/b/c/songs.x.y.z" causes the data table name default "songs".

Example to import from file "songs.csv" to table "songs":

sqlite-import-csv songs.csv

Example to import from file "songs.csv" to table "items":

sqlite-import-csv songs.csv items

Thanks: user Derek Mahar at post

If you have PowerShell, then you can use it to do similar:

Import-Csv songs.csv | 
Sort-Object Title, Album

To filter, use Where-Object:

Import-Csv songs.csv | 
Where-Object { $_.Album -eq 'Thriller' } | 
Sort-Object Title, Album

If you prefer JSON, then you can replace Import-Csv with Get-Content and ConvertFrom-Json:

Get-Content songs.json | 
ConvertFrom-Json | 
Select-Object Album -Unique

There's also Group-Object for aggregation.

Thanks: user brushfoot at post

DataProfiler is a library to easily load any delimited type of file and find headers (even if not first row). It also works to load JSON, Parquet, AVRO and loads it into a dataframe.

https://github.com/capitalone/dataprofiler

Install:

pip install dataprofiler[ml] --user

How it works:

csv_data = Data('songs.csv') # Load: delimited, JSON, Parquet, Avro
csv_data.data.head(10) # Get head
csv_data.data.sort_values(by='name', inplace=True) # Sort

Thanks: user citilife at post

• Program: sqlite-import-csv
• Version: 1.1.0
• Created: 2021-08-25T17:19:28Z
• Updated: 2021-08-26T02:30:17Z
• License: GPL
• Contact: Joel Parker Henderson ([email protected])