Use the local SQLite database program to import a CSV file. This enables using SQL to explore CSV data.
Syntax:
sqlite-import-csv <data-file-name> [data-table-name]
Parameters:
-
data-file-name: the file on the system to import, such as "songs.csv"
-
data-table-name: the SQLite table name to be created, such as "songs". The default is the data file name basename without any extensions. For example a data file name "~/a/b/c/songs.x.y.z" causes the data table name default "songs".
Example to import from file "songs.csv" to table "songs":
sqlite-import-csv songs.csv
Example to import from file "songs.csv" to table "items":
sqlite-import-csv songs.csv items
Thanks: user Derek Mahar at post
If you have PowerShell, then you can use it to do similar:
Import-Csv songs.csv |
Sort-Object Title, Album
To filter, use Where-Object
:
Import-Csv songs.csv |
Where-Object { $_.Album -eq 'Thriller' } |
Sort-Object Title, Album
If you prefer JSON, then you can replace Import-Csv
with Get-Content
and ConvertFrom-Json
:
Get-Content songs.json |
ConvertFrom-Json |
Select-Object Album -Unique
There's also Group-Object
for aggregation.
Thanks: user brushfoot at post
DataProfiler is a library to easily load any delimited type of file and find headers (even if not first row). It also works to load JSON, Parquet, AVRO and loads it into a dataframe.
https://github.com/capitalone/dataprofiler
Install:
pip install dataprofiler[ml] --user
How it works:
csv_data = Data('songs.csv') # Load: delimited, JSON, Parquet, Avro
csv_data.data.head(10) # Get head
csv_data.data.sort_values(by='name', inplace=True) # Sort
- Program: sqlite-import-csv
- Version: 1.1.0
- Created: 2021-08-25T17:19:28Z
- Updated: 2021-08-26T02:30:17Z
- License: GPL
- Contact: Joel Parker Henderson ([email protected])