Commits

Commits on Feb 9, 2021

Merge pull request #7 from SvetlanaGruzdeva/feat_refactorint_lambdas
SvetlanaGruzdeva
committedFeb 9, 2021
Added error handling to write-to-dynamodb lambdas
SvetlanaGruzdeva
committedFeb 9, 2021
Minor change
SvetlanaGruzdeva
committedFeb 9, 2021
Added error handling to get-file lambdas
SvetlanaGruzdeva
committedFeb 9, 2021

Commits on Feb 4, 2021

Merge pull request #6 from SvetlanaGruzdeva/events-lambda
SvetlanaGruzdeva
committedFeb 4, 2021
Adding new pipeline for collecting events data
SvetlanaGruzdeva
committedFeb 4, 2021
Merge pull request #5 from SvetlanaGruzdeva/Refactoring_lambda
SvetlanaGruzdeva
committedFeb 4, 2021
Update of incidents-get file lambda
SvetlanaGruzdeva
committedFeb 4, 2021
Minor update
SvetlanaGruzdeva
committedFeb 4, 2021
Delete raw_data directory
SvetlanaGruzdeva
committedFeb 4, 2021
Merge pull request #4 from SvetlanaGruzdeva/explore_trafficspeed
SvetlanaGruzdeva
committedFeb 4, 2021
Processing events records
SvetlanaGruzdeva
committedFeb 4, 2021

Commits on Jan 23, 2021

Merge pull request #3 from SvetlanaGruzdeva/feat_refactoring_lambda_db
SvetlanaGruzdeva
committedJan 23, 2021
Adding small pieces of code for testing before using in lambda.
SvetlanaGruzdeva
committedJan 23, 2021
Refactoring lambda_dynamodb
SvetlanaGruzdeva
committedJan 23, 2021

Commits on Jan 20, 2021

Merge pull request #2 from SvetlanaGruzdeva/lambda_md5_hash
SvetlanaGruzdeva
committedJan 20, 2021
Step 2 & 3: lambda is finished
SvetlanaGruzdeva
committedJan 20, 2021
Step 1: read latest file from s3 and calculate md5hash for it
SvetlanaGruzdeva
committedJan 20, 2021

Commits on Jan 18, 2021

Commits on Jan 17, 2021

Save processed file as csv
SvetlanaGruzdeva
committedJan 17, 2021

Commits on Dec 23, 2020

All data types have been defined
SvetlanaGruzdeva
committedDec 23, 2020
All numeric columns have been converted to float data type
SvetlanaGruzdeva
committedDec 23, 2020
Float columns have been detected and transformed
SvetlanaGruzdeva
committedDec 23, 2020

Commits on Dec 22, 2020

Tags had been flatten within the dataframe
SvetlanaGruzdeva
committedDec 22, 2020
Date-time columns have been transformed to an appropriate data type
SvetlanaGruzdeva
committedDec 22, 2020

Commits on Dec 19, 2020

Correction of a loop
SvetlanaGruzdeva
committedDec 19, 2020
Clean dataframe
SvetlanaGruzdeva
committedDec 19, 2020
Small adjustment
SvetlanaGruzdeva
committedDec 19, 2020
Loop to convert each situation into dataframe
SvetlanaGruzdeva
committedDec 19, 2020
Loop to extract content of one situation
SvetlanaGruzdeva
committedDec 19, 2020

Commits on Dec 18, 2020

Intermediary save
SvetlanaGruzdeva
committedDec 18, 2020