Skip to content
View mtami's full-sized avatar
:atom:
Coding
:atom:
Coding
2 followers · 10 following

Achievements

Achievement: Pull Sharkx3

Achievements

Achievement: Pull Sharkx3
Block or Report

Block or report mtami

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
mtami/README.md

Hi, I'm Tami 👋

Senior Software Engineer.

🧑‍💻 Daily work activities: .py, .json, .yaml, .sql, .slack .aws .etl, .k8s, .spark
💬 Ping me about: Web Design, Cloud, Data LakeHouse Solutions, ETL Pipeline, Football 💙
📪 Reach me: LinkedIn or [email protected]

Pinned Loading

  1. amazon-redshift-utils amazon-redshift-utils Public

    Forked from awslabs/amazon-redshift-utils

    Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment

    Python 1

  2. FunctionalProgramming FunctionalProgramming Public

    Python 2

  3. Hudi Partition timestamp based Hudi Partition timestamp based
    1 
    from pyspark.sql.session import SparkSession
    2 
    import pyspark.sql.functions as f
    3 
    

    

    
4

    

    

    
5

    spark = SparkSession.builder.config('spark.serializer', 'org.apache.spark.serializer.KryoSerializer').\
    

    

    

    

    

    4. 

  4. 

    

    

    


Ingesting data using Spark with Hudi
Ingesting data using Spark with Hudi 
    

    

    
1

    from pyspark.sql.session import SparkSession
    

    

    
2

    import pyspark.sql.functions as f
    

    

    
3

    

    

    
4

    

    

    
5

    spark = SparkSession.builder.config('spark.serializer', 'org.apache.spark.serializer.KryoSerializer').config('spark.sql.hive.convertMetastoreParquet', 'false').getOrCreate()
    

    

    

    

    

    5. 

  5. 

    

    

    

    


apache/hudi
apache/hudi Public

    

    

    
Upserts, Deletes And Incremental Processing on Big Data.

    

    


Java





5.2k





2.4k


    

    

    

    6.