Skip to content
View vishalsingh17's full-sized avatar
🎯
Focusing; Learning; Progressing
🎯
Focusing; Learning; Progressing

Block or report vishalsingh17

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
vishalsingh17/README.md

πŸ‘‹ Hello, Welcome to my profile.

I'm a passionate Big Data Engineer with 4+ years of hands-on experience in designing and implementing robust data solutions. My goal is to leverage the power of data to drive meaningful insights and solve complex business challenges.

πŸ’‘ Expertise:
In my journey as a Big Data Engineer, I have honed my skills in:

πŸ”Ή Big Data Technologies: I have a strong command over Hadoop, Spark and their ecosystems. I specialize in building scalable data pipelines, processing large datasets, and optimizing performance for efficient data processing.

πŸ”Ή Programming Languages: I am proficient in Python, SQL and Spark, using them to develop data-centric applications, perform data analysis, and build machine learning models.

πŸ”Ή Data Warehousing: I have hands-on experience with data warehousing principles, including data modeling, ETL (Extract, Transform, Load) processes, and dimensional modeling. I am well-versed in designing and implementing data warehouses for improved data accessibility and reporting.

πŸ”Ή Database Management: I have a strong grasp of SQL and have worked extensively with both relational databases (MySQL, PostgreSQL) and NoSQL databases (MongoDB, Cassandra). I excel at writing complex queries, optimizing database performance, and ensuring data integrity.

πŸ”Ή Cloud Platforms: I am adept at working with cloud-based environments, particularly on AWS and Azure.

πŸ”Ή Data Visualization: I possess a keen eye for visualizing data insights and effectively communicating complex findings to stakeholders. I am skilled in using tools like Tableau and Power BI to create intuitive dashboards and reports.

βš’οΈ Skills:

πŸ§‘β€πŸ’» Programming Languages:
Python | SQL | Spark

⛓️ Distributed Framework:
Spark | Hadoop | Hive | Kafka | Sqoop

πŸ’Ύ Databases:
MySQL | MongoDB | Cassandra | HBase

🧬 Version Control:
Git | DVC

⏰ Workflow Management:
Airflow | Mage

☁️ AWS Services:
S3 | EC2 | EMR | RDS | Redshift | Glue | CloudWatch | ECS

☁️ Azure Services:
Data Factory | Databricks | Functions | Blob | Synapse | Delta Lake

πŸš€ MLOps:
Docker | Docker Compose | GitHub Actions | MLflow

πŸͺ„ ML Frameworks:
Pandas | Numpy | Sklearn | PySpark | Pytorch | Matplotlib | Seaborn | TFX

🌐 Socials:

LinkedIn Topmate Resume Portfolio

πŸ“Š GitHub Stats:



✍️ Random Dev Quote


Pinned Loading

  1. AirPressureFailureDetection AirPressureFailureDetection Public

    Python 1

  2. FlightFarePrediction FlightFarePrediction Public

    Python 1

  3. OlympicsDataAnalysisWebapp OlympicsDataAnalysisWebapp Public

    Python 1 1

  4. BinanceRSIBot BinanceRSIBot Public

    Python 3

  5. Explore_classifier_UI Explore_classifier_UI Public

    Python

  6. FinRL FinRL Public

    Forked from AI4Finance-Foundation/FinRL

    FinRL: The first open-source project for financial reinforcement learning.

    Jupyter Notebook