Skip to content
View shihabuddinbuet's full-sized avatar
🎯
Focusing
🎯
Focusing
  • Pathao
  • Road 49, Gulashan 2, Dhaka

Block or report shihabuddinbuet

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
shihabuddinbuet/README.md

Md Shihab Uddin,

I'm Md Shihab Uddin from Bangladesh and currently working as staff data engineer in Pathao, Dhaka. Also I've experience to build data driven backend services that are ensuring better customer experience. I believe in ability to solve problem rather than focusing on technology. Language or technology are just a tool to address business problem. I work to build robust data infrastructure so that all the services run smoothly . I'm experienced to build and maintain data pipeline system using cutting edge technologies. Having deep understanding on different ecosystems including JVM based languages, Spark, apache beam, Hadoop and Nosql, I contribute to process terabytes of data in batch and millions of rows in streaming. I've broad experience in big data technology for data processing and machine learning algorithm for training model with effective features to boost up the business. Everyday I align with Agile process to deliver high performance application timely. I love to embrace new challenges and extend my knowledge by learning new technology.

Anurag's GitHub stats

Skills

  • Python | Golang | Java | Scala | Sql | Bash | Apache Spark | Apache Beam | Hadoop | Hive | ETL | Streaming | DW | Data lake | Airflow
  • GCP | AWS | Bigquery | Pub/Sub | Cloud Computing | MySql | Redis | Postgres | Hbase | Cassandra | NoSQL | CI/CD | Unit testing
  • Microservices | Docker | Kubernetes | Distributed Systems | Backend

Experience

Pathao, Dhaka

  • Led the desgin and implementation of Pathao batch & realtime ETL, data warehousing, machine learning work flow. Techstack: Python, Java, Bigquery, Apache beam, Dataflow, Google Pub/Sub, Airflow, Terraform, MLFlow.
  • Designed and Contributed in Pathao Allocation engine with randomized A/B testing capability to ensure better experience to the customers. Techstack: Golang, Feature engineering(Batch+realtime), A/B test, Kubernetes, CI/CD
  • Contributed to build Pathao's own customized map service for better routing, eta, geocoding, reverse geocoding in Bangladesh and Nepal geo regions.
  • Built framework to detect fraud activity in platform and take action based on the serverity.
  • Continuous Integration/Deployment Pipeline Integration, pull requests, code reviews, load/stress testing, unit/integration.

Widespace, Stockholm

  • Contributed to build Recommender system to recommend relevant Ads to User, boosted impression rate by 40%, interaction (click/swap) rate by 3% that is equivalent to hundreds of thousands in number in every single day. Tech : AWS, Hadoop, Apache Spark, Scala, Hbase, S3.
  • Contributed to build batch pipeline to generate feature data for recommender system, profile services using Pyspark, Hive, EMR cluster, S3, Hbase, Airflow.
  • Implemented recommender system performance metrics visualization tool.
  • Collaborative work with HQ in Stockholm , Sweden.

Pinned Loading

  1. apache-spark-abc apache-spark-abc Public

    Basic operations using apache spark in scala

    Scala 1

  2. beam-example beam-example Public

    A basic use of apache beam to process data

    Java 1

  3. machine-learning-spark machine-learning-spark Public

    use of spark machine learning library

    Scala 1

  4. su-top-algorithm su-top-algorithm Public

    Implementation of different data structure and algorithm

    Java 1

  5. su-funny-projects su-funny-projects Public

    Adhoc fun with coding by python, java, spark etc.

    Python 1

  6. su-problem-solution su-problem-solution Public

    Leetcode, Hackerrank, ACM problem solution in java

    Python 1