“For the past 4 months, Bin had been working as a problem adder. As of today, Bin added around 40% of the Database problem, and published about 80% of the Database problem solutions. Although the job requirement is simple, he had gone above and beyond his responsibilities by taking a leadership role in the team without anyone asking. For example, he would proactively suggest new methodology to improve our process workflow, and is also keen to share his knowledge by helping team members. When you assign a task to Bin, you can rest assured that he will do an excellent job without much supervision. He keeps detailed documentation of what he had done and maintains excellent communication so there is rarely misunderstanding, which is much appreciated especially in a remote work setting.”
About
Empowering businesses with advanced information technologies!
Experience
-
-
-
-
-
-
-
-
-
-
-
Education
-
Northeastern University
-
Activities and Societies: Hack-the-lab Data Science Competition (PNNL), Iasa IT Architect Competition
Emphasis:
* Application Engineering and Development
* Program Structure and Algorithms
* Advances Data Sci/Architecture
* Engineering of Big-Data Systems
* Web Development Tools & Methods
* Network Structures and Cloud Computing
* Big-Data Systems and Intelligence Analytics
* Cryptocurrency and Smart Contract Engineering -
-
Course Emphasis:
* Artificial Intelligence and Expert System B
* Management Information System
* System Integration and Application
* Principle of Data Structure
* Probability and Mathematical Statistics
* Computer Network and Communication
* Network Database
Licenses & Certifications
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Certificate of ACM Achievement
ACM
Issued -
IBM Certified Database Administrator,DB2 Universal Database V8.1 for Linux UNIX and Windows
IBM
Issued -
-
Volunteer Experience
-
Volunteer
Northeastern University
- Present 6 years 6 months
Science and Technology
Contributed to this 5 days' IEEE International Conference on Software Architecture (ICSA 2018, https://icsa-conferences.org/2018/).
* Registration
* Logistics
* Photograph
Courses
-
Application Development and Engineering
4.0/4.0
-
Application Engineering and Development
https://goo.gl/XgYVpo
-
Oracle Database Administrator Workshop I & II
10g
-
Program Structures and Algorithms
4.0/4.0
-
Program Structures and Algorithms
https://goo.gl/m4zA6i
-
Siebel Essentials
7.7
Projects
-
High Performance Data Processing Platform
- Present
* Implemented a high performance data processing platform using Apache Kafka, Apache Cassandra, and Apache Spark to analyze New York City Traffic Data (200k messages/s)
* Developed a dashboard web app using Redis, Node.js, D3.js.
* Created a scalable cloud deployment environment using Docker, Apache Mesos -
Big Data Hands-on
-
See project* Explored Pig and Hive for ETL and data analysis
* Implemented a data processing pipeline using Oozie, Sqoop, Pig, Hive and HCatalog
* Created a Hadoop web crawler based on Nutch
Languages
-
English
Professional working proficiency
-
Chinese
Native or bilingual proficiency
Recommendations received
-
LinkedIn User
3 people have recommended Bin
Join now to viewOther similar profiles
Explore more posts
-
Asif Razzaq
This AI Paper by Snowflake Introduces Arctic-Embed: Enhancing Text Retrieval with Optimized Embedding Models Researchers from Snowflake Inc. have introduced Arctic-embed models, setting a new standard for text embedding efficiency and accuracy. These models distinguish themselves by employing a data-centric training strategy that optimizes retrieval performance without excessively scaling model size or complexity. Using in-batch negatives and a sophisticated data filtering system helps the Arctic-embed models achieve superior retrieval accuracy compared to existing solutions, showcasing their practicality in real-world applications. The methodology behind Arctic-embed models involves training with datasets such as MSMARCO and BEIR, which are noted for their comprehensive coverage and benchmarking relevance in the field. The models range from small-scale variants with 22 million parameters to the largest with 334 million; each tuned to optimize performance metrics like nDCG@10 on the MTEB Retrieval leaderboard. These models leverage a mix of pre-trained language model backbones and fine-tuning strategies, including hard negative mining and optimized batch processing, to enhance retrieval accuracy. Quick read: https://lnkd.in/ehDf24XB Paper: https://lnkd.in/ejaVqPDX Snowflake #artificialintelligence #opensource #ai #llms
2 Comments -
Logan Abbott
Open Source Redis Fork 'Valkey' Has Momentum, Improvements, and Speed, Says Dirk Hohndel: "Dirk Hohndel, a Linux kernel developer and long-time open source leader, wanted his audience at KubeCon + CloudNativeCon + Open Source Summit China 2024 Summit China to know he's not a Valkey developer," writes Steven J. Vaughan-Nichols. "He's a Valkey user and fan." [Hohndel] opened his speech by recalling how the open source, high-performance key/value datastore Valkey had been forked from Redis... Hohndel emphasized that "forks are good. Forks are one of the key things that open source licenses are for. So, if the maintainer starts doing things you don't like, you can fork the code under the same license and do better..." In this case, though, Redis had done a "bait-and-switch" with the Redis code, Hohndale argued. This was because they had made an all-too-common business failure: They hadn't realized that "open source is not a business model...." While the licensing change is what prompted the fork, Hohndel sees leadership and technical reasons why the Valkey fork is likely to succeed. First, two-thirds of the formerly top Redis maintainers and developers have switched to Valkey. In addition, AWS, Google Cloud, and Oracle, under the Linux Foundation's auspices, all support Valkey. When both the technical and money people agree, good things can happen. The other reason is that Valkey already looks like it will be the better technical choice. That's because the recently announced Valkey 8.0, which builds upon the last open source version of Redis, 7.2.4, introduces serious speed improvements and new features that Redis users have wanted for some time. As [AWS principal engineer Madelyn] Olson said at Open Source Summit North America earlier this year, "Redis really didn't want to break anything." Valkey wants to move a bit faster. How much faster? A lot. Valkey 8.0 overhauls Redis's single-threaded event loop threading model with a more sophisticated multithreaded approach to I/O operations. Hohndel reported that on his small Valkey-powered aircraft tracking system, "I see roughly a threefold improvement in performance, and I stream a lot of data, 60 million data points a day." The article notes that Valkey is already being supported by major Linux distros including AlmaLinux, Fedora, and Alpine. Read more of this story at Slashdot.
-
Matthew W.
It gives us great pleasure to announce that Apache Spark in BigQuery is now officially available in Private Preview. This feature expands BigQuery’s processing capabilities by offering Apache Spark as an OSS processing engine under a unified control plane (admin, monitoring, billing, security, governance). It is the first step in delivering on the Unified Data Platform vision and was a key announcement at Next ‘24 #googlecloud #bigquery #spark
2 Comments -
Nikhil Krishnan
new post - we chatted with Davis Liang) about some of the engineering challenges and breakthroughs for a company training their own healthcare LLMs -dealing with multiple languages -handling model drift -generalist models vs. healthcare specific ones and more. You can read it here: https://lnkd.in/dgmZY35G (just fyi, this one is a sponsored post but it's pretty interesting if you're interested in healthcare-specific LLMs)
1 Comment
Explore collaborative articles
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
Explore MoreOthers named Bin Shi in United States
-
BIN SHI
-
Bin Shi
Senior Data Scientist at Walmart Labs
-
Bin S.
-
Bin Shi
Postdoc in Photonic Integrated Neural Networks at Hewlett-Packard Labs
27 others named Bin Shi in United States are on LinkedIn
See others named Bin Shi
