AssemblyLine 4: File triage and malware analysis

Malware Configuration And Payload Extraction

python implementation of the parquet columnar file format.

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

Deobfuscate obfuscator.io, unminify and unpack bundled javascript

A comprehensive, high-quality URL shorteners domain list for whitelist/allowlist or blacklist/blocklist purposes, utilized by NextDNS, ControlD, RethinkDNS, dnslow.me, and other OSINT projects.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Minimalistic large language model 3D-parallelism training

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Access large language models from the command-line

Runs checks to see if an EKS cluster follows EKS Best Practices.

Experimenting with Apple's WPS location service

Auto_Jobs_Applier by AIHawk is an Agen that automates the jobs application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in an automated and personalized way.

Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.

A guide to setting up a production-like Kubernetes cluster on a local machine

DOM to Semantic-Markdown for use with LLMs

A standalone version of the readability lib

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

Automate browser-based workflows with LLMs and Computer Vision

Finetune Llama 3.2, Mistral, Phi, Qwen & Gemma LLMs 2-5x faster with 80% less memory

Proxy to allow multi tenant sharing of Git credentials.

Build a RAG dataset for your domain in just a few lines of codes, using your XML sitemap

The tool to check the availability or syntax of domain, IP or URL.

Find, verify, and analyze leaked credentials

TensorFlow Neural Machine Translation Tutorial

A Python reference implementation for CZDS download zone file API

Fast similarity search using DuckDB

A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.

DataComp for Language Models