Pinned Loading

1. embed and load 2.5M arxiv abstracts ... embed and load 2.5M arxiv abstracts into qdrant

   1

   import json

   2

   import numpy as np

   3

   from FlagEmbedding import FlagModel

   4

   from qdrant_client import QdrantClient

   5

   from qdrant_client.http.models import Batch, VectorParams, Distance

2. vllm server wrapper with auto resta... vllm server wrapper with auto restart and vllm node script with exponential backoff for requests

   1

   import subprocess

   2

   import time

   3

   import re

   4

   import signal

   5

   import sys

3. open LLM tool use, a prompt template... open LLM tool use, a prompt template, tested with Mistral, OpenChat, SOLAR.

   1

   2

   # WHO ARE YOU

   3

   4

   - You are an AI trained to call functions in order to solve problems.

   5

   - You are an expert in XML outputs and well-formatted JSON.