Discussions

• 1 You must be logged in to vote

  🙏

  where is the dockerfile for https://hub.docker.com/r/kserve/vllmserver image?

  uthark asked Aug 22, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Controlling Serverless InferenceService to Save Resources

  fyuan1316 asked Aug 1, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Securing inferenceservices endpoints

  AidenGoodall asked Aug 1, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💡

  Propagate headers to all steps in inference graphs

  rachitchauhan43 started Jul 5, 2022 in Ideas

  

  

  1
• 3 You must be logged in to vote

  🙏

  Future of Open Inference Protocol and supported endpoints on KServe

  olekli asked Jun 7, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Directory structure when contributing a custom model implementation

  ssiegel95 asked Jul 18, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Path Based Routing

  vinayK34 asked Jul 16, 2024 in Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  🙏

  How to access custom torchserve metrics in kserve

  Nisarg-18 asked Jun 8, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Autoscaling with batcher

  cceyda asked May 27, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  KServe custom metrics

  Csehpi asked May 21, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  KServe ONNX model inference service not working

  Joshuat00 asked May 13, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to use minio to serve the model?

  photoszzt asked Feb 7, 2023 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Question on Inference loop blocking behaviour and how to handle

  ajstewart asked Apr 10, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Large memory usage when using readiness and liveness probes. Doing something wrong?

  ajstewart asked Apr 9, 2024 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Custom Model using KServe API is failing

  kjoth asked Apr 2, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Is there a way to make the controller list the secrets only for certain namespace/s?

  superfav asked Apr 3, 2023 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  How much memory must be assigned to KServe controller manager?

  superfav asked Apr 25, 2023 in Q&A · Unanswered

  

  

  

  

  4
• 2 You must be logged in to vote

  🙏

  What does mean "size of prediction is not equal to the size of instances" in batcher?

  hyunjoon1015 asked Mar 22, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  KServe storage-initializer error....!

  HrushikeshGowda asked May 24, 2023 in Q&A · Answered

  

  

  2
• 2 You must be logged in to vote

  🙏

  InferenceService to accomadte more than 1 endpoints

  kjoth asked Mar 20, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  What exactly is RawDeployment?

  iciclespider started Mar 10, 2024 in General

  

  

  

  

  11
• 1 You must be logged in to vote

  🙏

  Is KNative + Istio optional?

  iciclespider asked Mar 1, 2024 in Q&A · Answered

  

  

  4
• 1 You must be logged in to vote

  🙏

  Error when deploying model on Microk8s

  AkifCanSonmez asked Feb 6, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Batching based on another field in the instance

  cceyda asked Feb 5, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  [Q] Why CloudEventsIdHeader is "Ce-Id"?

  zzzinho asked Feb 1, 2024 in Q&A · Unanswered

  

  

  0