add openai error handler with retry and logger #148

ChuyueSun · 2024-02-06T03:27:00Z

created handler according to openai handbook: https://platform.openai.com/docs/guides/error-codes/handling-errors
added logger to record error

python/sglang/backend/openai.py

Chuyue Sun added 2 commits February 6, 2024 11:24

add openai error handler with retry

a25af57

format

b51a612

ChuyueSun requested a review from Ying1123 February 6, 2024 03:32

Ying1123 approved these changes Feb 6, 2024

View reviewed changes

python/sglang/backend/openai.py Outdated Show resolved Hide resolved

python/sglang/backend/openai.py Outdated Show resolved Hide resolved

python/sglang/backend/openai.py Outdated Show resolved Hide resolved

Ying1123 added 3 commits February 5, 2024 20:38

Update python/sglang/backend/openai.py

37dbf22

Update python/sglang/backend/openai.py

26e586c

Update python/sglang/backend/openai.py

ef171a3

Ying1123 merged commit e2bf732 into main Feb 6, 2024

Ying1123 deleted the openai_error_handler branch February 6, 2024 04:38

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add openai error handler with retry and logger #148

add openai error handler with retry and logger #148

ChuyueSun commented Feb 6, 2024

add openai error handler with retry and logger #148

add openai error handler with retry and logger #148

Conversation

ChuyueSun commented Feb 6, 2024