11 Releases published by 2 people

• v0.18.0

  published Jul 5, 2024

• v0.19.0

  published Jul 9, 2024

• v0.19.1

  published Jul 9, 2024

• v0.19.2

  published Jul 11, 2024

• v0.19.3

  published Jul 11, 2024

• v0.19.4

  published Jul 12, 2024

• v0.19.5

  published Jul 15, 2024

• v0.19.6

  published Jul 23, 2024

• v0.19.7

  published Jul 26, 2024

• v0.19.8

  published Jul 29, 2024

• v0.19.9

  published Jul 31, 2024

92 Pull requests merged by 9 people

• Feat: add Alembic support for database migration

  #1856 merged Aug 1, 2024

• [Enhancement]: Add cloud support for alembic

  #1939 merged Jul 31, 2024

• Minor UI improvement at human eval

  #1943 merged Jul 30, 2024

• [PoC-1][Frontend]: UI fixes

  #1947 merged Jul 29, 2024

• Bump versions

  #1946 merged Jul 29, 2024

• fix(sdk): AGE-480 Update litellm callbacks with new SDK

  #1945 merged Jul 29, 2024

• [FE][PoC-1]:Display optional inline intermediate outputs in Playground

  #1937 merged Jul 28, 2024

• refactor(sdk): Move trace processing from SDK to BE

  #1934 merged Jul 26, 2024

• Bump versions

  #1936 merged Jul 26, 2024

• Fix image deletion in cloud

  #1932 merged Jul 25, 2024

• chore(deps): bump importlib-metadata from 8.0.0 to 8.2.0 in /agenta-cli

  #1931 merged Jul 25, 2024

• merge main into fix-image-deletion-in-cloud

  #1933 merged Jul 25, 2024

• Fix: Ensure CLI catches and reports errors

  #1928 merged Jul 25, 2024

• [PoC-1] Display optional inline intermediate outputs in Playground

  #1930 merged Jul 25, 2024

• feat(sdk): Adding inline trace information

  #1929 merged Jul 25, 2024

• Enhancement/n+1 query resolve

  #1926 merged Jul 24, 2024

• [Feature]: Implemented Rag Faithfulness and Context Relevancy Evaluators

  #1924 merged Jul 24, 2024

• Bump versions

  #1923 merged Jul 23, 2024

• [Cleanup]: remove useless env

  #1648 merged Jul 23, 2024

• [Bug Fix]: resolve get_config exception: badly formed hexadecimal UUID string

  #1905 merged Jul 23, 2024

• [Feature]: Implement Semantic Similariity Match Evaluator

  #1921 merged Jul 23, 2024

• Fix: <img> warnings during build process

  #1908 merged Jul 23, 2024

• Fixes several issues with the SDK related to observability

  #1896 merged Jul 23, 2024

• chore(deps-dev): bump setuptools from 70.3.0 to 71.1.0 in /agenta-cli

  #1920 merged Jul 23, 2024

• chore(deps-dev): bump pytest from 8.2.2 to 8.3.1 in /agenta-cli

  #1919 merged Jul 23, 2024

• Dependabot prs 23 07

  #1922 merged Jul 23, 2024

• [Bug Fix]: age-374

  #1918 merged Jul 22, 2024

• [Bug Fix]: evaluation fails when using gh docker container

  #1917 merged Jul 22, 2024

• [Feature]: Implement JSON Diff Evaluator

  #1910 merged Jul 19, 2024

• feat(app): startweb standalone on any docker

  #1912 merged Jul 18, 2024

• Fix: resolved the title warning issue

  #1904 merged Jul 17, 2024

• Refactor: TestsetTable component code has been refactored

  #1892 merged Jul 17, 2024

• Fix: outdated sentry version

  #1903 merged Jul 17, 2024

• [Enhancement]: Logs are not fetched in cloud

  #1706 merged Jul 17, 2024

• Fix/webhooks errors and docs

  #1900 merged Jul 17, 2024

• Feat: save variant tabs position

  #1895 merged Jul 16, 2024

• [Enhancement]: Alembic migration strategy

  #1884 merged Jul 16, 2024

• chore(deps): bump cachetools from 5.3.3 to 5.4.0 in /agenta-cli

  #1898 merged Jul 16, 2024

• chore(deps): bump fastapi from 0.111.0 to 0.111.1 in /agenta-cli

  #1886 merged Jul 16, 2024

• Dependabot prs 16 07

  #1899 merged Jul 16, 2024

• Bump versions

  #1894 merged Jul 15, 2024

• fix(frontend): Test creation in single model eval does not work in table view

  #1885 merged Jul 15, 2024

• Refactor: removed duplicate StyleProps types

  #1891 merged Jul 15, 2024

• [Bug Fix]: Updating template table in cloud-dev fails

  #1869 merged Jul 15, 2024

• [Bug] TypeError: e.localeCompare is not a function

  #1878 merged Jul 15, 2024

• Bump versions

  #1881 merged Jul 12, 2024

• Filter out evaluations with null testsets

  #1880 merged Jul 12, 2024

• build(deps): bump pydantic from 2.7.4 to 2.8.2 in /agenta-cli

  #1843 merged Jul 11, 2024

• build(deps): bump pydantic from 2.7.4 to 2.8.0 in /agenta-cli

  #1832 merged Jul 11, 2024

• build(deps): bump pymongo from 4.7.3 to 4.8.0 in /agenta-cli

  #1819 merged Jul 11, 2024

• chore(deps-dev): bump setuptools from 70.2.0 to 70.3.0 in /agenta-cli

  #1868 merged Jul 11, 2024

• build(deps): bump importlib-metadata from 7.2.0 to 8.0.0 in /agenta-cli

  #1815 merged Jul 11, 2024

• Dependabot prs

  #1877 merged Jul 11, 2024

• Bump versions

  #1876 merged Jul 11, 2024

• [Hot fix]: ignore permission to check human evaluation access in the case object_db is None

  #1875 merged Jul 11, 2024

• docker compose cleanup from mongo post-migration

  #1871 merged Jul 11, 2024

• Bump versions

  #1874 merged Jul 11, 2024

• [Bug fix]: Human evaluation UI breaks when a variant has been deleted

  #1872 merged Jul 11, 2024

• refactor(backend): remove code for deleting db and tables

  #1864 merged Jul 10, 2024

• Bump versions

  #1867 merged Jul 9, 2024

• Refactor: removed code duplication from ChatInputs component

  #1834 merged Jul 9, 2024

• fix(backend): AGE-391 Fix different error info in playground and evals

  #1857 merged Jul 9, 2024

• Enhance: improved the settings LLM keys buttons and container spacing

  #1779 merged Jul 9, 2024

• fix(backend): Fixes use of feature flag for local cloud dev with templates

  #1862 merged Jul 9, 2024

• [Bug fix]: CLI overwriting an app does not update configuration #1863

  #1866 merged Jul 9, 2024

• [Feature]: Added postgres to gh compose for production use

  #1860 merged Jul 9, 2024

• AGE-386 Updated documenation and Readme for migration

  #1861 merged Jul 9, 2024

• Bump versions

  #1859 merged Jul 9, 2024

• feat(db-postgres): migrate from mongodb to postgres

  #1753 merged Jul 9, 2024

• [Bug Fix]: CLI config (app_id) mismatch with backend UUID handling

  #1858 merged Jul 8, 2024

• Resolve merge conflict between postgres and main

  #1854 merged Jul 7, 2024

• Bug/deleting docker image result in an integrity error for variant

  #1853 merged Jul 7, 2024

• Enhancement: update user lookup logic for backward compatibility in api key migration

  #1852 merged Jul 7, 2024

• Refactor/add function to fetch corresponding object UUID

  #1851 merged Jul 6, 2024

• Bump versions

  #1849 merged Jul 5, 2024

• fix(sdk): AGE-272 Propagate func errors up in @ag.instrument() wrappers

  #1846 merged Jul 5, 2024

• docs: add jp-agenta as a contributor for code, and bug

  #1848 merged Jul 5, 2024

• Fix two likely causes of infinitely running evaluations

  #1840 merged Jul 5, 2024

• Fix evaluation status which never was set to Queued.

  #1841 merged Jul 5, 2024

• Fix incomplete stacktraces in evaluations

  #1842 merged Jul 5, 2024

• Fix issue where Evaluation Results don't load when individual Evaluation Scenarios fail

  #1844 merged Jul 5, 2024

• Bug fix/variant deletion unpublish other variants environment

  #1845 merged Jul 5, 2024

• Improve error handling in evaluation

  #1708 merged Jul 5, 2024

• feat(db-postgres): data migration script from mongo to postgres

  #1772 merged Jul 3, 2024

• Postgres

  #1839 merged Jul 3, 2024

• [cloud related] migration/beanie to sqlalchemy

  #1811 merged Jul 3, 2024

• [Enhancement]: Resolve Failing Backend Tests

  #1838 merged Jul 3, 2024

• build(deps): bump importlib-metadata from 7.2.0 to 7.2.1 in /agenta-cli

  #1810 merged Jul 2, 2024

• Docs/postgres migration documentation

  #1831 merged Jul 2, 2024

• build(deps-dev): bump setuptools from 70.1.0 to 70.2.0 in /agenta-cli

  #1833 merged Jul 2, 2024

• code refactor (backend): replace query api .one_or_none() to .first()

  #1836 merged Jul 2, 2024

• Mmabrouk/fix/AGE-341-fix-nonetype-has-no-attribute-cost-in-playground

  #1826 merged Jul 2, 2024

16 Pull requests opened by 8 people

• fix(frontend): Restoring a variant revision in the playground fails

  #1837 opened Jul 2, 2024

• use next dev --turbo

  #1882 opened Jul 12, 2024

• Enhance: add encryption to LLM keys

  #1897 opened Jul 15, 2024

• [Enhancement]: Optimize SQL Queries in SQLAlchemy to Eliminate N+1 Problem

  #1902 opened Jul 16, 2024

• chore(deps-dev): bump pytest from 8.3.1 to 8.3.2 in /agenta-cli

  #1935 opened Jul 26, 2024

• feat(backend): AGE-276 and AGE-471 Improves LLM-as-a-judge reliability

  #1938 opened Jul 26, 2024

• [feature] : inline traces, internals, RAG evaluators

  #1940 opened Jul 28, 2024

• Improve description Json diff eval and fix minor issue

  #1941 opened Jul 28, 2024

• Fix: EvaluationCardView.tsx component's build warnings

  #1948 opened Jul 30, 2024

• chore(deps-dev): bump setuptools from 71.1.0 to 72.1.0 in /agenta-cli

  #1949 opened Jul 30, 2024

• Fix: all single warnings in the build process

  #1950 opened Jul 30, 2024

• Fix: evaluation related build warnings

  #1951 opened Jul 30, 2024

• Fix: random component's build time warning errors

  #1952 opened Jul 30, 2024

• Fix: human evaluation tests syntax error

  #1953 opened Jul 30, 2024

• fix: creates evaluators when app is created

  #1955 opened Jul 31, 2024

• [Feature][DRAFT]: expose running evaluators via API to playground

  #1956 opened Aug 1, 2024

17 Issues closed by 5 people

• K8s Support

  #1954 closed Jul 30, 2024

• [AGE-287] Add semantic similarity evaluator

  #1742 closed Jul 26, 2024

• [AGE-270] [Bug] Evaluation fails when using .gh docker container

  #1321 closed Jul 22, 2024

• [AGE-83] [PoC-4] Display trace information in the playground

  #1642 closed Jul 20, 2024

• [AGE-286] Create a JSON evaluator

  #1741 closed Jul 19, 2024

• [Bug]: Test set table columns position are not changing after drag-and-drop

  #1751 closed Jul 17, 2024

• Refactore: TestsetTable.tsx component code for better readability

  #1764 closed Jul 17, 2024

• Enhancement: save variant tabs order

  #1789 closed Jul 16, 2024

• [AGE-399] [bug] Test creation in single model eval does not work in table view

  #1855 closed Jul 15, 2024

• how can Agenta be integrated with ollama LLM platform

  #1887 closed Jul 15, 2024

• [AGE-424] [Bug] Organization Mongo ObjectId initialized to empty when signing up through Github

  #1470 closed Jul 15, 2024

• [Enhancement]: Table row's delete button placement and UI

  #1803 closed Jul 14, 2024

• [AGE-391] [bug] LLM invocation errors are not correctly shown in the evaluation detail view

  #1850 closed Jul 9, 2024

• [AGE-348] [bug] Errors are not correctly handled in the LLM applications

  #1805 closed Jul 5, 2024

• [AGE-365] Add new status for evaluation Queued

  #1821 closed Jul 5, 2024

• [AGE-272] [Bug] Improve errors in evaluation view

  #1300 closed Jul 5, 2024

• [AGE-273] [sub-issue] Evaluation fails when correct_answer is not set in the test set

  #1276 closed Jul 5, 2024

9 Issues opened by 4 people

• [AGE-474] JSON diff evaluator not working expectedly

  #1942 opened Jul 28, 2024

• [AGE-452] [bug] create_new_evaluator_config not setting default correct_answer value

  #1916 opened Jul 19, 2024

• After local deployment, when creating an app through the page, there is still an error message when opening it http:https://0.0.0.0:80 How to modify this for accessing

  #1915 opened Jul 19, 2024

• [AGE-451] Agent deployed by yourself, how to configure it when you want to Create a Custom App?

  #1913 opened Jul 18, 2024

• Can I deploy without using port 80 ？

  #1909 opened Jul 18, 2024

• [AGE-433] [bug] New exact match and JSON evaluators are created with each served variant

  #1901 opened Jul 16, 2024

• Add encryption to LLM provider keys before saving it

  #1879 opened Jul 12, 2024

• [AGE-112] [Evaluations] start new evaluation from previous evaluation

  #1870 opened Jul 10, 2024

• Add Exception handling in Agenta Observability

  #1847 opened Jul 5, 2024

11 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [AGE-271] View the configuration used in each LLM app in the evaluation comparison view

  #1308 commented on Jul 7, 2024 • 0 new comments

• [AGE-267] Add RAGAS evaluators to the platform

  #1530 commented on Jul 7, 2024 • 0 new comments

• [AGE-268] Display evaluators settings within the Evaluation Scenario page

  #1340 commented on Jul 7, 2024 • 0 new comments

• [AGE-274] Evaluation: Rerun a cancelled job

  #1249 commented on Jul 10, 2024 • 0 new comments

• [AGE-275] [Evaluations] cancel / terminate evaluation

  #1248 commented on Jul 12, 2024 • 0 new comments

• [AGE-345] [bug] Some models are not working in the playground

  #1801 commented on Jul 28, 2024 • 0 new comments

• [AGE-357] [bug] Removing a variant used in an A/B test evaluation breaks the human evaluation view

  #1817 commented on Jul 28, 2024 • 0 new comments

• [AGE-230] [Bug] Start from code can fail if user has a .dockerignore or Dockerfile

  #1738 commented on Jul 28, 2024 • 0 new comments

• [AGE-276] Improve robustness AI critique evaluation

  #1233 commented on Jul 30, 2024 • 0 new comments

• Fixes local URI for deployments

  #1695 commented on Jul 2, 2024 • 0 new comments

• [Test]: Add cypress tests in Cloud

  #1807 commented on Jul 28, 2024 • 0 new comments