Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: NatLibFi/Annif
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: NatLibFi/Annif
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: experiment-llm-rescoring-with-prompt
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 10 commits
  • 3 files changed
  • 1 contributor

Commits on Jun 13, 2024

  1. Expiriment to rescore suggestions with LLM

    @juhoinkinen
    juhoinkinen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    f384bbd View commit details
    Browse the repository at this point in the history

  2. Output json and try to be reproducible

    @juhoinkinen
    juhoinkinen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    afed06d View commit details
    Browse the repository at this point in the history

  3. Catch API error & some config improvements

    @juhoinkinen
    juhoinkinen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    fc30675 View commit details
    Browse the repository at this point in the history

  4. Drop redundant method; make client instance property

    @juhoinkinen
    juhoinkinen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    728bbd0 View commit details
    Browse the repository at this point in the history

  5. Use token/line probabilities to weight LLM scores

    @juhoinkinen
    juhoinkinen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    29001b8 View commit details
    Browse the repository at this point in the history

  6. Catch jsonerror; try relative weighting

    @juhoinkinen
    juhoinkinen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    ccb1b84 View commit details
    Browse the repository at this point in the history

  7. Cofigurable relative weights for LLM and base sources

    @juhoinkinen
    juhoinkinen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    463ba36 View commit details
    Browse the repository at this point in the history

  8. Disable probability weighting

    @juhoinkinen
    juhoinkinen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    d0ac922 View commit details
    Browse the repository at this point in the history

  9. Truncate text to 14k tokens; use only base suggestion score for llm l… 

    …abel misses
    @juhoinkinen
    juhoinkinen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    1da82fc View commit details
    Browse the repository at this point in the history

  10. Cleanup probability weights

    @juhoinkinen
    juhoinkinen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    5248218 View commit details
    Browse the repository at this point in the history
Loading