Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

train probe per prompt #271

Open
wants to merge 20 commits into
base: main
Choose a base branch
from
Open

train probe per prompt #271

Changes from 1 commit
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
47bcfb2
added cli arg
derpyplops Jul 13, 2023
a50fe57
refactor reporter training
derpyplops Jul 13, 2023
52b1394
WIP add multiprobe training
derpyplops Jul 14, 2023
2420ae0
multiprobe elicit works
derpyplops Jul 14, 2023
f35626a
fix pyright
derpyplops Jul 14, 2023
898c3f1
implemented multi probe for elicit
derpyplops Jul 18, 2023
01d5baa
undo list
derpyplops Jul 18, 2023
7701c29
add more types and sorting
derpyplops Jul 18, 2023
4310def
weird duplicate arg
derpyplops Jul 18, 2023
96a3dab
resolved circular import
derpyplops Jul 19, 2023
9c2def0
fixed index passing
derpyplops Jul 19, 2023
29eeb7f
fixed index passing again
derpyplops Jul 20, 2023
f533418
add assert
derpyplops Jul 20, 2023
0f5ce0b
fix prompt index in loading
derpyplops Jul 20, 2023
327d1eb
remove redundant method
derpyplops Jul 20, 2023
51b7d3c
correctly eval with multiple probes and some renaming
derpyplops Jul 20, 2023
75fe560
remove wrong function
derpyplops Jul 20, 2023
1b6757a
pyright
derpyplops Jul 20, 2023
0d6c8b9
pytest
derpyplops Jul 20, 2023
785537b
pyright
derpyplops Jul 20, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
pyright
  • Loading branch information
@derpyplops
derpyplops committed Jul 20, 2023
commit 785537b4882e9996e7c6b70aeb0e988d5c173acf
4 changes: 2 additions & 2 deletions elk/training/multi_reporter.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,8 +29,8 @@ def __init__(self, reporter: list[ReporterWithInfo]):
)

self.train_loss = (
sum(train_losses) / len(train_losses)
if train_losses is not None # type: ignore
sum(train_losses) / len(train_losses) # type: ignore
if train_losses is not None
else None
)

Expand Down