Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH - Add Pinball datafit #134

Merged
merged 31 commits into from
Dec 9, 2022
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
413ef54
remove sqrt n_samples
Badr-MOUFAD Nov 30, 2022
2ef5eb7
update unittest
Badr-MOUFAD Nov 30, 2022
5c0bedc
info comment statsmodels
Badr-MOUFAD Dec 1, 2022
ca6ece7
add prox subdiff to sqrt df
Badr-MOUFAD Dec 1, 2022
a6303e5
implement ``PDCD_WS``
Badr-MOUFAD Dec 1, 2022
e8fcee3
r sqrt_n from CB
Badr-MOUFAD Dec 1, 2022
339e98f
Merge branch 'r-sqrt-n' of https://github.com/Badr-MOUFAD/skglm into …
Badr-MOUFAD Dec 1, 2022
19a0ea9
bug w and subdiff
Badr-MOUFAD Dec 1, 2022
e01451d
unittest sqrt
Badr-MOUFAD Dec 1, 2022
dd36b88
add docs
Badr-MOUFAD Dec 1, 2022
523419b
fix docs SqrtQuadratic
Badr-MOUFAD Dec 1, 2022
71de179
Merge branch 'main' of https://github.com/scikit-learn-contrib/skglm …
Badr-MOUFAD Dec 2, 2022
63a547b
subdiff --> fixed_point
Badr-MOUFAD Dec 4, 2022
f78d17d
efficient prox conjugate && fix tests
Badr-MOUFAD Dec 5, 2022
d0ae3a4
remove go
Badr-MOUFAD Dec 5, 2022
ad36485
MM remarks
Badr-MOUFAD Dec 5, 2022
f60bd59
fix test && clean ups
Badr-MOUFAD Dec 5, 2022
5a5f1ba
MM round 2 remarks
Badr-MOUFAD Dec 5, 2022
4f27c56
CI Trigger
Badr-MOUFAD Dec 5, 2022
fe45faa
implement pinball
Badr-MOUFAD Dec 6, 2022
3ce886f
unittest
Badr-MOUFAD Dec 6, 2022
6928502
fix pinball value && ST step
Badr-MOUFAD Dec 6, 2022
1271288
more unittest
Badr-MOUFAD Dec 6, 2022
bd1984a
fix bug prox pinball
Badr-MOUFAD Dec 6, 2022
36100c7
Merge branch 'main' of https://github.com/scikit-learn-contrib/skglm …
Badr-MOUFAD Dec 8, 2022
1a03c60
MM remarks
Badr-MOUFAD Dec 8, 2022
4b3ea45
Update skglm/experimental/quantile_regression.py
mathurinm Dec 8, 2022
9cf2216
pinball expression
Badr-MOUFAD Dec 8, 2022
626b71d
Merge branch 'pinball-df' of https://github.com/Badr-MOUFAD/skglm int…
Badr-MOUFAD Dec 8, 2022
8e93720
sqrt --> pinball
Badr-MOUFAD Dec 8, 2022
0a247f0
quantile --> quantile_level
Badr-MOUFAD Dec 9, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
efficient prox conjugate && fix tests
  • Loading branch information
Badr-MOUFAD committed Dec 5, 2022
commit f78d17d3671b981cd6b509fdc9bd50c72a0b558a
5 changes: 2 additions & 3 deletions skglm/experimental/sqrt_lasso.py
Original file line number Diff line number Diff line change
Expand Up @@ -59,9 +59,8 @@ def prox(self, w, step, y):
return y - BST(y - w, step)

def prox_conjugate(self, z, step, y):
"""Prox of ||y - . ||^* with step using Moreau decomposition."""
inv_step = 1 / step
return z - step * self.prox(inv_step * z, inv_step, y)
"""Prox of ||y - . ||^* with step."""
return proj_L2ball(z - step * y)

def subdiff_distance(self, Xw, z, y):
"""Distance of ``z`` to subdiff of ||y - . || at ``Xw``."""
Expand Down
12 changes: 7 additions & 5 deletions skglm/experimental/tests/test_sqrt_lasso.py
Original file line number Diff line number Diff line change
Expand Up @@ -69,18 +69,20 @@ def test_PDCD_WS(with_dual_init):

dual_init = y / norm(y) if with_dual_init else None

w, _, _ = PDCD_WS(dual_init=dual_init).solve(X, y, SqrtQuadratic(), L1(alpha))
w = PDCD_WS(dual_init=dual_init).solve(X, y, SqrtQuadratic(), L1(alpha))[0]
clf = SqrtLasso(alpha=alpha, tol=1e-12).fit(X, y)
w, _, _ = _chambolle_pock_sqrt(X, y, alpha, max_iter=1000)
np.testing.assert_allclose(clf.coef_, w)
np.testing.assert_allclose(clf.coef_, w, atol=1e-6)


if __name__ == '__main__':
n_samples, n_features = 50, 1000
import plotly.graph_objects as go

n_samples, n_features = 10, 100
X, y, _ = make_correlated_data(n_samples, n_features, random_state=0)

alpha_max = norm(X.T @ y, ord=np.inf) / norm(y)
alpha = alpha_max / 10

PDCD_WS(verbose=1, dual_init=y / norm(y)).solve(X, y, SqrtQuadratic(), L1(alpha))
PDCD_WS(verbose=1, dual_init=y / norm(y), p0=1000,
max_epochs=10_000).solve(X, y, SqrtQuadratic(), L1(alpha))
pass