Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pyspark] support tying #9172

Merged
merged 1 commit into from
May 19, 2023
Merged

Conversation

wbo4958
Copy link
Contributor

@wbo4958 wbo4958 commented May 18, 2023

To fix #9169

Now, with this PR, pyspark can support typing.

@wbo4958
Copy link
Contributor Author

wbo4958 commented May 18, 2023

Hi @trivialfis, @WeichenXu123 please help to review this PR. Thx

Copy link
Member

@trivialfis trivialfis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for finalizing the type hint for the core package.

@@ -1071,8 +1117,9 @@ def _transform(self, dataset):
single_pred = False
schema = f"{pred.prediction} double, {pred.pred_contrib} array<double>"

@pandas_udf(schema)
@pandas_udf(schema) # type: ignore
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was thinking how did you figure out the typing for udf ...

@trivialfis trivialfis merged commit 6274fba into dmlc:master May 19, 2023
@wbo4958 wbo4958 deleted the pyspark-mypy-format branch April 23, 2024 07:43
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[pyspark] support typing for core.py
3 participants