Jupyter notebook example

[anuragreddygv323]

Could you let me know how to use it in Jupyter notebook.

Should I add something to lightgbm package ?

Can u add an example

[acbull]

Original "lightgbm" provides a good python API, which you can refer for using it in jupyter.
https://lightgbm.readthedocs.io/en/latest/Python-Intro.html
Thus, compile the files we provide, then you can use our code in Jupiter.
I will consider adding a test python code sooner for illustration, but you can first have a quick try.

[anuragreddygv323]

root@ml-dev-66d476d4dd-c5vvk:~/Unbiased_LambdaMart/Unbias_LightGBM/build# make -j4
Scanning dependencies of target lightgbm
Scanning dependencies of target _lightgbm
[ 3%] Building CXX object CMakeFiles/_lightgbm.dir/src/lightgbm_R.cpp.o
[ 3%] Building CXX object CMakeFiles/_lightgbm.dir/src/c_api.cpp.o
[ 4%] Building CXX object CMakeFiles/_lightgbm.dir/src/application/application.cpp.o
[ 6%] Building CXX object CMakeFiles/lightgbm.dir/src/main.cpp.o
[ 8%] Building CXX object CMakeFiles/lightgbm.dir/src/application/application.cpp.o
[ 9%] Building CXX object CMakeFiles/_lightgbm.dir/src/boosting/boosting.cpp.o
[ 11%] Building CXX object CMakeFiles/_lightgbm.dir/src/boosting/gbdt.cpp.o
[ 13%] Building CXX object CMakeFiles/lightgbm.dir/src/boosting/boosting.cpp.o
[ 14%] Building CXX object CMakeFiles/lightgbm.dir/src/boosting/gbdt.cpp.o
[ 16%] Building CXX object CMakeFiles/_lightgbm.dir/src/boosting/gbdt_model_text.cpp.o
[ 18%] Building CXX object CMakeFiles/lightgbm.dir/src/boosting/gbdt_model_text.cpp.o
[ 19%] Building CXX object CMakeFiles/lightgbm.dir/src/boosting/gbdt_prediction.cpp.o
[ 21%] Building CXX object CMakeFiles/lightgbm.dir/src/boosting/prediction_early_stop.cpp.o
[ 22%] Building CXX object CMakeFiles/_lightgbm.dir/src/boosting/gbdt_prediction.cpp.o
[ 24%] Building CXX object CMakeFiles/lightgbm.dir/src/io/bin.cpp.o
[ 26%] Building CXX object CMakeFiles/lightgbm.dir/src/io/config.cpp.o
[ 27%] Building CXX object CMakeFiles/_lightgbm.dir/src/boosting/prediction_early_stop.cpp.o
[ 29%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/bin.cpp.o
[ 31%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/config.cpp.o
[ 32%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/dataset.cpp.o
[ 34%] Building CXX object CMakeFiles/lightgbm.dir/src/io/dataset.cpp.o
[ 36%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/dataset_loader.cpp.o
[ 37%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/file_io.cpp.o
[ 39%] Building CXX object CMakeFiles/lightgbm.dir/src/io/dataset_loader.cpp.o
[ 40%] Building CXX object CMakeFiles/lightgbm.dir/src/io/file_io.cpp.o
[ 42%] Building CXX object CMakeFiles/lightgbm.dir/src/io/json11.cpp.o
[ 44%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/json11.cpp.o
[ 45%] Building CXX object CMakeFiles/lightgbm.dir/src/io/metadata.cpp.o
[ 47%] Building CXX object CMakeFiles/lightgbm.dir/src/io/parser.cpp.o
[ 49%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/metadata.cpp.o
[ 50%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/parser.cpp.o
[ 52%] Building CXX object CMakeFiles/lightgbm.dir/src/io/tree.cpp.o
[ 54%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/tree.cpp.o
[ 55%] Building CXX object CMakeFiles/lightgbm.dir/src/metric/dcg_calculator.cpp.o
[ 57%] Building CXX object CMakeFiles/lightgbm.dir/src/metric/metric.cpp.o
[ 59%] Building CXX object CMakeFiles/_lightgbm.dir/src/metric/dcg_calculator.cpp.o
[ 60%] Building CXX object CMakeFiles/_lightgbm.dir/src/metric/metric.cpp.o
[ 62%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/linker_topo.cpp.o
[ 63%] Building CXX object CMakeFiles/lightgbm.dir/src/network/linker_topo.cpp.o
[ 65%] Building CXX object CMakeFiles/lightgbm.dir/src/network/linkers_mpi.cpp.o
[ 67%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/linkers_mpi.cpp.o
[ 68%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/linkers_socket.cpp.o
[ 70%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/network.cpp.o
[ 72%] Building CXX object CMakeFiles/lightgbm.dir/src/network/linkers_socket.cpp.o
[ 73%] Building CXX object CMakeFiles/lightgbm.dir/src/network/network.cpp.o
[ 75%] Building CXX object CMakeFiles/lightgbm.dir/src/objective/objective_function.cpp.o
[ 77%] Building CXX object CMakeFiles/_lightgbm.dir/src/objective/objective_function.cpp.o
[ 78%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/data_parallel_tree_learner.cpp.o
[ 80%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/feature_parallel_tree_learner.cpp.o
[ 81%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/data_parallel_tree_learner.cpp.o
[ 83%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/feature_parallel_tree_learner.cpp.o
[ 85%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/gpu_tree_learner.cpp.o
[ 86%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/gpu_tree_learner.cpp.o
[ 88%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/serial_tree_learner.cpp.o
[ 90%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/serial_tree_learner.cpp.o
[ 91%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/tree_learner.cpp.o
[ 93%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/tree_learner.cpp.o
[ 95%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/voting_parallel_tree_learner.cpp.o
[ 96%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/voting_parallel_tree_learner.cpp.o
[ 98%] Linking CXX shared library ../lib_lightgbm.so
[ 98%] Built target _lightgbm
[100%] Linking CXX executable ../lightgbm
[100%] Built target lightgbm

**Compiled it. Now how to call this in a notebook. I tried doing

import lightgbm as lgb

error: ModuleNotFoundError: No module named 'lightgbm'

could you help. After compiling, what to do to make sure that I can call it like a typical package on Jupyter notebook.**

[acbull]

Sorry about previous mistake. I checked the python interface, and find that there are some parts need to be modified to adapt our changes. I will fix this issue as soon as possible.

Meanwhile, I also provide a really simple script for you to run. After you compile the model, you can find a compiled "lightgbm" file. Move this file into "examples/lambdarank", then execute it by:

./lightgbm config="train.conf"

And you can see the log and the trained model.

Using the jupyter is exactly the same as modifying "train.conf", so you can have a try before I modify the python interface.

[simon19891101]

Hey @acbull, thanks for contributing the great Unbiased LambdaMart. May I know if there's any update on the python API? Thanks!