1. 04 Sep, 2023 1 commit
    • Pavel Metrikov's avatar
      Treat position bias via GAM in LambdaMART (#5929) · 7e34d23c
      Pavel Metrikov authored
      
      
      * Update dataset.h
      
      * Update metadata.cpp
      
      * Update rank_objective.hpp
      
      * Update metadata.cpp
      
      * Update rank_objective.hpp
      
      * Update metadata.cpp
      
      * Update dataset.h
      
      * Update rank_objective.hpp
      
      * Update metadata.cpp
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Add files via upload
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update _rank.train.position
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update _rank.train.position
      
      * Update _rank.train.position
      
      * Update test_engine.py
      
      * Update _rank.train.position
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update the position of import statement
      
      * Update rank_objective.hpp
      
      * Update config.h
      
      * Update config_auto.cpp
      
      * Update rank_objective.hpp
      
      * Update rank_objective.hpp
      
      * update documentation
      
      * remove extra blank line
      
      * Update src/io/metadata.cpp
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update src/io/metadata.cpp
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * remove _rank.train.position
      
      * add position in python API
      
      * fix set_positions in basic.py
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update docs/Advanced-Topics.rst
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update docs/Advanced-Topics.rst
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * Update Advanced-Topics.rst
      
      * remove List from _LGBM_PositionType
      
      * move new position parameter to the last in Dataset constructor
      
      * add position_filename as a parameter
      
      * Update docs/Advanced-Topics.rst
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update docs/Advanced-Topics.rst
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update Advanced-Topics.rst
      
      * Update src/objective/rank_objective.hpp
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update src/io/metadata.cpp
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update metadata.cpp
      
      * Update python-package/lightgbm/basic.py
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update python-package/lightgbm/basic.py
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update python-package/lightgbm/basic.py
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update python-package/lightgbm/basic.py
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update src/io/metadata.cpp
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * more infomrative fatal message
      
      address more comments
      
      * update documentation for more flexible position specification
      
      * fix SetPosition
      
      add tests for get_position and set_position
      
      * remove position_filename
      
      * remove useless changes
      
      * Update python-package/lightgbm/basic.py
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * remove useless files
      
      * move position file when position set in Dataset
      
      * warn when positions are overwritten
      
      * skip ranking with position test in cuda
      
      * split test case
      
      * remove useless import
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update test_engine.py
      
      * Update docs/Advanced-Topics.rst
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update Parameters.rst
      
      * Update rank_objective.hpp
      
      * Update config.h
      
      * update config_auto.cppp
      
      * Update docs/Advanced-Topics.rst
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * fix randomness in test case for gpu
      
      ---------
      Co-authored-by: default avatarshiyu1994 <shiyu_k1994@qq.com>
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      7e34d23c
  2. 13 Aug, 2023 1 commit
  3. 06 Jul, 2023 1 commit
  4. 30 Jun, 2023 1 commit
  5. 16 Jun, 2023 1 commit
  6. 05 May, 2023 1 commit
    • shiyu1994's avatar
      Add quantized training (CPU part) (#5800) · 17ecfab3
      shiyu1994 authored
      * add quantized training (first stage)
      
      * add histogram construction functions for integer gradients
      
      * add stochastic rounding
      
      * update docs
      
      * fix compilation errors by adding template instantiations
      
      * update files for compilation
      
      * fix compilation of gpu version
      
      * initialize gradient discretizer before share states
      
      * add a test case for quantized training
      
      * add quantized training for data distributed training
      
      * Delete origin.pred
      
      * Delete ifelse.pred
      
      * Delete LightGBM_model.txt
      
      * remove useless changes
      
      * fix lint error
      
      * remove debug loggings
      
      * fix mismatch of vector and allocator types
      
      * remove changes in main.cpp
      
      * fix bugs with uninitialized gradient discretizer
      
      * initialize ordered gradients in gradient discretizer
      
      * disable quantized training with gpu and cuda
      
      fix msvc compilation errors and warnings
      
      * fix bug in data parallel tree learner
      
      * make quantized training test deterministic
      
      * make quantized training in test case more accurate
      
      * refactor test_quantized_training
      
      * fix leaf splits initialization with quantized training
      
      * check distributed quantized training result
      17ecfab3
  7. 21 Mar, 2023 1 commit
  8. 14 Feb, 2023 1 commit
  9. 13 Feb, 2023 1 commit
  10. 01 Feb, 2023 1 commit
    • James Lamb's avatar
      [CUDA] consolidate CUDA versions (#5677) · 4f47547c
      James Lamb authored
      
      
      * [ci] speed up if-else, swig, and lint conda setup
      
      * add 'source activate'
      
      * python constraint
      
      * start removing cuda v1
      
      * comment out CI
      
      * remove more references
      
      * revert some unnecessaary changes
      
      * revert a few more mistakes
      
      * revert another change that ignored params
      
      * sigh
      
      * remove CUDATreeLearner
      
      * fix tests, docs
      
      * fix quoting in setup.py
      
      * restore all CI
      
      * Apply suggestions from code review
      Co-authored-by: default avatarshiyu1994 <shiyu_k1994@qq.com>
      
      * Apply suggestions from code review
      
      * completely remove cuda_exp, update docs
      
      ---------
      Co-authored-by: default avatarshiyu1994 <shiyu_k1994@qq.com>
      4f47547c
  11. 28 Dec, 2022 1 commit
    • Yifei Liu's avatar
      Decouple Boosting Types (fixes #3128) (#4827) · fffd066c
      Yifei Liu authored
      
      
      * add parameter data_sample_strategy
      
      * abstract GOSS as a sample strategy(GOSS1), togetherwith origial GOSS (Normal Bagging has not been abstracted, so do NOT use it now)
      
      * abstract Bagging as a subclass (BAGGING), but original Bagging members in GBDT are still kept
      
      * fix some variables
      
      * remove GOSS(as boost) and Bagging logic in GBDT
      
      * rename GOSS1 to GOSS(as sample strategy)
      
      * add warning about use GOSS as boosting_type
      
      * a little ; bug
      
      * remove CHECK when "gradients != nullptr"
      
      * rename DataSampleStrategy to avoid confusion
      
      * remove and add some ccomments, followingconvention
      
      * fix bug about GBDT::ResetConfig (ObjectiveFunction inconsistencty bet…
      
      * add std::ignore to avoid compiler warnings (anpotential fails)
      
      * update Makevars and vcxproj
      
      * handle constant hessian
      
      move resize of gradient vectors out of sample strategy
      
      * mark override for IsHessianChange
      
      * fix lint errors
      
      * rerun parameter_generator.py
      
      * update config_auto.cpp
      
      * delete redundant blank line
      
      * update num_data_ when train_data_ is updated
      
      set gradients and hessians when GOSS
      
      * check bagging_freq is not zero
      
      * reset config_ value
      
      merge ResetBaggingConfig and ResetGOSS
      
      * remove useless check
      
      * add ttests in test_engine.py
      
      * remove whitespace in blank line
      
      * remove arguments verbose_eval and evals_result
      
      * Update tests/python_package_test/test_engine.py
      
      reduce num_boost_round
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update tests/python_package_test/test_engine.py
      
      reduce num_boost_round
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update tests/python_package_test/test_engine.py
      
      reduce num_boost_round
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update tests/python_package_test/test_engine.py
      
      reduce num_boost_round
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update tests/python_package_test/test_engine.py
      
      reduce num_boost_round
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update tests/python_package_test/test_engine.py
      
      reduce num_boost_round
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update src/boosting/sample_strategy.cpp
      
      modify warning about setting goss as `boosting_type`
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * Update tests/python_package_test/test_engine.py
      
      replace load_boston() with make_regression()
      
      remove value checks of mean_squared_error in test_sample_strategy_with_boosting()
      
      * Update tests/python_package_test/test_engine.py
      
      add value checks of mean_squared_error in test_sample_strategy_with_boosting()
      
      * Modify warnning about using goss as boosting type
      
      * Update tests/python_package_test/test_engine.py
      
      add random_state=42 for make_regression()
      
      reduce the threshold of mean_square_error
      
      * Update src/boosting/sample_strategy.cpp
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * remove goss from boosting types in documentation
      
      * Update src/boosting/bagging.hpp
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      
      * Update src/boosting/bagging.hpp
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      
      * Update src/boosting/goss.hpp
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      
      * Update src/boosting/goss.hpp
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      
      * rename GOSS with GOSSStrategy
      
      * update doc
      
      * address comments
      
      * fix table in doc
      
      * Update include/LightGBM/config.h
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      
      * update documentation
      
      * update test case
      
      * revert useless change in test_engine.py
      
      * add tests for evaluation results in test_sample_strategy_with_boosting
      
      * include <string>
      
      * change to assert_allclose in test_goss_boosting_and_strategy_equivalent
      
      * more tolerance in result checking, due to minor difference in results of gpu versions
      
      * change == to np.testing.assert_allclose
      
      * fix test case
      
      * set gpu_use_dp to true
      
      * change --report to --report-level for rstcheck
      
      * use gpu_use_dp=true in test_goss_boosting_and_strategy_equivalent
      
      * revert unexpected changes of non-ascii characters
      
      * revert unexpected changes of non-ascii characters
      
      * remove useless changes
      
      * allocate gradients_pointer_ and hessians_pointer when necessary
      
      * add spaces
      
      * remove redundant virtual
      
      * include <LightGBM/utils/log.h> for USE_CUDA
      
      * check for  in test_goss_boosting_and_strategy_equivalent
      
      * check for identity in test_sample_strategy_with_boosting
      
      * remove cuda  option in test_sample_strategy_with_boosting
      
      * Update tests/python_package_test/test_engine.py
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      
      * Update tests/python_package_test/test_engine.py
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      
      * ResetGradientBuffers after ResetSampleConfig
      
      * ResetGradientBuffers after ResetSampleConfig
      
      * ResetGradientBuffers after bagging
      
      * remove useless code
      
      * check objective_function_ instead of gradients
      
      * enable rf with goss
      
      simplify params in test cases
      
      * remove useless changes
      
      * allow rf with feature subsampling alone
      
      * change position of ResetGradientBuffers
      
      * check for dask
      
      * add parameter types for data_sample_strategy
      Co-authored-by: default avatarGuangda Liu <v-guangdaliu@microsoft.com>
      Co-authored-by: default avatarYu Shi <shiyu_k1994@qq.com>
      Co-authored-by: default avatarGuangdaLiu <90019144+GuangdaLiu@users.noreply.github.com>
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      fffd066c
  12. 27 Dec, 2022 1 commit
    • shiyu1994's avatar
      [CUDA] Add L2 metric for new CUDA version (#5633) · 6482b47e
      shiyu1994 authored
      * add rmse metric for new cuda version
      
      * add Init for CUDAMetricInterface
      
      * fix lint errors
      
      * fix rmse and add l2 metric for new cuda version
      
      * use CUDAL2Metric
      
      * explicit template instantiation
      
      * write result only with the first thread
      
      * pre allocate buffer for output converting
      
      * fix l2 regression with cuda metric evaluation
      
      * weighting loss in cuda metric evaluation
      
      * mark CUDATree::AsConstantTree as override
      6482b47e
  13. 02 Dec, 2022 1 commit
  14. 29 Nov, 2022 1 commit
  15. 27 Nov, 2022 1 commit
    • shiyu1994's avatar
      [CUDA] Add Poisson regression objective for cuda_exp and refactor objective... · 24af9fa5
      shiyu1994 authored
      
      [CUDA] Add Poisson regression objective for cuda_exp and refactor objective functions for cuda_exp (#5486)
      
      * add poisson regression objective for cuda_exp
      
      * enable Poisson regression for cuda_exp
      
      * refactor cuda objective functions
      
      * remove useless changes
      
      * fix linter errors
      
      * remove redundant buffer in cuda poisson regression objective
      
      * fix log of cuda_exp binary objective
      
      * fix threshold of poisson objective result
      
      * remove useless changes
      
      * fix compilation errors
      
      * add cuda quantile regression objective
      
      * remove cuda quantile regression objective
      Co-authored-by: default avatarJames Lamb <jaylamb20@gmail.com>
      24af9fa5
  16. 21 Nov, 2022 1 commit
  17. 03 Nov, 2022 1 commit
  18. 11 Oct, 2022 2 commits
  19. 07 Sep, 2022 1 commit
  20. 05 Sep, 2022 2 commits
  21. 02 Sep, 2022 2 commits
  22. 01 Sep, 2022 1 commit
  23. 31 Aug, 2022 2 commits
    • shiyu1994's avatar
      [CUDA] L2 regression objective for cuda_exp (#5452) · 9e89ee7f
      shiyu1994 authored
      * add (l2) regression objective for cuda_exp
      
      * fix lint errors
      
      * correct time tag
      9e89ee7f
    • shiyu1994's avatar
      [CUDA] Add binary objective for cuda_exp (#5425) · 2b8fe8b4
      shiyu1994 authored
      * add binary objective for cuda_exp
      
      * include <string> and <vector>
      
      * exchange include ordering
      
      * fix length of score to copy in evaluation
      
      * fix EvalOneMetric
      
      * fix cuda binary objective and prediction when boosting on gpu
      
      * Add white space
      
      * fix BoostFromScore for CUDABinaryLogloss
      
      update log in test_register_logger
      
      * include <algorithm>
      
      * simplify shared memory buffer
      2b8fe8b4
  24. 29 Aug, 2022 1 commit
  25. 10 Aug, 2022 1 commit
    • Scott Votaw's avatar
      feature: Add true streaming APIs to reduce client-side memory usage (#5299) · 0a5c5838
      Scott Votaw authored
      * Extract streaming to own PR
      
      * small merge fixes and cleanup
      
      * linting fixes
      
      * fix cast warning
      
      * Fix accidental deletion during branch transfer
      
      * responded to initial triage comments
      
      * Added more tests to use create-from-samples APIs
      
      * added mutex and adjusted nclasses logic
      
      * Fix thread-safety for pushing data to sparse bins through Push APIs
      
      * lint and doc fixes
      
      * Small SWIG fix
      
      * nit fix
      
      * Responded to StrikerRUS comments
      
      * fix breaking change after merge with master
      
      * Extract streaming to own PR
      
      * small merge fixes and cleanup
      
      * Fix accidental deletion during branch transfer
      
      * responded to initial triage comments
      
      * Added more tests to use create-from-samples APIs
      
      * Fix rstcheck call in ci
      
      * remove TODOs
      
      * Extract streaming to own PR
      
      * small merge fixes and cleanup
      
      * Fix accidental deletion during branch transfer
      
      * responded to initial triage comments
      
      * Added more tests to use create-from-samples APIs
      
      * Small SWIG fix
      
      * remove ci change
      
      * responded to shiyu1994 comments
      
      * responded to StrikerRUS comments
      
      * Fixes from StrikerRUS comments
      0a5c5838
  26. 30 Jul, 2022 1 commit
  27. 29 Jul, 2022 1 commit
  28. 21 Jul, 2022 1 commit
  29. 27 Jun, 2022 1 commit
    • José Morales's avatar
      [python-package] check feature names in predict with dataframe (fixes #812) (#4909) · bdb02e05
      José Morales authored
      
      
      * check feature names and order in predict with dataframe
      
      * slice df in predict to remove the target
      
      * scramble features
      
      * handle int column names
      
      * only change column order when needed
      
      * include validate_features param in booster and sklearn estimators
      
      * document validate_features argument
      
      * use all_close in preds checks and check for assertion error to compare different arrays
      
      * perform remapping and checks in cpp
      
      * remove extra logs
      
      * fixes
      
      * revert cpp
      
      * proposal
      
      * remove extra arg
      
      * lint
      
      * restore _data_from_pandas arguments
      
      * Apply suggestions from code review
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      
      * move data conversion to Predictor.predict
      
      * use Vector2Ptr
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      bdb02e05
  30. 29 May, 2022 1 commit
  31. 22 May, 2022 1 commit
  32. 15 Apr, 2022 1 commit
  33. 10 Apr, 2022 1 commit
  34. 27 Mar, 2022 1 commit
    • shiyu1994's avatar
      Log warnings for number of bins of categorical features (#4448) · d163c2c1
      shiyu1994 authored
      * log warnings when number of bins of categorical features exceeds the configured maximum number of bins
      
      * log only one warning information for all categorical features
      
      * Add #include <memory> for unique_ptr
      
      * remove useless param description
      d163c2c1
  35. 26 Mar, 2022 1 commit
  36. 23 Mar, 2022 1 commit
    • shiyu1994's avatar
      [CUDA] New CUDA version Part 1 (#4630) · 6b56a90c
      shiyu1994 authored
      
      
      * new cuda framework
      
      * add histogram construction kernel
      
      * before removing multi-gpu
      
      * new cuda framework
      
      * tree learner cuda kernels
      
      * single tree framework ready
      
      * single tree training framework
      
      * remove comments
      
      * boosting with cuda
      
      * optimize for best split find
      
      * data split
      
      * move boosting into cuda
      
      * parallel synchronize best split point
      
      * merge split data kernels
      
      * before code refactor
      
      * use tasks instead of features as units for split finding
      
      * refactor cuda best split finder
      
      * fix configuration error with small leaves in data split
      
      * skip histogram construction of too small leaf
      
      * skip split finding of invalid leaves
      
      stop when no leaf to split
      
      * support row wise with CUDA
      
      * copy data for split by column
      
      * copy data from host to CPU by column for data partition
      
      * add synchronize best splits for one leaf from multiple blocks
      
      * partition dense row data
      
      * fix sync best split from task blocks
      
      * add support for sparse row wise for CUDA
      
      * remove useless code
      
      * add l2 regression objective
      
      * sparse multi value bin enabled for CUDA
      
      * fix cuda ranking objective
      
      * support for number of items <= 2048 per query
      
      * speedup histogram construction by interleaving global memory access
      
      * split optimization
      
      * add cuda tree predictor
      
      * remove comma
      
      * refactor objective and score updater
      
      * before use struct
      
      * use structure for split information
      
      * use structure for leaf splits
      
      * return CUDASplitInfo directly after finding best split
      
      * split with CUDATree directly
      
      * use cuda row data in cuda histogram constructor
      
      * clean src/treelearner/cuda
      
      * gather shared cuda device functions
      
      * put shared CUDA functions into header file
      
      * change smaller leaf from <= back to < for consistent result with CPU
      
      * add tree predictor
      
      * remove useless cuda_tree_predictor
      
      * predict on CUDA with pipeline
      
      * add global sort algorithms
      
      * add global argsort for queries with many items in ranking tasks
      
      * remove limitation of maximum number of items per query in ranking
      
      * add cuda metrics
      
      * fix CUDA AUC
      
      * remove debug code
      
      * add regression metrics
      
      * remove useless file
      
      * don't use mask in shuffle reduce
      
      * add more regression objectives
      
      * fix cuda mape loss
      
      add cuda xentropy loss
      
      * use template for different versions of BitonicArgSortDevice
      
      * add multiclass metrics
      
      * add ndcg metric
      
      * fix cross entropy objectives and metrics
      
      * fix cross entropy and ndcg metrics
      
      * add support for customized objective in CUDA
      
      * complete multiclass ova for CUDA
      
      * separate cuda tree learner
      
      * use shuffle based prefix sum
      
      * clean up cuda_algorithms.hpp
      
      * add copy subset on CUDA
      
      * add bagging for CUDA
      
      * clean up code
      
      * copy gradients from host to device
      
      * support bagging without using subset
      
      * add support of bagging with subset for CUDAColumnData
      
      * add support of bagging with subset for dense CUDARowData
      
      * refactor copy sparse subrow
      
      * use copy subset for column subset
      
      * add reset train data and reset config for CUDA tree learner
      
      add deconstructors for cuda tree learner
      
      * add USE_CUDA ifdef to cuda tree learner files
      
      * check that dataset doesn't contain CUDA tree learner
      
      * remove printf debug information
      
      * use full new cuda tree learner only when using single GPU
      
      * disable all CUDA code when using CPU version
      
      * recover main.cpp
      
      * add cpp files for multi value bins
      
      * update LightGBM.vcxproj
      
      * update LightGBM.vcxproj
      
      fix lint errors
      
      * fix lint errors
      
      * fix lint errors
      
      * update Makevars
      
      fix lint errors
      
      * fix the case with 0 feature and 0 bin
      
      fix split finding for invalid leaves
      
      create cuda column data when loaded from bin file
      
      * fix lint errors
      
      hide GetRowWiseData when cuda is not used
      
      * recover default device type to cpu
      
      * fix na_as_missing case
      
      fix cuda feature meta information
      
      * fix UpdateDataIndexToLeafIndexKernel
      
      * create CUDA trees when needed in CUDADataPartition::UpdateTrainScore
      
      * add refit by tree for cuda tree learner
      
      * fix test_refit in test_engine.py
      
      * create set of large bin partitions in CUDARowData
      
      * add histogram construction for columns with a large number of bins
      
      * add find best split for categorical features on CUDA
      
      * add bitvectors for categorical split
      
      * cuda data partition split for categorical features
      
      * fix split tree with categorical feature
      
      * fix categorical feature splits
      
      * refactor cuda_data_partition.cu with multi-level templates
      
      * refactor CUDABestSplitFinder by grouping task information into struct
      
      * pre-allocate space for vector split_find_tasks_ in CUDABestSplitFinder
      
      * fix misuse of reference
      
      * remove useless changes
      
      * add support for path smoothing
      
      * virtual destructor for LightGBM::Tree
      
      * fix overlapped cat threshold in best split infos
      
      * reset histogram pointers in data partition and spllit finder in ResetConfig
      
      * comment useless parameter
      
      * fix reverse case when na is missing and default bin is zero
      
      * fix mfb_is_na and mfb_is_zero and is_single_feature_column
      
      * remove debug log
      
      * fix cat_l2 when one-hot
      
      fix gradient copy when data subset is used
      
      * switch shared histogram size according to CUDA version
      
      * gpu_use_dp=true when cuda test
      
      * revert modification in config.h
      
      * fix setting of gpu_use_dp=true in .ci/test.sh
      
      * fix linter errors
      
      * fix linter error
      
      remove useless change
      
      * recover main.cpp
      
      * separate cuda_exp and cuda
      
      * fix ci bash scripts
      
      add description for cuda_exp
      
      * add USE_CUDA_EXP flag
      
      * switch off USE_CUDA_EXP
      
      * revert changes in python-packages
      
      * more careful separation for USE_CUDA_EXP
      
      * fix CUDARowData::DivideCUDAFeatureGroups
      
      fix set fields for cuda metadata
      
      * revert config.h
      
      * fix test settings for cuda experimental version
      
      * skip some tests due to unsupported features or differences in implementation details for CUDA Experimental version
      
      * fix lint issue by adding a blank line
      
      * fix lint errors by resorting imports
      
      * fix lint errors by resorting imports
      
      * fix lint errors by resorting imports
      
      * merge cuda.yml and cuda_exp.yml
      
      * update python version in cuda.yml
      
      * remove cuda_exp.yml
      
      * remove unrelated changes
      
      * fix compilation warnings
      
      fix cuda exp ci task name
      
      * recover task
      
      * use multi-level template in histogram construction
      
      check split only in debug mode
      
      * ignore NVCC related lines in parameter_generator.py
      
      * update job name for CUDA tests
      
      * apply review suggestions
      
      * Update .github/workflows/cuda.yml
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      
      * Update .github/workflows/cuda.yml
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      
      * update header
      
      * remove useless TODOs
      
      * remove [TODO(shiyu1994): constrain the split with min_data_in_group] and record in #5062
      
      * #include <LightGBM/utils/log.h> for USE_CUDA_EXP only
      
      * fix include order
      
      * fix include order
      
      * remove extra space
      
      * address review comments
      
      * add warning when cuda_exp is used together with deterministic
      
      * add comment about gpu_use_dp in .ci/test.sh
      
      * revert changing order of included headers
      Co-authored-by: default avatarYu Shi <shiyu1994@qq.com>
      Co-authored-by: default avatarNikita Titov <nekit94-08@mail.ru>
      6b56a90c