GitLab

* speed up files downloading for Windows CI

* run CI

* revert changing CI branch

[docs][ci] added docs about GPU support out of the box for Windows wheels and small refactoring for dual test (#3660)

* added docs about GPU support out of the box for Windows and small refactoring for dual test

* test

* Revert "test"

This reverts commit 45188103c2c9b3773bc62d97fbe865a2e5dd9120.

* fix docs

* fix docs

* hotfix config

* Apply suggestions from code review
Co-authored-by: TP Boudreau <tpboudreau@gmail.com>
Co-authored-by: TP Boudreau <tpboudreau@gmail.com>

* Add specialized OpenCL/Python package build path

* Refer to upstream OpenCL repository

* Reset build job count in setup.py

* Run test for dual CPU/GPU code in CI

* TEMPORARY: refer to OpenCL fork to ensure Linux CI builds succeed

* Try switching to OpenCL 2.0

* Add --opencl-python-pacakge option to wheel

* Fix some typos.

* Remove intermediate cmake target

* Restrict OpenCL headers to documented API version

* Refresh the environment after installation

* Try testing with two processes

* Use command line definition to activate integrated build

* Try newer OpenCL runtime

* If we hit OpenCL code path that's good enough

* Make tests run correctly

* Correct directory

* Flag reference to unofficial repo with FIXME

* TEMPORARY: update private repo tag for dependency

* Further post-merge fixes.

* Fix attribute name.

* Reformat with black.

* Rewrite config.h before library compilation for Windows wheel

* Run dual cpu/gpu test once only for Windows bdist CI

* Avoid C API tests when building gpu library for wheel

* TEMPORARY -- add clinfo tool to vm for debugging

* Increase compilation logging

* Rename OpenCL registry parameter after driver installation

* Install legacy OpenCL runtime

* ...

* Remove config.h change, clinfo installation, latest opencl runtime reference

* Add explicit script exit

* revert to 18.1 intel driver

* Run test_dual.py in two different modes

* Revert "Run test_dual.py in two different modes"

This reverts commit cbfec02659816f0cb321e1184994a9c2f37d2a77.

* Remove unused expected failure test

* Install OpenCL in separate powershell script

* fix setup.py imports

* activate conda env after session update

* separate update functions; exit opencl installation on error

* nothing; start pipeline

* download from original source

* specify tls version for installer download

* eliminate variable from command

* download opencl installer in parts

* remove duplicate setup.py command class entry

* download smaller parts

* remove redundant bdist wheel class

* Import chocolatey modules and use RefreshEnv

* insert pipeline cache for opencl installer

* rerun to ensure pipeline cache hit

* add comments, test another pipeline cache hit

* remove cache task; download full installer file from new location

* try another installer download timing

* reinsert pipeline cache

* retain cache task; download full file on cache miss

* test cache hit again

* remove todo
Co-authored-by: TP Boudreau <tpboudreau@gmail.com>

* Update setup.py

* Update .appveyor.yml

* Update .travis.yml

* Update .vsts-ci.yml

* Update __init__.py

* Update test.sh

* Update test_windows.ps1

* Update advanced_example.py

* Update requirements_base.txt

* Update conf.py

* Update conf.py

* Update test_engine.py

* Update utils.py

* Update dockerfile-r

* Update README.md

* Update dockerfile.gpu

* Update test_consistency.py

* Update basic.py

* Update compat.py

* Update engine.py

* Update sklearn.py

* Update sklearn.py

* Update callback.py

* Update setup.py

* Update __init__.py

* Update plotting.py

* Update sklearn.py

* Update engine.py

* Update compat.py

* Update callback.py

* Update basic.py

* Update compat.py

* Update basic.py

* Update basic.py

* Update compat.py

* Update compat.py

* Update plotting.py

* Update engine.py

* Update basic.py

* Update sklearn.py

* Update compat.py

* Update engine.py

* Update engine.py

* Update callback.py

* Update basic.py

* Update basic.py

* Update basic.py

* Update basic.py

* Update basic.py

* Update sklearn.py

* Update sklearn.py

* Update plotting.py

* Update sklearn.py

* Update compat.py

* Update compat.py

* Update engine.py

* Update plotting.py

* Update sklearn.py

* Update basic.py

* Update basic.py

* Update basic.py

* Update basic.py

* Update compat.py

* Update compat.py

* Update compat.py

* Update engine.py

* Update basic.py

* Update compat.py

* Update basic.py

* Update basic.py

* Update basic.py

* Update compat.py

* Update compat.py

* Update basic.py

* Update basic.py

* Update .vsts-ci.yml

* Update .vsts-ci.yml

* Update conf.py

* Revert "Update dockerfile-r"

This reverts commit 4ff6ffc7e3eeda24cc6a59a3bb0c973f02d9d71c.

* Update .vsts-ci.yml

* Update setup.sh

* Update .vsts-ci.yml

* Update .vsts-ci.yml

* try not to hardcode path

* Update .appveyor.yml

* Update .travis.yml

* Update .vsts-ci.yml

* Update main.yml

* Update setup.py

* Update .vsts-ci.yml

* Update .travis.yml

* [ci] Move R Windows CI to GitHub Actions

* fix OS filter

* Apply suggestions from code review
Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* remove trailing semicolon
Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* [R-package] replaced gendef.exe with R code to create R.def (fixes #3064)

* fix broken things

* trying to add R4.0 docs

* changed make

* fixing make paths

* update notes on environment variables

* fix linting

* fixes to CI

* fixing build_cmd and other stuff

* fix bad substitution

* fix Azure Linux builds

* I am bad at bash

* simplifying

* only testing R

* getting better logs

* mingw32

* docs

* toolchain

* using msys

* fix visual studio condition

* toolchain test

* full CI

* fix if-elses

* bump allowed NOTEs

* search for Rscript

* updates to docs

* use processx

* fix mismatched arguments

* move CI to GitHub Actions

* minor changes

* fix workflow file

* fix templating

* fix Azure DevOps

* debugging windows builds

* dont shQuote file name

* all GitHub Actions jobs

* Apply suggestions from code review
Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* minor cleanup

* remove objdump printing

* make file.remove() invisible

* Apply suggestions from code review
Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* reduce duplicated paths in docs
Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* GitHub Actions

* ok

* fixing on list

* stuff

* directories

* directories

* things

* env variables

* working dir

* running a bunch of tasks

* more builds

* PATH

* actually use R task

* TASK

* be right, often

* doing stuff

* trying stuff

* more paths

* conda activate

* updating PATH

* trying bash

* where the hell is activate

* WHERE IS ACTIVATE

* set up conda

* more conda

* PLEASE WORK

* installing cpplint

* try r-package

* R version

* try windows job

* make windows work

* use powershell

* exe

* use conda

* conda init powershell

* different conda approach

* make it work

* cleaning up

* init powershell

* fixing windows

* more windows

* build directory

* no way right

* maybe it will work

* trying Visual Studio

* do this

* Windows is interesting

* put back check-output

* set compiler

* stuff

* more fixes

* fix the broken things

* updating jobs

* continuing

* poweshell is bad

* ok so maybe not powershell

* cmon now

* ok so

* fixing env variables

* maybe this

* MINGW job

* cleaning up

* conda init powershell

* moving more R stuff into GitHub Actions

* everything else

* use powershell

* cmon now powershell

* ttry to Continue

* override powershell

* peg MiKTeX URL

* what is happening

* try powershell -File

* trying stuff

* path

* more testing of output

* Matches uppercase

* more regex stuff

* this is getting ridiculous

* back to powershell I guess

* more commands

* this might work

* adding more reliable miktex download

* trying to download miktex

* installing httr

* fix error in MiKTeX script

* remove comments

* redirect output

* redirect output

* move linting back to Travis

* change redirection

* switch back to just mac and linux

* put linting exclude back

* renamed R_TRAVIS_LINUX

* revert changes to non-R tasks and update events

* simplify

* fix conflicts

* Update R-package/src/install.libs.R

* empty commit

* first test of appveyor

* strings are strings

* lil bit of build script

* fixing paths

* removed unnecessary file

* updated CRAN URL

* added a lot more printing

* fixing paths

* more stuff

* fixed paths

* more stuff

* more path guessing

* even more paths

* more stuff

* moar logz

* and now for something totally different

* please work

* ok could be a thing

* changing directories

* we might be in business

* fixed install syntax

* tryinv mingw

* more mingw

* ignore Suggests check

* trying Azure DevOps

* just run bare minimum for Azure DevOps

* fixed  build dir thing

* trying to set libPaths

* more testing

* trying R 3.6.3

* R 3.6.3

* this feels right

* still messing around with libraries

* more paths

* removed duplication in Windows testing code

* simpler

* fixed conda stuff

* more conda stuff

* more fixes

* fixed testing script

* moved AppVeyor setup to the top

* commenting

* ch-ch-ch-ch-chaaaanges

* paths

* plz work

* fixed conda stuff in Windows CI

* uncommented stuff to test a full build

* fixed quotes and removed some unnecessary stuff

* added install.libs.R change

* quotes are impoortant

* added commented-out stuff back in

* added Windows script, download retries, and MSVC linking

* minor fixes

* cleaned up debugging code in FindLibR

* cleaned up debugging code and moved R first in CI

* fixed vsts-ci indentation

* cut documentation stuff out of MSVC build

* fix R CMD check for Azure

* misc whitespace changes

* Added echoing of build logs from R CMD check

* cut out more documentation tests

* fixed NOTE about imports from Matrix

* moved some changes out of this PR and into #2963

* fixed whitespace stuff

* added check on number of NOTES

* adding better checks

* fixing check on NOTEs

* removing unnecessary variable

* Update .ci/test_r_package_windows.ps1
Co-Authored-By: Nikita Titov <nekit94-08@mail.ru>

* some changes

* fix quoting

* trying MINGW on Azure DevOps

* fixing paths

* more paths

* fixing paths

* testing paths

* fixing slashes

* pinned CTAN mirror

* get better logs

* made sure Azure finds MinGW, fixed search for LIBR_CORE_LIBRARY, stopped building R docs on Azure

* Apply suggestions from code review
Co-Authored-By: Nikita Titov <nekit94-08@mail.ru>

* added CXX, CC for Windows builds and changed back to building docs on all MINGW builds

* stored LIBR_CORE_LIBRARY hints in one variable

* Apply suggestions from code review
Co-Authored-By: Nikita Titov <nekit94-08@mail.ru>

* changes from code review

* increased parallel builds for Azure CI

* Apply suggestions from code review
Co-Authored-By: Nikita Titov <nekit94-08@mail.ru>
Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* start to support Python 3.8

* update configs

* hotfix

* [ci] reduced duplication in Python Windows CI

* fixed typo

* reorganized

* fixed task name

* Update .ci/test_windows.ps1
Co-Authored-By: Nikita Titov <nekit94-08@mail.ru>

* changes from code review

* added conda init powershell back

* Update .ci/test_windows.ps1
Co-Authored-By: Nikita Titov <nekit94-08@mail.ru>

* Switched to absolute paths

* fixed env variables
Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* Create release-drafter.yml

* Create no-response.yml

* disable comments

* Apply suggestions from code review

* Update release-drafter.yml

* Apply suggestions from code review

* Update .vsts-ci.yml

* bump Azure image versions

* fixed Windows builds

* Update .travis.yml

* Update .vsts-ci.yml

* commit

* fix a bug

* fix bug

* reset to track changes

* refine the auto choose logic

* sort the time stats output

* fix include

* change  multi_val_bin_sparse_threshold

* add cmake

* add _mm_malloc and _mm_free for cross platform

* fix cmake bug

* timer for split

* try to fix cmake

* fix tests

* refactor DataPartition::Split

* fix test

* typo

* formating

* Revert "formating"

This reverts commit 5b8de4f7fb9d975ee23701d276a66d40ee6d4222.

* add document

* [R-package] Added tests on use of force_col_wise and force_row_wise in training (#2719)

* naming

* fix gpu code

* Update include/LightGBM/bin.h
Co-Authored-By: James Lamb <jaylamb20@gmail.com>

* Update src/treelearner/ocl/histogram16.cl

* test: swap compilers for CI

* fix omp

* not avx2

* no aligned for feature histogram

* Revert "refactor DataPartition::Split"

This reverts commit 256e6d9641ade966a1f54da1752e998a1149b6f8.

* slightly refactor data partition

* reduce the memory cost
Co-authored-by: James Lamb <jaylamb20@gmail.com>
Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* removed temp fix for conda

* fixed conda activation before any conda command

* Update .appveyor.yml

* Update .vsts-ci.yml

* Update setup.sh

* added GitHub Release task

* add connection name

* test

* added triggers for tags

* hotfixes

* compile SWIG artifact on Windows

* compile SWIG artifact on Windows

* combined swig and sdist jobs for Linux

* added conditions for artifacts publishing

* added SWIG artifact compilation on macOS

* hotfix

* test: switch compilers

* harsh workaround for OpenMP library conflict

* switch compilers back

* consistent order of tasks in condition

* dummy commit to trigger CI and fix CLA

* added job for swig compilation on Linux with artifacts

* hotfix

* test: SWIG with Clang compiler

* switch compiler back to gcc

* switch to main docker

* updated boost submodule

* updated docker with new stable Clang and CMake

* switch to dev docker

* updated setup script

* updated MinGW on Appveyor

* updated Azure config to use docker for GPU task

* do not upgrade gcc - takes too long

* test: switch compilers

* switch compilers back

* get back to main docker

* added test for huge string model

* fixed tree sizes field

* simplified model structure

* fixed test and added try/except

* removed brew hotfix and deprecated sudo option on Travis

* removed brew hotfix on Azure

* fixed xcode version

* fixed brew on Travis

* fixed brew on Azure Pipelines

[ci][docs] updated temp fix for warning written to stderr, fixed conda permissions and updated bench link (#1849)

* Update .appveyor.yml

* updated bench link (404)

* fixed conda permission error on Azure

* use stable container