[ci][python-package] add testing for the shape of raw score predictions

[StrikerRUS]

Refer to #6753.

[jameslamb]

thank you for adding this

[jameslamb]

@shiyu1994 can you please check if something has changed with our Azure DevOps account?

Those jobs are not running:

https://dev.azure.com/lightgbm-ci/lightgbm-ci/_build?definitionId=1

[shiyu1994]

I see the jobs on Azure DevOps are running for other PRs. Maybe we can retrigger it for this PR?

[StrikerRUS]

Trying to close-reopen for Azure restart.

[jameslamb]

Excellent, thanks @shiyu1994 !

I do see jobs being picked up again there 🎉

Now we have a separate problem... all of the CUDA builds are failing like this at the "initialize containers" step:

  /usr/bin/docker ps --all --quiet --no-trunc --filter "label=df5bb3"
  bdd49dc44096c9f53785df313ab685de5547d00283d302b3c456f911d93f5196
  1085ca4cd1d18c5a6e8a4c772637b210cc7dd56e98a69abcce1976704fe9f5af
  /usr/bin/docker rm --force bdd49dc44096c9f53785df313ab685de5547d00283d302b3c456f911d93f5196
  Error: The operation was canceled.

(build link)

I just manually triggered a new run from master, restarting the docker daemon there.

build link: https://github.com/microsoft/LightGBM/actions/runs/12485778092

Hopefully that'll help.

[jameslamb]

:/ that did not help: https://github.com/microsoft/LightGBM/actions/runs/12485778092/job/34845059021

@shiyu1994 could you try fully rebooting the CUDA runner machine, then triggering a new CI run by clicking "Run workflow" at https://github.com/microsoft/LightGBM/actions/workflows/cuda.yml?

[jameslamb]

rebooting the CUDA runner machine

conversation about this is happening at #6766 (comment)