Tests are not being run because of https://github.com/ray-project/ray/pull/33555

[ollie-iterators]

What happened + What you expected to happen

When the Pull Request #33555 was merged, the number of tests ran dropped from 116 to 14.

Before:

After:

Errors for these tests:

Are causing tests to not be run on ray.

NOTE: If I could put something higher than the High severity, I would do it.

Versions / Dependencies

Main branch

Reproduction script

Look at https://flakey-tests.ray.io/

Issue Severity

High: It blocks me from completing my task.