[ci/bazel][1] bazelize some unit-tests

[can-anyscale]

Why are these changes needed?

Bazelize some of the tests I created. Without this it does not run on CI at all.

Checks

• I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
• I've run scripts/format.sh to lint the changes in this PR.
• Testing Strategy
  • Unit tests

[krfricke]

Thanks! We do have a script somewhere that checks if all test_ files are tracked in Bazel scripts (for the regular CI) - maybe we can activate that for the release package as well?

[aslonnie]

ugh... why is this merged..

[aslonnie]

for context, was trying to get #34689 merged first.

[can-anyscale]

There were some communications of not merge on the [ci/bazel][2] PRs but not this. My bad, should have move it to draft

[aslonnie]

it was not on "MergeReady" state (which is why I left it unreviewed)..

anyways, I can resolve the conflict. all good.