Hailo AI Processor

[ionultd]

@blakeblackshear I have been waiting to use your awesome module but am wanting to know it it is compatible with https://hailo.ai/

[blakeblackshear]

I don't think it will work unless it's compatible with tensorflow lite.

[Anaerin]

According to the documentation, it supports TensorFlow, TensorFlow Lite, ONNX, Keras and Pytorch.

[stub2k2]

Raspberry pi foundation chose Hailo 8 chip for their Pi AI hat. install base should rise a bunch.

[f18m]

I would really be curious to try out an Hailo adapter if Frigate supported that.
Today news is indeed that Raspberry will have an Hailo hat: https://hailo.ai/company-overview/newsroom/news/raspberry-pi-selects-hailo-to-enable-advanced-ai-capabilities-for-raspberry-pi-5/

[alienatedsec]

Refreshing the subject as Hailo modules are now part of the offering as the Pi5 AI kits.

[tlatts72]

+1 would love to see hailo supported!

[joergbattermann]

+1 from me.. these Hailo-8L modules the AI Hat comes with have seemingly 3.25x the TOPS than the Coral modules have at a much lower Watt/TOP efficiency number (see https://hailo.ai/files/hailo-8l-m-2-et-product-brief-en/).

Would really be neat if Frigate would support those.

[NickM-27]

Also, might want someone else to verify but I don't see anything in the docker file that copies or installs things from the h8l-deps layer into the main layer at the rootfs. All other images run a command that installs or moves necessary packages at the root

[hawkeye217]

Also, I see: dockerfile = "docker/hailo8l/Dockerfile" but you've called the file docker/hailo8l/dockerfile. Case sensitive? Do the logs show your h8l build is actually building?

[spanner3003]

with docker/podman on my pi5 yes and github actions did build one. Sorry that repo is not in sync with my local i have fixed the /dev/hailo typo and renamed dockerfile to Dockerfile.

[spanner3003]

Also, might want someone else to verify but I don't see anything in the docker file that copies or installs things from the h8l-deps layer into the main layer at the rootfs. All other images run a command that installs or moves necessary packages at the root

Could you help me, with how I would do that, Please. looking at the other Docker files in the docker folder has not really given me much incite

[NickM-27]

I am referring how, for example in the rockchip Dockerfile, a command is run that binds the results from the rkwheels image. You are just doing a full RUN command and I don't think this is going to install the necessary files into the final image at the correct location.

frigate/docker/rockchip/Dockerfile

Line 15 in f9e1ad2

RUN --mount=type=bind,from=rk-wheels,source=/rk-wheels,target=/deps/rk-wheels \