Attempt to fix graalpy-install-package

[bhoran]

I've added a profile to the POM to build a native executable, which succeeds, but the resulting binary does not run. This is mainly due to resource files, AFAICT.

[bhoran]

@timfel -- when you get chance, could you take a look at this? I can't figure out what I need to change so that the Python module is included in the native executable. Thanks.

[olyagpl]

A configuration file should be named resource-config.json. Could that be a reason? If you put it in META-INF/native-image/, native-image should pick it up, but not sure about the plugin.

[timfel]

@timfel -- when you get chance, could you take a look at this? I can't figure out what I need to change so that the Python module is included in the native executable. Thanks.

I think the entire thing should be deleted and recreated with the graalpy-maven-plugin. I'll try to make time to do that.

[timfel]

@timfel -- when you get chance, could you take a look at this? I can't figure out what I need to change so that the Python module is included in the native executable. Thanks.

I've updated the example using the maven plugin. Now the native image fails because of the use of AWT. IIRC this is documented to be complicated with native image, one has to use the tracing agent and some options to get it to work.

[bhoran]

@timfel -- when you get chance, could you take a look at this? I can't figure out what I need to change so that the Python module is included in the native executable. Thanks.

I've updated the example using the maven plugin. Now the native image fails because of the use of AWT. IIRC this is documented to be complicated with native image, one has to use the tracing agent and some options to get it to work.

Many thanks @timfel.

We're getting the following error on Windows 11

Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'PyfigletWrapper'
Exception in thread "main" org.graalvm.polyglot.PolyglotException
at org.graalvm.polyglot.Context.eval(Context.java:402)
at com.oracle.example.graalpy.Main.createPyfigletProxy(Main.java:140)
at com.oracle.example.graalpy.Main.main(Main.java:57)
[ERROR] Command execution failed.
org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:355)

As you say, native image on macOS and Linux fails because of AWT.

[timfel]

We're getting the following error on Windows 11
[...]
As you say, native image on macOS and Linux fails because of AWT.

That's a bug we had in 24.0 on Windows. I worked around it, but it still won't work, the native image on windows fails because of AWT as well:

D:\graalvm-demos\graalpy-install-package [fix-graalpy-package-install ≡ +0 ~2 -3 ~]> .\target\package-graalpy.exe
Exception in thread "main" java.lang.NoSuchMethodError: java.awt.Toolkit.getDefaultToolkit()Ljava/awt/Toolkit;
        at org.graalvm.nativeimage.builder/com.oracle.svm.core.jni.functions.JNIFunctions$Support.getMethodID(JNIFunctions.java:1347)
        at org.graalvm.nativeimage.builder/com.oracle.svm.core.jni.functions.JNIFunctions$Support.getMethodID(JNIFunctions.java:1332)
        at org.graalvm.nativeimage.builder/com.oracle.svm.core.jni.functions.JNIFunctions.GetStaticMethodID(JNIFunctions.java:440)
        at [email protected]/java.awt.Toolkit.initIDs(Native Method)
        at [email protected]/java.awt.Toolkit.initStatic(Toolkit.java:1421)
        at [email protected]/java.awt.Toolkit.<clinit>(Toolkit.java:1393)
        at [email protected]/java.awt.Component.<clinit>(Component.java:624)
        at [email protected]/java.lang.Class.ensureInitialized(DynamicHub.java:599)
        at [email protected]/java.lang.Class.ensureInitialized(DynamicHub.java:599)
        at [email protected]/java.lang.Class.ensureInitialized(DynamicHub.java:599)
        at [email protected]/java.lang.Class.ensureInitialized(DynamicHub.java:599)
        at [email protected]/java.lang.Class.ensureInitialized(DynamicHub.java:599)
        at com.oracle.example.graalpy.Main.main(Main.java:59)
        at [email protected]/java.lang.invoke.LambdaForm$DMH/sa346b79c.invokeStaticInit(LambdaForm$DMH)

[timfel]

A fix could be to add this:

modified   graalpy-install-package/pom.xml
@@ -131,6 +131,7 @@
           <arguments>
             <argument>-classpath</argument>
             <classpath />
+            <argument>-agentlib:native-image-agent=config-output-dir=${project.build.outputDirectory}/META-INF/native-image/awt/</argument>
             <argument>${main.class}</argument>
           </arguments>
         </configuration>

Then when you run mvn exec:exec on a Graal JDK once and build the native image after, it'll work. But then it won't run at all on Oracle JDK

[bhoran]

Not sure what changed, but this no longer compiles using mvn package.

[ERROR] Failed to execute goal org.graalvm.python:graalpy-maven-plugin:24.0.0:process-graalpy-resources (default) on project package-graalpy: failed to execute venv command [/Users/bhoran/Oracle/GraalVM/graalvm-demos/graalpy-install-package/target/classes/vfs/venv/bin/graalpy, -m, pip, install, pyfiglet==1.0.2]: Cannot run program "/Users/bhoran/Oracle/GraalVM/graalvm-demos/graalpy-install-package/target/classes/vfs/venv/bin/graalpy": error=2, No such file or directory -> [Help 1]

There's no /Users/bhoran/Oracle/GraalVM/graalvm-demos/graalpy-install-package/target/classes/vfs/venv/bin/graalpy.

[timfel]

Not sure what changed, but this no longer compiles using mvn package.

I tried on Windows and Linux with OpenJDK and Graal JDK and it works on both machines. Did you run mvn clean first?

[timfel]

@bhoran I updated the README with steps to make the native image work. I tested the steps on Linux and Windows.