Quantcast
Channel: Recent Questions - Stack Overflow
Viewing all articles
Browse latest Browse all 12141

py4j.protocol.Py4JJavaError: An error occurred while calling o184.fit

$
0
0

I have installed lightgbm 3.2.1 in my conda virtual env (python 3.8.19)Java version 11 openjdkpyspark 3.2.1.

Tried to run fit method in pyspark getting this error:

py4j.protocol.Py4JJavaError: An error occurred while calling o184.fit.E                   : java.lang.UnsatisfiedLinkError: Can't load library: /var/folders/dz/mc23060n2kq52djyhcxl9kmh0000gp/T/mml-natives10209761601010623195/lib_lightgbm.dylibE                       at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2638)E                       at java.base/java.lang.Runtime.load0(Runtime.java:768)E                       at java.base/java.lang.System.load(System.java:1854)E                       at com.microsoft.azure.synapse.ml.core.env.NativeLoader.loadLibraryByName(NativeLoader.java:66)E                       at com.microsoft.azure.synapse.ml.lightgbm.LightGBMUtils$.initializeNativeLibrary(LightGBMUtils.scala:33)E                       at com.microsoft.azure.synapse.ml.lightgbm.LightGBMBase.train(LightGBMBase.scala:36)E                       at com.microsoft.azure.synapse.ml.lightgbm.LightGBMBase.train$(LightGBMBase.scala:35)E                       at com.microsoft.azure.synapse.ml.lightgbm.LightGBMRegressor.train(LightGBMRegressor.scala:39)E                       at com.microsoft.azure.synapse.ml.lightgbm.LightGBMRegressor.train(LightGBMRegressor.scala:39)E                       at org.apache.spark.ml.Predictor.fit(Predictor.scala:151)E                       at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)E                       at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)E                       at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)E                       at java.base/java.lang.reflect.Method.invoke(Method.java:566)E                       at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)E                       at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)E                       at py4j.Gateway.invoke(Gateway.java:282)E                       at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)E                       at py4j.commands.CallCommand.execute(CallCommand.java:79)E                       at py4j.ClientServerConnection.waitForCommands(ClientServerConnection.java:182)E                       at py4j.ClientServerConnection.run(ClientServerConnection.java:106)E                       at java.base/java.lang.Thread.run(Thread.java:829)

Lightgbm should work properly in pyspark env


Viewing all articles
Browse latest Browse all 12141

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>