你好,
我有跟蹤在這個筆記本的步驟集群上安裝rasterframes磚。
最終我能導入以下:
來自pyrasterframes pyrasterframes rf_ipython導入。從pyspark.sql進口create_rf_spark_session跑龍套。函數從pyrasterframes進口點燃。rasterfunctions進口*
但當我運行:
火花= create_rf_spark_session ()
我得到以下錯誤:“. lang。NoClassDefFoundError的:scala美元/產品類”。
我使用一個集群使用火花3.2.1。我也安裝了Java運行時環境1.8.0_341,但這沒有影響。
有人能解釋一下出了什麼問題嗎?以及如何解決這個錯誤?
完整的錯誤日誌:
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Py4JJavaError回溯(最近調用最後)<命令- 2354681519525034 > <模塊> 5 6 #使用提供的便利函數來創建一個基本的本地SparkContext - - - - - > 7火花= create_rf_spark_session() /磚/ python / lib / python3.8 /網站/ pyrasterframes /跑龍套。py create_rf_spark_session(主、* * kwargs) 97 98試題:- - - - - - > 99 spark.withRasterFrames() 100年返回引發101年除了TypeError te: /磚/ python / lib / python3.8 /網站/ pyrasterframes / __init__。py _rf_init (spark_session) 42”“”RasterFrames PySpark會話功能。””“43如果不是hasattr (spark_session rasterframes): - - - - - - > 44 spark_session。45 spark_session.sparkContext rasterframes = RFContext (spark_session)。_rf_context = spark_session。rasterframes 46 /磚/ python / lib / python3.8 /網站/ pyrasterframes / rf_context。py __init__(自我,spark_session) 37自我。_jvm = self._gateway。jvm 38 jsess = self._spark_session。_jsparkSession - - - > 39自我。_jrfctx = self._jvm.org.locationtech.rasterframes.py.PyRFContext (jsess) 40 41 def list_to_seq(自我,py_list): /磚/火花/ python / lib / py4j-0.10.9.1-src.zip / py4j / java_gateway。py __call__(自我,* args) 1566 1567回答= self._gateway_client.send_command(命令)- > 1568 return_value = get_return_value(1569回答,自我。_gateway_client、沒有self._fqn) 1570 /磚/火花/ python / pyspark / sql /跑龍套。py在德科(*,* *千瓦)115年def德科(*,* *千瓦):116試:- - > 117返回f(*, * *千瓦)118 py4j.protocol除外。Py4JJavaError e: 119轉換= convert_exception (e.java_exception) /磚/火花/ python / lib / py4j-0.10.9.1-src.zip / py4j /協議。py get_return_value(答案,gateway_client target_id,名字)324價值= OUTPUT_CONVERTER[型](回答[2],gateway_client) 325如果回答[1]= = REFERENCE_TYPE: - - > 326提高Py4JJavaError(327”時發生一個錯誤調用{0}{1}{2}。\ n”。328格式(target_id”。“,name), value) Py4JJavaError: An error occurred while calling None.org.locationtech.rasterframes.py.PyRFContext. : java.lang.NoClassDefFoundError: scala/Product$class at org.locationtech.rasterframes.model.TileDimensions.(TileDimensions.scala:35) at org.locationtech.rasterframes.package$.(rasterframes.scala:55) at org.locationtech.rasterframes.package$.(rasterframes.scala) at org.locationtech.rasterframes.py.PyRFContext.(PyRFContext.scala:49) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:247) at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:380) at py4j.Gateway.invoke(Gateway.java:250) at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:80) at py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:69) at py4j.GatewayConnection.run(GatewayConnection.java:251) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: scala.Product$class at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:419) at com.databricks.backend.daemon.driver.ClassLoaders$LibraryClassLoader.loadClass(ClassLoaders.scala:151) at java.lang.ClassLoader.loadClass(ClassLoader.java:352) ... 15 more
提前感謝!
