[Rdma-spark-discuss] Questions about spark-sql in rdma-spark-0.9.1

[Peng,Zhenyi]

Hello,

   I downloaded rdma-spark-0.9.1 from website: http://hibd.cse.ohio-state.edu/downloads/ for evaluation.
   But I got a problem when testing with TPC-DS Benchmark, here is the detail.
   # spark-sql
java.lang.ClassNotFoundException: org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver
         at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
         at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
         at java.security.AccessController.doPrivileged(Native Method)
         at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
         at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
         at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
         at java.lang.Class.forName0(Native Method)
         at java.lang.Class.forName(Class.java:274)
         at org.apache.spark.util.Utils$.classForName(Utils.scala:173)
         at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:639)
         at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)
         at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)
         at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:120)
         at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Failed to load main class org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver.
You need to build Spark with -Phive and -Phive-thriftserver.

   I found spark-sql did not work well in our envirionment (I use Hadoop 2.6.3, Hbase 1.1.4 , Hive 2.0.0)

   Is rdma-spark-0.9.1 still not support spark-sql ? Or could you provide a rdma-spark-0.9.1 version with spark-sql for evaluation?

Best wishes & Thanks very much!


Tel：50817992 | 18501992482
Addr: Beijing, China
Email：pengzhenyi at baidu.com<mailto:pengzhenyi at baidu.com>
Hi: Peng_Zhenyi

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/rdma-spark-discuss/attachments/20160413/fd9bcae9/attachment.html>