java.lang.NoSuchMethodError: org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.withHttpClientResolving dependency problems in Apache SparkGetting java.lang.NoClassDefFoundError while using solr-solrj-3.6.1.jarException in thread “main” java.lang.NoClassDefFoundError: org/apache/commons/codec/DecoderExceptionException on spark testNoSuchMethodError: org.apache.spark.sql.SQLContext.applySchemaSpark LDA with scala and JavaHive Solr Storage handler Httpclient errorChange in the response format of solrjSpark: Solrj exception on serializationApache Spark: java.lang.NoSuchMethodError .rddToPairRDDFunctionsHow to solve java.io.InvalidClassException: org.apache.solr.client.solrj.SolrQuery
The plural of 'stomach"
Personal Teleportation as a Weapon
Using parameter substitution on a Bash array
Should my PhD thesis be submitted under my legal name?
Why does John Bercow say “unlock” after reading out the results of a vote?
Curses work by shouting - How to avoid collateral damage?
What would happen if the UK refused to take part in EU Parliamentary elections?
How does it work when somebody invests in my business?
voltage of sounds of mp3files
Can a monster with multiattack use this ability if they are missing a limb?
Tiptoe or tiphoof? Adjusting words to better fit fantasy races
Ways to speed up user implemented RK4
What is the opposite of 'gravitas'?
How can I use the arrow sign in my bash prompt?
How can I replace every global instance of "x[2]" with "x_2"
How can I get through very long and very dry, but also very useful technical documents when learning a new tool?
How do I define a right arrow with bar in LaTeX?
Valid Badminton Score?
Is the destination of a commercial flight important for the pilot?
Cynical novel that describes an America ruled by the media, arms manufacturers, and ethnic figureheads
Why did Kant, Hegel, and Adorno leave some words and phrases in the Greek alphabet?
Is it okay / does it make sense for another player to join a running game of Munchkin?
Greatest common substring
What's a natural way to say that someone works somewhere (for a job)?
java.lang.NoSuchMethodError: org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.withHttpClient
Resolving dependency problems in Apache SparkGetting java.lang.NoClassDefFoundError while using solr-solrj-3.6.1.jarException in thread “main” java.lang.NoClassDefFoundError: org/apache/commons/codec/DecoderExceptionException on spark testNoSuchMethodError: org.apache.spark.sql.SQLContext.applySchemaSpark LDA with scala and JavaHive Solr Storage handler Httpclient errorChange in the response format of solrjSpark: Solrj exception on serializationApache Spark: java.lang.NoSuchMethodError .rddToPairRDDFunctionsHow to solve java.io.InvalidClassException: org.apache.solr.client.solrj.SolrQuery
I am following this example to get data from Solr to my Scala Spark program. Below is my code:
val solrURL = "someurl"
val collectionName = "somecollection"
val solrRDD = new SelectSolrRDD(solrURL,collectionName,sc)
val solrQuery=new SolrQuery("somequery")
solrQuery.setTimeAllowed(0)
val solrDataRDD=solrRDD.query(solrQuery)
When I run this code on my local Spark cluster, I get the following exception at new selectSolrRDD line:
java.lang.NoSuchMethodError: org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.withHttpClient(Lorg/apache/http/client/HttpClient;)Lorg/apache/solr/client/solrj/impl/SolrClientBuilder;
I looked at some other answers on StackOverflow but nothing worked.
apache-spark solr solrj
asked Mar 8 at 9:38
Piyush ShrivastavaPiyush Shrivastava
458623
add a comment |
I am following this example to get data from Solr to my Scala Spark program. Below is my code:
val solrURL = "someurl"
val collectionName = "somecollection"
val solrRDD = new SelectSolrRDD(solrURL,collectionName,sc)
val solrQuery=new SolrQuery("somequery")
solrQuery.setTimeAllowed(0)
val solrDataRDD=solrRDD.query(solrQuery)
When I run this code on my local Spark cluster, I get the following exception at new selectSolrRDD line:
java.lang.NoSuchMethodError: org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.withHttpClient(Lorg/apache/http/client/HttpClient;)Lorg/apache/solr/client/solrj/impl/SolrClientBuilder;
I looked at some other answers on StackOverflow but nothing worked.
apache-spark solr solrj
asked Mar 8 at 9:38
Piyush ShrivastavaPiyush Shrivastava
458623
2
Possible duplicate of Resolving dependency problems in Apache Spark
– user10938362
Mar 8 at 10:05
add a comment |
I am following this example to get data from Solr to my Scala Spark program. Below is my code:
val solrURL = "someurl"
val collectionName = "somecollection"
val solrRDD = new SelectSolrRDD(solrURL,collectionName,sc)
val solrQuery=new SolrQuery("somequery")
solrQuery.setTimeAllowed(0)
val solrDataRDD=solrRDD.query(solrQuery)
When I run this code on my local Spark cluster, I get the following exception at new selectSolrRDD line:
java.lang.NoSuchMethodError: org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.withHttpClient(Lorg/apache/http/client/HttpClient;)Lorg/apache/solr/client/solrj/impl/SolrClientBuilder;
I looked at some other answers on StackOverflow but nothing worked.
apache-spark solr solrj
asked Mar 8 at 9:38
Piyush ShrivastavaPiyush Shrivastava
458623
I am following this example to get data from Solr to my Scala Spark program. Below is my code:
val solrURL = "someurl"
val collectionName = "somecollection"
val solrRDD = new SelectSolrRDD(solrURL,collectionName,sc)
val solrQuery=new SolrQuery("somequery")
solrQuery.setTimeAllowed(0)
val solrDataRDD=solrRDD.query(solrQuery)
When I run this code on my local Spark cluster, I get the following exception at new selectSolrRDD line:
java.lang.NoSuchMethodError: org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.withHttpClient(Lorg/apache/http/client/HttpClient;)Lorg/apache/solr/client/solrj/impl/SolrClientBuilder;
I looked at some other answers on StackOverflow but nothing worked.
apache-spark solr solrj
apache-spark solr solrj
asked Mar 8 at 9:38
Piyush ShrivastavaPiyush Shrivastava
458623
asked Mar 8 at 9:38
Piyush ShrivastavaPiyush Shrivastava
458623
asked Mar 8 at 9:38
Piyush ShrivastavaPiyush Shrivastava
458623
asked Mar 8 at 9:38
Piyush ShrivastavaPiyush Shrivastava
458623
asked Mar 8 at 9:38
Piyush ShrivastavaPiyush Shrivastava
458623
458623
2
Possible duplicate of Resolving dependency problems in Apache Spark
– user10938362
Mar 8 at 10:05
add a comment |
2
Possible duplicate of Resolving dependency problems in Apache Spark
– user10938362
Mar 8 at 10:05
2
2
Possible duplicate of Resolving dependency problems in Apache Spark
– user10938362
Mar 8 at 10:05
Possible duplicate of Resolving dependency problems in Apache Spark
– user10938362
Mar 8 at 10:05
add a comment |
2 Answers
2
active
oldest
votes
The problem is with your packaging and deployment (your pom.xml assuming you are using maven). The issue is that the Solr client libraries are not being loaded when you run your Spark app. You need to package your app and any dependencies into an "uber jar" for deployment to a cluster.
Take a look at how spark-solr has it setup. They use the maven-shade-plugin to generate the uber jar.
answered Mar 8 at 22:45
Kit MenkeKit Menke
6,58612752
I am using Scala and sbt and am building the jar using sbt assembly plugin which creates a fat jar. Could there be any other reason why solr libraries are not getting loaded?
– Piyush Shrivastava
Mar 11 at 7:43
add a comment |
My cluster had jars of spark-solr already present which were conflicting with the jars I was using. After removing those jars, my code worked correctly.
answered Mar 11 at 7:49
Piyush ShrivastavaPiyush Shrivastava
458623
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55060410%2fjava-lang-nosuchmethoderror-org-apache-solr-client-solrj-impl-cloudsolrclientb%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
The problem is with your packaging and deployment (your pom.xml assuming you are using maven). The issue is that the Solr client libraries are not being loaded when you run your Spark app. You need to package your app and any dependencies into an "uber jar" for deployment to a cluster.
Take a look at how spark-solr has it setup. They use the maven-shade-plugin to generate the uber jar.
answered Mar 8 at 22:45
Kit MenkeKit Menke
6,58612752
I am using Scala and sbt and am building the jar using sbt assembly plugin which creates a fat jar. Could there be any other reason why solr libraries are not getting loaded?
– Piyush Shrivastava
Mar 11 at 7:43
add a comment |
The problem is with your packaging and deployment (your pom.xml assuming you are using maven). The issue is that the Solr client libraries are not being loaded when you run your Spark app. You need to package your app and any dependencies into an "uber jar" for deployment to a cluster.
Take a look at how spark-solr has it setup. They use the maven-shade-plugin to generate the uber jar.
answered Mar 8 at 22:45
Kit MenkeKit Menke
6,58612752
I am using Scala and sbt and am building the jar using sbt assembly plugin which creates a fat jar. Could there be any other reason why solr libraries are not getting loaded?
– Piyush Shrivastava
Mar 11 at 7:43
add a comment |
The problem is with your packaging and deployment (your pom.xml assuming you are using maven). The issue is that the Solr client libraries are not being loaded when you run your Spark app. You need to package your app and any dependencies into an "uber jar" for deployment to a cluster.
Take a look at how spark-solr has it setup. They use the maven-shade-plugin to generate the uber jar.
answered Mar 8 at 22:45
Kit MenkeKit Menke
6,58612752
The problem is with your packaging and deployment (your pom.xml assuming you are using maven). The issue is that the Solr client libraries are not being loaded when you run your Spark app. You need to package your app and any dependencies into an "uber jar" for deployment to a cluster.
Take a look at how spark-solr has it setup. They use the maven-shade-plugin to generate the uber jar.
answered Mar 8 at 22:45
Kit MenkeKit Menke
6,58612752
answered Mar 8 at 22:45
Kit MenkeKit Menke
6,58612752
answered Mar 8 at 22:45
Kit MenkeKit Menke
6,58612752
answered Mar 8 at 22:45
Kit MenkeKit Menke
6,58612752
6,58612752
I am using Scala and sbt and am building the jar using sbt assembly plugin which creates a fat jar. Could there be any other reason why solr libraries are not getting loaded?
– Piyush Shrivastava
Mar 11 at 7:43
add a comment |
I am using Scala and sbt and am building the jar using sbt assembly plugin which creates a fat jar. Could there be any other reason why solr libraries are not getting loaded?
– Piyush Shrivastava
Mar 11 at 7:43
I am using Scala and sbt and am building the jar using sbt assembly plugin which creates a fat jar. Could there be any other reason why solr libraries are not getting loaded?
– Piyush Shrivastava
Mar 11 at 7:43
I am using Scala and sbt and am building the jar using sbt assembly plugin which creates a fat jar. Could there be any other reason why solr libraries are not getting loaded?
– Piyush Shrivastava
Mar 11 at 7:43
add a comment |
My cluster had jars of spark-solr already present which were conflicting with the jars I was using. After removing those jars, my code worked correctly.
answered Mar 11 at 7:49
Piyush ShrivastavaPiyush Shrivastava
458623
add a comment |
My cluster had jars of spark-solr already present which were conflicting with the jars I was using. After removing those jars, my code worked correctly.
answered Mar 11 at 7:49
Piyush ShrivastavaPiyush Shrivastava
458623
add a comment |
My cluster had jars of spark-solr already present which were conflicting with the jars I was using. After removing those jars, my code worked correctly.
answered Mar 11 at 7:49
Piyush ShrivastavaPiyush Shrivastava
458623
My cluster had jars of spark-solr already present which were conflicting with the jars I was using. After removing those jars, my code worked correctly.
answered Mar 11 at 7:49
Piyush ShrivastavaPiyush Shrivastava
458623
answered Mar 11 at 7:49
Piyush ShrivastavaPiyush Shrivastava
458623
answered Mar 11 at 7:49
Piyush ShrivastavaPiyush Shrivastava
458623
answered Mar 11 at 7:49
Piyush ShrivastavaPiyush Shrivastava
458623
458623
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55060410%2fjava-lang-nosuchmethoderror-org-apache-solr-client-solrj-impl-cloudsolrclientb%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
2
Possible duplicate of Resolving dependency problems in Apache Spark
– user10938362
Mar 8 at 10:05