Django-Oscar tutorial 'deploy/solr' file not found error? - solr

Django-Oscar tutorial.
It uses Solr. In the tutorial above there is a link to the Solr installation guide.
In the Solr guide, this is the line where I am stuck at:
ln -s <your_oscar_checkout>/sites/<sandbox|demo>/deploy/solr conf
That line gives me the error:
bash: /deploy/solr: No such file or directory
bash: your_oscar_checkout: No such file or directory
I tried searching for a solution but I couldn't find anything about those missing folders.
Any ideas on what could be wrong?

ln -s <your_oscar_checkout>/sites/<sandbox|demo>/deploy/solr conf
Essentially you are creating a link of solr directory from your oscar checkout to conf directory under solr-4.7.2/example/solr/collection1. Please check you have the correct replacement for <your_oscar_checkout> directory and <sandbox|demo>, which is why it has been put in angel bracket. Otherwise you can copy the content to solr-4.7.2/example/solr/collection1/conf path. But then if you need to update any properties for schema then you do it here not in oscar directory. Then just start the solr using java -jar solr-4.7.2/example/start.jar.
Hope this helps.

Related

Install zeppelin on windows

I have spark installed and I am trying to run zeppelin but just doesn't run.
Error while running Zepplin
I have used this as JAVA_HOME as "C:\Program Files (x86)\Java\jdk1.7.0_55"
Could someone please help me with the installation steps of Zeppelin on Windows10 ?
This is probably due to the fact that your zeppelin folder is located in your root directory. You can either:
Run the cmd window as administrator to start Zeppelin.
Move the Zeppelin folder in the user directory
What would echo %JAVA_HOME% return?
C:\Users\user1>echo %JAVA_HOME%
C:\Program Files\Java\jre1.8.0_121
Seems like you have extra quotes around the path to your Java directory.
Two issues here:
1. Spaces in your ENV-VARIABLE : You are getting the issue because of the space in your path.
To resolve it add following lines to your zeppelin-env.cmd
set JAVA="C:\Program Files (x86)\Java\jdk1.7.0_55"
set JAVA_HOME="%JAVA%"
This should solve your 'not recognized' error.
2a. To troubleshoot zeppelin setup refer my answer here.
2b. To make spark work on both command prompt and zeppelin refer this gist.
Hope this helps!

Solr 5: Adding a new Core fails out of the box

So I'm just playing around with Solr 5, but I tried to add a new Core through the Admin UI and the command line with:
bin/solr create -c new_core
But in both situations I get the following error:
new_core: org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Could not load conf for core new_core: Error loading solr config from /Users/blah/lib/solr-5.3.0/server/solr/new_core/conf/solrconfig.xml
I started my Solr server using this:
bin/solr start
I'm following the docs here:
https://cwiki.apache.org/confluence/display/solr/Running+Solr
So what's the fix? How was this supposed to work out of the box given I assume there must be some template that the Admin UI uses when creating new cores?
The error is coming because there is no new_core configured in your setup.
Please perform the following steps:
mkdir /Users/blah/lib/solr-5.3.0/server/solr/core_name
echo "name=core_name" > /Users/blah/lib/solr-5.3.0/server/solr/core_name/core.properties
cp -r /Users/blah/lib/solr-5.3.0/server/solr/configsets/basic_configs/conf /Users/blah/lib/solr-5.3.0/server/solr/core_name/
Some important point to note:
core.properties and conf directory should be placed at same path.
conf directory will contain the schema.xml and solrconfig.xml files.

How to create new core in Solr 5?

Currently we are using Apache Solr 4.10.3 OR Heliosearch Distribution for Solr [HDS] as a search engine to index our data.
Now after that, I got the news about Apache Solr 5.0.0 release in last month. I'd successfully installed Apache Solr 5.0.0 version and now its running properly on 8983 port (means only running solr but unable to create core). In that UI, I'm unable to find the example core as well as schema or config files under it. So, I started creating new core as we create in old versions but unable to create one. Following is the error, I'm getting it:
Error CREATEing SolrCore 'testcore1': Unable to create core [testcore1] Caused by: Could not find configName for collection testcore1 found:null
Note: I also seen Cloud tab on (ie. http://localhost:8983/solr/) left side of Solr UI and also don't know how it works? Meaning I don't know the location of the schema.xml, solrconfig.xml files due to lack of example folder (Collection1) and how to update those files?
Is there any useful document or solution available to solve this error?
In Solr 5, creation of cores is supported by the bin/solr script provided in the distribution. Try
bin/solr create -help
for a quick introduction.
From the above help doc, you may find:
bin/solr create [-c name] [-d confdir] [-n configName] [-shards #] [-replicationFactor #] [-p port]
In Solr 5.4.0 , create new core using command from Solr-5.x.x folder (Solr Installation folder) like following,
$ bin/solr create -c <name>
See this documentation of Apache Solr 5.4 https://cwiki.apache.org/confluence/display/solr/Running+Solr
{SOLR_INSTALLATION}/server/solr/configsets\basic_configs\conf
you can find the example schema.xml and solrconfig.xml.
if you want to create the new core
{SOLR_INSTALLATION}/server/solr/{new core name} folder and create conf folder with required schema and solrconfig.xml and blank core.properties file.
you can find the examples for schema and config in
{SOLR_INSTALLATION}/example/example-DIH/solr
Create using the web interface
Go to bin directory and issue
./solr start -e cloud -noprompt
Which will start solr.
Go to http://localhost:8983
(this is assuming you are running on localhost)
Click on core admin and they "Add Core"
Use provided solr script with solr user privileges to create Solr cores, e.g.
cd /opt/solr
sudo -u solr ./bin/solr create -c testcore1
Run bin/solr --help for syntax guidance.
For any other issues, please check your Solr logs (e.g. /var/solr/logs/solr.log).
Related: SOLR-7826: Permission issues when creating cores with bin/solr as root user.
You can find your solrconfig.xml and schema.xml inside the collection directory.
Go to /usr/lib/ambari-infra-solr/server/solr and u will see a folder with same name as of collection and with schema and config files.
Inside the conf folder there will be a managed-schema file and other files that you have been searching for.
As for this error
Error CREATEing SolrCore 'testcore1': Unable to create core [testcore1] Caused by: Could not find configName for collection testcore1 found:null
This error must be coming when you are creating solr collection from UI.
For that go to location where solr.cmd is located and type the below code
./solr create -c -d -s -r
copy conf from solr/example/conf to solr/server/solr/.

Fail to load ExtractingRequestHandler when running the Solr Quickstart Tutorial

I installed Solr 5.0.0 on OS X 10.10.2 using Homebrew. I am trying to follow the quick start instructions and am getting errors when I try to index a directory of files.
I am able to successfully start the sample Solr server by running
bin/solr start -e cloud -noprompt
as directed by the tutorial. I then try to index a directory of files by running
./bin/post -c gettingstarted docs/
(Note that this has to be done from the libexec subdirectory of the Solr install root.)
I get a server error 500 for every file it tries to add. The relevant stack:
Caused by: org.apache.solr.common.SolrException: Error loading class 'solr.extraction.ExtractingRequestHandler'
at org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:492)
at org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:423)
at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:559)
at org.apache.solr.core.SolrCore.createRequestHandler(SolrCore.java:632)
at org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.createRequestHandler(RequestHandlers.java:326)
at org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.getWrappedHandler(RequestHandlers.java:298)
... 30 more
The issue appears to be that ExtractingRequestHandler is not on the classpath.
ExtractingRequestHandler is in the solr-cell-5.0.0.jar.
jar tf dist/solr-cell-5.0.0.jar | grep ExtractingRequestHandler
org/apache/solr/handler/extraction/ExtractingRequestHandler.class
It's not clear to me if it needs to be on the classpath of the command doing the posting or the Solr instance. The answer to this question makes it sound like the latter. However, I tried setting
export CLASSPATH=dist/solr-cell-5.0.0.jar
before trying to index the files and saw the same error.
I don't see anything in the tutorial about how to configure this. What is the error and how do I get past it?
Looks like the problem is incorrect paths in the Solr example configuration. A workaround is to add softlinks from SOLR_ROOT/contrib and dist to the corresponding directories beneath SOLR_ROOT/libexec/contrib
Details here and here.

In which directory do files get downloaded when using download_data command in gae

I am following the instructions at https://developers.google.com/appengine/docs/python/tools/uploadingdata to download data from google app engine. The data gets successfully downloaded (per the python output) but I am not able to find the file on the filesystem.
E.g., For the following command, I get success but I can't find bulkloader.yaml in my computer. I have tried microsoft (Win 7) inbuilt search, google-desktop search, but I get 0 results.
C:\Program Files (x86)\Google\google_appengine>python appcfg.py create_bulkloader_config --filename=bulkloader.yaml --url=http://appname.appspot.com/remote_api
Any help in this regard will be greatly appreciated. Thanks.
Assuming that all worked, the file should be in the same directory from which you started the command appcfg.py. the default directory of command prompt windows is something like C:\Documents and Settings\User. Try to take a look there or restart command from a directory of your choice.
edit: in your case the file is probably in C:\Program Files (x86)\Google\google_appengine

Resources