While upgrading the solr from version 5.5 to 6.6, we observe the query time has been increased.
I wanted to ask, Is this normal behavior on solr 6.6.6, or was there some setting that we forgot to add?
Examples:
(Solr 6.6.6 version)
TimeTaken in Milliseconds: 838
Documents found in SOLR: 125
TimeTaken in Milliseconds: 105
Documents found in SOLR: 165813
TimeTaken in Milliseconds: 178
Documents found in SOLR: 6708
TimeTaken in Milliseconds: 252
Documents found in SOLR: 494679
(Solr 5.5 version)
TimeTaken in Milliseconds:11
Documents found in SOLR: 249
TimeTaken in Milliseconds:38
Documents found in SOLR: 120826
TimeTaken in Milliseconds:15
Documents found in SOLR: 3955
TimeTaken in Milliseconds:59
Documents found in SOLR: 521061
Pleas also tell us do we need to add any settings corresponding to solr 6.6.6 version.
Pleas also tell us do we need to add any settings corresponding to solr 6.6.6 version.
Related
In nutch, In solrindex job how we can calculate the number of documents which have been updated in solr and the number of documents which have been indexed as new documents.
You can use this to see stats and status (fetched, not_modified, gone...)
bin/nutch readdb crawl/crawldb/ -stats
Or else you can dump crawldb to see all urls that have been crawled with their status
bin/nutch readdb crawl/crawldb/ -dump whole_db
vi whole_db/part-r-00000
Here's our problem. We're runnig DSE Enterprise 4.8 with the following configuration:
6 servers with Cassandra
on 3 of them Spark is installes (DSE Analytics)
on the orher 3 SOLR is installed (DSE Search)
We want to do "query stats" with SOLR on a table using and excluding certain filter queries.
When we try to execute a simple query like this:
/select?q=*:*&wt=json&indent=true&fq={!tag=fq1}test:100&stats=true&stats.field={!ex=fq1}test&rows=1
it runs OK only on 1 node out of the 3 with SOLR installed.
For the other 2 nodes we get this exception:
{
"responseHeader":{
"status":400,
"QTime":2},
"error":{
"msg":"undefined field: \"{!ex=fq1}test\"",
"code":400},
"params":"q=*:*&indent=true&stats=true&fq={!tag%3Dfq1}test:100&rows=1&wt=json&stats.field={!ex%3Dfq1}test"}
Could you help us identify the reason of the "undefined field" exception when using exluding filter queries inside the stats.field parameter.
Also it would help us to use only a subset of the stats functions ( for example only count ) :
stats.field={!count=true}test
But these types of parameters seem to be ignored and the whole set of stats functions are computed...
Many Thanks
I have id field in solr that uniquely identifies a solr document
When querying solr using getHandler :
solr/{collection}/get?id=p_1266762970&fl=*
Result:
"doc":
{
"lastIndexed":"2014-12-25T09:48:56.509Z",
"id":"1266762970",
"solrId":"p_1266762970",
.....
}
But when querying using solr admin - selectHandler - no documents are returned.
Solr query looks like:
solr/{collection}/select?q=:&fq=solrId:p_1266762970
solr/{collection}/select?q=:&fq=id:1266762970
I tried doing a hard commit and it returned successfully but still the same results
I have other documents in solr as well that shows up correct results.This issue exist for some of the ids (8 out of 2.3 million) only.
Updated: UniqueKey is
<uniqueKey>solrId</uniqueKey>
The SOLR search response is extremely slow using SOLR Apache Lucene 3.6.
Some performance enhancement techniques I'm experimenting with are
SOLR Pagination
mergeFactor currently set to 10 in solrConfig.xml
SOLR Facet queries
filterCache in solrconfig.xml set to size 512 and using
solr.FastLRUCache and autowarm = 0;
queryResultCache in solfconfig.xml set to size 512 with
autowarmCount=0
newSearcher, firstSearcher, and useColdSearcher
single segment index for 100,000 documents
single machine SOLR server for 100,000 documents
How can I optimize items 1-7 to increase SOLR search response for a term/query?
Are there any other optimization parameters to consider not mentioned above?
You can also check below :-
SolrPerformanceFactors
ImproveSearchingSpeed
ImproveIndexingSpeed
SolrCaching
The Seven Deadly Sins of Solr
I have a problem with SOLR terms.
My query is
http://localhost:8080/solr/terms?terms=true&terms.lower.incl=false&indent=true&wt=json&terms.fl=a_dm_testo&terms.prefix=quel
Response from SOLR
{"responseHeader":{
"status":0,
"QTime":0},
"terms":{
"a_dm_testo":[
"quell",1]}}
But this field in SOLR contains much more words with prefix "quel":
quello - 2
quelle - 1
quella - 1
....
I don`t understand what is wrong, can anybody help me?
Problem was with settings of schema.xml. When I rolled back to default "text_general" settings in schema.xml my problem was resolved.