full text search - Handling the dot in ElasticSearch -


i have string property called summary has analyzer set trigrams , search_analyzer set words.

"filter": {     "words_splitter": {         "type": "word_delimiter",         "preserve_original": "true"     },     "english_words_filter": {         "type": "stop",         "stop_words": "_english_"     },     "trigrams_filter": {         "type": "ngram",         "min_gram": "2",         "max_gram": "20"     } }, "analyzer": {     "words": {         "filter": [             "lowercase",             "words_splitter",             "english_words_filter"         ],         "type": "custom",         "tokenizer": "whitespace"     },     "trigrams": {         "filter": [             "lowercase",             "words_splitter",             "trigrams_filter",             "english_words_filter"         ],         "type": "custom",         "tokenizer": "whitespace"     } }

i need query strings given in input react , html (or react, html) being matched documents contain in summary words react, reactjs, react.js, html, html5. more matching keywords have, higher score have (i expect lower scores on documents have word matching not @ 100%, ideally).

the thing is, guess @ moment react.js split in both react , js since documents contain js well. on other hand, reactjs returns nothing. think need words_splitter in order ignore comma.

you can solve problem names react.js keyword marker filter , defining analyzer uses keyword filter. prevent react.js being split react , js tokens.

here example configuration filter:

     "filter": {         "keywords": {            "type": "keyword_marker",            "keywords": [               "react.js",            ]         }      }

and analyzer:

     "analyzer": {         "main_analyzer": {            "type": "custom",            "tokenizer": "standard",            "filter": [               "lowercase",               "keywords",               "synonym_filter",               "german_stop",               "german_stemmer"            ]         }      }

you can see whether analyzer behaves required using analyze command:

get /<index_name>/_analyze?analyzer=main_analyzer&text="react.js nice library"

this should return following tokens react.js not tokenized:

{    "tokens": [       {          "token": "react.js",          "start_offset": 1,          "end_offset": 9,          "type": "<alphanum>",          "position": 0       },       {          "token": "is",          "start_offset": 10,          "end_offset": 12,          "type": "<alphanum>",          "position": 1       },       {          "token": "a",          "start_offset": 13,          "end_offset": 14,          "type": "<alphanum>",          "position": 2       },       {          "token": "nice",          "start_offset": 15,          "end_offset": 19,          "type": "<alphanum>",          "position": 3       },       {          "token": "library",          "start_offset": 20,          "end_offset": 27,          "type": "<alphanum>",          "position": 4       }    ] }

for words similar not same as: react.js , reactjs use synonym filter. have fixed set of keywords want match?


Comments

Post a Comment

Popular posts from this blog

jOOQ update returning clause with Oracle -

according http://www.jooq.org/doc/3.8/manual/sql-building/sql-statements/update-statement/ jooq doesn't support returning clause in update statements databases except firebird , postgres. does know, still correct oracle jooq? according oracle's documentation, oracle db supports returning clase delete, insert, or update statements. incorrect manual you're right - manual wrong , should fixed: https://github.com/jooq/jooq/issues/5470 single row update returning jooq 3.8 added support single row update .. returning statements. internally, uses callablestatement , pl/sql block of form: begin update "my_table" set "my_table"."column" = 'xyz' "my_table"."id" = 1 returning "my_table"."id", "my_table"."column" ?, ?; ? := sql%rowcount; end; the relevant issue is: https://github.com/jooq/jooq/issues/5190 multi row update returning a...
Read more

java - Warning equals/hashCode on @Data annotation lombok with inheritance -

i have entity inherits other. on other hand, i'm using lombok project reduce boilerplate code, put @data annotation. annotation @data inheritance produces next warning: generating equals/hashcode implementation without call superclass, though class not extend java.lang.object. if intentional, add '@equalsandhashcode(callsuper=false)' type. is advisable add annotation @equalsandhashcode (callsuper = true) or @equalsandhashcode (callsuper = false) ? if not added, 1 callsuper=false or callsuper=true ? the default value false . 1 if don't specify , ignore warning. yes, recommended add @equalsandhashcode annotation on @data annotated classes extend else object. cannot tell if need true or false , depends on class hierarchy, , need examined on case-by-case basis. however, project or package, can configure in lombok.config call super methods if not direct subclass of object. lombok.equalsandhashcode.callsuper = call for configuration system ...
Read more

java - BasicPathUsageException: Cannot join to attribute of basic type -

i using java 8 jpa (hibernate 5.2.1). have clause works perfectly, until introduce clause make use foreign key table values too. i getting following error: basicpathusageexception: cannot join attribute of basic type i think problem related fact have join table, , not sure how create join using join table. employee - employee_category - category model (employee.java): @manytomany(cascade = cascadetype.all, fetch=fetchtype.eager) @jointable ( name="employee_category", joincolumns={ @joincolumn(name="emp_id", referencedcolumnname="id") }, inversejoincolumns={ @joincolumn(name="cat_id", referencedcolumnname="id") } ) private set<category> categories; model (category.java): @id private string id; jpa when introduce following code, fails error above (i think problem new piece of code): join<t, category> category = from.join("id"); predicates.add(criteriabuilder.like(category....
Read more