datastax - Cassandra performance issue -


we have table looks like:

create table arc_dynamic.transit_map (     sal text,     pfn text,     transit_map_id text,     create_program_id text,     create_timestamp timestamp,     cutoff_times map<text, text>,     derived_priority int,     effective_date text,     modify_program_id text,     modify_timestamp timestamp,     relationship_type_id text,     solr_query text,     stop set<text>,     transit_days map<text, int>,     trigger_id text,     primary key (sal, pfn, transit_map_id) ) clustering order (pfn asc, transit_map_id asc)     , bloom_filter_fp_chance = 0.01     , caching = '{"keys":"all", "rows_per_partition":"none"}'     , comment = ''     , compaction = {'class': 'org.apache.cassandra.db.compaction.sizetieredcompactionstrategy'}     , compression = {'sstable_compression': 'org.apache.cassandra.io.compress.lz4compressor'}     , dclocal_read_repair_chance = 0.1     , default_time_to_live = 0     , gc_grace_seconds = 864000     , max_index_interval = 2048     , memtable_flush_period_in_ms = 0     , min_index_interval = 128     , read_repair_chance = 0.0     , speculative_retry = '99.0percentile';  create custom index arc_dynamic_transit_map_create_timestamp_index on arc_dynamic.transit_map (create_timestamp) using 'com.datastax.bdp.search.solr.cql3solrsecondaryindex'; create custom index arc_dynamic_transit_map_derived_priority_index on arc_dynamic.transit_map (derived_priority) using 'com.datastax.bdp.search.solr.cql3solrsecondaryindex'; create custom index arc_dynamic_transit_map_modify_timestamp_index on arc_dynamic.transit_map (modify_timestamp) using 'com.datastax.bdp.search.solr.cql3solrsecondaryindex'; create custom index arc_dynamic_transit_map_relationship_type_id_index on arc_dynamic.transit_map (relationship_type_id) using 'com.datastax.bdp.search.solr.cql3solrsecondaryindex'; create custom index arc_dynamic_transit_map_solr_query_index on arc_dynamic.transit_map (solr_query) using 'com.datastax.bdp.search.solr.cql3solrsecondaryindex'; create custom index arc_dynamic_transit_map_trigger_id_index on arc_dynamic.transit_map (trigger_id) using 'com.datastax.bdp.search.solr.cql3solrsecondaryindex';

when run:

select * transit_map sal='xxx_953';

it times out:

readtimeout: code=1200 [coordinator node timed out waiting replica nodes'  responses] message="operation timed out - received 0 responses." info= {'received_responses': 0, 'required_responses': 1, 'consistency': 'one'}

if limit 10 rows or less, comes back. more, times out. i'm trying figure out it's going wrong (either many sstables, tombstones, else), can't figure out how @ this.

i've enabled tracing. 10 row limit or less doesn't "look bad" (at least has output).

when put in 11 row limit, or leave blank (no limit), no output comes tracing.

any go appreciated. i'm coming long-time oracle background, , lost on how figure out in cassandra.

creating maps , other objects heavy operations cassandra. in case maps not constrained in size timeouts quite common.

from personal experience map sizes shouldn't on couple of dozen or so.

try , model data in way maps constrained in size or better don't use them @ all. 1 solution can changing transit_days uuid type , having connection table looks this:

create table arc_dynamic.transit_map_days_per ( transit_day_id uuid, data text primary key (transit_day_id) )

you able "map" table list of tuples , manipulate on end


Comments

Post a Comment

Popular posts from this blog

jOOQ update returning clause with Oracle -

according http://www.jooq.org/doc/3.8/manual/sql-building/sql-statements/update-statement/ jooq doesn't support returning clause in update statements databases except firebird , postgres. does know, still correct oracle jooq? according oracle's documentation, oracle db supports returning clase delete, insert, or update statements. incorrect manual you're right - manual wrong , should fixed: https://github.com/jooq/jooq/issues/5470 single row update returning jooq 3.8 added support single row update .. returning statements. internally, uses callablestatement , pl/sql block of form: begin update "my_table" set "my_table"."column" = 'xyz' "my_table"."id" = 1 returning "my_table"."id", "my_table"."column" ?, ?; ? := sql%rowcount; end; the relevant issue is: https://github.com/jooq/jooq/issues/5190 multi row update returning a...
Read more

java - Warning equals/hashCode on @Data annotation lombok with inheritance -

i have entity inherits other. on other hand, i'm using lombok project reduce boilerplate code, put @data annotation. annotation @data inheritance produces next warning: generating equals/hashcode implementation without call superclass, though class not extend java.lang.object. if intentional, add '@equalsandhashcode(callsuper=false)' type. is advisable add annotation @equalsandhashcode (callsuper = true) or @equalsandhashcode (callsuper = false) ? if not added, 1 callsuper=false or callsuper=true ? the default value false . 1 if don't specify , ignore warning. yes, recommended add @equalsandhashcode annotation on @data annotated classes extend else object. cannot tell if need true or false , depends on class hierarchy, , need examined on case-by-case basis. however, project or package, can configure in lombok.config call super methods if not direct subclass of object. lombok.equalsandhashcode.callsuper = call for configuration system ...
Read more

java - BasicPathUsageException: Cannot join to attribute of basic type -

i using java 8 jpa (hibernate 5.2.1). have clause works perfectly, until introduce clause make use foreign key table values too. i getting following error: basicpathusageexception: cannot join attribute of basic type i think problem related fact have join table, , not sure how create join using join table. employee - employee_category - category model (employee.java): @manytomany(cascade = cascadetype.all, fetch=fetchtype.eager) @jointable ( name="employee_category", joincolumns={ @joincolumn(name="emp_id", referencedcolumnname="id") }, inversejoincolumns={ @joincolumn(name="cat_id", referencedcolumnname="id") } ) private set<category> categories; model (category.java): @id private string id; jpa when introduce following code, fails error above (i think problem new piece of code): join<t, category> category = from.join("id"); predicates.add(criteriabuilder.like(category....
Read more