I create a schema and i add 1TB data to druid schema. then the log file version was upgraded and new two columns was added. then i want to add that data to druid schema. but couldn't yet.
Adding new data to existing datasources Druid can insert new data to an existing datasource by appending new segments to existing segment sets. It can also add new data by merging an existing set of segments with new data and overwriting the original set. Druid does not support single-record updates by primary key.
Druid supports the following column types: String, Long, Float, Double.
You initiate data loading in Druid by submitting an ingestion task spec to the Druid Overlord. You can write ingestion specs by hand or using the data loader built into the Druid console. The Quickstart shows you how to use the data loader to build an ingestion spec.
Druid stores data in files called segments. Historical processes cache data segments on local disk and serve queries from that cache as well as from an in-memory cache. This means that Druid never needs to access deep storage during a query, helping it offer the best query latencies possible.
In order to add a new column to existing datasource you need to follow the below steps:
Tasks
menu in druid console. Submit Supervisor
button.You'll find the new columns in the datasource which you can verify by querying the datasource in query section of druid.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With