Failure while reading messages from kafka

[Matt]

I have a Kafka topic with some non-JSON test messages in it, resulting in
errors "Error: DATA_READ ERROR: Failure while reading messages from kafka.
Recordreader was at record: 1"

I don't seem to be able to bypass these topic messages with
"store.json.reader.skip_invalid_records" or even an OFFSET in the query.

Is there a mechanism or setting I can use to query a topic and not fail on
malformed messages?

[Matt]

https://issues.apache.org/jira/browse/DRILL-6723

Post by Matt
I have a Kafka topic with some non-JSON test messages in it, resulting in
errors "Error: DATA_READ ERROR: Failure while reading messages from kafka.
Recordreader was at record: 1"
I don't seem to be able to bypass these topic messages with
"store.json.reader.skip_invalid_records" or even an OFFSET in the query.
Is there a mechanism or setting I can use to query a topic and not fail on
malformed messages?

[Khurram Faraaz]

Can you please share the stack trace from drillbit.log and the version of
Kafka that you are on ?

Thanks,
Khurram

https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.
apache.org_jira_browse_DRILL-2D6723&d=DwIBaQ&c=cskdkSMqhcnjZxdQVpwTXg&r=
H5JEl9vb-mBIjic10QAbDD2vkUUKAxjO6wZO322RtdI&m=1BtkhAfyGAwpn_Qov_2S8-
0asOGHNYFYaxumWdyI4kE&s=57Qb0eMSL8xLEok5uB7ovkEkro0DgQwTXYnFeERXGiY&e=

Post by Matt
I have a Kafka topic with some non-JSON test messages in it, resulting in
errors "Error: DATA_READ ERROR: Failure while reading messages from

kafka.

Post by Matt
Recordreader was at record: 1"
I don't seem to be able to bypass these topic messages with
"store.json.reader.skip_invalid_records" or even an OFFSET in the query.
Is there a mechanism or setting I can use to query a topic and not fail

on

Post by Matt
malformed messages?