November Apache Drill board report

Discussion:

Arina Ielchiieva

2018-11-01 13:42:35 UTC

Hi all,

please take a look at the draft board report for the last quarter and let
me know if you have any comments.

Thanks,
Arina

=====

## Description:
- Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.

## Issues:
- There are no issues requiring board attention at this time.

## Activity:
- Since the last board report, Drill has released version 1.14.0,
including the following enhancements:
- Drill in a Docket container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- There were active discussions about schema provision in Drill.
Based on these discussions two projects are currently evolving:
Drill metastore and schema provision in the file and in a query.
- Apache Drill book has been written by two PMC members (Charles and Paul).
- Drill developer meet up will be held on November 14, 2019.
The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow

## Health report:
- The project is healthy. Development activity
as reflected in the pull requests and JIRAs is good.
- Activity on the dev and user mailing lists are stable.
- Three committers and three new PMC member were added in the last period.

## PMC changes:

- Currently 23 PMC members.
- New PMC members:
- Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
- Charles Givre was added to the PMC on Mon Sep 03 2018
- Vova Vysotskyi was added to the PMC on Fri Aug 24 2018

## Committer base changes:

- Currently 48 committers.
- New commmitters:
- Chunhui Shi was added as a committer on Thu Sep 27 2018
- Gautam Parai was added as a committer on Mon Oct 22 2018
- Weijie Tong was added as a committer on Fri Aug 31 2018

## Releases:

- 1.14.0 was released on Sat Aug 04 2018

## Mailing list activity:

- ***@drill.apache.org:
- 427 subscribers (down -6 in the last 3 months):
- 2827 emails sent to list (2126 in previous quarter)

- ***@drill.apache.org:
- 18 subscribers (down -1 in the last 3 months):
- 3487 emails sent to list (4769 in previous quarter)

- ***@drill.apache.org:
- 597 subscribers (down -6 in the last 3 months):
- 332 emails sent to list (346 in previous quarter)

## JIRA activity:

- 164 JIRA tickets created in the last 3 months
- 128 JIRA tickets closed/resolved in the last 3 months

Aman Sinha

2018-11-01 16:19:56 UTC

Permalink

Docket container ==> 'Docker'
November 14, 2019 ==> 2018 :) (this is wrong in email that was sent
out)

Rest LGTM.

Post by Arina Ielchiieva
Hi all,
please take a look at the draft board report for the last quarter and let
me know if you have any comments.
Thanks,
Arina
=====
- Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.
- There are no issues requiring board attention at this time.
- Since the last board report, Drill has released version 1.14.0,
- Drill in a Docket container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- There were active discussions about schema provision in Drill.
Drill metastore and schema provision in the file and in a query.
- Apache Drill book has been written by two PMC members (Charles and Paul).
- Drill developer meet up will be held on November 14, 2019.
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow
- The project is healthy. Development activity
as reflected in the pull requests and JIRAs is good.
- Activity on the dev and user mailing lists are stable.
- Three committers and three new PMC member were added in the last period.
- Currently 23 PMC members.
- Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
- Charles Givre was added to the PMC on Mon Sep 03 2018
- Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
- Currently 48 committers.
- Chunhui Shi was added as a committer on Thu Sep 27 2018
- Gautam Parai was added as a committer on Mon Oct 22 2018
- Weijie Tong was added as a committer on Fri Aug 31 2018
- 1.14.0 was released on Sat Aug 04 2018
- 2827 emails sent to list (2126 in previous quarter)
- 3487 emails sent to list (4769 in previous quarter)
- 332 emails sent to list (346 in previous quarter)
- 164 JIRA tickets created in the last 3 months
- 128 JIRA tickets closed/resolved in the last 3 months

Arina Yelchiyeva

2018-11-01 16:28:55 UTC

Permalink

Thanks, Aman! Updated the report.
I went too far with 2019, luckily the meet up will be much earlier :)

=====

## Description:
- Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.

## Issues:
- There are no issues requiring board attention at this time.

## Activity:
- Since the last board report, Drill has released version 1.14.0,
including the following enhancements:
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- There were active discussions about schema provision in Drill.
Based on these discussions two projects are currently evolving:
Drill metastore and schema provision in the file and in a query.
- Apache Drill book has been written by two PMC members (Charles and Paul).
- Drill developer meet up will be held on November 14, 2018.
The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow

## Health report:
- The project is healthy. Development activity
as reflected in the pull requests and JIRAs is good.
- Activity on the dev and user mailing lists are stable.
- Three committers and three new PMC member were added in the last period.

## PMC changes:

- Currently 23 PMC members.
- New PMC members:
- Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
- Charles Givre was added to the PMC on Mon Sep 03 2018
- Vova Vysotskyi was added to the PMC on Fri Aug 24 2018

## Committer base changes:

- Currently 48 committers.
- New commmitters:
- Chunhui Shi was added as a committer on Thu Sep 27 2018
- Gautam Parai was added as a committer on Mon Oct 22 2018
- Weijie Tong was added as a committer on Fri Aug 31 2018

## Releases:

- 1.14.0 was released on Sat Aug 04 2018

## Mailing list activity:

- ***@drill.apache.org:
- 427 subscribers (down -6 in the last 3 months):
- 2827 emails sent to list (2126 in previous quarter)

- ***@drill.apache.org:
- 18 subscribers (down -1 in the last 3 months):
- 3487 emails sent to list (4769 in previous quarter)

- ***@drill.apache.org:
- 597 subscribers (down -6 in the last 3 months):
- 332 emails sent to list (346 in previous quarter)

## JIRA activity:

- 164 JIRA tickets created in the last 3 months
- 128 JIRA tickets closed/resolved in the last 3 months

Post by Aman Sinha
Docket container ==> 'Docker'
November 14, 2019 ==> 2018 :) (this is wrong in email that was sent
out)
Rest LGTM.

period.

Post by Arina Ielchiieva
- Currently 23 PMC members.
- Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
- Charles Givre was added to the PMC on Mon Sep 03 2018
- Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
- Currently 48 committers.
- Chunhui Shi was added as a committer on Thu Sep 27 2018
- Gautam Parai was added as a committer on Mon Oct 22 2018
- Weijie Tong was added as a committer on Fri Aug 31 2018
- 1.14.0 was released on Sat Aug 04 2018
- 2827 emails sent to list (2126 in previous quarter)
- 3487 emails sent to list (4769 in previous quarter)
- 332 emails sent to list (346 in previous quarter)
- 164 JIRA tickets created in the last 3 months
- 128 JIRA tickets closed/resolved in the last 3 months

Sorabh Hamirwasia

2018-11-01 22:25:17 UTC

Permalink

Hi Arina,
Lateral/Unnest feature was part of 1.14 though it was disabled by default.
Should we mention it as part of 1.14 enhancements in the report?

Thanks,
Sorabh

Post by Arina Yelchiyeva
Thanks, Aman! Updated the report.
I went too far with 2019, luckily the meet up will be much earlier :)
=====
- Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.
- There are no issues requiring board attention at this time.
- Since the last board report, Drill has released version 1.14.0,
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- There were active discussions about schema provision in Drill.
Drill metastore and schema provision in the file and in a query.
- Apache Drill book has been written by two PMC members (Charles and Paul).
- Drill developer meet up will be held on November 14, 2018.
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow
- The project is healthy. Development activity
as reflected in the pull requests and JIRAs is good.
- Activity on the dev and user mailing lists are stable.
- Three committers and three new PMC member were added in the last period.
- Currently 23 PMC members.
- Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
- Charles Givre was added to the PMC on Mon Sep 03 2018
- Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
- Currently 48 committers.
- Chunhui Shi was added as a committer on Thu Sep 27 2018
- Gautam Parai was added as a committer on Mon Oct 22 2018
- Weijie Tong was added as a committer on Fri Aug 31 2018
- 1.14.0 was released on Sat Aug 04 2018
- 2827 emails sent to list (2126 in previous quarter)
- 3487 emails sent to list (4769 in previous quarter)
- 332 emails sent to list (346 in previous quarter)
- 164 JIRA tickets created in the last 3 months
- 128 JIRA tickets closed/resolved in the last 3 months

Post by Aman Sinha
Docket container ==> 'Docker'
November 14, 2019 ==> 2018 :) (this is wrong in email that was

sent

Post by Aman Sinha
out)
Rest LGTM.

Post by Arina Ielchiieva
Hi all,
please take a look at the draft board report for the last quarter and

let

Post by Aman Sinha

Post by Arina Ielchiieva
me know if you have any comments.
Thanks,
Arina
=====
- Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.
- There are no issues requiring board attention at this time.
- Since the last board report, Drill has released version 1.14.0,
- Drill in a Docket container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- There were active discussions about schema provision in Drill.
Drill metastore and schema provision in the file and in a query.
- Apache Drill book has been written by two PMC members (Charles and Paul).
- Drill developer meet up will be held on November 14, 2019.
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow
- The project is healthy. Development activity
as reflected in the pull requests and JIRAs is good.
- Activity on the dev and user mailing lists are stable.
- Three committers and three new PMC member were added in the last

period.

Arina Ielchiieva

2018-11-02 09:55:41 UTC

Permalink

Sure, let's mention.
Updated the report.

=====

## Description:
- Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.

## Issues:
- There are no issues requiring board attention at this time.

## Activity:
- Since the last board report, Drill has released version 1.14.0,
including the following enhancements:
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- Lateral / Unnest support (disabled by default)
- There were active discussions about schema provision in Drill.
Based on these discussions two projects are currently evolving:
Drill metastore and schema provision in the file and in a query.
- Apache Drill book has been written by two PMC members (Charles and Paul).
- Drill developer meet up will be held on November 14, 2018.

The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow

## Health report:
- The project is healthy. Development activity
as reflected in the pull requests and JIRAs is good.
- Activity on the dev and user mailing lists are stable.
- Three committers and three new PMC member were added in the last period.

## PMC changes:

- Currently 23 PMC members.
- New PMC members:
- Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
- Charles Givre was added to the PMC on Mon Sep 03 2018
- Vova Vysotskyi was added to the PMC on Fri Aug 24 2018

## Committer base changes:

- Currently 48 committers.
- New commmitters:
- Chunhui Shi was added as a committer on Thu Sep 27 2018
- Gautam Parai was added as a committer on Mon Oct 22 2018
- Weijie Tong was added as a committer on Fri Aug 31 2018

## Releases:

- 1.14.0 was released on Sat Aug 04 2018

## Mailing list activity:

- ***@drill.apache.org:
- 427 subscribers (down -6 in the last 3 months):
- 2827 emails sent to list (2126 in previous quarter)

- ***@drill.apache.org:
- 18 subscribers (down -1 in the last 3 months):
- 3487 emails sent to list (4769 in previous quarter)

- ***@drill.apache.org:
- 597 subscribers (down -6 in the last 3 months):
- 332 emails sent to list (346 in previous quarter)

## JIRA activity:

- 164 JIRA tickets created in the last 3 months
- 128 JIRA tickets closed/resolved in the last 3 months

Post by Sorabh Hamirwasia
Hi Arina,
Lateral/Unnest feature was part of 1.14 though it was disabled by default.
Should we mention it as part of 1.14 enhancements in the report?
Thanks,
Sorabh
On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <

period.

Post by Arina Yelchiyeva
- Currently 23 PMC members.
- Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
- Charles Givre was added to the PMC on Mon Sep 03 2018
- Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
- Currently 48 committers.
- Chunhui Shi was added as a committer on Thu Sep 27 2018
- Gautam Parai was added as a committer on Mon Oct 22 2018
- Weijie Tong was added as a committer on Fri Aug 31 2018
- 1.14.0 was released on Sat Aug 04 2018
- 2827 emails sent to list (2126 in previous quarter)
- 3487 emails sent to list (4769 in previous quarter)
- 332 emails sent to list (346 in previous quarter)
- 164 JIRA tickets created in the last 3 months
- 128 JIRA tickets closed/resolved in the last 3 months

Post by Aman Sinha
Docket container ==> 'Docker'
November 14, 2019 ==> 2018 :) (this is wrong in email that was

sent

Post by Aman Sinha
out)
Rest LGTM.

Post by Arina Ielchiieva
Hi all,
please take a look at the draft board report for the last quarter and

let

Post by Aman Sinha

Post by Arina Ielchiieva
me know if you have any comments.
Thanks,
Arina
=====
- Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and

Cloud

Post by Arina Yelchiyeva

Post by Aman Sinha

Post by Arina Ielchiieva
Storage.
- There are no issues requiring board attention at this time.
- Since the last board report, Drill has released version 1.14.0,
- Drill in a Docket container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- There were active discussions about schema provision in Drill.
Drill metastore and schema provision in the file and in a query.
- Apache Drill book has been written by two PMC members (Charles and Paul).
- Drill developer meet up will be held on November 14, 2019.
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow
- The project is healthy. Development activity
as reflected in the pull requests and JIRAs is good.
- Activity on the dev and user mailing lists are stable.
- Three committers and three new PMC member were added in the last

period.

Padma Penumarthy

2018-11-02 18:33:37 UTC

Permalink

Hi Arina,

Can you add batch sizing (for bunch of operators and parquet reader) also ?

Thanks
Padma

Post by Arina Ielchiieva
Sure, let's mention.
Updated the report.
=====
- Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.
- There are no issues requiring board attention at this time.
- Since the last board report, Drill has released version 1.14.0,
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- Lateral / Unnest support (disabled by default)
- There were active discussions about schema provision in Drill.
Drill metastore and schema provision in the file and in a query.
- Apache Drill book has been written by two PMC members (Charles and Paul).
- Drill developer meet up will be held on November 14, 2018.
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow
- The project is healthy. Development activity
as reflected in the pull requests and JIRAs is good.
- Activity on the dev and user mailing lists are stable.
- Three committers and three new PMC member were added in the last period.
- Currently 23 PMC members.
- Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
- Charles Givre was added to the PMC on Mon Sep 03 2018
- Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
- Currently 48 committers.
- Chunhui Shi was added as a committer on Thu Sep 27 2018
- Gautam Parai was added as a committer on Mon Oct 22 2018
- Weijie Tong was added as a committer on Fri Aug 31 2018
- 1.14.0 was released on Sat Aug 04 2018
- 2827 emails sent to list (2126 in previous quarter)
- 3487 emails sent to list (4769 in previous quarter)
- 332 emails sent to list (346 in previous quarter)
- 164 JIRA tickets created in the last 3 months
- 128 JIRA tickets closed/resolved in the last 3 months

Post by Sorabh Hamirwasia
Hi Arina,
Lateral/Unnest feature was part of 1.14 though it was disabled by

default.

Post by Sorabh Hamirwasia
Should we mention it as part of 1.14 enhancements in the report?
Thanks,
Sorabh
On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <

period.

Post by Aman Sinha
Docket container ==> 'Docker'
November 14, 2019 ==> 2018 :) (this is wrong in email that

was