diff --git a/docs/34.0.0/ingestion/data-formats.md b/docs/34.0.0/ingestion/data-formats.md index a595b1c6d..db3cd1f0f 100644 --- a/docs/34.0.0/ingestion/data-formats.md +++ b/docs/34.0.0/ingestion/data-formats.md @@ -964,12 +964,11 @@ Each line can be further parsed using [`parseSpec`](#parsespec). :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). ::: + :::info You need to include [`druid-avro-extensions`](../development/extensions-core/avro.md) as an extension to use the Avro Hadoop Parser. @@ -1031,6 +1030,13 @@ For example, using Avro Hadoop parser with custom reader's schema file: ### ORC Hadoop Parser +:::caution[Deprecated] + +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). + +::: + + :::info You need to include the [`druid-orc-extensions`](../development/extensions-core/orc.md) as an extension to use the ORC Hadoop Parser. ::: @@ -1276,6 +1282,13 @@ setting `"mapreduce.job.user.classpath.first": "true"`, then this will not be an ### Parquet Hadoop Parser +:::caution[Deprecated] + +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). + +::: + + :::info You need to include the [`druid-parquet-extensions`](../development/extensions-core/parquet.md) as an extension to use the Parquet Hadoop Parser. ::: @@ -1420,6 +1433,13 @@ However, the Parquet Avro Hadoop Parser was the original basis for supporting th ### Parquet Avro Hadoop Parser +:::caution[Deprecated] + +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). + +::: + + :::info Consider using the [Parquet Hadoop Parser](#parquet-hadoop-parser) over this parser to ingest Parquet files. See [Parquet Hadoop Parser vs Parquet Avro Hadoop Parser](#parquet-hadoop-parser-vs-parquet-avro-hadoop-parser) diff --git a/docs/34.0.0/ingestion/hadoop.md b/docs/34.0.0/ingestion/hadoop.md index 3dd738f78..1a8574198 100644 --- a/docs/34.0.0/ingestion/hadoop.md +++ b/docs/34.0.0/ingestion/hadoop.md @@ -25,9 +25,7 @@ sidebar_label: "Hadoop-based" :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). ::: diff --git a/docs/34.0.0/operations/other-hadoop.md b/docs/34.0.0/operations/other-hadoop.md index a82b331de..51c1bd6f2 100644 --- a/docs/34.0.0/operations/other-hadoop.md +++ b/docs/34.0.0/operations/other-hadoop.md @@ -25,12 +25,11 @@ title: "Working with different versions of Apache Hadoop" :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: + Apache Druid can interact with Hadoop in two ways: 1. [Use HDFS for deep storage](../development/extensions-core/hdfs.md) using the druid-hdfs-storage extension. diff --git a/docs/34.0.0/release-info/release-notes.md b/docs/34.0.0/release-info/release-notes.md index c07dc5c1d..0578f65cc 100644 --- a/docs/34.0.0/release-info/release-notes.md +++ b/docs/34.0.0/release-info/release-notes.md @@ -59,10 +59,14 @@ This section contains important information about new and existing features. ### Java 11 support +**Update**: Support for Java 11 is scheduled to end with Druid 37.0.0. + Java 11 support has been deprecated since Druid 32.0, and official support will be removed as early as Druid 35.0.0 ### Hadoop-based ingestion +**Update**: Support for Hadoop-based ingestion is scheduled to end with Druid 37.0.0. + Hadoop-based ingestion has been deprecated since Druid 32.0 and will be removed as early as Druid 35.0.0. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md). @@ -372,12 +376,21 @@ Additionally, MSQ task engine metrics now include the following dimensions: - The task runner log now includes the task id for a job and includes a log before a job is created [#18105](https://github.com/apache/druid/pull/18105) + ## Upgrade notes and incompatible changes ### Upgrade notes +#### Java 11 support + +**Update**: Support for Java 11 is scheduled to end with Druid 37.0.0. + +Java 11 support has been deprecated since Druid 32.0, and official support will be removed as early as Druid 35.0.0 + #### Hadoop-based ingestion +**Update**: Support for Hadoop-based ingestion is scheduled to end with Druid 37.0.0. + Hadoop-based ingestion has been deprecated since Druid 32.0 and will be removed as early as Druid 35.0.0. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md). diff --git a/docs/34.0.0/release-info/upgrade-notes.md b/docs/34.0.0/release-info/upgrade-notes.md index 6aad866df..6fe7a8cbf 100644 --- a/docs/34.0.0/release-info/upgrade-notes.md +++ b/docs/34.0.0/release-info/upgrade-notes.md @@ -42,8 +42,16 @@ If you're already using this feature, you don't need to take any action. ### Upgrade notes +#### Java 11 support + +**Update**: Support for Java 11 is scheduled to end with Druid 37.0.0. + +Java 11 support has been deprecated since Druid 32.0, and official support will be removed as early as Druid 35.0.0 + #### Hadoop-based ingestion +**Update**: Support for Hadoop-based ingestion is scheduled to end with Druid 37.0.0. + Hadoop-based ingestion has been deprecated since Druid 32.0 and will be removed as early as Druid 35.0.0. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md). diff --git a/docs/34.0.0/tutorials/tutorial-batch-hadoop.md b/docs/34.0.0/tutorials/tutorial-batch-hadoop.md index cba190e7d..6d811655c 100644 --- a/docs/34.0.0/tutorials/tutorial-batch-hadoop.md +++ b/docs/34.0.0/tutorials/tutorial-batch-hadoop.md @@ -25,12 +25,11 @@ sidebar_label: Load from Apache Hadoop :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: + This tutorial shows you how to load data files into Apache Druid using a remote Hadoop cluster. For this tutorial, we'll assume that you've already completed the previous diff --git a/docs/34.0.0/tutorials/tutorial-kerberos-hadoop.md b/docs/34.0.0/tutorials/tutorial-kerberos-hadoop.md index cace9b879..535af37c0 100644 --- a/docs/34.0.0/tutorials/tutorial-kerberos-hadoop.md +++ b/docs/34.0.0/tutorials/tutorial-kerberos-hadoop.md @@ -25,9 +25,7 @@ sidebar_label: Kerberized HDFS deep storage :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: diff --git a/docs/latest/ingestion/data-formats.md b/docs/latest/ingestion/data-formats.md index a595b1c6d..db3cd1f0f 100644 --- a/docs/latest/ingestion/data-formats.md +++ b/docs/latest/ingestion/data-formats.md @@ -964,12 +964,11 @@ Each line can be further parsed using [`parseSpec`](#parsespec). :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). ::: + :::info You need to include [`druid-avro-extensions`](../development/extensions-core/avro.md) as an extension to use the Avro Hadoop Parser. @@ -1031,6 +1030,13 @@ For example, using Avro Hadoop parser with custom reader's schema file: ### ORC Hadoop Parser +:::caution[Deprecated] + +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). + +::: + + :::info You need to include the [`druid-orc-extensions`](../development/extensions-core/orc.md) as an extension to use the ORC Hadoop Parser. ::: @@ -1276,6 +1282,13 @@ setting `"mapreduce.job.user.classpath.first": "true"`, then this will not be an ### Parquet Hadoop Parser +:::caution[Deprecated] + +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). + +::: + + :::info You need to include the [`druid-parquet-extensions`](../development/extensions-core/parquet.md) as an extension to use the Parquet Hadoop Parser. ::: @@ -1420,6 +1433,13 @@ However, the Parquet Avro Hadoop Parser was the original basis for supporting th ### Parquet Avro Hadoop Parser +:::caution[Deprecated] + +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). + +::: + + :::info Consider using the [Parquet Hadoop Parser](#parquet-hadoop-parser) over this parser to ingest Parquet files. See [Parquet Hadoop Parser vs Parquet Avro Hadoop Parser](#parquet-hadoop-parser-vs-parquet-avro-hadoop-parser) diff --git a/docs/latest/ingestion/hadoop.md b/docs/latest/ingestion/hadoop.md index 3dd738f78..1a8574198 100644 --- a/docs/latest/ingestion/hadoop.md +++ b/docs/latest/ingestion/hadoop.md @@ -25,9 +25,7 @@ sidebar_label: "Hadoop-based" :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). ::: diff --git a/docs/latest/operations/other-hadoop.md b/docs/latest/operations/other-hadoop.md index a82b331de..51c1bd6f2 100644 --- a/docs/latest/operations/other-hadoop.md +++ b/docs/latest/operations/other-hadoop.md @@ -25,12 +25,11 @@ title: "Working with different versions of Apache Hadoop" :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: + Apache Druid can interact with Hadoop in two ways: 1. [Use HDFS for deep storage](../development/extensions-core/hdfs.md) using the druid-hdfs-storage extension. diff --git a/docs/latest/release-info/release-notes.md b/docs/latest/release-info/release-notes.md index c07dc5c1d..0578f65cc 100644 --- a/docs/latest/release-info/release-notes.md +++ b/docs/latest/release-info/release-notes.md @@ -59,10 +59,14 @@ This section contains important information about new and existing features. ### Java 11 support +**Update**: Support for Java 11 is scheduled to end with Druid 37.0.0. + Java 11 support has been deprecated since Druid 32.0, and official support will be removed as early as Druid 35.0.0 ### Hadoop-based ingestion +**Update**: Support for Hadoop-based ingestion is scheduled to end with Druid 37.0.0. + Hadoop-based ingestion has been deprecated since Druid 32.0 and will be removed as early as Druid 35.0.0. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md). @@ -372,12 +376,21 @@ Additionally, MSQ task engine metrics now include the following dimensions: - The task runner log now includes the task id for a job and includes a log before a job is created [#18105](https://github.com/apache/druid/pull/18105) + ## Upgrade notes and incompatible changes ### Upgrade notes +#### Java 11 support + +**Update**: Support for Java 11 is scheduled to end with Druid 37.0.0. + +Java 11 support has been deprecated since Druid 32.0, and official support will be removed as early as Druid 35.0.0 + #### Hadoop-based ingestion +**Update**: Support for Hadoop-based ingestion is scheduled to end with Druid 37.0.0. + Hadoop-based ingestion has been deprecated since Druid 32.0 and will be removed as early as Druid 35.0.0. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md). diff --git a/docs/latest/release-info/upgrade-notes.md b/docs/latest/release-info/upgrade-notes.md index 6aad866df..6fe7a8cbf 100644 --- a/docs/latest/release-info/upgrade-notes.md +++ b/docs/latest/release-info/upgrade-notes.md @@ -42,8 +42,16 @@ If you're already using this feature, you don't need to take any action. ### Upgrade notes +#### Java 11 support + +**Update**: Support for Java 11 is scheduled to end with Druid 37.0.0. + +Java 11 support has been deprecated since Druid 32.0, and official support will be removed as early as Druid 35.0.0 + #### Hadoop-based ingestion +**Update**: Support for Hadoop-based ingestion is scheduled to end with Druid 37.0.0. + Hadoop-based ingestion has been deprecated since Druid 32.0 and will be removed as early as Druid 35.0.0. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md). diff --git a/docs/latest/tutorials/tutorial-batch-hadoop.md b/docs/latest/tutorials/tutorial-batch-hadoop.md index cba190e7d..6d811655c 100644 --- a/docs/latest/tutorials/tutorial-batch-hadoop.md +++ b/docs/latest/tutorials/tutorial-batch-hadoop.md @@ -25,12 +25,11 @@ sidebar_label: Load from Apache Hadoop :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: + This tutorial shows you how to load data files into Apache Druid using a remote Hadoop cluster. For this tutorial, we'll assume that you've already completed the previous diff --git a/docs/latest/tutorials/tutorial-kerberos-hadoop.md b/docs/latest/tutorials/tutorial-kerberos-hadoop.md index cace9b879..535af37c0 100644 --- a/docs/latest/tutorials/tutorial-kerberos-hadoop.md +++ b/docs/latest/tutorials/tutorial-kerberos-hadoop.md @@ -25,9 +25,7 @@ sidebar_label: Kerberized HDFS deep storage :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: diff --git a/src/pages/community/join-slack.md b/src/pages/community/join-slack.md index d9988a610..2aa913815 100644 --- a/src/pages/community/join-slack.md +++ b/src/pages/community/join-slack.md @@ -6,11 +6,10 @@ import BrowserOnly from '@docusaurus/BrowserOnly'; {() => { - window.location.replace("https://join.slack.com/t/apachedruidworkspace/shared_invite/zt-265fczhyf-xFq8OyzzQ6TykfHDpfUzDA"); + window.location.replace("https://join.slack.com/t/apachedruidworkspace/shared_invite/zt-3eulauy9i-liykRPrufmV~OOncRNQbzQ"); return null; }} -Click here if you're not redirected. - +Click here if you're not redirected. \ No newline at end of file