Date   

Re: [cncf-strimzi-dev] [ANNOUNCE] [RELEASE] Strimzi Kafka Operators 0.21.0 released

Jakub Scholz
 

We found a bug in the new feature for configuring metrics from ConfigMap instead of directly in the custom resource. When used, it in some cases does not properly configure the network policies for the port 9404 used for the metrics. As a workaround, either keep using the old configuration or create manually an additional network policy with your custom name for the port 9404. This bug will be fixed in 0.21.1.

Thanks & Regards
Jakub

On Sat, Jan 16, 2021 at 2:11 PM Jakub Scholz via lists.cncf.io <jakub=scholz.cz@...> wrote:
Strimzi Operators 0.21.0 is now available with a lot of important changes and improvements. The main changes since the 0.20.0 release include:
* Add support for Kafka 2.7.0
* Add support for declarative management of connector plugins in Kafka Connect CR 
* Add `inter.broker.protocol.version` to the default configuration in example YAMLs
* Add support for `secretPrefix` property for User Operator to prefix all secret names created from KafkaUser resource.
* Allow configuring labels and annotations for Cluster CA certificate secrets
* Add the JAAS configuration string in the sasl.jaas.config property to the generated secrets for KafkaUser with SCRAM-SHA-512 authentication.
* Strimzi `test-container` has been renamed to `strimzi-test-container` to make the name more clear
* Updated the CPU usage metric in the Kafka, ZooKeeper and Cruise Control dashboards to include the CPU kernel time (other than the current user time)
* Allow disabling ownerReference on CA secrets
* Make it possible to run Strimzi operators and operands with read-only root filesystem
* Move from Docker Hub to Quay.io as our container registry
* Add possibility to configure DeploymentStrategy for Kafka Connect, Kafka Mirror Maker (1 and 2), and Kafka Bridge
* Support passing metrics configuration as an external ConfigMap
* Enable CORS configuration for Cruise Control
* Add support for rolling individual Kafka or ZooKeeper pods through the Cluster Operator using an annotation
* Add support for Topology Spread Constraints in Pod templates
* Make Kafka `cluster-id` (KIP-78) available on Kafka CRD status

There are also some deprecations you should be aware of:
* The `metrics` field in the Strimzi custom resources has been deprecated and will be removed in the future. For configuring metrics, use the new `metricsConfig` field and pass the configuration via ConfigMap.

Since 0.21.0 Strimzi supports Kubernetes version 1.16 and newer.

For more details and installation files, go to https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.21.0

Many thanks to everyone who contributed to this release!

Thanks & Regards
Strimzi team


[ANNOUNCE] [RELEASE] Strimzi Kafka Operators 0.21.0 released

Jakub Scholz
 

Strimzi Operators 0.21.0 is now available with a lot of important changes and improvements. The main changes since the 0.20.0 release include:
* Add support for Kafka 2.7.0
* Add support for declarative management of connector plugins in Kafka Connect CR 
* Add `inter.broker.protocol.version` to the default configuration in example YAMLs
* Add support for `secretPrefix` property for User Operator to prefix all secret names created from KafkaUser resource.
* Allow configuring labels and annotations for Cluster CA certificate secrets
* Add the JAAS configuration string in the sasl.jaas.config property to the generated secrets for KafkaUser with SCRAM-SHA-512 authentication.
* Strimzi `test-container` has been renamed to `strimzi-test-container` to make the name more clear
* Updated the CPU usage metric in the Kafka, ZooKeeper and Cruise Control dashboards to include the CPU kernel time (other than the current user time)
* Allow disabling ownerReference on CA secrets
* Make it possible to run Strimzi operators and operands with read-only root filesystem
* Move from Docker Hub to Quay.io as our container registry
* Add possibility to configure DeploymentStrategy for Kafka Connect, Kafka Mirror Maker (1 and 2), and Kafka Bridge
* Support passing metrics configuration as an external ConfigMap
* Enable CORS configuration for Cruise Control
* Add support for rolling individual Kafka or ZooKeeper pods through the Cluster Operator using an annotation
* Add support for Topology Spread Constraints in Pod templates
* Make Kafka `cluster-id` (KIP-78) available on Kafka CRD status

There are also some deprecations you should be aware of:
* The `metrics` field in the Strimzi custom resources has been deprecated and will be removed in the future. For configuring metrics, use the new `metricsConfig` field and pass the configuration via ConfigMap.

Since 0.21.0 Strimzi supports Kubernetes version 1.16 and newer.

For more details and installation files, go to https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.21.0

Many thanks to everyone who contributed to this release!

Thanks & Regards
Strimzi team


RC1 of Strimzi Operators 0.21.0

Jakub Scholz
 

Release Candidate 1 of Strimzi Operators 0.21.0 is now available for testing with a lot of changes and improvements. The main changes since the 0.20.0 release include:
* Add support for declarative management of connector plugins in Kafka Connect CR
* Add `inter.broker.protocol.version` to the default configuration in example YAMLs
* Add support for `secretPrefix` property for User Operator to prefix all secret names created from KafkaUser resource.
* Allow configuring labels and annotations for Cluster CA certificate secrets
* Add the JAAS configuration string in the sasl.jaas.config property to the generated secrets for KafkaUser with SCRAM-SHA-512 authentication.
* Strimzi `test-container` has been renamed to `strimzi-test-container` to make the name more clear
* Updated the CPU usage metric in the Kafka, ZooKeeper and Cruise Control dashboards to include the CPU kernel time (other than the current user time)
* Allow disabling ownerReference on CA secrets
* Make it possible to run Strimzi operators and operands with read-only root filesystem
* Move from Docker Hub to Quay.io as our container registry
* Add possibility to configure DeploymentStrategy for Kafka Connect, Kafka Mirror Maker (1 and 2), and Kafka Bridge
* Support passing metrics configuration as an external ConfigMap
* Enable CORS configuration for Cruise Control
* Add support for rolling individual Kafka or ZooKeeper pods through the Cluster Operator using an annotation
* Add support for Topology Spread Constraints in Pod templates
* Make Kafka `cluster-id` (KIP-78) available on Kafka CRD status

There are also some deprecations and removals which you should be aware of:
* The `metrics` field in the Strimzi custom resources has been deprecated and will be removed in the future. For configuring metrics, use the new `metricsConfig` field and pass the configuration via ConfigMap.

This version of Strimzi supports Kubernetes 1.16 and higher.


Any feedback can be provided on the Strimzi mailing list, on the #strimzi Slack channel on CNCF Slack or as a GitHub issue.

Thanks & Regards
Jakub & Strimzi team


[ANNOUNCE] [RELEASE] Strimzi Kafka Operators 0.20.1 released

Jakub Scholz
 

Strimzi Operators 0.20.1 is now available with several bug-fixes:
* Silent error from missing CRB RBAC in Kafka Connect when not needed (#4019)
* Fine-tune the Kafka Exporter health checks (#3885)
* Correct connect configuration comparison (#3987)
* Avoid changing custom resource status because of HashSet ordering (#4069)
* Fix the client rack-awareness in Kafka Connect (#3903)
* Connect default logging not expanded (#4057)
* Topic operator improvements (#3982)
* Do not use ownerReference in UO and TO bindings into a different namespace (#4080)
* Remove owner references from ClusterRoleBindings (#4077)
* Topic Operator metrics (#3883)

For more details and installation files, go to https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.20.1

Many thanks to everyone who contributed to this release!

Thanks & Regards
Strimzi team


RC1 of Strimzi Operators 0.20.1

Jakub Scholz
 

Release Candidate 1 of Strimzi Operators 0.20.1 is now available for testing with several bug-fixes:
* Silent error from missing CRB RBAC in Kafka Connect when not needed (#4019)
* Fine-tune the Kafka Exporter health checks (#3885)
* Correct connect configuration comparison (#3987)
* Avoid changing custom resource status because of HashSet ordering (#4069)
* Fix the client rack-awareness in Kafka Connect (#3903)
* Connect default logging not expanded (#4057)
* Topic operator improvements (#3982)
* Do not use ownerReference in UO and TO bindings into a different namespace (#4080)
* Remove owner references from ClusterRoleBindings (#4077)
* Topic Operator metrics (#3883)


Any feedback can be provided on the Strimzi mailing list, on the #strimzi Slack channel on CNCF Slack or as a GitHub issue.

Thanks & Regards
Jakub


RC1 of Strimzi Kafka OAuth library 0.7.0

Jakub Scholz
 

Hi,

Release Candidate 1 of the 0.7.0 version of the Strimzi Kafka OAuth library is now available for testing: https://github.com/strimzi/strimzi-kafka-oauth/releases/tag/0.7.0-rc1

The main changes are:
* OAuth authentication over SASL PLAIN
* Checking `audience` of the JWT token in the server part of the OAuth library

To test it, you can use the staging Maven repository:

  <repositories>
    <repository>
      <id>staging</id>
      <url>https://oss.sonatype.org/content/repositories/iostrimzi-1084</url>
    </repository>
  </repositories>

Any feedback can be provided on the mailing list, on Slack or as a GitHub issue.

Thanks & Regards
Jakub


[ANNOUNCE] [RELEASE] Strimzi Kafka Operators 0.20.0 released

Jakub Scholz
 

Strimzi Operators 0.20.0 is now available with a lot of important changes and improvements. The main changes since the 0.19.0 release include:
* Add support for Kafka 2.5.1 and 2.6.0. Remove support for 2.4.0 and 2.4.1
* Make `listeners` configurable as an array and add support for more different listeners in single cluster
* Remove TLS sidecars from Kafka pods => Kafka now uses native TLS to connect to ZooKeeper
* Updated to Cruise Control 2.5.11, which adds Kafka 2.6.0 support and fixes a previous issue with CPU utilization statistics for containers. As a result, the CPUCapacityGoal has now been enabled.
* Configure Cluster Operator logging using ConfigMap instead of environment variable and support dynamic changes  
* Switch to use the `AclAuthorizer` class for the `simple` Kafka authorization type. `AclAuthorizer` contains new features such as the ability to control the amount of authorization logs in the broker logs.
* Support dynamic logging configuration of Kafka, Kafka Connect, Kafka Connect S2I and Kafka MirrorMaker2
* Add support for `client.rack` property for Kafka Connect to use `fetch from closest replica` feature. 
* Add support for configuring `hostAliases` in Pod templates
* Cruise Control metrics integration including a new Grafana dashboard
* Improved operators Grafana dashboard
* Improvements to OAuth authentication and Keycloak authorization

There are also some deprecations and removals which you should be aware of:
* Deprecation of the old listener configuration
* Removal of monitoring port on Kafka and ZooKeeper related services
* Deprecation of Kafka TLS sidecar configuration

0.20.0 will also be the last version of Strimzi that will support Kubernetes 1.11-1.15. Future versions will support Kubernetes 1.16+.

For more details and installation files, go to https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.20.0

Many thanks to everyone who contributed to this release!

Thanks & Regards
Strimzi team


RC3 of Strimzi Operators 0.20.0

Jakub Scholz
 

Release Candidate 3 of Strimzi Operators 0.20.0 is now available for testing. Compared to the Release Candidate 2, there are several bugfixes and improvements:
* Fix rolling updates when all Kafka pods are Pending (#3848)
* Bump OPA Authorizer version to fix CVE in its dependencies (#3853)
* Fix rebalance examples (#3838)
* Fix cAdvisor metric labels (#3840)
* Several docs and system test fixes and improvements

Note: 0.20.0 will be the last version of Strimzi that will support Kubernetes 1.11-1.15. Future versions will support Kubernetes 1.16+.

For more details and installation files, go to https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.20.0-rc3

Any feedback can be provided on the Strimzi mailing list, on the #strimzi Slack channel on CNCF Slack or as a GitHub issue.

Thanks & Regards
Jakub


RC2 of Strimzi Operators 0.20.0

Jakub Scholz
 

Release Candidate 2 of Strimzi Operators 0.20.0 is now available for testing. Compared to the Release Candidate 1, there are several bugfixes and improvements:
* Fix secrets with `.` in name (#3820)
* Fix leak of HTTPClients in Connector Operator (#3827)
* Fix handling of custom and OAuth certificates (#3825)
* Upgrade JMX Exporter to 0.14.0
* Several docs and system test fixes and improvements

Note: 0.20.0 will be the last version of Strimzi that will support Kubernetes 1.11-1.15. Future versions will support Kubernetes 1.16+.

For more details and installation files, go to https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.20.0-rc2

Any feedback can be provided on the Strimzi mailing list, on the #strimzi Slack channel on CNCF Slack or as a GitHub issue.

Thanks & Regards
Jakub


RC1 of Strimzi Operators 0.20.0

Jakub Scholz
 

Hi,

Release Candidate 1 of Strimzi Operators 0.20.0 is now available for testing with a lot of changes and improvements. The main changes since the 0.19.0 release include:
* Add support for Kafka 2.5.1 and 2.6.0. Remove support for 2.4.0 and 2.4.1
* Make `listeners` configurable as an array and add support for more different listeners in single cluster
* Remove TLS sidecars from Kafka pods => Kafka now uses native TLS to connect to ZooKeeper
* Updated to Cruise Control 2.5.11, which adds Kafka 2.6.0 support and fixes a previous issue with CPU utilization statistics for containers. As a result, the CPUCapacityGoal has now been enabled.
* Configure Cluster Operator logging using ConfigMap instead of environment variable and support dynamic changes  
* Switch to use the `AclAuthorizer` class for the `simple` Kafka authorization type. `AclAuthorizer` contains new features such as the ability to control the amount of authorization logs in the broker logs.
* Support dynamic logging configuration of Kafka, Kafka Connect, Kafka Connect S2I and Kafka MirrorMaker2
* Add support for `client.rack` property for Kafka Connect to use `fetch from closest replica` feature. 
* Add support for configuring `hostAliases` in Pod templates
* Cruise Control metrics integration including a new Grafana dashboard
* Improved operators Grafana dashboard

There are also some deprecations and removals which you should be aware of:
* Deprecation of the old listener configuration
* Removal of monitoring port on Kafka and ZooKeeper related services
* Deprecation of Kafka TLS sidecar configuration

0.20.0 will also be the last version of Strimzi that will support Kubernetes 1.11-1.15. Future versions will support Kubernetes 1.16+.


Any feedback can be provided on the Strimzi mailing list, on the #strimzi Slack channel on CNCF Slack or as a GitHub issue.

Thanks & Regards
Jakub


[ANNOUNCE] Strimzi Kafka Bridge 0.19.0 released!

Paolo Patierno
 

Version 0.19.0 of Strimzi Kafka Bridge has been released. 

The main changes include:
  • Fixed bug not allowing to send records with null values
  • Added support for Kafka headers on records to send
  • Refactoring around overall tests suite
  • Fixed some other minor bugs

Thanks to everyone who contributed to these releases.

Thanks,
Paolo


Paolo Patierno
Principal Software Engineer @ Red Hat
Microsoft MVP on Azure

Twitter : @ppatierno
Linkedin : paolopatierno
Blog : DevExperience


Re: RC1 of Strimzi Kafka Bridge 0.19.0

Jakub Scholz
 

+1 (binding) ... I run my tests with the bridge RC1 used used Strimzi operators ad did not found any issues, all seemed to work fine.

Jakub

On Wed, Sep 30, 2020 at 4:22 PM Paolo Patierno <ppatierno@...> wrote:
Hi all,

Release Candidate 1 of Strimzi Kafka Bridge 0.19.0 is now available for testing.
The main changes since 0.18.0 include:

  • Fixed bug not allowing to send records with null values
  • Added support for Kafka headers on records to send
  • Refactoring around overall tests suite
  • Fixed some other minor bugs

Any feedback can be provided here or as a GitHub issue.

Thanks

Paolo Patierno
Principal Software Engineer @ Red Hat
Microsoft MVP on Azure

Twitter : @ppatierno
Linkedin : paolopatierno
Blog : DevExperience


RC1 of Strimzi Kafka Bridge 0.19.0

Paolo Patierno
 

Hi all,

Release Candidate 1 of Strimzi Kafka Bridge 0.19.0 is now available for testing.
The main changes since 0.18.0 include:

  • Fixed bug not allowing to send records with null values
  • Added support for Kafka headers on records to send
  • Refactoring around overall tests suite
  • Fixed some other minor bugs

Any feedback can be provided here or as a GitHub issue.

Thanks

Paolo Patierno
Principal Software Engineer @ Red Hat
Microsoft MVP on Azure

Twitter : @ppatierno
Linkedin : paolopatierno
Blog : DevExperience


[ANNOUNCE] [RELEASE] Strimzi Kafka OAuth library 0.6.1 released

Jakub Scholz
 

Version 0.6.1 of the Strimzi Kafka OAuth library is now available: https://github.com/strimzi/strimzi-kafka-oauth/releases/tag/0.6.1. The release contains an updated version of the Keycloak dependency.

Thanks & Regards
Jakub


Re: Kafka broker pods are not coming up and unable to create statefulset

Jakub Scholz
 

I guess it might depend on your MetalLB configuration. I use it on my local Kube cluster without any special settings. But in your case, it looks like the LoadBalancers are not being provisioned. You can use `kubectl get service` to see if at least some were provisioned or not. In case you want the LoadBalancers with some specific IP address, you can also use this in the KAfka CR:

  external:
    type: loadbalancer
    tls: false
    overrides:
      bootstrap:
        loadBalancerIP: 172.29.3.10
      brokers:
      - broker: 0
        loadBalancerIP: 172.29.3.1
      - broker: 1
        loadBalancerIP: 172.29.3.2
      - broker: 2
        loadBalancerIP: 172.29.3.3


This should make sure that the loadbalancers get these assigned IP addresses if possible. But as I said - not needed on my MetalLB installation. But you can give it a try.

If you want to use an annotation on the service (such as metallb.universe.tf/allow-shared-ip), you can use the perPodService and exteralBootstrapService options here: https://strimzi.io/docs/operators/latest/full/using.html#type-KafkaClusterTemplate-reference ... but I don't think Kafka will work with a shared IP address.

Thanks & Regards
Jakub

On Fri, Sep 18, 2020 at 5:09 PM <tsnagraj.08@...> wrote:

Hi Team,

Could you help me out with Listener configurations in kafka resource configurations. I am struggling with external listener configurations as i am using metallb. Is there any configuration changes required for metallb.
kafka-persistent.yaml:

apiVersion: kafka.strimzi.io/v1beta1

kind: Kafka

metadata:

  name: my-cluster

  annotations:

    metallb.universe.tf/allow-shared-ip: smart

spec:

  loadBalancerIP: xxxxxxx

  kafka:

    version: 2.5.0

    replicas: 3

    listeners:

      plain:  {}

      tls: {}

      external:

        type: loadbalancer

        tls: false

    config:

      offsets.topic.replication.factor: 3

      transaction.state.log.replication.factor: 3

      transaction.state.log.min.isr: 2

      log.message.format.version: "2.5"

    storage:

      type: persistent-claim

      size: 10Gi

      class: sc-paas

      deleteClaim: false

    resources:

      requests:

        memory: 8Gi

        cpu: "1"

      limits:

        memory: 24Gi

        cpu: "3"

  zookeeper:

    replicas: 3

    resources:

      requests:

        memory: 8Gi

        cpu: "1"

      limits:

        memory: 24Gi

        cpu: "3"

    storage:

      type: persistent-claim

      size: 10Gi

      class: sc-paas

      deleteClaim: false

  entityOperator:

    topicOperator: {}

    userOperator: {}

Logs for operator:

2020-09-18 13:08:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:10:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:12:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:14:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:16:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:18:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:20:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:22:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:23:40 INFO  OperatorWatcher:40 - Reconciliation #11(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was ADDED

2020-09-18 13:23:40 INFO  AbstractOperator:173 - Reconciliation #11(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:23:40 INFO  OperatorWatcher:40 - Reconciliation #12(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-18 13:23:50 WARN  AbstractOperator:247 - Reconciliation #12(watch) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:24:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:24:29 WARN  AbstractOperator:247 - Reconciliation #13(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:26:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:26:29 WARN  AbstractOperator:247 - Reconciliation #14(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:28:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:28:29 WARN  AbstractOperator:247 - Reconciliation #15(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:29:52 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:29:52 WARN  KafkaAssemblyOperator:1866 - Reconciliation #11(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:29:52 INFO  OperatorWatcher:40 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-18 13:29:52 ERROR AbstractOperator:175 - Reconciliation #11(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:29:52 WARN  AbstractOperator:330 - Reconciliation #11(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:29:52 INFO  AbstractOperator:173 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:30:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:30:29 WARN  AbstractOperator:247 - Reconciliation #17(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:32:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:32:29 WARN  AbstractOperator:247 - Reconciliation #18(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:33:46 INFO  OperatorWatcher:40 - Reconciliation #19(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-18 13:33:56 WARN  AbstractOperator:247 - Reconciliation #19(watch) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:34:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:34:29 WARN  AbstractOperator:247 - Reconciliation #20(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:34:44 INFO  OperatorWatcher:40 - Reconciliation #21(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was DELETED

2020-09-18 13:34:53 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:34:53 WARN  KafkaAssemblyOperator:1866 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:34:53 ERROR KafkaAssemblyOperator:498 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): Current Kafka resource not found

2020-09-18 13:34:53 ERROR KafkaAssemblyOperator:244 - Failed to set status for my-cluster

2020-09-18 13:34:53 ERROR AbstractOperator:175 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:34:53 WARN  AbstractOperator:330 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:34:53 INFO  AbstractOperator:179 - Reconciliation #21(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be deleted

2020-09-18 13:34:53 INFO  AbstractOperator:184 - Reconciliation #21(watch) Kafka(kafka-op-test/my-cluster): Assembly my-cluster should be deleted by garbage collection

2020-09-18 13:34:53 INFO  AbstractOperator:318 - Reconciliation #21(watch) Kafka(kafka-op-test/my-cluster): reconciled

2020-09-18 13:35:36 INFO  OperatorWatcher:40 - Reconciliation #22(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was ADDED

2020-09-18 13:35:36 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec with an unknown property: loadBalancerIP

2020-09-18 13:35:36 INFO  AbstractOperator:173 - Reconciliation #22(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:35:36 INFO  OperatorWatcher:40 - Reconciliation #23(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-18 13:35:46 WARN  AbstractOperator:247 - Reconciliation #23(watch) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:36:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:36:29 WARN  AbstractOperator:247 - Reconciliation #24(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:38:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:38:29 WARN  AbstractOperator:247 - Reconciliation #25(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:40:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:40:29 WARN  AbstractOperator:247 - Reconciliation #26(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:41:22 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:41:22 WARN  KafkaAssemblyOperator:1866 - Reconciliation #22(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:41:22 ERROR AbstractOperator:175 - Reconciliation #22(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:41:22 INFO  OperatorWatcher:40 - Reconciliation #27(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-18 13:41:22 WARN  AbstractOperator:330 - Reconciliation #22(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:41:22 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec with an unknown property: loadBalancerIP

2020-09-18 13:41:22 INFO  AbstractOperator:173 - Reconciliation #27(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:42:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:42:29 WARN  AbstractOperator:247 - Reconciliation #28(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:44:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:44:29 WARN  AbstractOperator:247 - Reconciliation #29(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:46:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:46:23 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:46:23 WARN  KafkaAssemblyOperator:1866 - Reconciliation #27(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:46:23 ERROR AbstractOperator:175 - Reconciliation #27(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:46:23 WARN  AbstractOperator:330 - Reconciliation #27(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:46:23 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec with an unknown property: loadBalancerIP

2020-09-18 13:46:23 INFO  AbstractOperator:173 - Reconciliation #30(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:48:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:48:29 WARN  AbstractOperator:247 - Reconciliation #31(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:50:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:50:29 WARN  AbstractOperator:247 - Reconciliation #32(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:51:25 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:51:25 WARN  KafkaAssemblyOperator:1866 - Reconciliation #30(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:51:25 ERROR AbstractOperator:175 - Reconciliation #30(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:51:25 WARN  AbstractOperator:330 - Reconciliation #30(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:52:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:52:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec with an unknown property: loadBalancerIP

2020-09-18 13:52:19 INFO  AbstractOperator:173 - Reconciliation #33(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:54:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:54:29 WARN  AbstractOperator:247 - Reconciliation #34(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:56:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:56:29 WARN  AbstractOperator:247 - Reconciliation #35(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:57:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:57:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #33(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:57:20 ERROR AbstractOperator:175 - Reconciliation #33(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:57:20 WARN  AbstractOperator:330 - Reconciliation #33(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:58:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:58:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec with an unknown property: loadBalancerIP

2020-09-18 13:58:19 INFO  AbstractOperator:173 - Reconciliation #36(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 14:00:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 14:00:29 WARN  AbstractOperator:247 - Reconciliation #37(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 14:02:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 14:02:29 WARN  AbstractOperator:247 - Reconciliation #38(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 14:03:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 14:03:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #36(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 14:03:20 ERROR AbstractOperator:175 - Reconciliation #36(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 14:03:20 WARN  AbstractOperator:330 - Reconciliation #36(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.





Kafka broker pods are not coming up and unable to create statefulset

tsnagraj.08@...
 

Hi Team,

Could you help me out with Listener configurations in kafka resource configurations. I am struggling with external listener configurations as i am using metallb. Is there any configuration changes required for metallb.
kafka-persistent.yaml:

apiVersion: kafka.strimzi.io/v1beta1

kind: Kafka

metadata:

  name: my-cluster

  annotations:

    metallb.universe.tf/allow-shared-ip: smart

spec:

  loadBalancerIP: xxxxxxx

  kafka:

    version: 2.5.0

    replicas: 3

    listeners:

      plain:  {}

      tls: {}

      external:

        type: loadbalancer

        tls: false

    config:

      offsets.topic.replication.factor: 3

      transaction.state.log.replication.factor: 3

      transaction.state.log.min.isr: 2

      log.message.format.version: "2.5"

    storage:

      type: persistent-claim

      size: 10Gi

      class: sc-paas

      deleteClaim: false

    resources:

      requests:

        memory: 8Gi

        cpu: "1"

      limits:

        memory: 24Gi

        cpu: "3"

  zookeeper:

    replicas: 3

    resources:

      requests:

        memory: 8Gi

        cpu: "1"

      limits:

        memory: 24Gi

        cpu: "3"

    storage:

      type: persistent-claim

      size: 10Gi

      class: sc-paas

      deleteClaim: false

  entityOperator:

    topicOperator: {}

    userOperator: {}

Logs for operator:

2020-09-18 13:08:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:10:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:12:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:14:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:16:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:18:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:20:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:22:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:23:40 INFO  OperatorWatcher:40 - Reconciliation #11(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was ADDED

2020-09-18 13:23:40 INFO  AbstractOperator:173 - Reconciliation #11(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:23:40 INFO  OperatorWatcher:40 - Reconciliation #12(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-18 13:23:50 WARN  AbstractOperator:247 - Reconciliation #12(watch) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:24:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:24:29 WARN  AbstractOperator:247 - Reconciliation #13(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:26:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:26:29 WARN  AbstractOperator:247 - Reconciliation #14(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:28:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:28:29 WARN  AbstractOperator:247 - Reconciliation #15(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:29:52 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:29:52 WARN  KafkaAssemblyOperator:1866 - Reconciliation #11(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:29:52 INFO  OperatorWatcher:40 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-18 13:29:52 ERROR AbstractOperator:175 - Reconciliation #11(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:29:52 WARN  AbstractOperator:330 - Reconciliation #11(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:29:52 INFO  AbstractOperator:173 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:30:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:30:29 WARN  AbstractOperator:247 - Reconciliation #17(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:32:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:32:29 WARN  AbstractOperator:247 - Reconciliation #18(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:33:46 INFO  OperatorWatcher:40 - Reconciliation #19(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-18 13:33:56 WARN  AbstractOperator:247 - Reconciliation #19(watch) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:34:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:34:29 WARN  AbstractOperator:247 - Reconciliation #20(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:34:44 INFO  OperatorWatcher:40 - Reconciliation #21(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was DELETED

2020-09-18 13:34:53 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:34:53 WARN  KafkaAssemblyOperator:1866 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:34:53 ERROR KafkaAssemblyOperator:498 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): Current Kafka resource not found

2020-09-18 13:34:53 ERROR KafkaAssemblyOperator:244 - Failed to set status for my-cluster

2020-09-18 13:34:53 ERROR AbstractOperator:175 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:34:53 WARN  AbstractOperator:330 - Reconciliation #16(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:34:53 INFO  AbstractOperator:179 - Reconciliation #21(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be deleted

2020-09-18 13:34:53 INFO  AbstractOperator:184 - Reconciliation #21(watch) Kafka(kafka-op-test/my-cluster): Assembly my-cluster should be deleted by garbage collection

2020-09-18 13:34:53 INFO  AbstractOperator:318 - Reconciliation #21(watch) Kafka(kafka-op-test/my-cluster): reconciled

2020-09-18 13:35:36 INFO  OperatorWatcher:40 - Reconciliation #22(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was ADDED

2020-09-18 13:35:36 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec with an unknown property: loadBalancerIP

2020-09-18 13:35:36 INFO  AbstractOperator:173 - Reconciliation #22(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:35:36 INFO  OperatorWatcher:40 - Reconciliation #23(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-18 13:35:46 WARN  AbstractOperator:247 - Reconciliation #23(watch) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:36:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:36:29 WARN  AbstractOperator:247 - Reconciliation #24(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:38:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:38:29 WARN  AbstractOperator:247 - Reconciliation #25(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:40:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:40:29 WARN  AbstractOperator:247 - Reconciliation #26(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:41:22 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:41:22 WARN  KafkaAssemblyOperator:1866 - Reconciliation #22(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:41:22 ERROR AbstractOperator:175 - Reconciliation #22(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:41:22 INFO  OperatorWatcher:40 - Reconciliation #27(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-18 13:41:22 WARN  AbstractOperator:330 - Reconciliation #22(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:41:22 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec with an unknown property: loadBalancerIP

2020-09-18 13:41:22 INFO  AbstractOperator:173 - Reconciliation #27(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:42:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:42:29 WARN  AbstractOperator:247 - Reconciliation #28(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:44:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:44:29 WARN  AbstractOperator:247 - Reconciliation #29(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:46:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:46:23 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:46:23 WARN  KafkaAssemblyOperator:1866 - Reconciliation #27(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:46:23 ERROR AbstractOperator:175 - Reconciliation #27(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:46:23 WARN  AbstractOperator:330 - Reconciliation #27(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:46:23 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec with an unknown property: loadBalancerIP

2020-09-18 13:46:23 INFO  AbstractOperator:173 - Reconciliation #30(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:48:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:48:29 WARN  AbstractOperator:247 - Reconciliation #31(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:50:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:50:29 WARN  AbstractOperator:247 - Reconciliation #32(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:51:25 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:51:25 WARN  KafkaAssemblyOperator:1866 - Reconciliation #30(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:51:25 ERROR AbstractOperator:175 - Reconciliation #30(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:51:25 WARN  AbstractOperator:330 - Reconciliation #30(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:52:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:52:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec with an unknown property: loadBalancerIP

2020-09-18 13:52:19 INFO  AbstractOperator:173 - Reconciliation #33(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 13:54:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:54:29 WARN  AbstractOperator:247 - Reconciliation #34(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:56:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:56:29 WARN  AbstractOperator:247 - Reconciliation #35(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 13:57:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 13:57:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #33(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:57:20 ERROR AbstractOperator:175 - Reconciliation #33(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:57:20 WARN  AbstractOperator:330 - Reconciliation #33(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 13:58:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 13:58:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec with an unknown property: loadBalancerIP

2020-09-18 13:58:19 INFO  AbstractOperator:173 - Reconciliation #36(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-18 14:00:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 14:00:29 WARN  AbstractOperator:247 - Reconciliation #37(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 14:02:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-18 14:02:29 WARN  AbstractOperator:247 - Reconciliation #38(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-18 14:03:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-18 14:03:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #36(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 14:03:20 ERROR AbstractOperator:175 - Reconciliation #36(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-18 14:03:20 WARN  AbstractOperator:330 - Reconciliation #36(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.





Re: Kafka Bridging Startup Error

Paolo Patierno
 

Hi,
which version of the bridge are you using? I have just downloaded and tried the latest 0.18.0 release (https://github.com/strimzi/strimzi-kafka-bridge/releases/tag/0.18.0) copy/pasting the same command you are executing and it's working fine with me.
Thanks.


Paolo Patierno
Principal Software Engineer @ Red Hat
Microsoft MVP on Azure

Twitter : @ppatierno
Linkedin : paolopatierno
Blog : DevExperience


From: cncf-strimzi-users@... <cncf-strimzi-users@...> on behalf of msjyosh@... <msjyosh@...>
Sent: Thursday, September 10, 2020 8:24 PM
To: cncf-strimzi-users@... <cncf-strimzi-users@...>
Subject: [cncf-strimzi-users] Kafka Bridging Startup Error
 
Hi, When i am trying to start KafkaBridge script I am getting below error

 bin/kafka_bridge_run.sh --config-file config/application.properties
Error: Could not find or load main class io.strimzi.kafka.bridge.Application


please advise on what could be the issue ? If i am missing anything !?


Kafka Bridging Startup Error

msjyosh@...
 

Hi, When i am trying to start KafkaBridge script I am getting below error

 bin/kafka_bridge_run.sh --config-file config/application.properties
Error: Could not find or load main class io.strimzi.kafka.bridge.Application


please advise on what could be the issue ? If i am missing anything !?


Strimzi Kafka OAuth library 0.6.0 released

Jakub Scholz
 

Hi,

Version 0.6.0 of the Strimzi Kafka OAuth library has been released! The main changes since last release are:
* Optimized internals
* Improved server-side logging
* Improved handling of expired or otherwise invalidated access tokens
    ** Fixed, and documented the re-authentication support
    ** Added OAuthSessionAuthorizer
    ** Deprecated the JwtKafkaPrincipalBuilder in favor of the new OAuthKafkaPrincipalBuilder
    ** KeycloakRBACAuthorizer improvements
    ** Introduced fast JWKS keys refresh
    ** Fixed exception types thrown during token validation

For more details go to the GitHub release page: https://github.com/strimzi/strimzi-kafka-oauth/releases/tag/0.6.0

Thanks a lot to everyone who contributed to this release by raising issues, opening PRs etc. And especially to Marko who did most of the work!

Thanks & Regards
Jakub


RC1 of Strimzi Kafka OAuth library 0.6.0

Jakub Scholz
 

Hi,

Release Candidate 1 of the 0.6.0 version of the Strimzi Kafka OAuth library is now available for testing: https://github.com/strimzi/strimzi-kafka-oauth/releases/tag/0.6.0-rc1

The main changes are:
* Optimized internals
* Improved server-side logging
* Improved handling of expired or otherwise invalidated access tokens
    ** Fixed, and documented the re-authentication support
    ** Added OAuthSessionAuthorizer
    ** Deprecated the JwtKafkaPrincipalBuilder in favor of the new OAuthKafkaPrincipalBuilder
    ** KeycloakRBACAuthorizer improvements
    ** Introduced fast JWKS keys refresh
    ** Fixed exception types thrown during token validation

To test it, you can use the staging Maven repository:

  <repositories>
    <repository>
      <id>staging</id>
      <url>https://oss.sonatype.org/content/repositories/iostrimzi-1073</url>
    </repository>
  </repositories>

Any feedback can be provided here, on Slack or as a GitHub issue.

Thanks & Regards
Jakub

1 - 20 of 92