Issue: Assigned ports for kafka brokers and bootstrap services are not reflecting


Jakub Scholz
 

Hi,

I'm not sure what exactly do you mean with _not reflecting_. If you mean that the port numbers you configured in the port fields are ignored, this is because there are no such fields for the loadbalancer type listeners. This is also repeatedly printed in the log file:

2020-09-23 15:18:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port
2020-09-23 15:18:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port
2020-09-23 15:18:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

When using load balancers, the port will be in Strimzi 0.19.0 always 9094.

Thanks & Regards
Jakub

On Wed, Sep 23, 2020 at 11:14 PM <tsnagraj.08@...> wrote:

Hi,


I am trying to deploy kafka using strimzi operator. For external listeners configurations are not getting reflecting on kafka brokers and bootstrap services in kubernetes. I have also tried with advertisedhost configurations for this but no luck. Hope you can provide some leads. Thank you.

Providing kafka.yaml  and logs details. 

Kafka.yaml:

 

apiVersion: kafka.strimzi.io/v1beta1

kind: Kafka

metadata:

  name: my-cluster

  #annotations:

   # metallb.universe.tf/allow-shared-ip: smart

spec:

  kafka:

    version: 2.5.0

    replicas: 3

    listeners:

      plain:  {}

      tls: {}

      external:

        type: loadbalancer

        tls: false

        overrides:

          bootstrap:

            loadBalancerIP: xxxxxx

            port: 30012

          brokers:

          - broker: 0

            loadBalancerIP: xxxxxx

            port: 30013

          - broker: 1

            loadBalancerIP: xxxxxx

            port: 30014

          - broker: 2

            loadBalancerIP: xxxxxx

            port: 30015

    config:

      offsets.topic.replication.factor: 3

      transaction.state.log.replication.factor: 3

      transaction.state.log.min.isr: 2

      log.message.format.version: "2.5"

    storage:

      type: persistent-claim

      size: 10Gi

      class: sc-paas

      deleteClaim: false

    resources:

      requests:

        memory: 8Gi

 

------------------------------------------------

 

$ kubectl get all -n kafka-op-test

NAME                                            READY   STATUS    RESTARTS   AGE

pod/my-cluster-zookeeper-0                      1/1     Running   0          42m

pod/my-cluster-zookeeper-1                      1/1     Running   0          42m

pod/my-cluster-zookeeper-2                      1/1     Running   0          42m

pod/strimzi-cluster-operator-55dd5ccd6f-rvcmk   1/1     Running   0          5d3h

 

 

NAME                                          TYPE           CLUSTER-IP       EXTERNAL-IP      PORT(S)                      AGE

service/my-cluster-kafka-0                    LoadBalancer   xxxxx             xxxxx          9094:30898/TCP               42m

service/my-cluster-kafka-1                    LoadBalancer   xxxxx              xxxxx         9094:31905/TCP               42m

service/my-cluster-kafka-2                    LoadBalancer   xxxxx             xxxxx          9094:30090/TCP               42m

service/my-cluster-kafka-bootstrap            ClusterIP      xxxxx            <none>         9091/TCP,9092/TCP,9093/TCP   42m

service/my-cluster-kafka-brokers              ClusterIP      None             <none>           9091/TCP,9092/TCP,9093/TCP   42m

service/my-cluster-kafka-external-bootstrap   LoadBalancer   xxxxx           <pending>        9094:31310/TCP               42m

service/my-cluster-zookeeper-client           ClusterIP      xxxxx          <none>           2181/TCP                     42m

service/my-cluster-zookeeper-nodes            ClusterIP      None             <none>           2181/TCP,2888/TCP,3888/TCP   42m

 

 

NAME                                       READY   UP-TO-DATE   AVAILABLE   AGE

deployment.apps/strimzi-cluster-operator   1/1     1            1           5d3h

 

NAME                                                  DESIRED   CURRENT   READY   AGE

replicaset.apps/strimzi-cluster-operator-55dd5ccd6f   1         1         1       5d3h

 

NAME                                    READY   AGE

statefulset.apps/my-cluster-zookeeper   3/3     42m

 

cluster operator logs:

2020-09-23 13:54:13 INFO  AbstractOperator:318 - Reconciliation #2969(watch) Kafka(kafka-op-test/my-cluster): reconciled

2020-09-23 13:54:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 13:56:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 13:58:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:00:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:02:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:04:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:06:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:08:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:10:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:12:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:14:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:16:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:18:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:20:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:22:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:24:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:26:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:28:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:30:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:30:56 INFO  OperatorWatcher:40 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was ADDED

2020-09-23 14:30:56 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:30:56 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:30:56 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:30:56 INFO  AbstractOperator:173 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 14:30:56 INFO  OperatorWatcher:40 - Reconciliation #2971(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-23 14:31:06 WARN  AbstractOperator:247 - Reconciliation #2971(watch) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:32:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:32:29 WARN  AbstractOperator:247 - Reconciliation #2972(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:34:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:34:29 WARN  AbstractOperator:247 - Reconciliation #2973(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:36:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:36:29 WARN  AbstractOperator:247 - Reconciliation #2974(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:36:47 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 14:36:47 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:36:47 ERROR AbstractOperator:175 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:36:47 WARN  AbstractOperator:330 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:36:47 INFO  OperatorWatcher:40 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-23 14:36:47 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:36:47 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:36:47 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:36:47 INFO  AbstractOperator:173 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 14:38:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:38:29 WARN  AbstractOperator:247 - Reconciliation #2976(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:40:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:40:29 WARN  AbstractOperator:247 - Reconciliation #2977(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:41:49 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 14:41:49 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:41:49 ERROR AbstractOperator:175 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:41:49 WARN  AbstractOperator:330 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:42:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:42:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:42:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:42:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:42:19 INFO  AbstractOperator:173 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 14:44:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:44:29 WARN  AbstractOperator:247 - Reconciliation #2979(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:46:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:46:29 WARN  AbstractOperator:247 - Reconciliation #2980(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:47:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 14:47:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:47:20 ERROR AbstractOperator:175 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:47:20 WARN  AbstractOperator:330 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:48:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:48:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:48:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:48:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:48:19 INFO  AbstractOperator:173 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 14:50:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:50:29 WARN  AbstractOperator:247 - Reconciliation #2982(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:52:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:52:29 WARN  AbstractOperator:247 - Reconciliation #2983(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:53:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 14:53:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:53:20 ERROR AbstractOperator:175 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:53:20 WARN  AbstractOperator:330 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:54:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:54:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:54:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:54:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:54:19 INFO  AbstractOperator:173 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 14:56:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:56:29 WARN  AbstractOperator:247 - Reconciliation #2985(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:58:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:58:29 WARN  AbstractOperator:247 - Reconciliation #2986(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:59:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 14:59:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:59:20 ERROR AbstractOperator:175 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:59:20 WARN  AbstractOperator:330 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:00:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:00:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:00:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:00:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:00:19 INFO  AbstractOperator:173 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 15:02:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:02:29 WARN  AbstractOperator:247 - Reconciliation #2988(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:04:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:04:29 WARN  AbstractOperator:247 - Reconciliation #2989(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:05:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 15:05:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:05:20 ERROR AbstractOperator:175 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:05:20 WARN  AbstractOperator:330 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:06:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:06:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:06:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:06:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:06:19 INFO  AbstractOperator:173 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 15:08:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:08:29 WARN  AbstractOperator:247 - Reconciliation #2991(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:10:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:10:29 WARN  AbstractOperator:247 - Reconciliation #2992(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:11:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 15:11:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:11:20 ERROR AbstractOperator:175 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:11:20 WARN  AbstractOperator:330 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:12:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:12:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:12:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:12:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:12:19 INFO  AbstractOperator:173 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 15:14:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:14:29 WARN  AbstractOperator:247 - Reconciliation #2994(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:16:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:16:29 WARN  AbstractOperator:247 - Reconciliation #2995(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:17:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 15:17:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:17:20 ERROR AbstractOperator:175 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:17:20 WARN  AbstractOperator:330 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:18:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:18:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:18:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:18:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:18:19 INFO  AbstractOperator:173 - Reconciliation #2996(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

 

 

 

 


Nag Raj
 

Hi,


I am trying to deploy kafka using strimzi operator. For external listeners configurations are not getting reflecting on kafka brokers and bootstrap services in kubernetes. I have also tried with advertisedhost configurations for this but no luck. Hope you can provide some leads. Thank you.

Providing kafka.yaml  and logs details. 

Kafka.yaml:

 

apiVersion: kafka.strimzi.io/v1beta1

kind: Kafka

metadata:

  name: my-cluster

  #annotations:

   # metallb.universe.tf/allow-shared-ip: smart

spec:

  kafka:

    version: 2.5.0

    replicas: 3

    listeners:

      plain:  {}

      tls: {}

      external:

        type: loadbalancer

        tls: false

        overrides:

          bootstrap:

            loadBalancerIP: xxxxxx

            port: 30012

          brokers:

          - broker: 0

            loadBalancerIP: xxxxxx

            port: 30013

          - broker: 1

            loadBalancerIP: xxxxxx

            port: 30014

          - broker: 2

            loadBalancerIP: xxxxxx

            port: 30015

    config:

      offsets.topic.replication.factor: 3

      transaction.state.log.replication.factor: 3

      transaction.state.log.min.isr: 2

      log.message.format.version: "2.5"

    storage:

      type: persistent-claim

      size: 10Gi

      class: sc-paas

      deleteClaim: false

    resources:

      requests:

        memory: 8Gi

 

------------------------------------------------

 

$ kubectl get all -n kafka-op-test

NAME                                            READY   STATUS    RESTARTS   AGE

pod/my-cluster-zookeeper-0                      1/1     Running   0          42m

pod/my-cluster-zookeeper-1                      1/1     Running   0          42m

pod/my-cluster-zookeeper-2                      1/1     Running   0          42m

pod/strimzi-cluster-operator-55dd5ccd6f-rvcmk   1/1     Running   0          5d3h

 

 

NAME                                          TYPE           CLUSTER-IP       EXTERNAL-IP      PORT(S)                      AGE

service/my-cluster-kafka-0                    LoadBalancer   xxxxx             xxxxx          9094:30898/TCP               42m

service/my-cluster-kafka-1                    LoadBalancer   xxxxx              xxxxx         9094:31905/TCP               42m

service/my-cluster-kafka-2                    LoadBalancer   xxxxx             xxxxx          9094:30090/TCP               42m

service/my-cluster-kafka-bootstrap            ClusterIP      xxxxx            <none>         9091/TCP,9092/TCP,9093/TCP   42m

service/my-cluster-kafka-brokers              ClusterIP      None             <none>           9091/TCP,9092/TCP,9093/TCP   42m

service/my-cluster-kafka-external-bootstrap   LoadBalancer   xxxxx           <pending>        9094:31310/TCP               42m

service/my-cluster-zookeeper-client           ClusterIP      xxxxx          <none>           2181/TCP                     42m

service/my-cluster-zookeeper-nodes            ClusterIP      None             <none>           2181/TCP,2888/TCP,3888/TCP   42m

 

 

NAME                                       READY   UP-TO-DATE   AVAILABLE   AGE

deployment.apps/strimzi-cluster-operator   1/1     1            1           5d3h

 

NAME                                                  DESIRED   CURRENT   READY   AGE

replicaset.apps/strimzi-cluster-operator-55dd5ccd6f   1         1         1       5d3h

 

NAME                                    READY   AGE

statefulset.apps/my-cluster-zookeeper   3/3     42m

 

cluster operator logs:

2020-09-23 13:54:13 INFO  AbstractOperator:318 - Reconciliation #2969(watch) Kafka(kafka-op-test/my-cluster): reconciled

2020-09-23 13:54:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 13:56:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 13:58:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:00:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:02:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:04:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:06:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:08:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:10:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:12:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:14:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:16:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:18:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:20:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:22:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:24:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:26:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:28:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:30:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:30:56 INFO  OperatorWatcher:40 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was ADDED

2020-09-23 14:30:56 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:30:56 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:30:56 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:30:56 INFO  AbstractOperator:173 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 14:30:56 INFO  OperatorWatcher:40 - Reconciliation #2971(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-23 14:31:06 WARN  AbstractOperator:247 - Reconciliation #2971(watch) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:32:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:32:29 WARN  AbstractOperator:247 - Reconciliation #2972(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:34:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:34:29 WARN  AbstractOperator:247 - Reconciliation #2973(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:36:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:36:29 WARN  AbstractOperator:247 - Reconciliation #2974(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:36:47 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 14:36:47 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:36:47 ERROR AbstractOperator:175 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:36:47 WARN  AbstractOperator:330 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:36:47 INFO  OperatorWatcher:40 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED

2020-09-23 14:36:47 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:36:47 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:36:47 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:36:47 INFO  AbstractOperator:173 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 14:38:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:38:29 WARN  AbstractOperator:247 - Reconciliation #2976(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:40:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:40:29 WARN  AbstractOperator:247 - Reconciliation #2977(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:41:49 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 14:41:49 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:41:49 ERROR AbstractOperator:175 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:41:49 WARN  AbstractOperator:330 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:42:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:42:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:42:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:42:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:42:19 INFO  AbstractOperator:173 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 14:44:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:44:29 WARN  AbstractOperator:247 - Reconciliation #2979(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:46:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:46:29 WARN  AbstractOperator:247 - Reconciliation #2980(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:47:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 14:47:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:47:20 ERROR AbstractOperator:175 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:47:20 WARN  AbstractOperator:330 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:48:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:48:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:48:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:48:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:48:19 INFO  AbstractOperator:173 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 14:50:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:50:29 WARN  AbstractOperator:247 - Reconciliation #2982(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:52:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:52:29 WARN  AbstractOperator:247 - Reconciliation #2983(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:53:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 14:53:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:53:20 ERROR AbstractOperator:175 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:53:20 WARN  AbstractOperator:330 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:54:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:54:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:54:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:54:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 14:54:19 INFO  AbstractOperator:173 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 14:56:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:56:29 WARN  AbstractOperator:247 - Reconciliation #2985(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:58:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 14:58:29 WARN  AbstractOperator:247 - Reconciliation #2986(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 14:59:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 14:59:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:59:20 ERROR AbstractOperator:175 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 14:59:20 WARN  AbstractOperator:330 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:00:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:00:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:00:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:00:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:00:19 INFO  AbstractOperator:173 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 15:02:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:02:29 WARN  AbstractOperator:247 - Reconciliation #2988(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:04:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:04:29 WARN  AbstractOperator:247 - Reconciliation #2989(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:05:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 15:05:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:05:20 ERROR AbstractOperator:175 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:05:20 WARN  AbstractOperator:330 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:06:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:06:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:06:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:06:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:06:19 INFO  AbstractOperator:173 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 15:08:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:08:29 WARN  AbstractOperator:247 - Reconciliation #2991(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:10:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:10:29 WARN  AbstractOperator:247 - Reconciliation #2992(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:11:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 15:11:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:11:20 ERROR AbstractOperator:175 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:11:20 WARN  AbstractOperator:330 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:12:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:12:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:12:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:12:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:12:19 INFO  AbstractOperator:173 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated

2020-09-23 15:14:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:14:29 WARN  AbstractOperator:247 - Reconciliation #2994(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:16:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:16:29 WARN  AbstractOperator:247 - Reconciliation #2995(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms.

2020-09-23 15:17:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable

2020-09-23 15:17:20 WARN  KafkaAssemblyOperator:1866 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:17:20 ERROR AbstractOperator:175 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:17:20 WARN  AbstractOperator:330 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile

io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned.

2020-09-23 15:18:19 INFO  ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test...

2020-09-23 15:18:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:18:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:18:19 WARN  AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port

2020-09-23 15:18:19 INFO  AbstractOperator:173 - Reconciliation #2996(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated