|
[ANNOUNCE] [RELEASE] Strimzi Kafka OAuth library 0.6.1 released
Jakub Scholz
Version 0.6.1 of the Strimzi Kafka OAuth library is now available: https://github.com/strimzi/strimzi-kafka-oauth/releases/tag/0.6.1. The release contains an updated version of the Keycloak dependency. Thanks & Regards Jakub
|
|
|
|
Re: Issue: Assigned ports for kafka brokers and bootstrap services are not reflecting
Jakub Scholz
Hi, I'm not sure what exactly do you mean with _not reflecting_. If you mean that the port numbers you configured in the port fields are ignored, this is because there are no such fields for the loadbalancer type listeners. This is also repeatedly printed in the log file: 2020-09-23 15:18:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port When using load balancers, the port will be in Strimzi 0.19.0 always 9094. Thanks & Regards Jakub
On Wed, Sep 23, 2020 at 11:14 PM <tsnagraj.08@...> wrote:
|
|
|
|
Issue: Assigned ports for kafka brokers and bootstrap services are not reflecting
Nag Raj
Hi, Providing kafka.yaml and logs details. Kafka.yaml:
apiVersion: kafka.strimzi.io/v1beta1 kind: Kafka metadata: name: my-cluster #annotations: # metallb.universe.tf/allow-shared-ip: smart spec: kafka: version: 2.5.0 replicas: 3 listeners: plain: {} tls: {} external: type: loadbalancer tls: false overrides: bootstrap: loadBalancerIP: xxxxxx port: 30012 brokers: - broker: 0 loadBalancerIP: xxxxxx port: 30013 - broker: 1 loadBalancerIP: xxxxxx port: 30014 - broker: 2 loadBalancerIP: xxxxxx port: 30015 config: offsets.topic.replication.factor: 3 transaction.state.log.replication.factor: 3 transaction.state.log.min.isr: 2 log.message.format.version: "2.5" storage: type: persistent-claim size: 10Gi class: sc-paas deleteClaim: false resources: requests: memory: 8Gi
------------------------------------------------
$ kubectl get all -n kafka-op-test NAME READY STATUS RESTARTS AGE pod/my-cluster-zookeeper-0 1/1 Running 0 42m pod/my-cluster-zookeeper-1 1/1 Running 0 42m pod/my-cluster-zookeeper-2 1/1 Running 0 42m pod/strimzi-cluster-operator-55dd5ccd6f-rvcmk 1/1 Running 0 5d3h
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE service/my-cluster-kafka-0 LoadBalancer xxxxx xxxxx 9094:30898/TCP 42m service/my-cluster-kafka-1 LoadBalancer xxxxx xxxxx 9094:31905/TCP 42m service/my-cluster-kafka-2 LoadBalancer xxxxx xxxxx 9094:30090/TCP 42m service/my-cluster-kafka-bootstrap ClusterIP xxxxx <none> 9091/TCP,9092/TCP,9093/TCP 42m service/my-cluster-kafka-brokers ClusterIP None <none> 9091/TCP,9092/TCP,9093/TCP 42m service/my-cluster-kafka-external-bootstrap LoadBalancer xxxxx <pending> 9094:31310/TCP 42m service/my-cluster-zookeeper-client ClusterIP xxxxx <none> 2181/TCP 42m service/my-cluster-zookeeper-nodes ClusterIP None <none> 2181/TCP,2888/TCP,3888/TCP 42m
NAME READY UP-TO-DATE AVAILABLE AGE deployment.apps/strimzi-cluster-operator 1/1 1 1 5d3h
NAME DESIRED CURRENT READY AGE replicaset.apps/strimzi-cluster-operator-55dd5ccd6f 1 1 1 5d3h
NAME READY AGE statefulset.apps/my-cluster-zookeeper 3/3 42m
cluster operator logs: 2020-09-23 13:54:13 INFO AbstractOperator:318 - Reconciliation #2969(watch) Kafka(kafka-op-test/my-cluster): reconciled 2020-09-23 13:54:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 13:56:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 13:58:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:00:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:02:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:04:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:06:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:08:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:10:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:12:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:14:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:16:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:18:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:20:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:22:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:24:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:26:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:28:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:30:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:30:56 INFO OperatorWatcher:40 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was ADDED 2020-09-23 14:30:56 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:30:56 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:30:56 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:30:56 INFO AbstractOperator:173 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated 2020-09-23 14:30:56 INFO OperatorWatcher:40 - Reconciliation #2971(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED 2020-09-23 14:31:06 WARN AbstractOperator:247 - Reconciliation #2971(watch) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:32:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:32:29 WARN AbstractOperator:247 - Reconciliation #2972(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:34:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:34:29 WARN AbstractOperator:247 - Reconciliation #2973(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:36:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:36:29 WARN AbstractOperator:247 - Reconciliation #2974(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:36:47 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable 2020-09-23 14:36:47 WARN KafkaAssemblyOperator:1866 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:36:47 ERROR AbstractOperator:175 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:36:47 WARN AbstractOperator:330 - Reconciliation #2970(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:36:47 INFO OperatorWatcher:40 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster in namespace kafka-op-test was MODIFIED 2020-09-23 14:36:47 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:36:47 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:36:47 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:36:47 INFO AbstractOperator:173 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated 2020-09-23 14:38:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:38:29 WARN AbstractOperator:247 - Reconciliation #2976(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:40:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:40:29 WARN AbstractOperator:247 - Reconciliation #2977(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:41:49 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable 2020-09-23 14:41:49 WARN KafkaAssemblyOperator:1866 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:41:49 ERROR AbstractOperator:175 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): createOrUpdate failed io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:41:49 WARN AbstractOperator:330 - Reconciliation #2975(watch) Kafka(kafka-op-test/my-cluster): Failed to reconcile io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:42:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:42:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:42:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:42:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:42:19 INFO AbstractOperator:173 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated 2020-09-23 14:44:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:44:29 WARN AbstractOperator:247 - Reconciliation #2979(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:46:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:46:29 WARN AbstractOperator:247 - Reconciliation #2980(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:47:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable 2020-09-23 14:47:20 WARN KafkaAssemblyOperator:1866 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:47:20 ERROR AbstractOperator:175 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:47:20 WARN AbstractOperator:330 - Reconciliation #2978(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:48:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:48:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:48:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:48:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:48:19 INFO AbstractOperator:173 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated 2020-09-23 14:50:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:50:29 WARN AbstractOperator:247 - Reconciliation #2982(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:52:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:52:29 WARN AbstractOperator:247 - Reconciliation #2983(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:53:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable 2020-09-23 14:53:20 WARN KafkaAssemblyOperator:1866 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:53:20 ERROR AbstractOperator:175 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:53:20 WARN AbstractOperator:330 - Reconciliation #2981(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:54:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:54:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:54:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:54:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 14:54:19 INFO AbstractOperator:173 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated 2020-09-23 14:56:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:56:29 WARN AbstractOperator:247 - Reconciliation #2985(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:58:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 14:58:29 WARN AbstractOperator:247 - Reconciliation #2986(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 14:59:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable 2020-09-23 14:59:20 WARN KafkaAssemblyOperator:1866 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:59:20 ERROR AbstractOperator:175 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 14:59:20 WARN AbstractOperator:330 - Reconciliation #2984(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 15:00:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 15:00:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:00:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:00:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:00:19 INFO AbstractOperator:173 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated 2020-09-23 15:02:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 15:02:29 WARN AbstractOperator:247 - Reconciliation #2988(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 15:04:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 15:04:29 WARN AbstractOperator:247 - Reconciliation #2989(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 15:05:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable 2020-09-23 15:05:20 WARN KafkaAssemblyOperator:1866 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 15:05:20 ERROR AbstractOperator:175 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 15:05:20 WARN AbstractOperator:330 - Reconciliation #2987(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 15:06:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 15:06:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:06:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:06:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:06:19 INFO AbstractOperator:173 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated 2020-09-23 15:08:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 15:08:29 WARN AbstractOperator:247 - Reconciliation #2991(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 15:10:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 15:10:29 WARN AbstractOperator:247 - Reconciliation #2992(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 15:11:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable 2020-09-23 15:11:20 WARN KafkaAssemblyOperator:1866 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 15:11:20 ERROR AbstractOperator:175 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 15:11:20 WARN AbstractOperator:330 - Reconciliation #2990(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 15:12:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 15:12:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:12:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:12:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:12:19 INFO AbstractOperator:173 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated 2020-09-23 15:14:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 15:14:29 WARN AbstractOperator:247 - Reconciliation #2994(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 15:16:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 15:16:29 WARN AbstractOperator:247 - Reconciliation #2995(timer) Kafka(kafka-op-test/my-cluster): Failed to acquire lock lock::kafka-op-test::Kafka::my-cluster within 10000ms. 2020-09-23 15:17:20 ERROR Util:120 - Exceeded timeout of 300000ms while waiting for Service resource my-cluster-kafka-external-bootstrap in namespace kafka-op-test to be addressable 2020-09-23 15:17:20 WARN KafkaAssemblyOperator:1866 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 15:17:20 ERROR AbstractOperator:175 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): createOrUpdate failed io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 15:17:20 WARN AbstractOperator:330 - Reconciliation #2993(timer) Kafka(kafka-op-test/my-cluster): Failed to reconcile io.vertx.core.impl.NoStackTraceThrowable: No loadbalancer address found in the Status section of Service my-cluster-kafka-external-bootstrap resource. Loadbalancer was probably not provisioned. 2020-09-23 15:18:19 INFO ClusterOperator:125 - Triggering periodic reconciliation for namespace kafka-op-test... 2020-09-23 15:18:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:18:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:18:19 WARN AbstractOperator:106 - Kafka resource my-cluster in namespace kafka-op-test: Contains object at path spec.kafka.listeners.external.overrides.brokers with an unknown property: port 2020-09-23 15:18:19 INFO AbstractOperator:173 - Reconciliation #2996(timer) Kafka(kafka-op-test/my-cluster): Kafka my-cluster should be created or updated
|
|
|
|
Strimzi Kafka OAuth library 0.6.0 released
Jakub Scholz
Hi, Version 0.6.0 of the Strimzi Kafka OAuth library has been released! The main changes since last release are: * Optimized internals * Improved server-side logging * Improved handling of expired or otherwise invalidated access tokens ** Fixed, and documented the re-authentication support ** Added OAuthSessionAuthorizer ** Deprecated the JwtKafkaPrincipalBuilder in favor of the new OAuthKafkaPrincipalBuilder ** KeycloakRBACAuthorizer improvements ** Introduced fast JWKS keys refresh ** Fixed exception types thrown during token validation For more details go to the GitHub release page: https://github.com/strimzi/strimzi-kafka-oauth/releases/tag/0.6.0 Thanks a lot to everyone who contributed to this release by raising issues, opening PRs etc. And especially to Marko who did most of the work! Thanks & Regards Jakub
|
|
|
|
RC1 of Strimzi Kafka OAuth library 0.6.0
Jakub Scholz
Hi, Release Candidate 1 of the 0.6.0 version of the Strimzi Kafka OAuth library is now available for testing: https://github.com/strimzi/strimzi-kafka-oauth/releases/tag/0.6.0-rc1. The main changes are: * Optimized internals * Improved server-side logging * Improved handling of expired or otherwise invalidated access tokens ** Fixed, and documented the re-authentication support ** Added OAuthSessionAuthorizer ** Deprecated the JwtKafkaPrincipalBuilder in favor of the new OAuthKafkaPrincipalBuilder ** KeycloakRBACAuthorizer improvements ** Introduced fast JWKS keys refresh ** Fixed exception types thrown during token validation To test it, you can use the staging Maven repository: <repositories> <repository> <id>staging</id> <url>https://oss.sonatype.org/content/repositories/iostrimzi-1073</url> </repository> </repositories> Any feedback can be provided here, on Slack or as a GitHub issue. Thanks & Regards Jakub
|
|
|
|
[ANNOUNCE] [RELEASE] Strimzi Kafka Operators 0.19.0 released
Jakub Scholz
Hi, Strimzi Kafka Operators 0.19.0 has been released with a lot of changes and improvements. The main changes since the 0.18.0 release include: * Add support for authorization using Open Policy Agent * Add support for scale subresource to make scaling of following resources easier: * KafkaConnect * KafkaConnectS2I * KafkaBridge * KafkaMirrorMaker * KafkaMirrorMaker2 * KafkaConnector * Remove deprecated `Kafka.spec.topicOperator` classes and deployment logic * Use Java 11 as the Java runtime * Removed the need to manually create Cruise Control metrics topics if topic auto creation is disabled. * Migration to Helm 3 * Refactored the format of the `KafkaRebalance` resource's status. The state of the rebalance is now displayed in the associated `Condition`'s `type` field rather than the `status` field. This was done so that the information would display correctly in various Kubernetes tools. * Added performance tuning options to the `KafkaRebalance` CR and the ability to define a regular expression that will exclude matching topics from a rebalance optimization proposal. * Use Strimzi Kafka Bridge 0.18.0 * Make it possible to configure labels and annotations for secrets created by the User Operator * Strimzi Kafka Bridge metrics integration: * Enable/disable metrics in the KafkaBridge custom resource * New Grafana dashboard for the bridge metrics * Support dynamically changeable logging in the Entity Operator and Kafka Bridge There are also some deprecations and removals which you should be aware of: * Deprecation of Helm v2 chart * Removal deprecated cadvisor metric labels * Deprecation of monitoring port on Kafka and ZooKeeper related services In the next version, we will also remove the support for the v1alpha1 resources deprecated in Strimzi 0.12.0. For more details and installation files, go to https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.19.0. Documentation and Quick Starts can be found on our website https://strimzi.io/. Thanks to everyone who contributed to this release! Thanks & Regards Jakub
|
|
|
|
RC1 of Strimzi Operators 0.19.0
Jakub Scholz
Hi, Release Candidate 1 of Strimzi Operators 0.19.0 is now available for testing with a lot of changes and improvements. The main changes since the 0.18.0 release include: * Add support for authorization using Open Policy Agent * Add support for scale subresource to make scaling of following resources easier: * KafkaConnect * KafkaConnectS2I * KafkaBridge * KafkaMirrorMaker * KafkaMirrorMaker2 * KafkaConnector * Remove deprecated `Kafka.spec.topicOperator` classes and deployment logic * Use Java 11 as the Java runtime * Removed the need to manually create Cruise Control metrics topics if topic auto creation is disabled. * Migration to Helm 3 * Refactored the format of the `KafkaRebalance` resource's status. The state of the rebalance is now displayed in the associated `Condition`'s `type` field rather than the `status` field. This was done so that the information would display correctly in various Kubernetes tools. * Added performance tuning options to the `KafkaRebalance` CR and the ability to define a regular expression that will exclude matching topics from a rebalance optimization proposal. * Use Strimzi Kafka Bridge 0.18.0 * Make it possible to configure labels and annotations for secrets created by the User Operator * Strimzi Kafka Bridge metrics integration: * Enable/disable metrics in the KafkaBridge custom resource * New Grafana dashboard for the bridge metrics * Support dynamically changeable logging in the Entity Operator and Kafka Bridge There are also some deprecations and removals which you should be aware of: * Deprecation of Helm v2 chart * Removal deprecated cadvisor metric labels * Deprecation of monitoring port on Kafka and ZooKeeper related services In the next version, we will also remove the support for the v1alpha1 resources deprecated in Strimzi 0.12.0. For more details and installation files, go to https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.19.0-rc1 Any feedback can be provided here, on the #strimzi Slack channel on CNCF Slack or as a GitHub issue. Thanks & Regards Jakub
|
|
|
|
Strimzi Survey
Tom Bentley
Hi, At the last community meeting we talked about how we'd like to do a survey of Strimzi users so we can better understand how people are using Strimzi with a view to better serving the needs of our community. CNCF advice is to try to keep to 10 questions or fewer and we've been developing the set of the questions to ask. The attached google doc is the current draft: If you have any feedback feel free to add comments to the document, or reply to this thread. I'm planning to wrap this up within the next week, so don't delay! Kind regards, Tom
|
|
|
|
[ANNOUNCE] [RELEASE] Strimzi Kafka Operators 0.18.0 released
Jakub Scholz
Strimzi Kafka Operators version 0.18.0 has been released. The main new features since 0.17.0 include: * Add possibility to set Java System Properties via custom resources * Make it possible to configure PodManagementPolicy for StatefulSets * Add more metrics to Cluster, User and Topic Operators * New Grafana dashboard for Operator monitoring * Allow `ssl.cipher.suites`, `ssl.protocol` and `ssl.enabled.protocols` to be configurable for Kafka and the different components supported by Strimzi * Add support for user configurable SecurityContext for each Strimzi container * Add support for Kafka 2.4.1 and 2.5.0 * Remove TLS sidecars from ZooKeeper pods, using native ZooKeeper TLS support instead * Use Strimzi Kafka Bridge 0.16.0 with support for CORS in the HTTP protocol * Pass HTTP Proxy configuration from operator to operands * Add Cruise Control support More details about the release and the download files are available on the Git Hub release page: https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.18.0. Documentation and Quick Starts can be found on our website https://strimzi.io/. Thanks a lot to everyone who contributed to this release by raising issues, opening PRs etc. On behalf of the Strimzi maintainers Jakub
|
|
|
|
RC2 of Strimzi Operators 0.18.0
Jakub Scholz
Hi, Release Candidate 2 of Strimzi Operators 0.18.0 is now available for testing. Compared to RC1, it includes some bug fixes: * Improve the `KafkaRebalance` resources * Add the `KafkaRebalance` resource to the `strimzi` category * Add `KafkaRebalance` resources to Operators Grafana dashboard * Make sure TLS protocol can be configured in Kafka brokers * Fix Prometheus installation guide For more details and installation files, go to https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.18.0-rc2 Any feedback can be provided here, on the #strimzi Slack channel on CNCF Slack or as a GitHub issue. Thanks & Regards Jakub
|
|
|
|
RC1 of Strimzi Operators 0.18.0
Jakub Scholz
Hi, Release Candidate 1 of Strimzi Operators 0.18.0 is now available for testing. The main changes since the 0.17.0 release include: * Add possibility to set Java System Properties via custom resources * Make it possible to configure PodManagementPolicy for StatefulSets * Update build system to use `yq` version 3 (https://github.com/mikefarah/yq) * Add more metrics to Cluster, User and Topic Operators * New Grafana dashboard for Operator monitoring * Allow `ssl.cipher.suites`, `ssl.protocol` and `ssl.enabled.protocols` to be configurable for Kafka and the different components supported by Strimzi * Add support for user configurable SecurityContext for each Strimzi container * Add support for Kafka 2.4.1 and 2.5.0 * Remove TLS sidecars from ZooKeeper pods, using native ZooKeeper TLS support instead * Use Strimzi Kafka Bridge 0.16.0 with support for CORS in the HTTP protocol * Pass HTTP Proxy configuration from operator to operands For more details and installation files, go to https://github.com/strimzi/strimzi-kafka-operator/releases/tag/0.18.0-rc1 Any feedback can be provided here, on the #strimzi Slack channel on CNCF Slack or as a GitHub issue. Thanks & Regards Jakub
|
|
|
|
[ANNOUNCE] Strimzi Kafka Bridge 0.16.0 released!
Jakub Scholz
Version 0.16.0 of Strimzi Kafka Bridge has been released. The main changes include: * Add support for CORS * Various bugfixes and dependencies updates For more details, go to: https://github.com/strimzi/strimzi-kafka-bridge/releases/tag/0.16.0 Thanks to everyone who contributed to these releases. Thanks & Regards Jakub
|
|
|
|
RC1 of Strimzi Kafka Bridge 0.16.0
Jakub Scholz
Hi, Release Candidate 1 of Strimzi Kafka Bridge 0.16.0 is now available for testing. The main changes since 0.15 include: * Add support for CORS in the HTTP part of the Bridge * Various bugfixes and dependencies updates For more details and binaries, go to https://github.com/strimzi/strimzi-kafka-bridge/releases/tag/0.16.0-rc1 Any feedback can be provided here or as a GitHub issue. Thanks & Regards Jakub
|
|
|
|
[ANNOUNCE] [RELEASE] Strimzi Kafka OAuth library 0.5.0 released
Jakub Scholz
Hi, Version 0.5.0 of the Strimzi Kafka OAuth library is now available: https://github.com/strimzi/strimzi-kafka-oauth/releases/tag/0.5.0. The main changes since 0.4.0 are: * Improved compatibility with authorization servers * Fixed JWKS keys refresh bug * Fixed a non-standard token_type enforcement when using the Introspection Endpoint * Improved examples * Improved logging to facilitate troubleshooting * Bumped keycloak-core library version Thanks a lot to everyone who contributed to this release by raising issues, opening PRs etc. Thanks & Regards Jakub
|
|
|
|
RC2 of Strimzi Kafka OAuth library 0.5.0
Jakub Scholz
Release Candidate 2 of the 0.5.0 version of the Strimzi Kafka OAuth library is now available for testing: https://github.com/strimzi/strimzi-kafka-oauth/releases/tag/0.5.0-rc2. The only change since RC1 is the following bugfix: * Fix scope support when refreshing the token (#55) To test it, you can use the staging Maven repository: <repositories> <repository> <id>staging</id> <url>https://oss.sonatype.org/content/repositories/iostrimzi-1065/</url> </repository> </repositories> Any feedback can be provided here or as a GitHub issue. Thanks & Regards Jakub
|
|
|
|
Re: [ANNOUNCE] New maintainer Jakub Stejskal
Paolo Patierno
Congrats Jakub,
very well deserved!
Paolo Patierno
Principal Software Engineer @ Red Hat
Microsoft MVP on Azure
From: cncf-strimzi-dev@... <cncf-strimzi-dev@...> on behalf of Jakub Scholz <jakub@...>
Sent: Tuesday, May 5, 2020 8:47 AM To: cncf-strimzi-dev@... <cncf-strimzi-dev@...>; cncf-strimzi-users@... <cncf-strimzi-users@...> Subject: [cncf-strimzi-dev] [ANNOUNCE] New maintainer Jakub Stejskal I'm happy to announce that Jakub Stejskal has become a new Strimzi maintainer.
Jakub has already done a lot of great work on Strimzi:
* He does a great job on the system tests, which are a critical part of the project. Without him I'm not sure we would have any actual system test suite which we could use.
* He writes regularly new tests and fixes bugs in existing tests
* He reviews the system tests PRs written by other contributors
* He did all of the work on the migration of the system tests (and builds) to Azure Pipelines
* He is always ready to help anyone who has any issues with tests / system tests or look into any failures
* He is currently the fourth biggest committer of Strimzi operators
@Jakub: Thanks a lot for all the past and future work. It is great to have you here!
Thanks & Regards
Strimzi maintainers team
|
|
|
|
Re: [cncf-strimzi-users] [cncf-strimzi-dev] [ANNOUNCE] New maintainer Jakub Stejskal
Tom Bentley
Congratulations Jakub!
On Tue, May 5, 2020 at 10:05 AM Paolo Patierno <ppatierno@...> wrote:
|
|
|
|
[ANNOUNCE] New maintainer Jakub Stejskal
Jakub Scholz
I'm happy to announce that Jakub Stejskal has become a new Strimzi maintainer. Jakub has already done a lot of great work on Strimzi: * He does a great job on the system tests, which are a critical part of the project. Without him I'm not sure we would have any actual system test suite which we could use. * He writes regularly new tests and fixes bugs in existing tests * He reviews the system tests PRs written by other contributors * He did all of the work on the migration of the system tests (and builds) to Azure Pipelines * He is always ready to help anyone who has any issues with tests / system tests or look into any failures * He is currently the fourth biggest committer of Strimzi operators @Jakub: Thanks a lot for all the past and future work. It is great to have you here! Thanks & Regards Strimzi maintainers team
|
|
|
|
RC1 of Strimzi Kafka OAuth library 0.5.0
Jakub Scholz
Hi, Release Candidate 1 of the 0.5.0 version of the Strimzi Kafka OAuth library is now available for testing: https://github.com/strimzi/strimzi-kafka-oauth/releases/tag/0.5.0-rc1. The main changes are: * Improved compatibility with authorization servers * Fixed JWKS keys refresh bug * Fixed a non-standard token_type enforcement when using the Introspection Endpoint * Improved examples * Improved logging to facilitate troubleshooting * Bumped keycloak-core library version To test it, you can use the staging Maven repository: <repositories> <repository> <id>staging</id> <url>https://oss.sonatype.org/content/repositories/iostrimzi-1064/</url> </repository> </repositories> Any feedback can be provided here or as a GitHub issue. Thanks & Regards Jakub
|
|
|
|
[ANNOUNCE]: New maintainer: Sam Hawker
Tom Bentley
The Strimzi maintainers have invited Sam Hawker to become a maintainer and we're happy to announce that he has accepted. Sam has been doing some great work, with high quality PRs and code
reviews and we're looking forward to what he can bring to the project going forward. Congratulations Sam! Tom, on behalf of the Strimzi maintainers.
|
|
|