Kafka UI Error starting the application.

[hmusali]

Hi,
I am trying to get kafka UI for my IAM Kafka.
We had added the parameters as suggested in the official documentation for kafka IAM.
here is the error.And paramters are in this.

| | | |_ | / |_ _ _ /\ _ __ __ _ | | ___ | |/ /_ _ / | |____
| || || | | / _ | '| / _ | '_ / / _| ' \/ -_) | ' </ _ | | / / `|
_/|| || ___|| // _| .___,_|||___| ||__,|| |__,|
|_|

2024-06-29 15:32:56,547 INFO [main] c.p.k.u.KafkaUiApplication: Starting KafkaUiApplication using Java 17.0.6 with PID 1 (/kafka-ui-api.jar started by kafkaui in /)
2024-06-29 15:32:56,557 DEBUG [main] c.p.k.u.KafkaUiApplication: Running with Spring Boot v3.1.3, Spring v6.0.11
2024-06-29 15:32:56,559 INFO [main] c.p.k.u.KafkaUiApplication: No active profile set, falling back to 1 default profile: "default"
2024-06-29 15:33:05,428 DEBUG [main] c.p.k.u.s.SerdesInitializer: Configuring serdes for cluster dev-TOOLS-development-cluster
2024-06-29 15:33:08,077 INFO [main] o.s.b.a.s.r.ReactiveUserDetailsServiceAutoConfiguration:

Using generated security password: 1a418e58-565e-4d2b-a611-5cba8216a5a1

2024-06-29 15:33:08,206 WARN [main] c.p.k.u.c.a.DisabledAuthSecurityConfig: Authentication is disabled. Access will be unrestricted.
2024-06-29 15:33:08,803 INFO [main] o.s.b.a.e.w.EndpointLinksResolver: Exposing 3 endpoint(s) beneath base path '/actuator'
2024-06-29 15:33:10,305 INFO [main] o.s.b.w.e.n.NettyWebServer: Netty started on port 8080
2024-06-29 15:33:10,382 INFO [main] c.p.k.u.KafkaUiApplication: Started KafkaUiApplication in 16.274 seconds (process running for 19.134)
2024-06-29 15:33:12,214 DEBUG [parallel-2] c.p.k.u.s.ClustersStatisticsScheduler: Start getting metrics for kafkaCluster: dev-TOOLS-development-cluster
2024-06-29 15:33:12,278 INFO [parallel-2] o.a.k.c.a.AdminClientConfig: AdminClientConfig values:
auto.include.jmx.reporter = true
bootstrap.servers = [bootstrap-servers details]
client.dns.lookup = use_all_dns_ips
client.id = kafka-ui-admin-1719675192-1
connections.max.idle.ms = 300000
default.api.timeout.ms = 60000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 2147483647
retry.backoff.ms = 100
sasl.client.callback.handler.class = class software.amazon.msk.auth.iam.IAMClientCallbackHandler
sasl.jaas.config = [hidden]
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.connect.timeout.ms = null
sasl.login.read.timeout.ms = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.login.retry.backoff.max.ms = 10000
sasl.login.retry.backoff.ms = 100
sasl.mechanism = AWS_MSK_IAM
sasl.oauthbearer.clock.skew.seconds = 30
sasl.oauthbearer.expected.audience = null
sasl.oauthbearer.expected.issuer = null
sasl.oauthbearer.jwks.endpoint.refresh.ms = 3600000
sasl.oauthbearer.jwks.endpoint.retry.backoff.max.ms = 10000
sasl.oauthbearer.jwks.endpoint.retry.backoff.ms = 100
sasl.oauthbearer.jwks.endpoint.url = null
sasl.oauthbearer.scope.claim.name = scope
sasl.oauthbearer.sub.claim.name = sub
sasl.oauthbearer.token.endpoint.url = null
security.protocol = SASL_SSL
security.providers = null
send.buffer.bytes = 131072
socket.connection.setup.timeout.max.ms = 30000
socket.connection.setup.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
ssl.endpoint.identification.algorithm = https
ssl.engine.factory.class = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.certificate.chain = null
ssl.keystore.key = null
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLSv1.3
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.certificates = null
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS

2024-06-29 15:33:12,577 INFO [parallel-2] o.a.k.c.s.a.AbstractLogin: Successfully logged in.
2024-06-29 15:33:12,624 INFO [parallel-2] o.a.k.c.u.AppInfoParser: Kafka version: 3.5.0
2024-06-29 15:33:12,624 INFO [parallel-2] o.a.k.c.u.AppInfoParser: Kafka commitId: c97b88d5db4de28d
2024-06-29 15:33:12,624 INFO [parallel-2] o.a.k.c.u.AppInfoParser: Kafka startTimeMs: 1719675192622
2024-06-29 15:33:15,252 INFO [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.n.Selector: [AdminClient clientId=kafka-ui-admin-1719675192-1] Failed authentication with b-3.devauthenticatedkafka.nl27jz.c24.kafka.us-east-1.amazonaws.com/10.177.70.107 (channelId=-3) ([d5c5f890-5d45-4aa6-bf72-9c7c880ce011]: Access denied)
2024-06-29 15:33:15,255 INFO [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1719675192-1] Node -3 disconnected.
2024-06-29 15:33:15,257 ERROR [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1719675192-1] Connection to node -3 (b-3.devauthenticatedkafka.nl27jz.c24.kafka.us-east-1.amazonaws.com/10.177.70.107:9098) failed authentication due to: [d5c5f890-5d45-4aa6-bf72-9c7c880ce011]: Access denied
2024-06-29 15:33:15,257 WARN [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.a.i.AdminMetadataManager: [AdminClient clientId=kafka-ui-admin-1719675192-1] Metadata update failed due to authentication error
org.apache.kafka.common.errors.SaslAuthenticationException: [d5c5f890-5d45-4aa6-bf72-9c7c880ce011]: Access denied
2024-06-29 15:33:15,282 INFO [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.u.AppInfoParser: App info kafka.admin.client for kafka-ui-admin-1719675192-1 unregistered
2024-06-29 15:33:15,283 INFO [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.a.i.AdminMetadataManager: [AdminClient clientId=kafka-ui-admin-1719675192-1] Metadata update failed
org.apache.kafka.common.errors.TimeoutException: Timed out waiting to send the call. Call: fetchMetadata
2024-06-29 15:33:15,283 INFO [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.a.i.AdminMetadataManager: [AdminClient clientId=kafka-ui-admin-1719675192-1] Metadata update failed
org.apache.kafka.common.errors.TimeoutException: Timed out waiting to send the call. Call: fetchMetadata
2024-06-29 15:33:15,284 INFO [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.a.KafkaAdminClient: [AdminClient clientId=kafka-ui-admin-1719675192-1] Timed out 2 remaining operation(s) during close.
2024-06-29 15:33:15,298 INFO [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.m.Metrics: Metrics scheduler closed
2024-06-29 15:33:15,300 INFO [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.m.Metrics: Closing reporter org.apache.kafka.common.metrics.JmxReporter
2024-06-29 15:33:15,300 INFO [kafka-admin-client-thread | kafka-ui-admin-1719675192-1] o.a.k.c.m.Metrics: Metrics reporters closed
2024-06-29 15:33:15,301 ERROR [parallel-2] c.p.k.u.s.StatisticsService: Failed to collect cluster dev-TOOLS-development-cluster info
java.lang.IllegalStateException: Error while creating AdminClient for Cluster dev-TOOLS-development-cluster
at com.provectus.kafka.ui.service.AdminClientServiceImpl.lambda$createAdminClient$5(AdminClientServiceImpl.java:56)
at reactor.core.publisher.Mono.lambda$onErrorMap$28(Mono.java:3783)
at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onError(FluxOnErrorResume.java:94)
at reactor.core.publisher.MonoPeekTerminal$MonoTerminalPeekSubscriber.onError(MonoPeekTerminal.java:258)
at reactor.core.publisher.FluxMap$MapConditionalSubscriber.onError(FluxMap.java:265)
at reactor.core.publisher.Operators$MonoSubscriber.onError(Operators.java:1886)
at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.signalCached(MonoCacheTime.java:340)
at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.onError(MonoCacheTime.java:363)
at reactor.core.publisher.MonoFlatMap$FlatMapMain.onError(MonoFlatMap.java:180)
at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.onError(MonoIgnoreThen.java:278)
at reactor.core.publisher.MonoPublishOn$PublishOnSubscriber.run(MonoPublishOn.java:187)
at reactor.core.scheduler.SchedulerTask.call(SchedulerTask.java:68)
at reactor.core.scheduler.SchedulerTask.call(SchedulerTask.java:28)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: org.apache.kafka.common.errors.SaslAuthenticationException: [d5c5f890-5d45-4aa6-bf72-9c7c880ce011]: Access denied

[germanosin]

Me and @Haarolean no longer support this repo.
Don't you mind to propose your change to our repo https://github.com/kafbat/kafka-ui