Kafka Mac下安装与使用

文章目录

  • 一、下载安装
  • 二、启动Zookeeper
  • 三、启动Kafka
  • 四、创建Topic
  • 五、查看Topic
  • 六、删除Topic
  • 七、生产/消费数据
  • 八、查看消费组
  • 九、查看消费组详情

一、下载安装

Kafka 官网下载:https://kafka.apache.org/downloads

下载好 tar包 后,执行下面命令解压:

tar -zxvf xxx.tar

二、启动Zookeeper

进入Kafkabin目录,执行如下命令:

./zookeeper-server-start.sh ../config/zookeeper.properties &

执行结果:

[2022-03-11 17:20:30,410] INFO Reading configuration from: ../config/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,411] WARN ../config/zookeeper.properties is relative. Prepend ./ to indicate that you're sure! (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,422] INFO clientPortAddress is 0.0.0.0:2181 (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,423] INFO secureClientPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,423] INFO observerMasterPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,423] INFO metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,424] INFO autopurge.snapRetainCount set to 3 (org.apache.zookeeper.server.DatadirCleanupManager)
[2022-03-11 17:20:30,424] INFO autopurge.purgeInterval set to 0 (org.apache.zookeeper.server.DatadirCleanupManager)
[2022-03-11 17:20:30,424] INFO Purge task is not scheduled. (org.apache.zookeeper.server.DatadirCleanupManager)
[2022-03-11 17:20:30,424] WARN Either no config or no quorum defined in config, running in standalone mode (org.apache.zookeeper.server.quorum.QuorumPeerMain)
[2022-03-11 17:20:30,428] INFO Log4j 1.2 jmx support found and enabled. (org.apache.zookeeper.jmx.ManagedUtil)
[2022-03-11 17:20:30,440] INFO Reading configuration from: ../config/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,440] WARN ../config/zookeeper.properties is relative. Prepend ./ to indicate that you're sure! (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,441] INFO clientPortAddress is 0.0.0.0:2181 (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,441] INFO secureClientPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,441] INFO observerMasterPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,441] INFO metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2022-03-11 17:20:30,441] INFO Starting server (org.apache.zookeeper.server.ZooKeeperServerMain)
[2022-03-11 17:20:30,453] INFO ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@15975490 (org.apache.zookeeper.server.ServerMetrics)
[2022-03-11 17:20:30,457] INFO zookeeper.snapshot.trust.empty : false (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2022-03-11 17:20:30,473] INFO  (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:30,473] INFO   ______                  _                                           (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:30,473] INFO  |___  /                 | |                                          (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:30,473] INFO     / /    ___     ___   | | __   ___    ___   _ __     ___   _ __    (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:30,473] INFO    / /    / _ \   / _ \  | |/ /  / _ \  / _ \ | '_ \   / _ \ | '__| (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:30,473] INFO   / /__  | (_) | | (_) | |   <  |  __/ |  __/ | |_) | |  __/ | |     (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:30,473] INFO  /_____|  \___/   \___/  |_|\_\  \___|  \___| | .__/   \___| |_| (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:30,473] INFO                                               | |                      (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:30,473] INFO                                               |_|                      (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:30,473] INFO  (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,480] INFO Server environment:zookeeper.version=3.6.3--6401e4ad2087061bc6b9f80dec2d69f2e3c8660a, built on 04/08/2021 16:35 GMT (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,480] INFO Server environment:host.name=10.0.22.112 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,480] INFO Server environment:java.version=1.8.0_121 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,480] INFO Server environment:java.vendor=Oracle Corporation (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,480] INFO Server environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.8.0_121.jdk/Contents/Home/jre (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,481] INFO Server environment:java.class.path=/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/activation-1.1.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/aopalliance-repackaged-2.6.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/argparse4j-0.7.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/audience-annotations-0.5.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/commons-cli-1.4.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/commons-lang3-3.8.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-api-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-basic-auth-extension-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-file-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-json-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-mirror-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-mirror-client-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-runtime-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-transforms-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/hk2-api-2.6.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/hk2-locator-2.6.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/hk2-utils-2.6.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-annotations-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-core-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-databind-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-dataformat-csv-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-datatype-jdk8-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-jaxrs-base-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-jaxrs-json-provider-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-module-jaxb-annotations-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-module-scala_2.12-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.activation-api-1.2.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.annotation-api-1.3.5.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.inject-2.6.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.validation-api-2.0.2.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.ws.rs-api-2.1.6.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.xml.bind-api-2.3.2.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/javassist-3.27.0-GA.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/javax.servlet-api-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/javax.ws.rs-api-2.1.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jaxb-api-2.3.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-client-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-common-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-container-servlet-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-container-servlet-core-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-hk2-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-server-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-client-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-continuation-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-http-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-io-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-security-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-server-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-servlet-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-servlets-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-util-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-util-ajax-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jline-3.12.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jopt-simple-5.0.4.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jose4j-0.7.8.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-clients-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-log4j-appender-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-metadata-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-raft-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-server-common-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-shell-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-storage-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-storage-api-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-streams-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-streams-examples-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-streams-scala_2.12-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-streams-test-utils-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-tools-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka_2.12-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/log4j-1.2.17.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/lz4-java-1.8.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/maven-artifact-3.8.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/metrics-core-2.2.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/metrics-core-4.1.12.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-buffer-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-codec-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-common-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-handler-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-resolver-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-transport-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-transport-native-epoll-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-transport-native-unix-common-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/osgi-resource-locator-1.0.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/paranamer-2.8.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/plexus-utils-3.2.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/reflections-0.9.12.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/rocksdbjni-6.22.1.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/scala-collection-compat_2.12-2.4.4.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/scala-java8-compat_2.12-1.0.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/scala-library-2.12.14.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/scala-logging_2.12-3.9.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/scala-reflect-2.12.14.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/slf4j-api-1.7.30.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/slf4j-log4j12-1.7.30.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/snappy-java-1.1.8.4.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/trogdor-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/zookeeper-3.6.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/zookeeper-jute-3.6.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/zstd-jni-1.5.0-4.jar (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,482] INFO Server environment:java.library.path=/Users/davis/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:. (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,482] INFO Server environment:java.io.tmpdir=/var/folders/5n/6g464jd97r13x39t5w69ybfr0000gn/T/ (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,482] INFO Server environment:java.compiler=<NA> (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,482] INFO Server environment:os.name=Mac OS X (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,482] INFO Server environment:os.arch=x86_64 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO Server environment:os.version=10.15.5 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO Server environment:user.name=davis (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO Server environment:user.home=/Users/davis (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO Server environment:user.dir=/Users/davis/soft/kafka/kafka_3.1.0/bin (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO Server environment:os.memory.free=494MB (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO Server environment:os.memory.max=512MB (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO Server environment:os.memory.total=512MB (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO zookeeper.enableEagerACLCheck = false (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO zookeeper.digest.enabled = true (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO zookeeper.closeSessionTxn.enabled = true (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,483] INFO zookeeper.flushDelay=0 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,484] INFO zookeeper.maxWriteQueuePollTime=0 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,484] INFO zookeeper.maxBatchSize=1000 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,484] INFO zookeeper.intBufferStartingSizeBytes = 1024 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,485] INFO Weighed connection throttling is disabled (org.apache.zookeeper.server.BlueThrottle)
[2022-03-11 17:20:35,486] INFO minSessionTimeout set to 6000 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,487] INFO maxSessionTimeout set to 60000 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,488] INFO Response cache size is initialized with value 400. (org.apache.zookeeper.server.ResponseCache)
[2022-03-11 17:20:35,488] INFO Response cache size is initialized with value 400. (org.apache.zookeeper.server.ResponseCache)
[2022-03-11 17:20:35,489] INFO zookeeper.pathStats.slotCapacity = 60 (org.apache.zookeeper.server.util.RequestPathMetricsCollector)
[2022-03-11 17:20:35,489] INFO zookeeper.pathStats.slotDuration = 15 (org.apache.zookeeper.server.util.RequestPathMetricsCollector)
[2022-03-11 17:20:35,490] INFO zookeeper.pathStats.maxDepth = 6 (org.apache.zookeeper.server.util.RequestPathMetricsCollector)
[2022-03-11 17:20:35,490] INFO zookeeper.pathStats.initialDelay = 5 (org.apache.zookeeper.server.util.RequestPathMetricsCollector)
[2022-03-11 17:20:35,490] INFO zookeeper.pathStats.delay = 5 (org.apache.zookeeper.server.util.RequestPathMetricsCollector)
[2022-03-11 17:20:35,490] INFO zookeeper.pathStats.enabled = false (org.apache.zookeeper.server.util.RequestPathMetricsCollector)
[2022-03-11 17:20:35,493] INFO The max bytes for all large requests are set to 104857600 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,493] INFO The large request threshold is set to -1 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,493] INFO Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 60000 clientPortListenBacklog -1 datadir /tmp/zookeeper/version-2 snapdir /tmp/zookeeper/version-2 (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,504] INFO Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory (org.apache.zookeeper.server.ServerCnxnFactory)
[2022-03-11 17:20:35,505] WARN maxCnxns is not configured, using default value 0. (org.apache.zookeeper.server.ServerCnxnFactory)
[2022-03-11 17:20:35,507] INFO Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers. (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2022-03-11 17:20:35,515] INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2022-03-11 17:20:35,532] INFO Using org.apache.zookeeper.server.watch.WatchManager as watch manager (org.apache.zookeeper.server.watch.WatchManagerFactory)
[2022-03-11 17:20:35,532] INFO Using org.apache.zookeeper.server.watch.WatchManager as watch manager (org.apache.zookeeper.server.watch.WatchManagerFactory)
[2022-03-11 17:20:35,532] INFO zookeeper.snapshotSizeFactor = 0.33 (org.apache.zookeeper.server.ZKDatabase)
[2022-03-11 17:20:35,532] INFO zookeeper.commitLogCount=500 (org.apache.zookeeper.server.ZKDatabase)
[2022-03-11 17:20:35,536] INFO zookeeper.snapshot.compression.method = CHECKED (org.apache.zookeeper.server.persistence.SnapStream)
[2022-03-11 17:20:35,538] INFO Reading snapshot /tmp/zookeeper/version-2/snapshot.0 (org.apache.zookeeper.server.persistence.FileSnap)
[2022-03-11 17:20:35,542] INFO The digest value is empty in snapshot (org.apache.zookeeper.server.DataTree)
[2022-03-11 17:20:35,571] INFO 29 txns loaded in 24 ms (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2022-03-11 17:20:35,571] INFO Snapshot loaded in 40 ms, highest zxid is 0x1d, digest is 51174012753 (org.apache.zookeeper.server.ZKDatabase)
[2022-03-11 17:20:35,572] INFO Snapshotting: 0x1d to /tmp/zookeeper/version-2/snapshot.1d (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2022-03-11 17:20:35,574] INFO Snapshot taken in 2 ms (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:35,584] INFO PrepRequestProcessor (sid:0) started, reconfigEnabled=false (org.apache.zookeeper.server.PrepRequestProcessor)
[2022-03-11 17:20:35,585] INFO zookeeper.request_throttler.shutdownTimeout = 10000 (org.apache.zookeeper.server.RequestThrottler)
[2022-03-11 17:20:35,598] INFO Using checkIntervalMs=60000 maxPerMinute=10000 maxNeverUsedIntervalMs=0 (org.apache.zookeeper.server.ContainerManager)
[2022-03-11 17:20:35,599] INFO ZooKeeper audit is disabled. (org.apache.zookeeper.audit.ZKAuditProvider)
[2022-03-11 17:20:54,971] INFO Expiring session 0x10072721ea90000, timeout of 18000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
[2022-03-11 17:20:54,974] INFO Creating new log file: log.1e (org.apache.zookeeper.server.persistence.FileTxnLog)

三、启动Kafka

进入Kafkabin目录,执行如下命令:

./kafka-server-start.sh ../config/server.properties &

执行结果:

[2022-03-11 17:21:45,472] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$)
[2022-03-11 17:21:45,964] INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util)
[2022-03-11 17:21:46,054] INFO Registered signal handlers for TERM, INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler)
[2022-03-11 17:21:46,059] INFO starting (kafka.server.KafkaServer)
[2022-03-11 17:21:46,060] INFO Connecting to zookeeper on localhost:2181 (kafka.server.KafkaServer)
[2022-03-11 17:21:46,085] INFO [ZooKeeperClient Kafka server] Initializing a new session to localhost:2181. (kafka.zookeeper.ZooKeeperClient)
[2022-03-11 17:21:51,099] INFO Client environment:zookeeper.version=3.6.3--6401e4ad2087061bc6b9f80dec2d69f2e3c8660a, built on 04/08/2021 16:35 GMT (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,099] INFO Client environment:host.name=10.0.22.112 (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,100] INFO Client environment:java.version=1.8.0_121 (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,100] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,100] INFO Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.8.0_121.jdk/Contents/Home/jre (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,100] INFO Client environment:java.class.path=/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/activation-1.1.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/aopalliance-repackaged-2.6.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/argparse4j-0.7.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/audience-annotations-0.5.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/commons-cli-1.4.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/commons-lang3-3.8.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-api-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-basic-auth-extension-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-file-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-json-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-mirror-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-mirror-client-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-runtime-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/connect-transforms-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/hk2-api-2.6.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/hk2-locator-2.6.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/hk2-utils-2.6.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-annotations-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-core-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-databind-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-dataformat-csv-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-datatype-jdk8-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-jaxrs-base-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-jaxrs-json-provider-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-module-jaxb-annotations-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jackson-module-scala_2.12-2.12.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.activation-api-1.2.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.annotation-api-1.3.5.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.inject-2.6.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.validation-api-2.0.2.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.ws.rs-api-2.1.6.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jakarta.xml.bind-api-2.3.2.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/javassist-3.27.0-GA.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/javax.servlet-api-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/javax.ws.rs-api-2.1.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jaxb-api-2.3.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-client-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-common-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-container-servlet-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-container-servlet-core-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-hk2-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jersey-server-2.34.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-client-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-continuation-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-http-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-io-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-security-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-server-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-servlet-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-servlets-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-util-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jetty-util-ajax-9.4.43.v20210629.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jline-3.12.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jopt-simple-5.0.4.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/jose4j-0.7.8.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-clients-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-log4j-appender-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-metadata-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-raft-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-server-common-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-shell-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-storage-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-storage-api-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-streams-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-streams-examples-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-streams-scala_2.12-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-streams-test-utils-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka-tools-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/kafka_2.12-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/log4j-1.2.17.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/lz4-java-1.8.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/maven-artifact-3.8.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/metrics-core-2.2.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/metrics-core-4.1.12.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-buffer-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-codec-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-common-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-handler-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-resolver-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-transport-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-transport-native-epoll-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/netty-transport-native-unix-common-4.1.68.Final.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/osgi-resource-locator-1.0.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/paranamer-2.8.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/plexus-utils-3.2.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/reflections-0.9.12.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/rocksdbjni-6.22.1.1.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/scala-collection-compat_2.12-2.4.4.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/scala-java8-compat_2.12-1.0.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/scala-library-2.12.14.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/scala-logging_2.12-3.9.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/scala-reflect-2.12.14.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/slf4j-api-1.7.30.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/slf4j-log4j12-1.7.30.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/snappy-java-1.1.8.4.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/trogdor-3.1.0.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/zookeeper-3.6.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/zookeeper-jute-3.6.3.jar:/Users/davis/soft/kafka/kafka_3.1.0/bin/../libs/zstd-jni-1.5.0-4.jar (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,101] INFO Client environment:java.library.path=/Users/davis/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:. (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,101] INFO Client environment:java.io.tmpdir=/var/folders/5n/6g464jd97r13x39t5w69ybfr0000gn/T/ (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,101] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,101] INFO Client environment:os.name=Mac OS X (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,101] INFO Client environment:os.arch=x86_64 (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,101] INFO Client environment:os.version=10.15.5 (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,101] INFO Client environment:user.name=davis (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,101] INFO Client environment:user.home=/Users/davis (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,101] INFO Client environment:user.dir=/Users/davis/soft/kafka/kafka_3.1.0/bin (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,102] INFO Client environment:os.memory.free=1012MB (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,102] INFO Client environment:os.memory.max=1024MB (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,102] INFO Client environment:os.memory.total=1024MB (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,104] INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=18000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@36ebc363 (org.apache.zookeeper.ZooKeeper)
[2022-03-11 17:21:51,110] INFO jute.maxbuffer value is 4194304 Bytes (org.apache.zookeeper.ClientCnxnSocket)
[2022-03-11 17:21:51,114] INFO zookeeper.request.timeout value is 0. feature enabled=false (org.apache.zookeeper.ClientCnxn)
[2022-03-11 17:21:51,116] INFO [ZooKeeperClient Kafka server] Waiting until connected. (kafka.zookeeper.ZooKeeperClient)
[2022-03-11 17:21:51,120] INFO Opening socket connection to server localhost/127.0.0.1:2181. (org.apache.zookeeper.ClientCnxn)
[2022-03-11 17:21:51,120] INFO SASL config status: Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2022-03-11 17:21:51,131] INFO Socket connection established, initiating session, client: /127.0.0.1:54127, server: localhost/127.0.0.1:2181 (org.apache.zookeeper.ClientCnxn)
[2022-03-11 17:21:51,143] INFO Session establishment complete on server localhost/127.0.0.1:2181, session id = 0x100727923aa0000, negotiated timeout = 18000 (org.apache.zookeeper.ClientCnxn)
[2022-03-11 17:21:51,146] INFO [ZooKeeperClient Kafka server] Connected. (kafka.zookeeper.ZooKeeperClient)
[2022-03-11 17:21:51,223] INFO [feature-zk-node-event-process-thread]: Starting (kafka.server.FinalizedFeatureChangeListener$ChangeNotificationProcessorThread)
[2022-03-11 17:21:51,378] INFO Updated cache from existing <empty> to latest FinalizedFeaturesAndEpoch(features=Features{}, epoch=0). (kafka.server.FinalizedFeatureCache)
[2022-03-11 17:21:51,382] INFO Cluster ID = 3D8RQ653S9exEPtwxVwuaQ (kafka.server.KafkaServer)
[2022-03-11 17:21:51,457] INFO KafkaConfig values:advertised.listeners = nullalter.config.policy.class.name = nullalter.log.dirs.replication.quota.window.num = 11alter.log.dirs.replication.quota.window.size.seconds = 1authorizer.class.name =auto.create.topics.enable = trueauto.leader.rebalance.enable = truebackground.threads = 10broker.heartbeat.interval.ms = 2000broker.id = 0broker.id.generation.enable = truebroker.rack = nullbroker.session.timeout.ms = 9000client.quota.callback.class = nullcompression.type = producerconnection.failed.authentication.delay.ms = 100connections.max.idle.ms = 600000connections.max.reauth.ms = 0control.plane.listener.name = nullcontrolled.shutdown.enable = truecontrolled.shutdown.max.retries = 3controlled.shutdown.retry.backoff.ms = 5000controller.listener.names = nullcontroller.quorum.append.linger.ms = 25controller.quorum.election.backoff.max.ms = 1000controller.quorum.election.timeout.ms = 1000controller.quorum.fetch.timeout.ms = 2000controller.quorum.request.timeout.ms = 2000controller.quorum.retry.backoff.ms = 20controller.quorum.voters = []controller.quota.window.num = 11controller.quota.window.size.seconds = 1controller.socket.timeout.ms = 30000create.topic.policy.class.name = nulldefault.replication.factor = 1delegation.token.expiry.check.interval.ms = 3600000delegation.token.expiry.time.ms = 86400000delegation.token.master.key = nulldelegation.token.max.lifetime.ms = 604800000delegation.token.secret.key = nulldelete.records.purgatory.purge.interval.requests = 1delete.topic.enable = truefetch.max.bytes = 57671680fetch.purgatory.purge.interval.requests = 1000group.initial.rebalance.delay.ms = 0group.max.session.timeout.ms = 1800000group.max.size = 2147483647group.min.session.timeout.ms = 6000initial.broker.registration.timeout.ms = 60000inter.broker.listener.name = nullinter.broker.protocol.version = 3.1-IV0kafka.metrics.polling.interval.secs = 10kafka.metrics.reporters = []leader.imbalance.check.interval.seconds = 300leader.imbalance.per.broker.percentage = 10listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSLlisteners = PLAINTEXT://:9092log.cleaner.backoff.ms = 15000log.cleaner.dedupe.buffer.size = 134217728log.cleaner.delete.retention.ms = 86400000log.cleaner.enable = truelog.cleaner.io.buffer.load.factor = 0.9log.cleaner.io.buffer.size = 524288log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308log.cleaner.max.compaction.lag.ms = 9223372036854775807log.cleaner.min.cleanable.ratio = 0.5log.cleaner.min.compaction.lag.ms = 0log.cleaner.threads = 1log.cleanup.policy = [delete]log.dir = /tmp/kafka-logslog.dirs = /tmp/kafka-logslog.flush.interval.messages = 9223372036854775807log.flush.interval.ms = nulllog.flush.offset.checkpoint.interval.ms = 60000log.flush.scheduler.interval.ms = 9223372036854775807log.flush.start.offset.checkpoint.interval.ms = 60000log.index.interval.bytes = 4096log.index.size.max.bytes = 10485760log.message.downconversion.enable = truelog.message.format.version = 3.0-IV1log.message.timestamp.difference.max.ms = 9223372036854775807log.message.timestamp.type = CreateTimelog.preallocate = falselog.retention.bytes = -1log.retention.check.interval.ms = 300000log.retention.hours = 168log.retention.minutes = nulllog.retention.ms = nulllog.roll.hours = 168log.roll.jitter.hours = 0log.roll.jitter.ms = nulllog.roll.ms = nulllog.segment.bytes = 1073741824log.segment.delete.delay.ms = 60000max.connection.creation.rate = 2147483647max.connections = 2147483647max.connections.per.ip = 2147483647max.connections.per.ip.overrides =max.incremental.fetch.session.cache.slots = 1000message.max.bytes = 1048588metadata.log.dir = nullmetadata.log.max.record.bytes.between.snapshots = 20971520metadata.log.segment.bytes = 1073741824metadata.log.segment.min.bytes = 8388608metadata.log.segment.ms = 604800000metadata.max.retention.bytes = -1metadata.max.retention.ms = 604800000metric.reporters = []metrics.num.samples = 2metrics.recording.level = INFOmetrics.sample.window.ms = 30000min.insync.replicas = 1node.id = 0num.io.threads = 8num.network.threads = 3num.partitions = 1num.recovery.threads.per.data.dir = 1num.replica.alter.log.dirs.threads = nullnum.replica.fetchers = 1offset.metadata.max.bytes = 4096offsets.commit.required.acks = -1offsets.commit.timeout.ms = 5000offsets.load.buffer.size = 5242880offsets.retention.check.interval.ms = 600000offsets.retention.minutes = 10080offsets.topic.compression.codec = 0offsets.topic.num.partitions = 50offsets.topic.replication.factor = 1offsets.topic.segment.bytes = 104857600password.encoder.cipher.algorithm = AES/CBC/PKCS5Paddingpassword.encoder.iterations = 4096password.encoder.key.length = 128password.encoder.keyfactory.algorithm = nullpassword.encoder.old.secret = nullpassword.encoder.secret = nullprincipal.builder.class = class org.apache.kafka.common.security.authenticator.DefaultKafkaPrincipalBuilderprocess.roles = []producer.purgatory.purge.interval.requests = 1000queued.max.request.bytes = -1queued.max.requests = 500quota.window.num = 11quota.window.size.seconds = 1remote.log.index.file.cache.total.size.bytes = 1073741824remote.log.manager.task.interval.ms = 30000remote.log.manager.task.retry.backoff.max.ms = 30000remote.log.manager.task.retry.backoff.ms = 500remote.log.manager.task.retry.jitter = 0.2remote.log.manager.thread.pool.size = 10remote.log.metadata.manager.class.name = nullremote.log.metadata.manager.class.path = nullremote.log.metadata.manager.impl.prefix = nullremote.log.metadata.manager.listener.name = nullremote.log.reader.max.pending.tasks = 100remote.log.reader.threads = 10remote.log.storage.manager.class.name = nullremote.log.storage.manager.class.path = nullremote.log.storage.manager.impl.prefix = nullremote.log.storage.system.enable = falsereplica.fetch.backoff.ms = 1000replica.fetch.max.bytes = 1048576replica.fetch.min.bytes = 1replica.fetch.response.max.bytes = 10485760replica.fetch.wait.max.ms = 500replica.high.watermark.checkpoint.interval.ms = 5000replica.lag.time.max.ms = 30000replica.selector.class = nullreplica.socket.receive.buffer.bytes = 65536replica.socket.timeout.ms = 30000replication.quota.window.num = 11replication.quota.window.size.seconds = 1request.timeout.ms = 30000reserved.broker.max.id = 1000sasl.client.callback.handler.class = nullsasl.enabled.mechanisms = [GSSAPI]sasl.jaas.config = nullsasl.kerberos.kinit.cmd = /usr/bin/kinitsasl.kerberos.min.time.before.relogin = 60000sasl.kerberos.principal.to.local.rules = [DEFAULT]sasl.kerberos.service.name = nullsasl.kerberos.ticket.renew.jitter = 0.05sasl.kerberos.ticket.renew.window.factor = 0.8sasl.login.callback.handler.class = nullsasl.login.class = nullsasl.login.connect.timeout.ms = nullsasl.login.read.timeout.ms = nullsasl.login.refresh.buffer.seconds = 300sasl.login.refresh.min.period.seconds = 60sasl.login.refresh.window.factor = 0.8sasl.login.refresh.window.jitter = 0.05sasl.login.retry.backoff.max.ms = 10000sasl.login.retry.backoff.ms = 100sasl.mechanism.controller.protocol = GSSAPIsasl.mechanism.inter.broker.protocol = GSSAPIsasl.oauthbearer.clock.skew.seconds = 30sasl.oauthbearer.expected.audience = nullsasl.oauthbearer.expected.issuer = nullsasl.oauthbearer.jwks.endpoint.refresh.ms = 3600000sasl.oauthbearer.jwks.endpoint.retry.backoff.max.ms = 10000sasl.oauthbearer.jwks.endpoint.retry.backoff.ms = 100sasl.oauthbearer.jwks.endpoint.url = nullsasl.oauthbearer.scope.claim.name = scopesasl.oauthbearer.sub.claim.name = subsasl.oauthbearer.token.endpoint.url = nullsasl.server.callback.handler.class = nullsecurity.inter.broker.protocol = PLAINTEXTsecurity.providers = nullsocket.connection.setup.timeout.max.ms = 30000socket.connection.setup.timeout.ms = 10000socket.receive.buffer.bytes = 102400socket.request.max.bytes = 104857600socket.send.buffer.bytes = 102400ssl.cipher.suites = []ssl.client.auth = nonessl.enabled.protocols = [TLSv1.2]ssl.endpoint.identification.algorithm = httpsssl.engine.factory.class = nullssl.key.password = nullssl.keymanager.algorithm = SunX509ssl.keystore.certificate.chain = nullssl.keystore.key = nullssl.keystore.location = nullssl.keystore.password = nullssl.keystore.type = JKSssl.principal.mapping.rules = DEFAULTssl.protocol = TLSv1.2ssl.provider = nullssl.secure.random.implementation = nullssl.trustmanager.algorithm = PKIXssl.truststore.certificates = nullssl.truststore.location = nullssl.truststore.password = nullssl.truststore.type = JKStransaction.abort.timed.out.transaction.cleanup.interval.ms = 10000transaction.max.timeout.ms = 900000transaction.remove.expired.transaction.cleanup.interval.ms = 3600000transaction.state.log.load.buffer.size = 5242880transaction.state.log.min.isr = 1transaction.state.log.num.partitions = 50transaction.state.log.replication.factor = 1transaction.state.log.segment.bytes = 104857600transactional.id.expiration.ms = 604800000unclean.leader.election.enable = falsezookeeper.clientCnxnSocket = nullzookeeper.connect = localhost:2181zookeeper.connection.timeout.ms = 18000zookeeper.max.in.flight.requests = 10zookeeper.session.timeout.ms = 18000zookeeper.set.acl = falsezookeeper.ssl.cipher.suites = nullzookeeper.ssl.client.enable = falsezookeeper.ssl.crl.enable = falsezookeeper.ssl.enabled.protocols = nullzookeeper.ssl.endpoint.identification.algorithm = HTTPSzookeeper.ssl.keystore.location = nullzookeeper.ssl.keystore.password = nullzookeeper.ssl.keystore.type = nullzookeeper.ssl.ocsp.enable = falsezookeeper.ssl.protocol = TLSv1.2zookeeper.ssl.truststore.location = nullzookeeper.ssl.truststore.password = nullzookeeper.ssl.truststore.type = nullzookeeper.sync.time.ms = 2000(kafka.server.KafkaConfig)
[2022-03-11 17:21:51,467] INFO KafkaConfig values:advertised.listeners = nullalter.config.policy.class.name = nullalter.log.dirs.replication.quota.window.num = 11alter.log.dirs.replication.quota.window.size.seconds = 1authorizer.class.name =auto.create.topics.enable = trueauto.leader.rebalance.enable = truebackground.threads = 10broker.heartbeat.interval.ms = 2000broker.id = 0broker.id.generation.enable = truebroker.rack = nullbroker.session.timeout.ms = 9000client.quota.callback.class = nullcompression.type = producerconnection.failed.authentication.delay.ms = 100connections.max.idle.ms = 600000connections.max.reauth.ms = 0control.plane.listener.name = nullcontrolled.shutdown.enable = truecontrolled.shutdown.max.retries = 3controlled.shutdown.retry.backoff.ms = 5000controller.listener.names = nullcontroller.quorum.append.linger.ms = 25controller.quorum.election.backoff.max.ms = 1000controller.quorum.election.timeout.ms = 1000controller.quorum.fetch.timeout.ms = 2000controller.quorum.request.timeout.ms = 2000controller.quorum.retry.backoff.ms = 20controller.quorum.voters = []controller.quota.window.num = 11controller.quota.window.size.seconds = 1controller.socket.timeout.ms = 30000create.topic.policy.class.name = nulldefault.replication.factor = 1delegation.token.expiry.check.interval.ms = 3600000delegation.token.expiry.time.ms = 86400000delegation.token.master.key = nulldelegation.token.max.lifetime.ms = 604800000delegation.token.secret.key = nulldelete.records.purgatory.purge.interval.requests = 1delete.topic.enable = truefetch.max.bytes = 57671680fetch.purgatory.purge.interval.requests = 1000group.initial.rebalance.delay.ms = 0group.max.session.timeout.ms = 1800000group.max.size = 2147483647group.min.session.timeout.ms = 6000initial.broker.registration.timeout.ms = 60000inter.broker.listener.name = nullinter.broker.protocol.version = 3.1-IV0kafka.metrics.polling.interval.secs = 10kafka.metrics.reporters = []leader.imbalance.check.interval.seconds = 300leader.imbalance.per.broker.percentage = 10listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSLlisteners = PLAINTEXT://:9092log.cleaner.backoff.ms = 15000log.cleaner.dedupe.buffer.size = 134217728log.cleaner.delete.retention.ms = 86400000log.cleaner.enable = truelog.cleaner.io.buffer.load.factor = 0.9log.cleaner.io.buffer.size = 524288log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308log.cleaner.max.compaction.lag.ms = 9223372036854775807log.cleaner.min.cleanable.ratio = 0.5log.cleaner.min.compaction.lag.ms = 0log.cleaner.threads = 1log.cleanup.policy = [delete]log.dir = /tmp/kafka-logslog.dirs = /tmp/kafka-logslog.flush.interval.messages = 9223372036854775807log.flush.interval.ms = nulllog.flush.offset.checkpoint.interval.ms = 60000log.flush.scheduler.interval.ms = 9223372036854775807log.flush.start.offset.checkpoint.interval.ms = 60000log.index.interval.bytes = 4096log.index.size.max.bytes = 10485760log.message.downconversion.enable = truelog.message.format.version = 3.0-IV1log.message.timestamp.difference.max.ms = 9223372036854775807log.message.timestamp.type = CreateTimelog.preallocate = falselog.retention.bytes = -1log.retention.check.interval.ms = 300000log.retention.hours = 168log.retention.minutes = nulllog.retention.ms = nulllog.roll.hours = 168log.roll.jitter.hours = 0log.roll.jitter.ms = nulllog.roll.ms = nulllog.segment.bytes = 1073741824log.segment.delete.delay.ms = 60000max.connection.creation.rate = 2147483647max.connections = 2147483647max.connections.per.ip = 2147483647max.connections.per.ip.overrides =max.incremental.fetch.session.cache.slots = 1000message.max.bytes = 1048588metadata.log.dir = nullmetadata.log.max.record.bytes.between.snapshots = 20971520metadata.log.segment.bytes = 1073741824metadata.log.segment.min.bytes = 8388608metadata.log.segment.ms = 604800000metadata.max.retention.bytes = -1metadata.max.retention.ms = 604800000metric.reporters = []metrics.num.samples = 2metrics.recording.level = INFOmetrics.sample.window.ms = 30000min.insync.replicas = 1node.id = 0num.io.threads = 8num.network.threads = 3num.partitions = 1num.recovery.threads.per.data.dir = 1num.replica.alter.log.dirs.threads = nullnum.replica.fetchers = 1offset.metadata.max.bytes = 4096offsets.commit.required.acks = -1offsets.commit.timeout.ms = 5000offsets.load.buffer.size = 5242880offsets.retention.check.interval.ms = 600000offsets.retention.minutes = 10080offsets.topic.compression.codec = 0offsets.topic.num.partitions = 50offsets.topic.replication.factor = 1offsets.topic.segment.bytes = 104857600password.encoder.cipher.algorithm = AES/CBC/PKCS5Paddingpassword.encoder.iterations = 4096password.encoder.key.length = 128password.encoder.keyfactory.algorithm = nullpassword.encoder.old.secret = nullpassword.encoder.secret = nullprincipal.builder.class = class org.apache.kafka.common.security.authenticator.DefaultKafkaPrincipalBuilderprocess.roles = []producer.purgatory.purge.interval.requests = 1000queued.max.request.bytes = -1queued.max.requests = 500quota.window.num = 11quota.window.size.seconds = 1remote.log.index.file.cache.total.size.bytes = 1073741824remote.log.manager.task.interval.ms = 30000remote.log.manager.task.retry.backoff.max.ms = 30000remote.log.manager.task.retry.backoff.ms = 500remote.log.manager.task.retry.jitter = 0.2remote.log.manager.thread.pool.size = 10remote.log.metadata.manager.class.name = nullremote.log.metadata.manager.class.path = nullremote.log.metadata.manager.impl.prefix = nullremote.log.metadata.manager.listener.name = nullremote.log.reader.max.pending.tasks = 100remote.log.reader.threads = 10remote.log.storage.manager.class.name = nullremote.log.storage.manager.class.path = nullremote.log.storage.manager.impl.prefix = nullremote.log.storage.system.enable = falsereplica.fetch.backoff.ms = 1000replica.fetch.max.bytes = 1048576replica.fetch.min.bytes = 1replica.fetch.response.max.bytes = 10485760replica.fetch.wait.max.ms = 500replica.high.watermark.checkpoint.interval.ms = 5000replica.lag.time.max.ms = 30000replica.selector.class = nullreplica.socket.receive.buffer.bytes = 65536replica.socket.timeout.ms = 30000replication.quota.window.num = 11replication.quota.window.size.seconds = 1request.timeout.ms = 30000reserved.broker.max.id = 1000sasl.client.callback.handler.class = nullsasl.enabled.mechanisms = [GSSAPI]sasl.jaas.config = nullsasl.kerberos.kinit.cmd = /usr/bin/kinitsasl.kerberos.min.time.before.relogin = 60000sasl.kerberos.principal.to.local.rules = [DEFAULT]sasl.kerberos.service.name = nullsasl.kerberos.ticket.renew.jitter = 0.05sasl.kerberos.ticket.renew.window.factor = 0.8sasl.login.callback.handler.class = nullsasl.login.class = nullsasl.login.connect.timeout.ms = nullsasl.login.read.timeout.ms = nullsasl.login.refresh.buffer.seconds = 300sasl.login.refresh.min.period.seconds = 60sasl.login.refresh.window.factor = 0.8sasl.login.refresh.window.jitter = 0.05sasl.login.retry.backoff.max.ms = 10000sasl.login.retry.backoff.ms = 100sasl.mechanism.controller.protocol = GSSAPIsasl.mechanism.inter.broker.protocol = GSSAPIsasl.oauthbearer.clock.skew.seconds = 30sasl.oauthbearer.expected.audience = nullsasl.oauthbearer.expected.issuer = nullsasl.oauthbearer.jwks.endpoint.refresh.ms = 3600000sasl.oauthbearer.jwks.endpoint.retry.backoff.max.ms = 10000sasl.oauthbearer.jwks.endpoint.retry.backoff.ms = 100sasl.oauthbearer.jwks.endpoint.url = nullsasl.oauthbearer.scope.claim.name = scopesasl.oauthbearer.sub.claim.name = subsasl.oauthbearer.token.endpoint.url = nullsasl.server.callback.handler.class = nullsecurity.inter.broker.protocol = PLAINTEXTsecurity.providers = nullsocket.connection.setup.timeout.max.ms = 30000socket.connection.setup.timeout.ms = 10000socket.receive.buffer.bytes = 102400socket.request.max.bytes = 104857600socket.send.buffer.bytes = 102400ssl.cipher.suites = []ssl.client.auth = nonessl.enabled.protocols = [TLSv1.2]ssl.endpoint.identification.algorithm = httpsssl.engine.factory.class = nullssl.key.password = nullssl.keymanager.algorithm = SunX509ssl.keystore.certificate.chain = nullssl.keystore.key = nullssl.keystore.location = nullssl.keystore.password = nullssl.keystore.type = JKSssl.principal.mapping.rules = DEFAULTssl.protocol = TLSv1.2ssl.provider = nullssl.secure.random.implementation = nullssl.trustmanager.algorithm = PKIXssl.truststore.certificates = nullssl.truststore.location = nullssl.truststore.password = nullssl.truststore.type = JKStransaction.abort.timed.out.transaction.cleanup.interval.ms = 10000transaction.max.timeout.ms = 900000transaction.remove.expired.transaction.cleanup.interval.ms = 3600000transaction.state.log.load.buffer.size = 5242880transaction.state.log.min.isr = 1transaction.state.log.num.partitions = 50transaction.state.log.replication.factor = 1transaction.state.log.segment.bytes = 104857600transactional.id.expiration.ms = 604800000unclean.leader.election.enable = falsezookeeper.clientCnxnSocket = nullzookeeper.connect = localhost:2181zookeeper.connection.timeout.ms = 18000zookeeper.max.in.flight.requests = 10zookeeper.session.timeout.ms = 18000zookeeper.set.acl = falsezookeeper.ssl.cipher.suites = nullzookeeper.ssl.client.enable = falsezookeeper.ssl.crl.enable = falsezookeeper.ssl.enabled.protocols = nullzookeeper.ssl.endpoint.identification.algorithm = HTTPSzookeeper.ssl.keystore.location = nullzookeeper.ssl.keystore.password = nullzookeeper.ssl.keystore.type = nullzookeeper.ssl.ocsp.enable = falsezookeeper.ssl.protocol = TLSv1.2zookeeper.ssl.truststore.location = nullzookeeper.ssl.truststore.password = nullzookeeper.ssl.truststore.type = nullzookeeper.sync.time.ms = 2000(kafka.server.KafkaConfig)
[2022-03-11 17:21:51,504] INFO [ThrottledChannelReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2022-03-11 17:21:51,505] INFO [ThrottledChannelReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2022-03-11 17:21:51,507] INFO [ThrottledChannelReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2022-03-11 17:21:51,508] INFO [ThrottledChannelReaper-ControllerMutation]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2022-03-11 17:21:51,543] INFO Loading logs from log dirs ArrayBuffer(/tmp/kafka-logs) (kafka.log.LogManager)
[2022-03-11 17:21:51,546] INFO Attempting recovery for all logs in /tmp/kafka-logs since no clean shutdown file was found (kafka.log.LogManager)
[2022-03-11 17:21:51,557] INFO Loaded 0 logs in 15ms. (kafka.log.LogManager)
[2022-03-11 17:21:51,558] INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager)
[2022-03-11 17:21:51,561] INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager)
[2022-03-11 17:21:51,881] INFO [BrokerToControllerChannelManager broker=0 name=forwarding]: Starting (kafka.server.BrokerToControllerRequestThread)
[2022-03-11 17:21:52,044] INFO Updated connection-accept-rate max connection creation rate to 2147483647 (kafka.network.ConnectionQuotas)
[2022-03-11 17:21:52,049] INFO Awaiting socket connections on 0.0.0.0:9092. (kafka.network.Acceptor)
[2022-03-11 17:21:52,078] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Created data-plane acceptor and processors for endpoint : ListenerName(PLAINTEXT) (kafka.network.SocketServer)
[2022-03-11 17:21:52,086] INFO [BrokerToControllerChannelManager broker=0 name=alterIsr]: Starting (kafka.server.BrokerToControllerRequestThread)
[2022-03-11 17:21:52,111] INFO [ExpirationReaper-0-Produce]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2022-03-11 17:21:52,112] INFO [ExpirationReaper-0-Fetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2022-03-11 17:21:52,113] INFO [ExpirationReaper-0-DeleteRecords]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2022-03-11 17:21:52,114] INFO [ExpirationReaper-0-ElectLeader]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2022-03-11 17:21:52,129] INFO [LogDirFailureHandler]: Starting (kafka.server.ReplicaManager$LogDirFailureHandler)
[2022-03-11 17:21:57,176] INFO Creating /brokers/ids/0 (is it secure? false) (kafka.zk.KafkaZkClient)
[2022-03-11 17:21:57,197] INFO Stat of the created znode at /brokers/ids/0 is: 46,46,1646990517190,1646990517190,1,0,0,72183458652880896,206,0,46(kafka.zk.KafkaZkClient)
[2022-03-11 17:21:57,198] INFO Registered broker 0 at path /brokers/ids/0 with addresses: PLAINTEXT://10.0.22.112:9092, czxid (broker epoch): 46 (kafka.zk.KafkaZkClient)
[2022-03-11 17:21:57,261] INFO [ExpirationReaper-0-topic]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2022-03-11 17:21:57,270] INFO [ExpirationReaper-0-Heartbeat]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2022-03-11 17:21:57,271] INFO [ExpirationReaper-0-Rebalance]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2022-03-11 17:21:57,306] INFO [GroupCoordinator 0]: Starting up. (kafka.coordinator.group.GroupCoordinator)
[2022-03-11 17:21:57,314] INFO [GroupCoordinator 0]: Startup complete. (kafka.coordinator.group.GroupCoordinator)
[2022-03-11 17:21:57,335] INFO [TransactionCoordinator id=0] Starting up. (kafka.coordinator.transaction.TransactionCoordinator)
[2022-03-11 17:21:57,339] INFO [Transaction Marker Channel Manager 0]: Starting (kafka.coordinator.transaction.TransactionMarkerChannelManager)
[2022-03-11 17:21:57,339] INFO [TransactionCoordinator id=0] Startup complete. (kafka.coordinator.transaction.TransactionCoordinator)
[2022-03-11 17:21:57,376] INFO [ExpirationReaper-0-AlterAcls]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2022-03-11 17:21:57,404] INFO [/config/changes-event-process-thread]: Starting (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessThread)
[2022-03-11 17:21:57,417] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Starting socket server acceptors and processors (kafka.network.SocketServer)
[2022-03-11 17:21:57,423] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Started data-plane acceptor and processor(s) for endpoint : ListenerName(PLAINTEXT) (kafka.network.SocketServer)
[2022-03-11 17:21:57,424] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Started socket server acceptors and processors (kafka.network.SocketServer)
[2022-03-11 17:21:57,429] INFO Kafka version: 3.1.0 (org.apache.kafka.common.utils.AppInfoParser)
[2022-03-11 17:21:57,430] INFO Kafka commitId: 37edeed0777bacb3 (org.apache.kafka.common.utils.AppInfoParser)
[2022-03-11 17:21:57,430] INFO Kafka startTimeMs: 1646990517425 (org.apache.kafka.common.utils.AppInfoParser)
[2022-03-11 17:21:57,432] INFO [KafkaServer id=0] started (kafka.server.KafkaServer)
[2022-03-11 17:21:57,537] INFO [BrokerToControllerChannelManager broker=0 name=forwarding]: Recorded new controller, from now on will use broker 10.0.22.112:9092 (id: 0 rack: null) (kafka.server.BrokerToControllerRequestThread)
[2022-03-11 17:21:57,537] INFO [BrokerToControllerChannelManager broker=0 name=alterIsr]: Recorded new controller, from now on will use broker 10.0.22.112:9092 (id: 0 rack: null) (kafka.server.BrokerToControllerRequestThread)⚙  ~/soft/kafka/kafka_3.1.0/bin  [2022-03-11 17:30:22,980] INFO Creating topic javaTopic with configuration {} and initial partition assignment Map(1 -> ArrayBuffer(0), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient)
[2022-03-11 17:30:23,077] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions Set(javaTopic-0, javaTopic-1) (kafka.server.ReplicaFetcherManager)
[2022-03-11 17:30:23,146] INFO [LogLoader partition=javaTopic-0, dir=/tmp/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.UnifiedLog$)
[2022-03-11 17:30:23,164] INFO Created log for partition javaTopic-0 in /tmp/kafka-logs/javaTopic-0 with properties {} (kafka.log.LogManager)
[2022-03-11 17:30:23,165] INFO [Partition javaTopic-0 broker=0] No checkpointed highwatermark is found for partition javaTopic-0 (kafka.cluster.Partition)
[2022-03-11 17:30:23,166] INFO [Partition javaTopic-0 broker=0] Log loaded for partition javaTopic-0 with initial high watermark 0 (kafka.cluster.Partition)
[2022-03-11 17:30:23,195] INFO [LogLoader partition=javaTopic-1, dir=/tmp/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.UnifiedLog$)
[2022-03-11 17:30:23,195] INFO Created log for partition javaTopic-1 in /tmp/kafka-logs/javaTopic-1 with properties {} (kafka.log.LogManager)
[2022-03-11 17:30:23,196] INFO [Partition javaTopic-1 broker=0] No checkpointed highwatermark is found for partition javaTopic-1 (kafka.cluster.Partition)
[2022-03-11 17:30:23,196] INFO [Partition javaTopic-1 broker=0] Log loaded for partition javaTopic-1 with initial high watermark 0 (kafka.cluster.Partition)

四、创建Topic

我安装的Kafka版本是:2.13。

进入Kafkabin目录,执行如下命令:

./kafka-topics.sh --bootstrap-server localhost:9092 --create --topic javaTopic --partitions 2 --replication-factor 1
  • replication-factor:指定副本数量

  • partitions:指定分区

执行结果:

Created topic javaTopic.

Kafka版本小于2.2版本的创建命令如下:

./kafka-topics.sh --zookeeper localhost:2181 --create --toptic javaTopic --partitions 2 --replication-factor 1

注:2.2以及更高版本使用如上命令的话,会报如下错误:

Exception in thread "main" joptsimple.UnrecognizedOptionException: zookeeper is not a recognized optionat joptsimple.OptionException.unrecognizedOption(OptionException.java:108)at joptsimple.OptionParser.handleLongOptionToken(OptionParser.java:510)at joptsimple.OptionParserState$2.handleArgument(OptionParserState.java:56)at joptsimple.OptionParser.parse(OptionParser.java:396)at kafka.admin.TopicCommand$TopicCommandOptions.<init>(TopicCommand.scala:567)at kafka.admin.TopicCommand$.main(TopicCommand.scala:47)at kafka.admin.TopicCommand.main(TopicCommand.scala)

五、查看Topic

进入Kafkabin目录,执行如下命令:

./kafka-topics.sh --bootstrap-server localhost:9092 --list# 2.2版本之前使用
./kafka-topics.sh --zookeeper localhost:2181 --list

执行结果:

javaTopic

六、删除Topic

./kafka-topics.sh --bootstrap-server localhost:9092 --delete -topic javaTopic# 2.2版本之前使用
./kafka-topics.sh --zookeeper localhost:2181 --delete -topic javaTopic

七、生产/消费数据

进入Kafkabin目录,打开两个终端,分别执行如下命令:

生产者命令:

./kafka-console-producer.sh --broker-list localhost:9092 --topic javaTopic# 2.2版本之前
./kafka-console-producer.sh --zookeeper localhost:9092 --topic javaTopic

消费者命令:

./kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic javaTopic# 2.2版本之前
./kafka-console-consumer.sh --zookeeper localhost:9092 --topic javaTopic

然后在生产者终端中随便输入,然后回车,在消费者终端界面出现生产者终端输入的内容,则说明消费成功。


八、查看消费组

./kafka-consumer-groups.sh --bootstrap-server localhost:9092 --list# 2.2版本之前使用
./kafka-consumer-groups.sh --zookeeper localhost:2181 --list

九、查看消费组详情

./kafka-consumer-groups.sh --new-consumer --bootstrap-server localhost:9092  --group test-consumer-group --describe
  • test-consumer-group:消费组名称。

本文来自互联网用户投稿,该文观点仅代表作者本人,不代表本站立场。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如若转载,请注明出处:http://www.mzph.cn/news/446685.shtml

如若内容造成侵权/违法违规/事实不符,请联系多彩编程网进行投诉反馈email:809451989@qq.com,一经查实,立即删除!

相关文章

C++primer第一章 开始

运算符打印endl,这是一个被称为操纵符(manipulator)的特殊值。写入endl 的效果是结束当前行&#xff0c;并将与设备关联的缓冲区(buffer)中的内容刷到设备中。缓冲刷新操作可以保证到目前为止程序所产生的所有输出都真正写入输出流中&#xff0c;而不是仅停留在内存中等待写入流…

codeforces 617A-C语言解题报告

617A题目网址 题目解析 1.输入x,能够通过1,2,3,4,5去到达x,求最小到达x的步数. 举例: 输入: 12 输出: 3 2.注意点: 要最小的步数,所以直接使用最大的5去比较判断 1)当x<5时,只需要1 2)当x>5时,如果x%50(x能整除5),只需要x/5步数,不能整除则需要x/51步数 代码 #inclu…

SpringBoot —— Bean的注入方式

文章目录1、组件注解2、Component Bean3、Import(PlaceHolderClass)快速导入一个组件4、使用Spring提供的FactoryBean注入1、组件注解 注解描述Component组件定义不清晰时候的注解Controller控制器层Service服务层Repository数据层 注&#xff1a;添加注解的类需要与启动类在…

如何保养电池

1&#xff0c;不要在低于0度和高于35度的范围下使用电池&#xff0c;尤其是高温环境下对电脑充电&#xff0c;对电池的破坏是不可逆转的。2&#xff0c;放电过于彻底或者充电过于饱和&#xff0c;也会对电池的容量造成损耗。BMS 调整电池的充放电3&#xff0c;电脑长期不用&…

codeforces 116A-C语言解题报告

116A题目网址 题目解析 1.输入n(n个循环),每一个循环-a,b;第一个循环只有b;最后一个循环只有-a;求其中在车上的最大人数? 举例: 输入: 4 0 3 2 5 4 2 4 0 输出: 6 2.注意点:因为使用count计数时,count一直在改变,所以再加入一个max变量去记录count中出现的最大数. 代码 #…

SpringBoot —— @ComponentScan注解

文章目录一、作用二、注解属性说明三、使用方式一、作用 主要是从定义的扫描路径中&#xff0c;找出标识了需要装配的类自动装配到Spring的bean容器中。 简单的说就是 ComponentScan告诉Spring从哪里找到bean&#xff0c;一旦指定了&#xff0c;Spring就会将指定的包及其下级…

硬盘 相关知识

磁盘存储数据于轨道上&#xff0c;为了防止数据不被干扰&#xff0c;轨道之间是存在间隙的。如果间隙越小存储的数据越多&#xff0c;但是对数据的写入和读取所使用的磁头是不一样的&#xff0c;写入的磁头比较宽&#xff0c;读取的磁头比较窄。叠瓦式硬盘&#xff0c;将轨道和…

Java 序列化反序列化框架比较

文章目录一、简介二、序列化框架1、JDK2、XML序列化3、JSON序列化4、Hessian5、Avro序列化6、Kyro序列化7、Protostuff三、序列化框架对比测试1、对象准备2、JDK方式3、FastJson方式4、Hessian方式5、Protostuff方式6、测试代码四、总结五、序列化应用场景六、注意事项一、简介…

C++primer 第 2 章 变量和基本类型

2.1 基本内置类型 算术类型&#xff08;arithmetictype&#xff09;和空类型&#xff08;void&#xff09;在内的基本数据类型。其中算术类型包含了字符、整型数、布尔值和浮点数。空类型不对应具体的值&#xff0c;仅用于一些特殊的场合&#xff0c;例如最常见的是&#xff0…

codeforces 58A-C语言解题报告

58A题目网址 题目解析 1.输入字符串,问如果删去其中的一些自发,能否得到hello,如果能就输出YES,否则输出NO 举例: 输入: ahhellllloou 输出: YES 2.注意点: 因为C语言没有java中的匹配字符串,则新建立一个 word[6]“hello”; 在循环中使用word去与s匹配,当匹配到了就 count…

ClickHouse 客户端命令

文章目录一、简介二、常用命令1、连接命令2、SQL语法&#xff08;1&#xff09;查看数据库列表&#xff08;2&#xff09;查看当前使用的数据库&#xff08;3&#xff09;查看数据库中表列表&#xff08;4&#xff09;创建数据库&#xff08;5&#xff09;创建表&#xff08;6&…

2000年考研英语阅读理解文章三

文章详细解析 注意点 1.当作者在文章中写到:实际问题是:我们从根本上改变了吗? 说明:我们没有发生根本上的改变,作者不同意前文中的未来派诗歌 知识点 ----单词 unhampered adj无阻碍的 finite adj有限的 ink n墨水 corresponding adj相应的,符合的 upsetting adj令人生厌…

SpringBoot 集成Mybatis

文章目录一、创建SpringBoot项目二、添加Mybatis相关依赖三、数据源配置四、创建事务的模型实体类五、创建和数据库交互联系的映射关系类六、创建业务接口和实现类七、创建控制器类八、请求验证一、创建SpringBoot项目 如何创建详见&#xff1a;IDEA 创建 SpringBoot 项目 二、…

C++primer 第 3 章 字符串、向量和数组 3.1 命名空间的using声明 3.2标准库类型string

引言 除了第2章介绍的内置类型之外,C语言还定义了 -个内容丰富的抽象数据类型库。其中,string和 vector是两种最重耍的标准库类型&#xff0c;前者支持可变长字符串&#xff0c;后者则 表示可变长的集合。还有…种标准库类型是迭代器&#xff0c;它是string和vector的配套类型…

ClickHouse 四舍五入函数

文章目录一、round(x[,N])二、floor(x[,N])三、ceil(x[,N]),ceiling(x[,N])四、trunc(x[, N]), truncate(x[, N])一、round(x[,N]) 说明&#xff1a;将值取整到指定的小数位数&#xff0c;该函数按顺序返回最近的数字。 语法&#xff1a; round(expression [, decimal_place…

codeforces 59A-C语言解题报告

59A题目网址 题目解析 1.输入字符串,如果大写字母最多,则全部输出为大写;如果小写字母多或大小写字母一样多,则全部输出为小写 举例: 输入: maTRIx 输出: matrix 2.使用a,b两个变量去记录大小写字母的数量 代码 #include<stdio.h> #include<stdlib.h> #includ…

C++primer 第 3 章 字符串、向量和数组 3 . 3 标准库类型vector

标准库类型vector表示对象的集合&#xff0c;其中所有对象的类型都相同。集合中的每个对象都有一个与之对应的索引&#xff0c;索引用于访问对象。因为vector"容纳着”其他对象&#xff0c;所以它也常被称作容器(container).第 II部将对容器进行更为详细的介绍。 要想使用…

SpringBoot AOP切面实现

文章目录一、AOP简介二、AOP体系与概念三、AOP实例1、创建SpringBoot工程2、添加依赖3、AOP相关注解3.1、Aspect3.2、Pointcut3.2.1、execution()3.2.2、annotation()3.3、Around3.4、Before3.5、After3.6、AfterReturning3.7、AfterThrowing一、AOP简介 AOP&#xff08;Aspec…

英语口语-文章朗读Week8 Friday

文章 It is a phenomenon that people are losing trust in each other in today’s society. Some people become selfish,and for interest, they are likely to betray their colleagues,friends, and even their relatives. They tend to cater to those who can benefit …

C++primer 第 3 章 字符串、向量和数组 3 . 4 迭代器介绍

3.4迭代器介绍 我们已经知道可以使用下标运算符来访问string对象的字符或vector对象的元素&#xff0c;还有另外一种更通用的机制也可以实现同样的目的&#xff0c;这就是迭代器&#xff08;iterator&#xff09;。在第II部分中将要介绍&#xff0c;除了vector之外&#xff0c…