I updated zookeeper's process
1. Update conf/ zoo.cfg Configure the configuration of two new server nodes
2. Add myid under dataDir
3. Restart the existing zookeeper node
4. Start the other two zookeeper nodes
5. The existing zookeeper node is changed from stand-alone to leader
zookeeper version 3.4.14-4
kafka version 2.3.0
This is part of the log：
[2020-08-28 08:43:23,872] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x5 zxid:0x2000005e0 txnt ype:-1 reqpath:n/a Error Path:/brokers/topics Error:KeeperErrorCode = NodeExists for /brokers/topics (org.apache.zookeeper.server.PrepRequestProcesso r)
181 [2020-08-28 08:43:23,945] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x6 zxid:0x2000005e1 txnt ype:-1 reqpath:n/a Error Path:/config/changes Error:KeeperErrorCode = NodeExists for /config/changes (org.apache.zookeeper.server.PrepRequestProcesso r)
182 [2020-08-28 08:43:24,018] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x7 zxid:0x2000005e2 txnt ype:-1 reqpath:n/a Error Path:/admin/delete_topics Error:KeeperErrorCode = NodeExists for /admin/delete_topics (org.apache.zookeeper.server.PrepReque stProcessor)
183 [2020-08-28 08:43:24,092] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x8 zxid:0x2000005e3 txnt ype:-1 reqpath:n/a Error Path:/brokers/seqid Error:KeeperErrorCode = NodeExists for /brokers/seqid (org.apache.zookeeper.server.PrepRequestProcessor)
184 [2020-08-28 08:43:24,166] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x9 zxid:0x2000005e4 txnt ype:-1 reqpath:n/a Error Path:/isr_change_notification Error:KeeperErrorCode = NodeExists for /isr_change_notification (org.apache.zookeeper.server.P repRequestProcessor)
185 [2020-08-28 08:43:24,240] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xa zxid:0x2000005e5 txnt ype:-1 reqpath:n/a Error Path:/latest_producer_id_block Error:KeeperErrorCode = NodeExists for /latest_producer_id_block (org.apache.zookeeper.server .PrepRequestProcessor)
186 [2020-08-28 08:43:24,313] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xb zxid:0x2000005e6 txnt ype:-1 reqpath:n/a Error Path:/log_dir_event_notification Error:KeeperErrorCode = NodeExists for /log_dir_event_notification (org.apache.zookeeper.se rver.PrepRequestProcessor)
187 [2020-08-28 08:43:24,388] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xc zxid:0x2000005e7 txnt ype:-1 reqpath:n/a Error Path:/config/topics Error:KeeperErrorCode = NodeExists for /config/topics (org.apache.zookeeper.server.PrepRequestProcessor)
188 [2020-08-28 08:43:24,461] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xd zxid:0x2000005e8 txnt ype:-1 reqpath:n/a Error Path:/config/clients Error:KeeperErrorCode = NodeExists for /config/clients (org.apache.zookeeper.server.PrepRequestProcesso r)
189 [2020-08-28 08:43:24,534] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xe zxid:0x2000005e9 txnt ype:-1 reqpath:n/a Error Path:/config/users Error:KeeperErrorCode = NodeExists for /config/users (org.apache.zookeeper.server.PrepRequestProcessor)
190 [2020-08-28 08:43:24,607] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xf zxid:0x2000005ea txnt ype:-1 reqpath:n/a Error Path:/config/brokers Error:KeeperErrorCode = NodeExists for /config/brokers (org.apache.zookeeper.server.PrepRequestProcesso r)
191 [2020-08-28 08:45:03,991] WARN Connection broken for id 74, my id = 185, error = (org.apache.zookeeper.server.quorum.QuorumCnxManager)
192 java.io.EOFException
193 at java.io.DataInputStream.readInt(DataInputStream.java:392)
194 at org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:1010)
195 [2020-08-28 08:45:03,991] WARN Interrupting SendWorker (org.apache.zookeeper.server.quorum.QuorumCnxManager)
196 [2020-08-28 08:45:03,991] WARN Interrupted while waiting for message on queue (org.apache.zookeeper.server.quorum.QuorumCnxManager)
197 java.lang.InterruptedException
198 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
Thanks for your help!
________________________________
发件人: Manoj.Agrawal2@cognizant.com <Manoj.Agrawal2@cognizant.com>
发送时间: 2020年8月29日 0:01
收件人: users@kafka.apache.org <users@kafka.apache.org>
主题: Re: Kafka cluster cannot connect to zookeeper
You have'nt describe how you are adding zookeeper .
Right way to add zookeeper
One host at a time
1. update the existing zookeeper node conf/zoo.cfg by adding new host
2. restart the zk process on existing host
3. start the zk process in new node
On 8/28/20, 8:20 AM, "Li,Dingqun" <lidingqun@agora.io> wrote:
[External]
We have one zookeeper node and two Kafka nodes. After that, we expand the capacity of zookeeper: change the configuration of zookeeper node, restart it, and add two zookeeper nodes. After that, my Kafka cluster could not connect to the zookeeper cluster, and there was no information available in the log.
What should we do? Thank you
This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient(s), please reply to the sender and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or any action taken in reliance on the contents of this e-mail is strictly prohibited and may be unlawful. Where permitted by applicable law, this e-mail and other e-mail communications sent to and from Cognizant e-mail addresses may be monitored.
This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient(s), please reply to the sender and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or any action taken in reliance on the contents of this e-mail is strictly prohibited and may be unlawful. Where permitted by applicable law, this e-mail and other e-mail communications sent to and from Cognizant e-mail addresses may be monitored.
1. Update conf/ zoo.cfg Configure the configuration of two new server nodes
2. Add myid under dataDir
3. Restart the existing zookeeper node
4. Start the other two zookeeper nodes
5. The existing zookeeper node is changed from stand-alone to leader
zookeeper version 3.4.14-4
kafka version 2.3.0
This is part of the log：
[2020-08-28 08:43:23,872] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x5 zxid:0x2000005e0 txnt ype:-1 reqpath:n/a Error Path:/brokers/topics Error:KeeperErrorCode = NodeExists for /brokers/topics (org.apache.zookeeper.server.PrepRequestProcesso r)
181 [2020-08-28 08:43:23,945] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x6 zxid:0x2000005e1 txnt ype:-1 reqpath:n/a Error Path:/config/changes Error:KeeperErrorCode = NodeExists for /config/changes (org.apache.zookeeper.server.PrepRequestProcesso r)
182 [2020-08-28 08:43:24,018] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x7 zxid:0x2000005e2 txnt ype:-1 reqpath:n/a Error Path:/admin/delete_topics Error:KeeperErrorCode = NodeExists for /admin/delete_topics (org.apache.zookeeper.server.PrepReque stProcessor)
183 [2020-08-28 08:43:24,092] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x8 zxid:0x2000005e3 txnt ype:-1 reqpath:n/a Error Path:/brokers/seqid Error:KeeperErrorCode = NodeExists for /brokers/seqid (org.apache.zookeeper.server.PrepRequestProcessor)
184 [2020-08-28 08:43:24,166] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x9 zxid:0x2000005e4 txnt ype:-1 reqpath:n/a Error Path:/isr_change_notification Error:KeeperErrorCode = NodeExists for /isr_change_notification (org.apache.zookeeper.server.P repRequestProcessor)
185 [2020-08-28 08:43:24,240] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xa zxid:0x2000005e5 txnt ype:-1 reqpath:n/a Error Path:/latest_producer_id_block Error:KeeperErrorCode = NodeExists for /latest_producer_id_block (org.apache.zookeeper.server .PrepRequestProcessor)
186 [2020-08-28 08:43:24,313] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xb zxid:0x2000005e6 txnt ype:-1 reqpath:n/a Error Path:/log_dir_event_notification Error:KeeperErrorCode = NodeExists for /log_dir_event_notification (org.apache.zookeeper.se rver.PrepRequestProcessor)
187 [2020-08-28 08:43:24,388] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xc zxid:0x2000005e7 txnt ype:-1 reqpath:n/a Error Path:/config/topics Error:KeeperErrorCode = NodeExists for /config/topics (org.apache.zookeeper.server.PrepRequestProcessor)
188 [2020-08-28 08:43:24,461] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xd zxid:0x2000005e8 txnt ype:-1 reqpath:n/a Error Path:/config/clients Error:KeeperErrorCode = NodeExists for /config/clients (org.apache.zookeeper.server.PrepRequestProcesso r)
189 [2020-08-28 08:43:24,534] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xe zxid:0x2000005e9 txnt ype:-1 reqpath:n/a Error Path:/config/users Error:KeeperErrorCode = NodeExists for /config/users (org.apache.zookeeper.server.PrepRequestProcessor)
190 [2020-08-28 08:43:24,607] INFO Got user-level KeeperException when processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xf zxid:0x2000005ea txnt ype:-1 reqpath:n/a Error Path:/config/brokers Error:KeeperErrorCode = NodeExists for /config/brokers (org.apache.zookeeper.server.PrepRequestProcesso r)
191 [2020-08-28 08:45:03,991] WARN Connection broken for id 74, my id = 185, error = (org.apache.zookeeper.server.quorum.QuorumCnxManager)
192 java.io.EOFException
193 at java.io.DataInputStream.readInt(DataInputStream.java:392)
194 at org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:1010)
195 [2020-08-28 08:45:03,991] WARN Interrupting SendWorker (org.apache.zookeeper.server.quorum.QuorumCnxManager)
196 [2020-08-28 08:45:03,991] WARN Interrupted while waiting for message on queue (org.apache.zookeeper.server.quorum.QuorumCnxManager)
197 java.lang.InterruptedException
198 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
Thanks for your help!
________________________________
发件人: Manoj.Agrawal2@cognizant.com <Manoj.Agrawal2@cognizant.com>
发送时间: 2020年8月29日 0:01
收件人: users@kafka.apache.org <users@kafka.apache.org>
主题: Re: Kafka cluster cannot connect to zookeeper
You have'nt describe how you are adding zookeeper .
Right way to add zookeeper
One host at a time
1. update the existing zookeeper node conf/zoo.cfg by adding new host
2. restart the zk process on existing host
3. start the zk process in new node
On 8/28/20, 8:20 AM, "Li,Dingqun" <lidingqun@agora.io> wrote:
[External]
We have one zookeeper node and two Kafka nodes. After that, we expand the capacity of zookeeper: change the configuration of zookeeper node, restart it, and add two zookeeper nodes. After that, my Kafka cluster could not connect to the zookeeper cluster, and there was no information available in the log.
What should we do? Thank you
This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient(s), please reply to the sender and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or any action taken in reliance on the contents of this e-mail is strictly prohibited and may be unlawful. Where permitted by applicable law, this e-mail and other e-mail communications sent to and from Cognizant e-mail addresses may be monitored.
This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient(s), please reply to the sender and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or any action taken in reliance on the contents of this e-mail is strictly prohibited and may be unlawful. Where permitted by applicable law, this e-mail and other e-mail communications sent to and from Cognizant e-mail addresses may be monitored.
Comments
Post a Comment