In chrome, I can right-click on the page and select "Translate to" and change to Chinese. I am Chinese too ， and I can use English, not bad.
------------------ 原始邮件 ------------------
发件人: "users" < xianshengziming@gmail.com >;
发送时间: 2023年2月1日(星期三) 中午1:07
收件人: "users"< users@kafka.apache.org >;
主题: Re: Some question about the kafka website language
To sunil chaudhari:Hi, You are right, but the configure is english that
are unimporment.
To Daniel Hinojosa：Hi, I'm from China. I'm interested in Chinese.
- About "Translate it" : It is a good way for "Translate to", but it
also has ...
Posts
To sunil chaudhari:Hi, You are right, but the configure is english that
are unimporment.
To Daniel Hinojosa：Hi, I'm from China. I'm interested in Chinese.
- About "Translate it" : It is a good way for "Translate to", but it
also has some porblem.If my English is not good, I have frequently
double click and then use it to translate.I think it is not enough
friendly to reader. If you are reading a long document (like this:
https://kafka.apache.org/documentation/#design ), the problem is more
serious.Better way is providing a native Language.
- About "no one has come forward to translate": I found some Chinese in
github contributor list.They may be would contribute this. At least we
should submit the idea to talk, and then look the how many people would to
join in.
sunil chaudhari < sunilmchaudhari05@gmail.com > 于2023年2月1日周三 01:16写道：
> I am just wondering even if you read document in you...
Hey folks, we found a couple of blockers with RC1 and have fixed them in
the latest release candidate, RC2.
The major features of this release include:
* KIP-881: Rack-aware Partition Assignment for Kafka Consumers
< https://cwiki.apache.org/confluence/display/KAFKA/KIP-881%3A+Rack-aware+Partition+Assignment+for+Kafka+Consumers >
* KIP-876: Time based cluster metadata snapshots
< https://cwiki.apache.org/confluence/display/KAFKA/KIP-876%3A+Time+based+cluster+metadata+snapshots >
* KIP-787: MM2 manage Kafka resources with custom Admin implementation.
< https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=191335620 >
* KIP-866 ZooKeeper to KRaft Migration
< https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration >
(Early
Access)
Release notes for the 3.4.0 release:
https://home.apache.org/~davidarthur/kafka-3.4.0-rc2/RELEASE_NOTES.html
Please download, test and vote by Friday, Februar...
I am just wondering even if you read document in your language, but
ultimately server.config and server.log will be in english only.. right?
On Tue, 31 Jan 2023 at 9:00 PM, Nengda Ouyang < xianshengziming@gmail.com >
wrote:
> I see the kafka website only have language version. Why doesn't provide
> other language.
>
I can only assume that no one has come forward to translate. You can in most browsers, translate the page. In Chrome, you can right-click on the page and select "Translate to" and change to whatever language you need. It may not be perfect but it would get you going. Here is a snapshot (Not sure if snapshots are allowed on this list). What language are you interested in? On Tue, Jan 31, 2023 at 8:32 AM Nengda Ouyang < xianshengziming@gmail.com > wrote: I mean our have English website .Why doesn't provide other language. >
I mean our have English website .Why doesn't provide other language.
>
I see the kafka website only have language version. Why doesn't provide
other language.
Nevermind,
https://github.com/spring-projects/spring-kafka is the place to raise this.
BR,
Jan
On Mon, Jan 30, 2023 at 1:33 PM Jan Hendriks < dahoc3150@gmail.com > wrote:
> Hi,
> we have issues with dependency convergence with Spring-Kafka-test and the
> maven enforcer plugin.
> A reproducer can be found at
> https://gist.github.com/DaHoC/67daf9a7cb90e8626dbe6a144e93fa16 - simply
> run "mvn clean install" in the folder of the provided pom.xml
> The divergences we encounter (probably not complete):
>
> [INFO] --- maven-enforcer-plugin:3.0.0-M3:enforce (enforce) @
> SpringKafkaDependencyIssue ---
> [WARNING]
> Dependency convergence error for org.scala-lang:scala-library:2.13.6 paths
> to dependency are:
> +-org.example:SpringKafkaDependencyIssue:1.0-SNAPSHOT
> +-org.springframework.kafka:spring-kafka-test:2.8.11
> +-org.apache.kafka:kafka_2.13:3.1.2
> +-org.scala-lang:scala-library:...
Hi Fuxin,
I've created your JIRA account with the preferred username and email
address you provided.
You have the "contributors" role, so you should be able to self-assign
tickets going forward.
Thanks for your interest in Apache Kafka.
-Bill
On Mon, Jan 30, 2023 at 5:13 AM Fuxin Hao < haofxpro@gmail.com > wrote:
> Hi,
>
> Sorry for bothering you. I want to create a Jira ticket to report a bug but
> seems like public signups are disabled. could you help me get a new Jira
> account? Thanks.
>
> email address: haofxpro@gmail.com
> preferred username: haofuxin
> alternate username: fuxinhao
> display name: Fuxin Hao
>
> Thanks in advance,
> Best Regards,
> Fuxin Hao
>
Hi,
we have issues with dependency convergence with Spring-Kafka-test and the
maven enforcer plugin.
A reproducer can be found at
https://gist.github.com/DaHoC/67daf9a7cb90e8626dbe6a144e93fa16 - simply run
"mvn clean install" in the folder of the provided pom.xml
The divergences we encounter (probably not complete):
[INFO] --- maven-enforcer-plugin:3.0.0-M3:enforce (enforce) @
SpringKafkaDependencyIssue ---
[WARNING]
Dependency convergence error for org.scala-lang:scala-library:2.13.6 paths
to dependency are:
+-org.example:SpringKafkaDependencyIssue:1.0-SNAPSHOT
+-org.springframework.kafka:spring-kafka-test:2.8.11
+-org.apache.kafka:kafka_2.13:3.1.2
+-org.scala-lang:scala-library:2.13.6
and
+-org.example:SpringKafkaDependencyIssue:1.0-SNAPSHOT
+-org.springframework.kafka:spring-kafka-test:2.8.11
+-org.apache.kafka:kafka_2.13:3.1.2
+-com.fasterxml.jackson.module:jackson-module-scala_2.13:2.13.4
+-org.scala-lang:scala-libr...
Hi,
Sorry for bothering you. I want to create a Jira ticket to report a bug but
seems like public signups are disabled. could you help me get a new Jira
account? Thanks.
email address: haofxpro@gmail.com
preferred username: haofuxin
alternate username: fuxinhao
display name: Fuxin Hao
Thanks in advance,
Best Regards,
Fuxin Hao
Hi Sunil,
Yes. I use the default server config file that came with the tarball.
JAVA_HOME is set properly too.
I also tried to switch from jdk 17 and jdk 11 to see if that helps and that
still didn't work.
echo $JAVA_HOME
/opt/homebrew/Cellar/openjdk@11/11.0.18/libexec/openjdk.jdk/Contents/Home
On Mon, Jan 30, 2023, 6:23 AM sunil chaudhari < sunilmchaudhari05@gmail.com >
wrote:
> So did you provided server.properties properly?
> Check if property file exists at location.
> JAVA_HOME os availble?
>
> Regards,
> Sunil.
>
> On Mon, 30 Jan 2023 at 4:47 AM, xiao cheng < xiaocheng.2016@gmail.com >
> wrote:
>
> > Hi Sunil,
> > bin/kafka-server-start.sh --help give me output of
> >
> > bin/kafka-server-start.sh --help
> >
> > [2023-01-30 00:14:32,122] INFO Registered
> kafka:type=kafka.Log4jController
> > MBean (kafka.utils.Log4jControllerRegistration$)
> >
...
So did you provided server.properties properly?
Check if property file exists at location.
JAVA_HOME os availble?
Regards,
Sunil.
On Mon, 30 Jan 2023 at 4:47 AM, xiao cheng < xiaocheng.2016@gmail.com > wrote:
> Hi Sunil,
> bin/kafka-server-start.sh --help give me output of
>
> bin/kafka-server-start.sh --help
>
> [2023-01-30 00:14:32,122] INFO Registered kafka:type=kafka.Log4jController
> MBean (kafka.utils.Log4jControllerRegistration$)
>
> USAGE: java [options] kafka.Kafka server.properties [--override
> property=value]*
>
> Option Description
>
> ------ -----------
>
> --override <String> Optional property that should override values set in
>
> server.properties file
>
> --version Print version information and exit.
>
>
>
>
> On Sat, Jan 28, 2023 at 12:58 AM sunil chaudhari <
> sunilmchaudhari0...
Yes you can. data replication is in async mode.
On Mon, Jan 30, 2023 at 12:27 AM 大雁小鱼 <747121521@qq.com.invalid> wrote:
> Can producers send messages if all brokers in a Kafka cluster are unable
> to communicate with each other while the connection between brokers and
> Zookeeper is normal? Thanks for answering.
Hi Sunil,
bin/kafka-server-start.sh --help give me output of
bin/kafka-server-start.sh --help
[2023-01-30 00:14:32,122] INFO Registered kafka:type=kafka.Log4jController
MBean (kafka.utils.Log4jControllerRegistration$)
USAGE: java [options] kafka.Kafka server.properties [--override
property=value]*
Option Description
------ -----------
--override <String> Optional property that should override values set in
server.properties file
--version Print version information and exit.
On Sat, Jan 28, 2023 at 12:58 AM sunil chaudhari <
sunilmchaudhari05@gmail.com > wrote:
> Please try executing..
>
> bin/kafka-server-start.sh —help
>
>
>
> On Fri, 27 Jan 2023 at 8:47 PM, xiao cheng < xiaocheng.2016@gmail.com >
> wrote:
>
> > Hey all,
> >
> > I recently tried to run kafka locally on my macos again after a while (it
> ...
Can producers send messages if all brokers in a Kafka cluster are unable to communicate with each other while the connection between brokers and Zookeeper is normal? Thanks for answering.
OK, I've made it work.
Steps to fix:
+ Build https://github.com/a0x8o/kafka < https://github.com/a0x8o/kafka >
+ Collect the "connect-file-3.5.0-SNAPSHOT.jar"
+ Update the "plugin.path" in "connect-distributed.properties" to the directory containing that jar file
+ Start Kafka Connect
+ The connector name is "FileStreamSource" instead of "FileStream-Source" (The hyphen comes from the book)
---
See https://docs.confluent.io/platform/current/connect/filestream_connector.html#kconnect-long-filestream-connectors < https://docs.confluent.io/platform/current/connect/filestream_connector.html#kconnect-long-filestream-connectors > to understand why "connect-file.jar" is not included
> On 28 Jan 2023, at 22:36, Hieu Nguyen < emerald.hieu@gmail.com > wrote:
>
> Hello,
>
> I'm reading the book "Kafka: The Definitive Guide: Real-Time Data and Stream Processing at Scale...
Hieu,
The FileStreamSource and FileStreamSink (no hyphen) connectors are no
longer included on the classpath by default since minor version 3.2.0 (and
some earlier patch releases) due to security concerns.
See the release notes that mention this, and contain a workaround here:
https://kafka.apache.org/32/documentation.html#upgrade_320_notable .
See the internal issue for this change here:
https://issues.apache.org/jira/browse/KAFKA-13748
I hope this helps,
Greg Harris
On Sat, Jan 28, 2023 at 7:36 AM Hieu Nguyen < emerald.hieu@gmail.com > wrote:
> Hello,
>
> I'm reading the book "Kafka: The Definitive Guide: Real-Time Data and
> Stream Processing at Scale" by by Neha Narkhede, Gwen Shapira, and Todd
> Palino.
>
> In the chapter "Kafka Connect", section "Connector Example: File Source
> and File Sink", I run the below command and got the missing connector error.
>
> hieunguyenduc@hieugioi ...
Hello,
I'm reading the book "Kafka: The Definitive Guide: Real-Time Data and Stream Processing at Scale" by by Neha Narkhede, Gwen Shapira, and Todd Palino.
In the chapter "Kafka Connect", section "Connector Example: File Source and File Sink", I run the below command and got the missing connector error.
hieunguyenduc@hieugioi kafka_2.13-3.3.1 % echo '{"name":"load-kafka-config", "config":{"connector.class":"FileStream-Source","file":"config/server.properties","topic":"kafka-config-topic"}}' | curl -X POST -d @- http://localhost:8083/connectors --header "Content-Type:application/json"
{"error_code":500,"message":"Failed to find any class that implements Connector and which name matches FileStream-Source, available connectors are: PluginDesc{klass=class org.apache.kafka.connect.mirror.MirrorCheckpointConnector,...
Please try executing..
bin/kafka-server-start.sh —help
On Fri, 27 Jan 2023 at 8:47 PM, xiao cheng < xiaocheng.2016@gmail.com > wrote:
> Hey all,
>
> I recently tried to run kafka locally on my macos again after a while (it
> used to work). I followed the quickstart guide from
> https://kafka.apache.org/quickstart .
>
> However, when I try to run it (bin/kafka-server-start.sh
> config/server.properties) again today I am seeing error message of
> [2023-01-27 15:39:11,900] ERROR Encountered an error while configuring the
> connection, closing it. (kafka.network.DataPlaneAcceptor)
> java.net.SocketException: Invalid argument
> at java.base/sun.nio.ch.Net.setIntOption0(Native Method)
> at java.base/sun.nio.ch.Net.setSocketOption(Net.java:455)
> at java.base/sun.nio.ch.Net.setSocketOption(Net.java:393)
> at
> java.base/ sun.nio.ch
> .SocketChannelImpl.setOption(SocketChannelImpl.java:280)
> at
> ja...
I can look at the pom files and see the recommended versions of Kafka with Ranger. However, I would like to upgrade Kafka. Does anyone have any experience upgrading Kafka but keeping Ranger on an older version, say 1.2?
Best Regards,
Douglas Whitfield | Enterprise Architect, OpenLogic< https://www.openlogic.com/?utm_leadsource=email-signature&utm_source=outlook-direct-email&utm_medium=email&utm_campaign=2019-common&utm_content=email-signature-link >
This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.
hi,
there is a kafka connector for weblogic.
https://docs.confluent.io/kafka-connectors/weblogic-source/current/overview.html < https://docs.confluent.io/kafka-connectors/weblogic-source/current/overview.html >
greetings,
Andreas
> Op 27 jan. 2023, om 16:55 heeft Olamide Sode < sodeolamide@gmail.com > het volgende geschreven:
>
> Hi,
>
> I am looking for an architecture that uses kafka to integrate with an
> Oracle Cloud Infrastructure Legacy system that runs a weblogic server as
> the application server.
>
> Would be great if I can be pointed to a starting guide or direction?
>
> Thank you.
>
> Ola
Hi,
I am looking for an architecture that uses kafka to integrate with an
Oracle Cloud Infrastructure Legacy system that runs a weblogic server as
the application server.
Would be great if I can be pointed to a starting guide or direction?
Thank you.
Ola
Hey all,
I recently tried to run kafka locally on my macos again after a while (it
used to work). I followed the quickstart guide from
https://kafka.apache.org/quickstart .
However, when I try to run it (bin/kafka-server-start.sh
config/server.properties) again today I am seeing error message of
[2023-01-27 15:39:11,900] ERROR Encountered an error while configuring the
connection, closing it. (kafka.network.DataPlaneAcceptor)
java.net.SocketException: Invalid argument
at java.base/sun.nio.ch.Net.setIntOption0(Native Method)
at java.base/sun.nio.ch.Net.setSocketOption(Net.java:455)
at java.base/sun.nio.ch.Net.setSocketOption(Net.java:393)
at
java.base/sun.nio.ch.SocketChannelImpl.setOption(SocketChannelImpl.java:280)
at
java.base/sun.nio.ch.SocketAdaptor.setBooleanOption(SocketAdaptor.java:237)
at java.base/sun.nio.ch.SocketAdaptor.setTcpNoDelay(SocketAdaptor.java:273)
at
kafka.network.Acceptor.configureAcceptedSocketChannel(SocketServer.scala:759)
at kafka.networ...
Thanks for running the release Chris!
On Mon, Jan 23, 2023 at 5:18 PM Chris Egerton < cegerton@apache.org > wrote:
> The Apache Kafka community is pleased to announce the release for Apache
> Kafka 3.3.2
>
> Apache Kafka 3.3.2 is a bugfix release and it contains, among other things,
> fixes for 20 issues reported since 3.3.1.
>
> All of the changes in this release can be found in the release notes:
> https://www.apache.org/dist/kafka/3.3.2/RELEASE_NOTES.html
>
>
> You can download the source and binary release (Scala 2.12 and 2.13) from:
> https://kafka.apache.org/downloads#3.3.2
>
>
> ---------------------------------------------------------------------------------------------------
>
>
> Apache Kafka is a distributed streaming platform with four core APIs:
>
>
> ** The Producer API allows an application to publish a stream of records to
> one or more Kafka topics.
>
> ** The C...
Do you have a great data streaming story to share?
We want to hear from you!
Speaking at Current 2023 is a great way to connect with hundreds of your
peers, become more involved in the data streaming community, and have a
public platform for you to share your story of the future of streaming and
real-time data.
Check out the details at the link below and share your CFP with us
https://sessionize.com/current-2023/
Important Dates:
Call for Papers opens: January 12, 2023
Speaker Office Hours:
Wednesday, February 1: 10:00 - 11:00 GMT and 11:00 - 12:00 PST
Wednesday, March 8: 10:00 - 11:00 GMT and 11:00 - 12:00 PST
Wednesday, March 15: 10:00 - 11:00 GMT and 11:00 - 12:00 PST
Call for Papers closes: March 20, 2023
Speaker Notifications sent: April 18, 2023
Questions? Please email speakers@currentevent.io
We are waiting to hear from you.
Hello,
I was wondering if anybody has seen the following:
I have a topic with about 200 partitions and with a replication factor of
3. Once in a while I am seeing a partition or two lose a replica. That is
the replica list for those partitions goes from 3 to 2 brokers. Kafka does
not see anything wrong, all the kafka brokers seem healthy, and I don't see
any errors in the logs. The topic still has a replication of 3. To fix
this I have to create a partition reassignment plan and add back the third
replica.
Has anybody seen anything similar?
Thanks!
ttyl
Dima
--
ddbrodsky@gmail.com
"The price of reliability is the pursuit of the utmost simplicity.
It is a price which the very rich find the most hard to pay."
(Sir
Antony Hoare, 1980)
Yeah, work around we've come up with is to use the Processor.init() method. We confirmed that this is only called once all state stores for used by that processor have been fully restored. From there, we iterate over the entire store and (re)build our tracking map. It seems to work well and is performant enough thus far! Thanks for your help. Cheers, Upesh Upesh Desai | Senior Software Developer | udesai@itrsgroup.com www.itrsgroup.com From: Matthias J. Sax <mjsax@apache.org> Date: Monday, January 23, 2023 at 8:05 PM To: users@kafka.apache.org <users@kafka.apache.org> Subject: Re: Custom Kafka Streams State Restore Logic Thanks. I agree. Seems your options are limited. The API is not really a good fix for what you want to do... Sorry. -Matthias On 1/18/23 7:48 AM, Upesh Desai wrote: > Hi Matthias, thanks for your reply! Sure, so the use case is as follows. ...
Thanks.
I agree. Seems your options are limited. The API is not really a good
fix for what you want to do... Sorry.
-Matthias
On 1/18/23 7:48 AM, Upesh Desai wrote:
> Hi Matthias, thanks for your reply! Sure, so the use case is as follows.
>
> We currently store some time series data in the state store, and it is
> stored to a changelog as well. The time series data is bucketed (5
> minutes, 1 hour, and 1 day). Our goal was to always only have a max of 2
> time buckets in the store at once. As we receive new timeseries data, we
> figure out what time bucket it belongs to, and add it to its respective
> bucket. We have a "grace period" which allows for late arriving data to
> be processed even after a time bucket has ended. That's the reason why
> we have this constraint of 2 time buckets max within the store; 1 for
> the previous bucket in its grace period, 1 for the current bucket.
>
> So we wanted ...
The Apache Kafka community is pleased to announce the release for Apache
Kafka 3.3.2
Apache Kafka 3.3.2 is a bugfix release and it contains, among other things,
fixes for 20 issues reported since 3.3.1.
All of the changes in this release can be found in the release notes:
https://www.apache.org/dist/kafka/3.3.2/RELEASE_NOTES.html
You can download the source and binary release (Scala 2.12 and 2.13) from:
https://kafka.apache.org/downloads#3.3.2
---------------------------------------------------------------------------------------------------
Apache Kafka is a distributed streaming platform with four core APIs:
** The Producer API allows an application to publish a stream of records to
one or more Kafka topics.
** The Consumer API allows an application to subscribe to one or more
topics and process the stream of records produced to them.
** The Streams API allows an application to act as a stream processor,
consuming an input stream from one or mor...
Hi Titouan,
I've added you to our Jira project; you should be good to go now.
Cheers,
Chris
On Mon, Jan 23, 2023 at 10:41 AM Titouan Chary < titouan.chary@gmail.com >
wrote:
> Hi,
>
> It seems that JIRA access are disabled by default. Is it the right email to
> reach out in order to get a new JIRA account. I would like to participate
> and give additional data points to the following ticket:
> https://issues.apache.org/jira/browse/KAFKA-13077
>
> Thanks in advance,
> Regards,
> Titouan Chary
>
Hi,
It seems that JIRA access are disabled by default. Is it the right email to
reach out in order to get a new JIRA account. I would like to participate
and give additional data points to the following ticket:
https://issues.apache.org/jira/browse/KAFKA-13077
Thanks in advance,
Regards,
Titouan Chary
Ok, thanks Divij, I will check it.
---
Thanks & Regards,
Kunal Jadhav
On Mon, Jan 16, 2023 at 7:47 PM Divij Vaidya < divijvaidya13@gmail.com >
wrote:
> Hey Kunal
>
> The stack trace you provided for the broker is from a non-controller node.
> The actual error occurs at the controller while processing the
> AllocateProduceIds API. Could you please check the controller at that time
> and let us know what kind of errors you see over there which are correlated
> with this time frame?
>
> Thanks!
>
> Regards,
> Divij Vaidya
>
>
>
> On Thu, Jan 12, 2023 at 3:13 PM Kunal Jadhav
> <kunal.jadhav@nciportal.com.invalid> wrote:
>
> > Hello All,
> >
> > We are facing some issues in the 3.2.3 kafka version cluster. We have
> > implemented 3 brokers cluster on a single node server in the kubernetes
> > environment. After every week are facing issues which are listed ...
Hi all.
We've faced strange broker behaviour in our cluster and are out of thoughts
now what could cause it now. One of the brokers is always entering stage
with ~90% CPU usage and 5-30% CPU throttling without any visible reason. We
have 5 broker cluster with 1 KRaft controller using the latest 3.3.1
release (Bitnami docker images in K8s).
All the brokers have 1000-1500 topics with 1 partition each and replication
factor 1. K8s pods are configured to have 10GiB heap size and 6 CPUs.
Thread states almost do not change (runnable-blocked-etc), just CPU usage
increases. Network idle is around 76%. We have 10 producers (6 working
mostly at a constant rate, others via periodic tasks so distribution is not
normal for them), and 20 consumers (4 of them consuming the most).
Distribution for data load is per 10m: broker IN bytes 19% (250 MiB),
broker OUT bytes 81% (1.6GiB), active topics receiving publishes 44%
(~900), active topics fetched by consumers 66% (~1200).
The ...
Hello Kafka users, developers and client-developers,
This is the first candidate for release of Apache Kafka 3.4.0. Some of the
major features include:
* KIP-881: Rack-aware Partition Assignment for Kafka Consumers
<
https://cwiki.apache.org/confluence/display/KAFKA/KIP-881%3A+Rack-aware+Partition+Assignment+for+Kafka+Consumers >
(protocol changes only)
* KIP-876: Time based cluster metadata snapshots
<
https://cwiki.apache.org/confluence/display/KAFKA/KIP-876%3A+Time+based+cluster+metadata+snapshots
>
* KIP-787: MM2 manage Kafka resources with custom Admin implementation.
< https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=191335620 >
* KIP-866 ZooKeeper to KRaft Migration
<
https://cwiki.apache.org/confluence/display/KAFKA/KIP-866+ZooKeeper+to+KRaft+Migration
>
(Early
Access)
For a full list of the features in this release, please refer to the
release notes:
https://home.apache.org/~ableegoldman/kafka-3.4.0-rc1...