Kafka

Hi Wenhao, I added you as a contributor in Jira, so you should now be able to assign issues to yourself etc. We normally discuss development of Kafka on the dev@kafka.apache.org mailing list. Thanks for your interest. Tom On Wed, Apr 28, 2021 at 3:39 PM Wenhao Ji < predator.ray@gmail.com > wrote: > Hi everyone, > > I am requesting to be added to the contributors list since I would like to > fix the bug KAFKA-7572. > Can somebody help with this? Thanks in advance! > > Wenhao >

Btw. Just now accomplished a working poc in dev using wso2 , confluent rest proxy , confluent schema registry, kafka Produce message to kafka via post http rest request בתאריך יום ד׳, 28 באפר׳ 2021, 06:42, מאת Ran Lupovich ‏< ranlupovich@gmail.com >: > Hi, have a look for Rest Proxy component as part of the kafka eco system > > בתאריך יום ד׳, 28 באפר׳ 2021, 01:27, מאת Reed Villanueva ‏< > villanuevareed@gmail.com >: > >> What is the best-practice/kafka way to get http(s) POST requests into a >> Kafka topic (kafka v2.0.0 installed on a HDP cluster)? >> Have never used kafka before and would like to know the best way that this >> should be done. >> Basically, we have a public URL that is going to receive requests from a >> specific external URL based on event hooks ( >> https://developers.acuityscheduling.com/docs/webhooks ) and I want to get >> these requests into a kafka topic. >>...

that article linked to apache error code, which tells you their meaning. https://kafka.apache.org/protocol.html#protocol_error_codes On Wed, Apr 28, 2021 at 6:44 AM Nikita Kretov < kretov995@gmail.com > wrote: > I'm doing little research about what metrics and formulas used to > calculate SLA for kafka clusters. I found that some of major cloud > providers offer managed kafka solutions. for example - aws msk (Amazon > Managed Streaming for Apache Kafka) > > Interestingly, aws msk SLA document defines ``Error``` as ```...any > Apache Kafka API Request that returns the 2, 8, 9, 15, 56, 72 error > codes, or an Apache Kafka API Request that upon retry returns the 19 and > 20 error codes as described in the Apache Kafka site...``` (from > https://aws.amazon.com/msk/sla/ ) > So my question is - Does someone know what's so special about this > specific error codes ? > > Thank you. >

I'm doing little research about what metrics and formulas used to calculate SLA for kafka clusters. I found that some of major cloud providers offer managed kafka solutions. for example - aws msk (Amazon Managed Streaming for Apache Kafka) Interestingly, aws msk SLA document defines ``Error``` as ```...any Apache Kafka API Request that returns the 2, 8, 9, 15, 56, 72 error codes, or an Apache Kafka API Request that upon retry returns the 19 and 20 error codes as described in the Apache Kafka site...``` (from https://aws.amazon.com/msk/sla/ ) So my question is - Does someone know what's so special about this specific error codes ? Thank you.

Hi Reed, Something will have to produce the POST request body into Kafka. We do this at the Wikimedia Foundation with a service called EventGate < https://github.com/wikimedia/eventgate >. I've got a 3 part blog series in which the 3rd entry < https://techblog.wikimedia.org/2020/09/24/wikimedias-event-data-platform-event-intake/ > explains how we use EventGate. -Andrew Otto SRE, Wikimedia Foundation On Tue, Apr 27, 2021 at 11:42 PM Ran Lupovich < ranlupovich@gmail.com > wrote: > Hi, have a look for Rest Proxy component as part of the kafka eco system > > בתאריך יום ד׳, 28 באפר׳ 2021, 01:27, מאת Reed Villanueva ‏< > villanuevareed@gmail.com >: > > > What is the best-practice/kafka way to get http(s) POST requests into a > > Kafka topic (kafka v2.0.0 installed on a HDP cluster)? > > Have never used kafka before and would like to know the best way that > this > > should be done. >...

Hi everyone, I am requesting to be added to the contributors list since I would like to fix the bug KAFKA-7572. Can somebody help with this? Thanks in advance! Wenhao

Hi, have a look for Rest Proxy component as part of the kafka eco system בתאריך יום ד׳, 28 באפר׳ 2021, 01:27, מאת Reed Villanueva ‏< villanuevareed@gmail.com >: > What is the best-practice/kafka way to get http(s) POST requests into a > Kafka topic (kafka v2.0.0 installed on a HDP cluster)? > Have never used kafka before and would like to know the best way that this > should be done. > Basically, we have a public URL that is going to receive requests from a > specific external URL based on event hooks ( > https://developers.acuityscheduling.com/docs/webhooks ) and I want to get > these requests into a kafka topic. > I've seen this ( https://docs.confluent.io/3.0.0/kafka-rest/docs/intro.html > ), > but am a bit confused (again, have never used kafka before). Will there > need to be an always-on producer to read from these event hooks to produce > into a topic? What is the best practice way to do this to account for ...