ICode9

精准搜索请尝试: 精确搜索
首页 > 其他分享> 文章详细

Docker搭建kafka

2022-05-03 03:00:49  阅读:182  来源: 互联网

标签:producer -- zookeeper kafka props Docker docker 搭建


一、拉取镜像

docker pull wurstmeister/zookeeper
docker pull wurstmeister/kafka

二、检查 docker-compose

docker-compose -v

三、创建 docker-compose.yml 文件

cd /data && mkdir docker-compose && cd docker-compose

touch docker-compose.yml

添加内容

version: '1'
services:
  zookeeper:
    image: "zookeeper"
    hostname: "zookeeper"
    container_name: "zookeeper"
  kafka:
    image: "wurstmeister/kafka"
    hostname: "kafka"
    container_name: "kafka"
    ports:
      - "9092:9092"
    environment:
      KAFKA_ADVERTISED_HOST_NAME: kafka
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
#设置网络,名为local
networks:
  local:
    driver: bridge

四、进入该文件所在目录执行

cd /data/docker-compose
docker-compose build

五、启动服务

docker-compose up -d

六、查看容器

docker ps

七、进入容器之中

docker exec -it kafka bash

八、创建topic

kafka-topics.sh --create --zookeeper zookeeper:2181 -replication-factor 1 --partitions 1 --topic mykafka

执行后输出 Created topic mykafka. 表示成功

九、查看topic

kafka-topics.sh --list --zookeeper zookeeper:2181

十、创建生产者

kafka-console-producer.sh --broker-list kafka:9092 --topic mykafka

十一、查看topic内容

kafka-console-consumer.sh --bootstrap-server kafka:9092 --topic mykafka --from-beginning

  

转载自:

https://www.jianshu.com/p/16e4fb821fa8

 

备注:

经常抛出 host kafka not found的问题,我的做法是更改 /etc/hosts 的域名配置文件,增加一行

127.0.0.1 kafka

我的验证的 java 脚本:

package com.example.one.kafka;
import java.util.Properties;
import org.apache.kafka.clients.producer.Producer;
import org.apache.kafka.clients.producer.KafkaProducer;
import org.apache.kafka.clients.producer.ProducerRecord;
import org.apache.kafka.common.serialization.StringSerializer;

// 示例地址: https://www.yiibai.com/kafka/apache_kafka_simple_producer_example.html
public class SimpleProducer {
    public static void main(String[] args) throws Exception {
        //Assign topicName to string variable
        String topicName = "mykafka";
        // create instance for properties to access producer configs
        Properties props = new Properties();
        //Assign localhost id
        props.put("bootstrap.servers", "localhost:9092");
        //Set acknowledgements for producer requests.
        props.put("acks", "all");
        //If the request fails, the producer can automatically retry,
        props.put("retries", 0);
        //Specify buffer size in config
        props.put("batch.size", 16384);
        //Reduce the no of requests less than 0
        props.put("linger.ms", 1);
        //The buffer.memory controls the total amount of memory available to the producer for buffering.
        props.put("buffer.memory", 33554432);
        props.put("key.serializer","org.apache.kafka.common.serialization.StringSerializer");
        props.put("value.serializer","org.apache.kafka.common.serialization.StringSerializer");

        Producer<String, String> producer = new KafkaProducer
                <String, String>(props);

        for (int i = 8; i < 19; i++)
            producer.send(new ProducerRecord<String, String>(topicName,
                    Integer.toString(i), Integer.toString(i)));
        System.out.println("Message sent successfully");
        producer.close();
    }
}

 

 

 

TRANSLATE with x English
Arabic Hebrew Polish
Bulgarian Hindi Portuguese
Catalan Hmong Daw Romanian
Chinese Simplified Hungarian Russian
Chinese Traditional Indonesian Slovak
Czech Italian Slovenian
Danish Japanese Spanish
Dutch Klingon Swedish
English Korean Thai
Estonian Latvian Turkish
Finnish Lithuanian Ukrainian
French Malay Urdu
German Maltese Vietnamese
Greek Norwegian Welsh
Haitian Creole Persian  
  TRANSLATE with COPY THE URL BELOW Back EMBED THE SNIPPET BELOW IN YOUR SITE Enable collaborative features and customize widget: Bing Webmaster Portal Back

标签:producer,--,zookeeper,kafka,props,Docker,docker,搭建
来源: https://www.cnblogs.com/xuweiqiang/p/16217546.html

本站声明: 1. iCode9 技术分享网(下文简称本站)提供的所有内容,仅供技术学习、探讨和分享;
2. 关于本站的所有留言、评论、转载及引用,纯属内容发起人的个人观点,与本站观点和立场无关;
3. 关于本站的所有言论和文字,纯属内容发起人的个人观点,与本站观点和立场无关;
4. 本站文章均是网友提供,不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属;如您发现该文章侵犯了您的权益,可联系我们第一时间进行删除;
5. 本站为非盈利性的个人网站,所有内容不会用来进行牟利,也不会利用任何形式的广告来间接获益,纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。

专注分享技术,共同学习,共同进步。侵权联系[81616952@qq.com]

Copyright (C)ICode9.com, All Rights Reserved.

ICode9版权所有