How to create a log trace and send to file in Kafka

Question: How can I create a trace log file in Kafka ? I want to set the logger level to TRACE , sending the trace details to a file. Answer: To change from the current Kafka Connect logging level to the TRACE , you'll need to edit the connect-log4j.properties and restart Connect edit - $(confluent_home)/etc/kafka/connect-log4j.properties log4j.rootLogger=TRACE, traceFile, stdout log4j.appender.traceFile=org.apache.log4j.DailyRollingFileAppender log4j.appender.traceFile.DatePattern='.'yyyy-MM-dd-HH log4j.appender.traceFile.File=/tmp/kafka-connect-trace.log log4j.appender.traceFile.layout=org.apache.log4j.PatternLayout log4j.appender.traceFile.layout.ConversionPattern=[%d] %p %m (%c)%n You'll need to restart Connect for the changes to take effect Read more →

How to Rock Apache Kafka with a cheat-sheet

This Apache Kafka cheat sheet covers regularly used commands across different deployments of Apache Kafka. --view error logs on Confluent Kafka confluent log connect tail -f --How to retrieve broker properties from a client step 1 - Enter zookeeper shell zookeeper-shell localhost:2181 step 2 - get /brokers/ids/0 --Check Confluent Current confluent current --Check Confluent version confluent version --List Connectors currently loaded confluent status connectors --List Kafka topics /bin/kafka-topics --zookeeper localhost:2181 --list --Delete a Kafka topic bin/kafka-topics --zookeeper localhost:2181/chroot --delete --topic my_topic_ --Set error logging to DEBUG level edit $(confluent_home)/etc/kafka/connect-log4j.properties log4j.rootLogger=DEBUG,stdout restart Connect --List configured Connectors curl localhost:8083/connectors Read more →