Breaking News: Grepper is joining You.com. Read the official announcement!

Use Avro

Pragya Keshap answered on February 11, 2023 Popularity 2/10 Helpfulness 1/10

answer Use Avro

Use Avro

Comment

By using Avro we are able to read the data from disk with applications written in other languages besides Java or the JVM.

Also, Avro allows us to transfer data across a remote system without any overhead of java serialization.

{
"namespace": "io.github.fernanda.maia.kafka.avro",
"type": "record",
"name": "Track",
"fields": [
{ "name": "id", "type": "long"},
{ "name": "latitude", "type": "string"},
{ "name": "longitude", "type": "string"}
]
}
// TrackProducer.java
import io.confluent.kafka.serializers.KafkaAvroSerializer;
import io.github.fernanda.maia.kafka.avro.Track;
import org.apache.kafka.clients.producer.KafkaProducer;
import org.apache.kafka.clients.producer.ProducerRecord;
import java.util.Properties;
public class TrackProducer {
public static void main(String[] args) {
Properties props = new Properties();
props.setProperty("bootstrap.servers", "http://localhost:9092");
props.setProperty("key.serializer", KafkaAvroSerializer.class.getName());
props.setProperty("value.serializer",
KafkaAvroSerializer.class.getName());
props.setProperty("schema.registry.url", "http://localhost:8081");
try(KafkaProducer<Long, Track> producer = new
KafkaProducer<>(props)) {
Track track = Track.newBuilder()
.setId(1L)
.setLatitude("20.576N")
.setLongitude("89.3639E")
.build();
ProducerRecord<Long, Track> record = new
ProducerRecord<>("TrackAvroTopic", track.getId(), track);
producer.send(record);
} catch(Exception e) {
e.printStackTrace();
}
}
}
// TrackConsumer.java
import io.confluent.kafka.serializers.KafkaAvroDeserializer;
import io.github.fernanda.maia.kafka.avro.Track;
import org.apache.kafka.clients.consumer.ConsumerRecords;
import org.apache.kafka.clients.consumer.KafkaConsumer;
import java.time.Duration;
import java.util.Arrays;
import java.util.Properties;
public class TrackConsumer {
public static void main(String[] args) {
Properties props = new Properties();
props.setProperty("bootstrap.servers", "http://localhost:9092");
props.setProperty("key.deserializer",
KafkaAvroDeserializer.class.getName());
props.setProperty("value.deserializer",
KafkaAvroDeserializer.class.getName());
props.setProperty("schema.registry.url", "http://localhost:8081");
props.setProperty("group.id", "TrackGroup");
props.setProperty("specific.avro.reader", "true");
try(KafkaConsumer<Long, Track> consumer = new
KafkaConsumer<>(props)) {
consumer.subscribe(Arrays.asList("TrackAvroTopic"));
while(true) {
ConsumerRecords<Long, Track> records =
consumer.poll(Duration.ofSeconds(20));
records.forEach(c -> {
Track coordinates = c.value();
System.out.println("ID: " + c.key());
System.out.println("LATITUDE: " + coordinates.getLatitude());
System.out.println("LONGITUDE: " + coordinates.getLongitude());
});
}
} catch(Exception e) {
e.printStackTrace();
}
}
}

https://data-flair.training/blogs/avro-uses/

Popularity 2/10 Helpfulness 1/10 Language java

Source: Grepper

Tags: avro java

Link to this answer
Share Copy Link

Contributed on Feb 11 2023

Pragya Keshap

0 Answers Avg Quality 2/10

Use Avro

Contents

More Related Answers

Use Avro

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.