I got the following error while trying to run spark streaming code for one of my assignment.
java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
When I searched the internet I found that it is a bug and it is fixed in latest version. The link to bug is:
https://jira.apache.org/jira/browse/SPARK-19185
It is fixed in version 2.4.0
I used the following pom.xml file to fix this problem.
No comments:
Post a Comment