The kafka protocol is explained ion this page: https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol