代码之家  ›  专栏  ›  技术社区  ›  Giorgos Myrianthous

试图运行Kafka JDBC源连接器时出现损坏的_消息

  •  0
  • Giorgos Myrianthous  · 技术社区  · 6 年前

    我尝试运行具有以下配置的Kafka JDBC源连接器:

    {
        "name": "source-mariadb-VIEW_GIORGOS", 
        "config": { "connector.class":"io.confluent.connect.jdbc.JdbcSourceConnector", 
                    "tasks.max":"10", 
                    "connection.url":"jdbc:mariadb://localhost:3306/kafka?user=myuser&password=mypass", 
                    "table.whitelist":"VIEW_GIORGOS", 
                    "mode":"timestamp", 
                    "timestamp.column.name":"ROWVERSION", 
                    "validate.non.null":"false", 
                    "topic.prefix":"GIORGOS-", 
                    "table.types":"TABLE,VIEW", 
                    "poll.interval.ms":"1000",
                    "consumer.group.id":"mytopicgroup1" 
        }
    }
    

    但Kafka Connect报告以下错误:

    WARN [Producer clientId=producer-8] Got error produce response with correlation id 1504 on topic-partition GIORGOS-VW_GIORGOS, retrying (2147483149 attempts left). 
    Error: CORRUPT_MESSAGE (org.apache.kafka.clients.producer.internals.Sender:526)
    
    1 回复  |  直到 6 年前
        1
  •  1
  •   Giorgos Myrianthous    6 年前

    我发现这个错误与保留策略有关。

    compact delete