Facing issue in Exploding JSON for kafka-scylla sink connector

ScyllaDB
, ,
1

Hey everyone,
Can anyone help me with some documentation for kafka-scylla-sink connector for some issues which I am facing. How can I configure these things in connector config json file.

{
  "name": "user-deatils-connector",
  "config": {
    "connector.class": "io.connect.scylladb.ScyllaDbSinkConnector",
    "tasks.max": "1",
    "topics": "user-details-topic",
    "scylladb.contact.points": "192.168.53.211",
    "scylladb.keyspace": "kafka_json_test",
    "scylladb.consistency.level": "LOCAL_QUORUM",
    "scylladb.port": "9042",
    "scylladb.loadbalancing.localdc": "datacenter1",
    "key.converter": "org.apache.kafka.connect.storage.StringConverter",
    "value.converter": "org.apache.kafka.connect.json.JsonConverter",
    "value.converter.schemas.enable": "false",
    "scylladb.offset.storage.table.enable": "true",
    "transforms": "createKey,renameTopic",
    "transforms.createKey.type": "org.apache.kafka.connect.transforms.ValueToKey",
    "transforms.createKey.fields": "name",
    "transforms.renameTopic.type": "org.apache.kafka.connect.transforms.RegexRouter",
    "transforms.renameTopic.regex": "user-details-topic",
    "transforms.renameTopic.replacement": "user_details"
  }
}

Issues:
In my kafka Json message I am getting some field as eventName while the table has column name as event_name .
In my kafka message, I am getting nested JSON, how can I map these to column names.
Example:

{
    "userId" : "xxxx",
    "phoneNumber": "xxxxxxxxxx",
    "data" : {
        "gamesPlayed": 10,
        "gamesWon": 8,
        "gamesLoss": 1,
        "gamesDraw": 1,
        "addCashAmt": 5132
    }
}
  1. In some kafka topic I am getting Array of JSON for a particular key. Like this:
    Example:
{
  "dealId": "wwww",
  "data": [
    {
      "userId": "xxxx",
      "brandName": "xxxx",
      "brandId": xx,
      "displayName": "xxxx"
    },
    {
      "userId": "yyyy",
      "brandName": "yyyy",
      "brandId": yy,
      "displayName": "yyyy"
    }
  ]
}

Now I have to insert data into the table such that for each element in data there should be a new unique row in table. The primary key for row is dealId, userId.
For example, new rows will be like:

dealId   userId
wwww     xxxx
wwww     yyyy

Can anyone help with there expertise/documentation.
Thanks in Advance for your valuable time :blush:.