Unable to do complex searches in ScyllaDB

ScyllaDB
,
1

Good morning,
How can ScyllaDB help with our use case in a most optimal way, what is the best approach?
I was hoping we could do everything in ScyllaDB and eliminate having to use PostgreSQL(as a separate DB for the final stage of reporting) but it seems that’s not feasible.
Therefore our approach is still to stream the large volumes of data in real-time from the NoSQL database(ScyllaDB) out to Postgres and do our queries from there.

Note that:
1.Reporting is not in real-time.
2.source systems that do searches is in real-time(complex queries in the sense that different systems come in to the scylladb cluster to do queries their own way, some do joins and also temporary tables)
3. A microservice does the transformation.

2

Take a look at ScyllaDB CDC Feature

You can use it to read updates from ScyllaDB and feed them to external systems (like PostgreSQL).
Keep in mind:

  • The External system needs to be fast enough to consume the updates.
  • CDC have a performance impact on ScyllaDB