# \#spark

**URL:** https://forum.scylladb.com/tag/spark/116.md

[Latest](https://forum.scylladb.com/latest.md) · [Categories](https://forum.scylladb.com/categories.md) · [Tags](https://forum.scylladb.com/tags.md)

---

## [Scylla Write failure](https://forum.scylladb.com/t/scylla-write-failure/2219)

<div class="topic-metadata">

**Author:** [@iman.experian](https://forum.scylladb.com/u/iman.experian)\
**Replies:** 3\
**Last updated:** [February 21, 2025, 4:02am UTC](https://forum.scylladb.com/t/scylla-write-failure/2219 "2025-02-21T04:02:34Z")

</div>

Hi All, I am getting below exception while trying to load data in Scylla DB using PySpark Application (running in AWS EMR) - Traceback (most recent call last): File “/mnt/tmp/aip-workflows/scylla-load/src/s3-to-scylla…

---

## [Where can I find a docker-compose for ScyllaDB with Spark - Analytical workloads?](https://forum.scylladb.com/t/where-can-i-find-a-docker-compose-for-scylladb-with-spark-analytical-workloads/2957)

<div class="topic-metadata">

**Author:** [@Guy](https://forum.scylladb.com/u/Guy)\
**Replies:** 0\
**Last updated:** [September 25, 2024, 7:55am UTC](https://forum.scylladb.com/t/where-can-i-find-a-docker-compose-for-scylladb-with-spark-analytical-workloads/2957 "2024-09-25T07:55:15Z")

</div>

---

## [Migrating from Cassandra and DynamoDB using the Migrator](https://forum.scylladb.com/t/migrating-from-cassandra-and-dynamodb-using-the-migrator/2519)

<div class="topic-metadata">

**Author:** [@Guy](https://forum.scylladb.com/u/Guy)\
**Replies:** 0\
**Last updated:** [August 21, 2024, 5:30am UTC](https://forum.scylladb.com/t/migrating-from-cassandra-and-dynamodb-using-the-migrator/2519 "2024-08-21T05:30:49Z")

</div>

The new blog post covers the latest changes in the open source Migrator project. The Migrator simplifies the migration process and gives you more control over how it’s performed. The post covers the architecture, sample…

---

## [Probabilistic Data: HyperLogLog](https://forum.scylladb.com/t/probabilistic-data-hyperloglog/2129)

<div class="topic-metadata">

**Author:** [@yarosman](https://forum.scylladb.com/u/yarosman)\
**Replies:** 2\
**Last updated:** [August 8, 2024, 1:01am UTC](https://forum.scylladb.com/t/probabilistic-data-hyperloglog/2129 "2024-08-08T01:01:08Z")

</div>

Does it exist HyperLogLog data structure for distinct counting like in Redis or Aerospike?

---

## [Spark Connector, TTL on a per-element basis within the map collection type, which compaction strategy](https://forum.scylladb.com/t/spark-connector-ttl-on-a-per-element-basis-within-the-map-collection-type-which-compaction-strategy/2297)

<div class="topic-metadata">

**Author:** [@Guy](https://forum.scylladb.com/u/Guy)\
**Replies:** 0\
**Last updated:** [July 14, 2024, 4:56am UTC](https://forum.scylladb.com/t/spark-connector-ttl-on-a-per-element-basis-within-the-map-collection-type-which-compaction-strategy/2297 "2024-07-14T04:56:14Z")

</div>

---

## [Different running compactions between multi dc](https://forum.scylladb.com/t/different-running-compactions-between-multi-dc/2282)

<div class="topic-metadata">

**Author:** [@tg.um](https://forum.scylladb.com/u/tg.um)\
**Replies:** 1\
**Last updated:** [July 12, 2024, 3:32pm UTC](https://forum.scylladb.com/t/different-running-compactions-between-multi-dc/2282 "2024-07-12T15:32:06Z")

</div>

Hi, we’re running two clusters scyllaDB with 3 nodes. DC1 (3 nodes) DC2 (3 nodes) CREATE KEYSPACE test\_keyspace WITH replication = {‘class’: ‘NetworkTopologyStrategy’, ‘dc1’: ‘3’, ‘dc2’: ‘3’}; Table is using STCS As…

---

## [Live migration from DynamoDB to ScyllaDB, Migrator and different options](https://forum.scylladb.com/t/live-migration-from-dynamodb-to-scylladb-migrator-and-different-options/1897)

<div class="topic-metadata">

**Author:** [@Guy](https://forum.scylladb.com/u/Guy)\
**Replies:** 1\
**Last updated:** [May 2, 2024, 8:46pm UTC](https://forum.scylladb.com/t/live-migration-from-dynamodb-to-scylladb-migrator-and-different-options/1897 "2024-05-02T20:46:40Z")

</div>

---

## [Running ScyllaDB and Spark on the same node, (like Cassandra + Spark)](https://forum.scylladb.com/t/running-scylladb-and-spark-on-the-same-node-like-cassandra-spark/1811)

<div class="topic-metadata">

**Author:** [@Guy](https://forum.scylladb.com/u/Guy)\
**Replies:** 0\
**Last updated:** [April 25, 2024, 9:17am UTC](https://forum.scylladb.com/t/running-scylladb-and-spark-on-the-same-node-like-cassandra-spark/1811 "2024-04-25T09:17:29Z")

</div>

---

## [Spark Connector, getting specific data without full table scans](https://forum.scylladb.com/t/spark-connector-getting-specific-data-without-full-table-scans/1481)

<div class="topic-metadata">

**Author:** [@Guy](https://forum.scylladb.com/u/Guy)\
**Replies:** 0\
**Last updated:** [April 12, 2024, 9:04am UTC](https://forum.scylladb.com/t/spark-connector-getting-specific-data-without-full-table-scans/1481 "2024-04-12T09:04:34Z")

</div>

---

## [Timeout, paging, memory: ReadTimeoutException: Cassandra timeout during read query at consistency](https://forum.scylladb.com/t/timeout-paging-memory-readtimeoutexception-cassandra-timeout-during-read-query-at-consistency/1463)

<div class="topic-metadata">

**Author:** [@Guy](https://forum.scylladb.com/u/Guy)\
**Replies:** 0\
**Last updated:** [April 7, 2024, 5:42am UTC](https://forum.scylladb.com/t/timeout-paging-memory-readtimeoutexception-cassandra-timeout-during-read-query-at-consistency/1463 "2024-04-07T05:42:26Z")

</div>