Spark Streaming
-
Extending Spark for improved performance in handling multiple search terms
9 min read -
To boost performance, we implement a forgetful bloom filter and a custom Spark state store…
9 min read -
We implement a Spark structured streaming stateful mapping function to handle temporal proximity correlations in…
7 min read -
Sigma rules are used to detect anomalies in cyber security logs. We use Spark structured…
9 min read -
Spark Structured Streaming supports a Kafka source and a file source, meaning it can treat…
11 min read -
One of the roles of the Canadian Centre for Cyber Security (CCCS) is Computer Emergency…
3 min read -
A tutorial on how to use SparkML to make predictions on streaming data using PySpark
7 min read -