📄️ Run via Ilum UI
Learn how to deploy and manage standard Jar or Python Apache Spark jobs on Kubernetes using the Ilum UI. A powerful, user-friendly alternative to spark-submit.
📄️ Run via Ilum API
Learn how to programmatically submit, manage, and monitor Apache Spark jobs on Kubernetes using the Ilum REST API. Ideal for CI/CD pipelines and automation.
📄️ Run via Ilum Spark Submit
Learn how to run Apache Spark jobs on Kubernetes using the familiar spark-submit command with Ilum. Automate configuration, monitoring, and storage access.
📄️ Run via Spark Connect
Configurazione e connessione ad Apache Spark Connect nel cluster Ilum. Introduzione ai microservizi Spark.
📄️ Run in Different Namespaces
A complete guide on configuring Ilum to execute Apache Spark jobs across different Kubernetes namespaces for better multi-tenancy and security.
📄️ Run dbt Job
Configure dbt-spark with Thrift Server or Spark Connect on Kubernetes. Step-by-step guide for data transformation pipelines.
📄️ Orchestrate dbt with Airflow
Learn how to automate dbt pipelines using Apache Airflow. Build medallion architectures with auto-generated DAGs on Kubernetes.
📄️ Schedule Jobs
Automate Apache Spark job execution on Kubernetes. Configure CRON schedules for ETL pipelines, Python scripts, and JARs using Ilum.
📄️ Streaming & CDC Ingestion with Kafka
Build real-time streaming pipelines using Kafka with Spark Structured Streaming and Apache Flink on ilum. Covers CDC ingestion patterns with Iceberg.