Questions tagged [spring-cloud-dataflow]

Spring Cloud Data Flow is a toolkit for building data integration and real-time data processing pipelines. Pipelines consist of Spring Boot apps, built using the Spring Cloud Stream or Spring Cloud Task microservice frameworks. This makes Spring Cloud Data Flow suitable for a range of data processing use cases, from import/export to event streaming and predictive analytics.

Filter by
Sorted by
Tagged with
0 votes
1 answer
14 views

Spring Cloud Data Flow http-source application with Oauth2 Security Config

I was trying to configure the Oauth2 server on http-source-kafka connector in SCDF. There are no such properties available to configure the Oauth2 related configs. permitted.endpoints=xxx restricted....
Zishnu's user avatar
  • 1
0 votes
1 answer
12 views

How to make Azure services available in Spring Cloud Dataflow UI as sources and sinks?

My current team develops microservices in an Azure environment that using Service Bus and Event Hubs for processing messages via Spring Cloud Stream. I'm evaluating using Spring Cloud Data Flow to do ...
Alan Krueger's user avatar
  • 4,771
0 votes
1 answer
40 views

Spring Data Flow streams with multiple inputs

I use Spring Cloud Data Flow 2.11.2. My goal is making two sources and one processor that accepts both messages as input and performs some operations on them, e.g.: stream view I found a guide on this ...
Roman's user avatar
  • 3
0 votes
0 answers
15 views

spring cloud stream failed with IllegalStateException: deploymentId doesn't match expected state

I have been engaging with the Spring Cloud ecosystem for the past 3 months. We have created different streams with both prebuilt and custom Spring Cloud Stream apps. During this period, we have come ...
Udhaya's user avatar
  • 117
0 votes
1 answer
10 views

Spring-cloud-dataflow: How to default the RabbitMQ binder to create quorum queues

I am playing around with the latest Spring Cloud Dataflow with RabbitMQ as the message broker and have noticed the queues that are created on RabbitMQ from the http-source and log-sink are classic ...
Stefan Du Preez's user avatar
0 votes
1 answer
18 views

Spring-cloud-data-flow: how to paste default execution properties on each task execution

I launched spring cloud data flow locally running tow jars: spring-cloud-skipper-server-2.11.1.jar and spring-cloud-dataflow-server-2.11.1.jar Now I want to add java-opts field but not manually each ...
Enio Rich's user avatar
0 votes
0 answers
52 views

Two Spring Cloud Data Flow Servers Pointing to Same Database(Multi Node)

I want to deploy two SCDF servers locally by pointing it to same Database. Suppose now Server1 starts executing Job1 and it goes down in between. How to make server2 to continue this processing. I am ...
Shreyas Holla P's user avatar
0 votes
1 answer
23 views

Spring cloud dataflow's dashboard not found - 404

i'm trying to create a spring cloud dataflow server v2.10.3, but when i run the project i can't access the dashboard, it gives me an 404 error... here is my main class : @EnableDataFlowServer @...
Fahd's user avatar
  • 1
0 votes
0 answers
44 views

Spring Cloud Dataflow - Composite Task Runner Issue

I'm exploring all the features of Spring Cloud Dataflow for our project. Currently I'm doing all development locally(No docker, Cloudfoundry & Kubernates) Currently I have created 2 Spring Batch ...
iCode's user avatar
  • 8,912
0 votes
1 answer
38 views

Stream deployment properties are being locked after a deployment with errors

We're using spring cloud dataflow 2.10.3 deployed using helm in a kubernetes cluster. I'm not sure if this is a bug or something were doing wrong but we've seen it happen across all types of streams, ...
oldvirus_231's user avatar
0 votes
1 answer
29 views

Redis serializer properties in SCDF

I'm using a splitter and an aggregator in SCDF 2.10.3 and I want to cache messages in Redis. Here is a simple example stream : http | splitter | aggregator | log This stream works fine without Redis. ...
CEDDM's user avatar
  • 21
0 votes
0 answers
38 views

SCDF server returning "Error waiting to get Release from a statemachine" when trying to deploy scdf stream

I am trying to deploy an scdf stream through ArgoCD but the pod is not created and I receive the following error: Error waiting to get Release from a statemachine Any idea what this error is? Where ...
goulpan's user avatar
  • 466
0 votes
1 answer
43 views

Spring batch task pod(jvm) is not automatically terminated after competition of task

Spring batch task pod(jvm) is not automatically terminated after the competition of the task. So, I thought to close the application context explicitly post-completion of the task by closing the ...
Ankit Gupta's user avatar
0 votes
1 answer
39 views

Spring Cloud Data Flow 2.10.3 : may i launch a Task linked to a specific application version, instead of default version

I'd like to run a Task (or create a new Task and run it) whom execution will trigger deployment and execution of a specified (on task level) version of the linked application. I don't find how to do, ...
Damien Tacheron's user avatar
0 votes
0 answers
34 views

Spring Cloud Data Flow deploy batch application to multiple cluster

I have two clusters in Openshift that share the same database: Cluster A: https://10.0.0.1:443 Cluster B: https://10.0.0.2:443 The SCDF is installed on cluster A where I can deploy batch ...
Kane's user avatar
  • 9

15 30 50 per page
1
2 3 4 5
86