Skip to main content
Filter by
Sorted by
Tagged with
0 votes
1 answer
13 views

How can I import newer versions of pre-defined SCDF starter apps?

I'm working on evaluating Spring Cloud Data Flow, and want to get a demonstration working with the out of the box apps (Kafka on Kubernetes). I'm having trouble getting things working, but before I ...
Eric's user avatar
  • 5,962
0 votes
1 answer
20 views

What is the right way to add custom JDBC drivers to Spring Cloud Data Flow?

I'd like to use an Oracle database for a new Spring Cloud Data Flow install, but it doesn't come with ojdbc, and I'm a little confused on the best way to add custom JDBC drivers. According to the ...
Eric's user avatar
  • 5,962
0 votes
0 answers
24 views

Spring Cloud Dataflow 2.11.4 on GKE 1.29.6: Server POD crashing

I am hosting SCDF on GKE by following below documentation - https://dataflow.spring.io/docs/installation/kubernetes/kubectl/ PODS for all components are up and running but getting below error with ...
Sumit's user avatar
  • 1
0 votes
0 answers
44 views

Unable to create scheduled Tasks in SCDF - 2.11.0

I am using SCDF version 2.11.0 . Earlier I am able to create schedule tasks with CRON_TZ and it was working fine . Recently , not able to create schedule with CRON_TZ . We are getting the below error ,...
17_4088_ Subashini.S's user avatar
0 votes
1 answer
38 views

Spring cloud data flow cannot find driver class at startup

I'm trying to up spring cloud data flow in my local. By default SCDF use h2 as primary database to store meta information. In my cloud-task-batch application all the properties related to database are ...
Arti Prajapati's user avatar
0 votes
1 answer
32 views

Spring Cloud Data Flow - Passing secret to the Cloud Task

How to pass the secrets to a cloud task when executing through Spring Cloud Data Flow. I am trying to set the secrets using deployer properties but it's not working Thanks for your help in advance. ...
Jaswinder K's user avatar
0 votes
1 answer
75 views

SCDF 2.11.3 Job Executions menu not showing Spring Batch 5 application's job execution

I am new to Spring Cloud Data Flow. I am using Spring Batch 5.1.1 version and have implemented some batch jobs. To use monitoring and manual launches, I am trying to adopt SCDF for its purpose. I ...
xronace's user avatar
0 votes
1 answer
16 views

Is it possible to see the request coming in to an SCDF Server?

An external service tries to start a SCDF Task with a Rest call. But I only see it's missing some properties it should have. Is it possible to see the exact call that is coming in to the SCDF Server? ...
Vin's user avatar
  • 11
0 votes
1 answer
155 views

Issues in SCDF upgrade from spring boot 2.7.18 to 3.1.0

I am upgrading my existing scdf application from spring boot 2.7.18 to 3.1.0. I am facing below error during start-up. java.lang.NoClassDefFoundError: org/springframework/boot/actuate/autoconfigure/...
anudeep kn's user avatar
0 votes
1 answer
44 views

Multiple Namespace Deployer Properties in Spring Cloud Data Flow

We are in process of having a single SCDF server instance in k8s deploying stream applications to multiple namespaces based on the platformName property. My question is when i specify a property like ...
CuriousK's user avatar
0 votes
1 answer
43 views

How to get around Oracle driver error when setting up a jdbc source application for Spring Cloud Dataflow?

I'm trying to use Spring Cloud Dataflow to set up an ETL pipeline with Oracle as the source, a custom application as the processor/transformer, and MySQL as the sink. Oracle is also used as the ...
Eugene M's user avatar
  • 1,307
0 votes
1 answer
36 views

How to deal with the removal of support of running multiple batch jobs at once?

Spring Batch recently removed the opportunity to run multiple batch jobs at once. So now, you can still package multiple batch jobs into the same application but for every execution of the batch ...
Manu's user avatar
  • 354
0 votes
0 answers
79 views

How do I retrieve the Execution Id for a job in Spring Cloud Data Flow?

In my Spring Cloud Data Flow (SCDF) dashboard under "Tasks/Jobs" -> "Job Executions" there is an overview of all the jobs that have run so far with their status. The first ...
The_Unknown's user avatar
0 votes
1 answer
63 views

Statefulset for apps deployed by spring cloud data flow in Kubernetes

I know this question was asked last year and that isnt supported then, but is it still the same? in SCDF(Spring Cloud Data Flow), how can i deploy application(stream or task) as statefulset? not ...
CuriousK's user avatar
0 votes
1 answer
42 views

spring-cloud-dataflow 2.11.2 cronjob

is there anyway to set the timeZone for dataflow schedule cronJob? I looked into the dataflow documentation and seem only have cronJobSpec options for backOffLimit and ttlSecondAfterFinished I couldnt ...
Dank's user avatar
  • 1
0 votes
0 answers
36 views

SCDF-Server Unauthorized to read metadata from my private registry(docker)

I'm using SCDF 2.11.x in k8s cluster. I'm facing error while registering the app, error log like below : [nio-9393-exec-1] ApplicationConfigurationMetadataResolver : Failed to retrieve properties for ...
쭌낙이's user avatar
-1 votes
1 answer
42 views

Configure Kubernetes services of Spring Cloud Dataflow streams

When Spring Cloud Dataflow deploys a stream, it delegates the actual deployment to Spring Cloud Skipper. Effectively, it is possible to configure Skipper to customize the Kubernetes deployment, using ...
dcolazin's user avatar
  • 1,052
0 votes
1 answer
40 views

How can I make task to reuse all of the properties from previous successful run in Spring Cloud DataFlow

I'm running Spring Cloud Dataflow in Kubernetes and for some reason only part of properties from previous run is reused on the next run. Here is list of properties on a previous run and after I press ...
Ivan Volzhev's user avatar
0 votes
0 answers
30 views

Getting "CF-InvalidAuthToken(1000): Invalid Auth Token" while launching the tasks in Spring Cloud Data Flow 2.11.1

Spring Cloud Data Flow 2.11.1 showing below error. org.cloudfoundry.client.v2.ClientV2Exception: CF-InvalidAuthToken(1000): Invalid Auth Token 16:56:26.513: [APP/PROC/WEB.0] at org.cloudfoundry....
Bharath Kumar's user avatar
0 votes
1 answer
30 views

running maven task on spring cloud data flow in kubernetes platform

I'm trying to setup spring cloud data flow to be able to run maven tasks in kubernetes cluster. I was able to register repository in the SCDF server, and register application with maven://group:...
Ivan Volzhev's user avatar
0 votes
1 answer
90 views

spring-cloud-dataflow 2.11.2

I have latest SCDF installed in kubernetes and my spring cloud tasks is working fine with springboot 2.x however When I upgraded to springboot 3.x and ran I kept having error "Invalid ...
Dank's user avatar
  • 1
0 votes
1 answer
33 views

Not Able to Register app using SCDF 2.11.2 Dashboard UI due to one mandatory field (Spring boot version) which is disabled in my Application

Recently Upgraded Spring cloud dataflow from 2.9.2 to 2.11.2. After the upgrade, all the existing apps were cleaned up don't know how. But, now I am trying to import or register these apps using the ...
Ajay Rathod's user avatar
0 votes
1 answer
126 views

Spring Cloud DataFlow - SpringBoot3 not showing stats of execution

When running Spring DataFlow in kubernetes and deploying docker images I'm not seeing boot3 stats from the execution. I do see the data in the database (in the tables prefixed with boot3), but not in ...
mdeterman's user avatar
  • 4,379
0 votes
1 answer
147 views

Deploying java 17 apps on Spring cloud data flow 2.9.6

We are using spring cloud data flow version 2.9.6 and all our apps were so far on Java 8, deploying them on to pivotal cloud foundry environment. But we are in process of migration and upgraded a ...
CuriousK's user avatar
0 votes
1 answer
98 views

Spring Cloud Data Flow jar task on kubernetes

How to run a task as a Java jar file in SCDF running in Kubernetes? To determine the launch platform I use the following configmap: apiVersion: v1 kind: ConfigMap metadata: name: scdf-server ...
Konstantin's user avatar
0 votes
0 answers
236 views

Is spring-cloud-dataflow-rest-client with Spring Boot 3 support already available?

I'm running a Spring Boot 2 application with a dependency on org.springframework.cloud:spring-cloud-dataflow-rest-client:2.11.2. I want to upgrade my application to Spring Boot 3, but I receive the ...
StrdtV's user avatar
  • 1
0 votes
0 answers
42 views

Not able to to establish Github Oauth2 authentication for Spring cloud dataflow

I am trying to establish authentication with GitHub in the Spring Cloud dataflow server. referring this document https://docs.spring.io/spring-cloud-dataflow/docs/current/reference/htmlsingle/#...
Brijesh's user avatar
  • 23
0 votes
2 answers
189 views

Trying to update Spring Cloud Dataflow v2.9.4 to 2.11.2 on Pivotal CloudFoundry but getting errors during deployment

I am trying to update our instance of Spring Cloud DataFlow from 2.9.4 to 2.11.2 but I'm getting errors during deployment to our PCF (Pivotal CloudFoundry) environment. I am totally unsure about what ...
Favna's user avatar
  • 340
0 votes
0 answers
25 views

SCDF UI doesnt override the properties either in the property or in argument section

SCDF UI Pulls the configuration for the properties from consul, i need to override consul configuration for one of the property, but it doesnt override the properties with app.taskname.propertykeyname=...
K G's user avatar
  • 11
0 votes
1 answer
102 views

spring-cloud-dataflow UI timezone use only UTC?

I use spring-cloud-dataflow(scdf) in the k8s environment. The timezone was modified by changing the application property as follows. spring.cloud.dataflow.task.platform.kubernetes.accounts.default....
hythloth's user avatar
0 votes
1 answer
29 views

SCDF Adds additional Cloud Foundry specific Props on a K8s install

We are using bitnami helm charts to install Spring cloud dataflow and skipper on a K8s cluster. Things all work fine and we are able to get streams deployed. But do notice that there are few ...
CuriousK's user avatar
0 votes
1 answer
53 views

How to create route/ingress for apps deployed via spring cloud data flow in kubernetes

We are working on setting up Spring cloud data flow in kubernetes cluster. Wanted to know how we can enable external access to deployed apps from outside the cluster. We are basically migrating from ...
CuriousK's user avatar
0 votes
1 answer
157 views

Spring Cloud Task execution fails when running via SpringCloud dataflow server 2.11.2 with Invalid TaskExecution ID, but works fine with 2.10

I am writing a spring cloud task(Spring Boot 3, Java 17) that reads a flat file and inserts it into a database. So this is a multiple databases scenario. Running via SpringCloud dataflow server 2.112,...
Jaswinder K's user avatar
0 votes
1 answer
76 views

Spring Cloud Dataflow kafka-source-kafka throwing error

I am trying to create a steam application using SCDF kafka-source-kafka as a kafka supplier config. Below are the properties to configure the external source kafka as a consumer config. app.kafka-...
Zishnu's user avatar
  • 3
0 votes
1 answer
49 views

Will spring cloud data flow (SCDF) server emit notifications?

Is it possible for the Spring cloud data flow server to emit notifications whenever applications are deployed and undeployed. I want to write a java code, that receives above notification from the ...
oviyarajee's user avatar
0 votes
2 answers
152 views

Monitor and manage spring cloud data flow (SCDF) Server using Prometheus

Is it possible to monitor and manage spring cloud data flow(SCDF) server itself using Prometheus? I am aware that, I can monitor and collect metrics for the jars deployed in SCDF Server (i.e source, ...
oviyarajee's user avatar
0 votes
0 answers
60 views

Restarting only failed partitions of a Cloud Task in Spring Cloud Data Flow on K8s platform

We are using Spring Cloud Data Flow running in Kubernetes platform. Sometimes when we run large number of partitions (pods), some partitions are failing. We want to restart those failed tasks only. ...
Madhu's user avatar
  • 31
0 votes
0 answers
42 views

SCDF Composed task child k8s pods are not deleted on cleanup

I have composed task based batch app with 3 tasks tied together. When I start a composed task, there are totally 4 pods gets created. one for parent and 3 child pods. For example I have a composed app ...
vijayashankard's user avatar
0 votes
1 answer
52 views

Spring Cloud Data Flow http-source application with Oauth2 Security Config

I was trying to configure the Oauth2 server on http-source-kafka connector in SCDF. There are no such properties available to configure the Oauth2 related configs. permitted.endpoints=xxx restricted....
Zishnu's user avatar
  • 3
0 votes
1 answer
38 views

How to make Azure services available in Spring Cloud Dataflow UI as sources and sinks?

My current team develops microservices in an Azure environment that using Service Bus and Event Hubs for processing messages via Spring Cloud Stream. I'm evaluating using Spring Cloud Data Flow to do ...
Alan Krueger's user avatar
  • 4,776
0 votes
2 answers
186 views

Spring Data Flow streams with multiple inputs

I use Spring Cloud Data Flow 2.11.2. My goal is making two sources and one processor that accepts both messages as input and performs some operations on them, e.g.: stream view I found a guide on this ...
Roman's user avatar
  • 3
0 votes
0 answers
60 views

spring cloud stream failed with IllegalStateException: deploymentId doesn't match expected state

I have been engaging with the Spring Cloud ecosystem for the past 3 months. We have created different streams with both prebuilt and custom Spring Cloud Stream apps. During this period, we have come ...
Udhaya's user avatar
  • 117
0 votes
1 answer
59 views

Spring-cloud-dataflow: How to default the RabbitMQ binder to create quorum queues

I am playing around with the latest Spring Cloud Dataflow with RabbitMQ as the message broker and have noticed the queues that are created on RabbitMQ from the http-source and log-sink are classic ...
Stefan Du Preez's user avatar
0 votes
1 answer
79 views

Spring-cloud-data-flow: how to paste default execution properties on each task execution

I launched spring cloud data flow locally running tow jars: spring-cloud-skipper-server-2.11.1.jar and spring-cloud-dataflow-server-2.11.1.jar Now I want to add java-opts field but not manually each ...
Enio Rich's user avatar
0 votes
0 answers
111 views

Two Spring Cloud Data Flow Servers Pointing to Same Database(Multi Node)

I want to deploy two SCDF servers locally by pointing it to same Database. Suppose now Server1 starts executing Job1 and it goes down in between. How to make server2 to continue this processing. I am ...
Shreyas Holla P's user avatar
0 votes
2 answers
150 views

Spring cloud dataflow's dashboard not found - 404

i'm trying to create a spring cloud dataflow server v2.10.3, but when i run the project i can't access the dashboard, it gives me an 404 error... here is my main class : @EnableDataFlowServer @...
Fahd's user avatar
  • 1
0 votes
0 answers
212 views

Spring Cloud Dataflow - Composite Task Runner Issue

I'm exploring all the features of Spring Cloud Dataflow for our project. Currently I'm doing all development locally(No docker, Cloudfoundry & Kubernates) Currently I have created 2 Spring Batch ...
iCode's user avatar
  • 9,122
0 votes
1 answer
53 views

Stream deployment properties are being locked after a deployment with errors

We're using spring cloud dataflow 2.10.3 deployed using helm in a kubernetes cluster. I'm not sure if this is a bug or something were doing wrong but we've seen it happen across all types of streams, ...
oldvirus_231's user avatar
0 votes
1 answer
52 views

Redis serializer properties in SCDF

I'm using a splitter and an aggregator in SCDF 2.10.3 and I want to cache messages in Redis. Here is a simple example stream : http | splitter | aggregator | log This stream works fine without Redis. ...
CEDDM's user avatar
  • 21
1 vote
0 answers
102 views

SCDF server returning "Error waiting to get Release from a statemachine" when trying to deploy scdf stream

I am trying to deploy an scdf stream through ArgoCD but the pod is not created and I receive the following error: Error waiting to get Release from a statemachine Any idea what this error is? Where ...
goulpan's user avatar
  • 496

1
2 3 4 5
27