Questions tagged [netflix-conductor]
An open source orchestration library for micro services orchestration in the cloud. Allows the creation and execution of scalable complex workflows with emphasis on Dev Ops management.
45
questions
-1
votes
0
answers
21
views
whats best platform for orchestrate custom workflows [closed]
there are many orchestrate workflow in market "netflix conductor/ chamunda /temporal".
which one should i use,based on what?
0
votes
0
answers
48
views
Docker using Rancher throwing an error and Gradle looking for jdk at an older JAVA_HOME
I am new to docker and I was trying to run Netflix conductor on my local machine from here using rancher and docker cli. I cloned the repository, went inside the docker directory and ran
docker-...
0
votes
0
answers
42
views
Netflix conductor data sharing with multiple instances
We are using Netflix Conductor for orchestration purpose. We have some customisation around conductor library.
We started to face issues after integrated with MySQL database. All Netflix instances ...
0
votes
0
answers
79
views
Netflix Conductor cleanup workflow data
I'm using Conductor 2.10.1. The main problem is that we have a scheduled job that on each weekend try to delete old workflows history (older than two weeks) using delete workflow api.
When we check ...
0
votes
1
answer
44
views
How to run conductor jar on different port, other then 8080?
I am running conductor jar using command, java -jar conductor3.3.4.jar so conductor is up and running on port 8080 now I want to run the above command again but with different port java -jar ...
0
votes
1
answer
327
views
Netflix conductor - Orkes or self managed?
Is anyone using Netflix conductor on production code? If yes are you using the managed version by Orkes or integrated and managing directly yourself?
Would like any insights here, as we are in ...
1
vote
1
answer
84
views
forked subworkflows all to run to completion but fail the parent workflow if one or more do fail
consider a case in netflix conductor (or orkes) where 2 subworkflows are forked in paralel. The default behaviour of FORK + SUB_WORKFLOW + JOIN tasks is that if the first subworkflow fails, the second ...
0
votes
0
answers
43
views
typescript conditional generic type in Netflix conductor sdk
I am reading the following piece of code in Netflix conductor SDK.
type O2T<O extends {}> = {} extends O
? []
: {
[key in keyof O]: [key, ...O2T<O[key]>];
}[keyof O];
After ...
0
votes
0
answers
45
views
Netflix Conductor on SOAP based Microservice
Wanted to know if we can Orchestrate Soap Based Microservice using Netflix conductor ? If somebody tried or thought about this? Any reference I can look for? Also wanted to know if Netflix Conductor ...
0
votes
1
answer
143
views
How to get workflowIsntanceId and taskId in workflow execution
Here below is a definition of two Tasks, 1st one is HTTP and 2nd is HUMAN, in HTTP task need to pass workflowInstanceId and HUMAN taskId.
I am not able to find a way to get workflow contextual data. ...
0
votes
0
answers
180
views
Netflix Conductor not retrying failed HTTP call?
I have a conductor workflow which makes an HTTP call to a service. When the service is completely down (not started), conductor just set the task and the workflow states to FAILED. I have added retry ...
0
votes
1
answer
441
views
Using Nexus Repository and Other Repository in Gradle
Can you help me with this problem please? I have to use in-house built-in dependencies which is hosted on Nexus for Netflix conductor project. I have setup the settings.xml which resolves the ...
0
votes
0
answers
106
views
How to migrate Netflix Conductor workflows from one environment to other
I have created 5 workflows in my DEV environment using netflix conductor.
Now, my requirement is to migrate these workflows to my TEST environment or PRE-PROD or PROD?
Also, if I make changes to one ...
0
votes
0
answers
35
views
How to add/update netflix workflow without impacting other workflows
I have a requirement where I have multiple workflows created in netflix conductor and deployed on EC2 instance.
Now, if I want to change or update any one of the workflow I'll need to redeploy that ...
0
votes
1
answer
348
views
How to terminate process after certain duration in Netflix Conductor
I am trying to fork the process after it starts into parallel executions in Netflix Conductor. Some form an actual flow and the last one should be timer. So if the execution will not finish within the ...
1
vote
2
answers
1k
views
Could Run netflix conductor with postgress -
I am trying to follow the simple tutorial of Netflix conductor but could not run the postgress or any other persistence option
I have got APPLICATION FAILED TO START and can not use the persistence ...
0
votes
0
answers
306
views
How to extract a number/status code from "Netflix Conductor" workflow output/task output parameters?
I am using Netflix Conductor's HTTP task in my workflow to call one of the third-party APIs. For success scenarios, I am able to retrieve the status code as "200" in the task output, but for ...
0
votes
2
answers
601
views
Netflix conductor HTTP tasks stuck on scheduled state for a long time
We have Netflix conductor deployed on GCP, with a strong Postgres
persistence storage.
Whenever more then 3k workflows are starting to execute in parallel (Each workflow has like 4 HTTP tasks),
The ...
0
votes
1
answer
212
views
Netflix Conductor type:KAFKA_PUBLISH - Failed to construct kafka producer error
I have this task created in my workflow:
"tasks": [
{
"name": "get_users_list",
"taskReferenceName": "get_users_list",
"inputParameters&...
-1
votes
1
answer
272
views
Change log errors to warning in netflix conductor (java springboot)
Is there a way to change the log errors to warnings in Workflow Task Coordinator of Netflix Conductor.
PS: I'm using Java SpringBoot
for (Task task : tasks) {
try {
...
-1
votes
1
answer
240
views
Change log levels in netflix conductor (java springboot)
Is there a way to change the log level from error to warn in Workflow Task Coordinator of Netflix Conductor.
PS: I'm using Java SpringBoot
for (Task task : tasks) {
try {
...
-1
votes
1
answer
412
views
Creating worker process in Netflix conductor in c#
I am trying to create Worker in Netflix conductor. I am not able to find any code in C# except https://github.com/courosh12/conductor-dotnet-client .
Please provide link where i can refer for C#
0
votes
1
answer
235
views
Needed clarification on how number of queues are defined in Netflix conductor
I am a beginner to Netflix Conductor workflow and needed clarification on below.
If I have 3 instances of same workflow and all are ran together as follows.
Workflow Instance 1 - https://i.stack.imgur....
0
votes
1
answer
254
views
Using Netflix Conductor with a different backend
Has anyone used Netflix Conductor with a completely different backend . We are thinking to plug in the Conductor with Azure Cosmos DB as backend .
0
votes
1
answer
325
views
Netflix Conductor aws integration
Please, I would like to ask some questions related to Conductor and AWS.
I'm creating a new workflow where I will have a task that will send an SQS message to a microservice. I have some doubts:
How ...
0
votes
2
answers
465
views
`RUN ./gradlew build -x test` command error
I have been trying to install conductor using docker but I have been constantly getting errors. I tried using [https://github.com/Netflix/conductor/tree/main/docker][1] commands as given in this. But ...
2
votes
1
answer
611
views
Why netflix conductor does not provide a way to run tasks/subworkflows asynchronously?
Only several task can be run async: HTTP, EVENT, KAFKA. But why there is no a way to run SIMPLE tasks async. Especially would be very useful feature to run sub workflows async. The only workaround(and ...
0
votes
1
answer
432
views
What is task polling?
I am going through Netflix Conductor documentation. It keeps using task polling and loop polling but I can't seem to get my head around it. Please help. TIA.
1
vote
3
answers
179
views
Where should I store the JSON retrieved from a GET request so that I have access to it in a v-for directive?
I'm pretty new to using APIs, so please forgive me if this is really trivial.
There are two GET requests I want to use:
/workflow/search will allow me to get an entire list of workflows along with ...
1
vote
0
answers
300
views
Apache Airflow, fetching and executing tasks
I have been using Netflix Conductor as workflow orchestration before and Apache Airflow is new to me. In Conductor, the execution of workflows works in these steps:
Workflow starts via REST API call
...
3
votes
1
answer
289
views
How to set retention time in Netflix Conductor?
We use MySQL as database for working with Netflix Conductor.
Is it possible to set time to keep workflow execution history (in MySQL and in Elasticsearch)?
0
votes
1
answer
131
views
How to prevent upload kitchensink workflow in docker?
I run Netflix conductor docker (conductor/docker docker-compose.yaml).
Docker starts and uploads workflows:
ephemeralKitchenSinkEphemeralTasks
ephemeralKitchenSinkStoredTasks
kitchensink
How I can ...
0
votes
0
answers
51
views
Cannot find module 'conductor-client' already install module?
I am trying to use this module
https://www.npmjs.com/package/conductor-client?activeTab=readme
and I run the same example given in documentation getting below error
https://codesandbox.io/s/thirsty-...
0
votes
0
answers
501
views
Netflix Conductor Health Check
What is the way to setup health check on netflix conductor? There is an endpoint for health check, but it always returns healthy even if the dynomite has some issues.
/api/health
returns
{"healthy":...
1
vote
0
answers
705
views
Using Netflix Conductor Orchestration on AWS ECS
We are currently working on a approach which will work with collaboration of multiple microservices to provide us with solution.
Dataflow example:
These services will be deployed in ECS with ALB in ...
4
votes
1
answer
1k
views
Netflix conductor server local docker container is unhealthy
I am following the steps here to install & run Netflix Conductor locally on my desktop. I am trying to use docker-compose to bring all the services up. After initial problems of incorrect docker ...
2
votes
0
answers
487
views
netflix conductor - http type task - should not start with workflow - to achieve retry
I have created a task with retry of 5 times.And created a workflow using the task of http type(my rest url api endpoint) for input parameters.
But the moment I run the workflow - it is hitting the ...
3
votes
1
answer
843
views
Netflix/Conductor prints too many dynomite related logs
I'm using Netflix/Conductor with docker-compose. When I set the docker-compose.yml file up I see too many lines related to dynomite. I think it consumes a lot of memory and slows down my system. I ...
1
vote
0
answers
1k
views
Netflix Conductor - java.exe error=206 The filename or extension is too long
In my windows 10 machine I am trying to run Netflix Conductor in memory server.
and on this command gradle server getting this error.
Caused by: java.io.IOException: Cannot run program "C:\Program ...
3
votes
4
answers
5k
views
Netflix Conductor as a workflow engine solution
Can someone share a tutorial on how to use Netflix Conductor? Is there like a code example on github or something? I've done a sample on Amazon SWF and understand how the whole thing works but need ...
5
votes
1
answer
4k
views
Using Kafka with Netflix Conductor
I want to know if there is an easy way to connect Kafka and Netflix Conductor (instead of SQS)? At now, it seems to work only with Amazon SQS. Moreover, it seems that it is only possible to make one ...
4
votes
1
answer
865
views
Netflix Conductor SQS
Has anyone successfully integrated Netflix Conductor with AWS SQS?
I have tried below steps but the workflow is not triggered.
Create SQS queue
Added AWS creds to environment
Registered tasks, ...
-2
votes
1
answer
763
views
Getting error while creating new task definition on conductor
I am creating a Worker task on conductor with
http://localhost:8080/api/metadata/taskdefs
but getting this error
{
"code": "INTERNAL_ERROR",
"message": "INTERNAL_ERROR - Can not deserialize ...
1
vote
3
answers
2k
views
Running netflix conductor with standalone elastic search?
How to configure Netflix conductor to run standalone elastic search rather than embedded elastic search ?
9
votes
4
answers
4k
views
How do I register a microservice (or its methods) to Task in Netflix Conductor?
I was looking for a more sophisticated workflow than Saga from AxonFramework -- which we are currently using -- and I found one in Netflix Conductor.
Sadly, I have searched the Internet for a decent ...