Questions tagged [pipeline]

A pipeline is a sequence of functions (or the equivalent thereof), composed so that the output of one is input for the next, in order to create a compound transformation. Famously, a shell pipeline looks like "command | command2 | command3" (but use the tag "pipe" for this). It's also used in computer architecture to define a sequence of serial stages that execute in parallel over elements being fed into a pipe, in order to increase the overall throughput.

Filter by
Sorted by
Tagged with
0 votes
0 answers
10 views

Is there a way to transform both the data matrix and labels in a single pipeline before fitting a model in sklearn?

Suppose I have a data matrix X (numpy ndarray, all features are numeric) labels y (numpy array of string). I want to apply SimpleImputer(strategy='mean') and StandardScaler() to X, and ...
HARSHIL PANDEY's user avatar
0 votes
0 answers
19 views

Github Action with Laravel to run Test Cases before merge or during Pull Requests fails

I have a setup where the root directory of my project holds a .github directory. Alongside this directory is git, for example, alongside src which inevitably has my Laravel-Based Framework Application....
scruffycoder86's user avatar
-1 votes
0 answers
8 views

Metadata track of Azure DevOps pipeline and GitLab Pipeline

I wanted to discuss a potential solution involving our use of Azure DevOps pipelines with Power Platform tools for deploying D365 solutions to various environments. Our leadership team has expressed a ...
bharat jadhav's user avatar
0 votes
0 answers
9 views

We couldn't clone the repository. Try rerunning the pipeline Bitbucket

I'm trying to set my Bitbucket pipeline with runner. I can run my pipeline. I can build my project but repository couldnt clone when i add the runner option as ; runs-on: self.hosted windows The ...
Emre İÇMEN's user avatar
0 votes
2 answers
39 views

.net command list package --format json in azure pipeline

I would like to run the following dotnet command on a hosted Azure pipeline to generate a nuget package list: dotnet list package --format json --include-transitive > /home/vsts/work/1/a/depts.json ...
sentenz's user avatar
  • 113
0 votes
0 answers
10 views

Azure DevOps build fails for XAML files

I have an Azure DevOps build for a new class library project which is building correctly (.NET Framework 4.6.2). I have added some XAML files from another project via Visual Studio and it displayed an ...
Garry Lodge's user avatar
-1 votes
1 answer
28 views

NodeJS — Stream pipeline silently crashes

I noticed the usage of NodeJS's pipeline (through the "stream" package) silently crashing consistently without understanding why. Here is a minimal reproduction: const { pipeline, Readable, ...
theofarus's user avatar
-2 votes
0 answers
12 views

Data engineer tech stack for a starter project [closed]

Having experience with the data science libraries like pandas, numpy and ML libraries like scikit, I am having trouble getting a tech stach for a data engineering project when using free tier versions ...
Hermione's user avatar
2 votes
1 answer
28 views

Blue/Green Deployment, Table Cloning, and Delta live table pipelines

this a rather complex question that addresses Databricks users only. Let me recap a bit of the context that produced it. In the attempt to adopt the Blue/Green deployment protocol, we found good ...
ozw1z5rd's user avatar
  • 3,069
0 votes
0 answers
27 views

Azure Devops build Pipelines [closed]

I am working on Azure Pipelines and i need to configure about the ci cd pipelines which are presented in azure devops portal it have been running the pipelines and need to configure the pipelines ...
ayaz basha's user avatar
-1 votes
1 answer
50 views

Use installed tooling from previous step in bitbucket pipeline

I'm trying to understand more about pipelines and I created this pipeline file. How can I reuse the awscli installation that occurs in the &build-ecr step in the &update-ecs step? ERROR + aws ...
Pablo Marques's user avatar
0 votes
1 answer
37 views

How can I create pipeline variables in Azure DevOps using PowerShell script

I already have an existing piece of script that I use to create release pipelines in Azure DevOps. I am looking to refine it to create pipeline variables that are settable at release time. I tried ...
Enig's user avatar
  • 1
0 votes
1 answer
28 views

How to build one specific Docker image in a mono repo that contains many Dockerfiles

I have a repository with 8 different Dockerfiles that builds different images. They are all in the same repo because they share 80% of the same code. Each Dockerfile corresponds to a separate ...
Rui Nian's user avatar
  • 2,588
0 votes
0 answers
32 views

Pipeline for Machine Learning Model has 'Feature shape mismatch' when trying to predict the target for a single observation

Here is the outline of my Machine Learning / Python project: Build a ColumnTransformer called preprocessor containing multiple transformers (e.g. One Hot Encoding, Ordinal Encoding etc) Build a ...
Zoe's user avatar
  • 35
0 votes
0 answers
36 views

Is it possible to run an asset from an image?

I am trying to understand what I can really do with Dagster. I have some Python codes already containerised and pushed to a container registry. I was wondering if in a Dagster'op or asset I can read ...
TryingToGetBetter's user avatar
0 votes
0 answers
22 views

"Unkown Pipeline node step" on Jenkins

Lately one of our Jenkins nodes has developed an issue with its executors. From a total of 8, three of them are unavailable (meaning, neither "idle" nor "busy") showing that "...
Emilio's user avatar
  • 1
0 votes
1 answer
20 views

How to Convert SSIS Package xml to Azure Data Factory xml Format?

Hi there i have SSIS packages and i want to move jobs to Azure Data Factory pipelines. I dont mean execute SSIS package. Im looking for a easy way to move packages activities to adf pipeline. All ...
padawan's user avatar
  • 21
0 votes
0 answers
15 views

Jenkins Pipeline SCM failover

My Jenkins Pipeline Script code is managed by the Bitbucket repository. The selection of Jenkins Job Definition is Pipeline script from SCM. enter image description here When building the Jenkins Job, ...
Rachel's user avatar
  • 1
-2 votes
0 answers
26 views

How to model a pipeline with a given attrition rate for a certain phase?

I´m trying to create a model in Excel which can provide me with a graphical overview of a portfolio of projects. I´m operating with 4 different phases which my projects will go through, which goes ...
Chris's user avatar
  • 1
0 votes
1 answer
70 views

Run pipeline using Azure REST API

As I see in the last version of documentation https://learn.microsoft.com/en-us/rest/api/azure/devops/pipelines/runs/run-pipeline?view=azure-devops-rest-7.2 To using this API POST https://dev.azure....
workmichsem's user avatar
0 votes
1 answer
69 views

Error: The path would result in a file outside of the app bundle in .NET MAUI Blazor project

I'm working on a .NET MAUI Blazor project, specifically the NativeClients part of the project. My Razor components are organized in the HikaridoConnect.Shared project under the Pages folder, and the ...
Ahune ajé o ahe's user avatar
1 vote
1 answer
35 views

How to manually select features for Scikit-Learn model regression?

There are various methods for doing automated feature selection in Scikit-learn. E.g. my_feature_selector = SelectKBest(score_func=f_regression, k=3) my_feature_selector.fit_transform(X, y) The ...
Bill's user avatar
  • 10.4k
0 votes
1 answer
14 views

Azure Devops Pipeline howto export variable dynamically in cmd.exe script

Hi I have a small snippet to run on Azure devops. It is from an larger project using the "windows-latest" Runs as script aka cmd.exe bat steps: - script: | set ARTEFACTNAME=lorem....
user2752256's user avatar
0 votes
0 answers
9 views

jenkins poststep archiveArtifacts: how to retrieve files from other machine?

I run a jenkins pipeline which executes jobs on a (always the same) virtual machine using agent.jar. These jobs produce artifacts on the VM-workspace directory and these files are successfully ...
user3711142's user avatar
0 votes
0 answers
15 views

Azure Web App Not Updated Despite Succesful Deployment

I have deployed a Flask Web App via an Azure DevOps Pipeline. When I commit on the main branch the Pipeline runs successfully and I can see the updated Python files in Kudu Debug Console in the ...
PK Przemek's user avatar
0 votes
0 answers
15 views

Jenkins extended mail plugin wrong credentials

I'm using mail extended plugin (2.101). I setup the SMTP in Manage Page, When I tried to use it in process in post stages, Jenkins and DEBUG SMTP return this: DEBUG SMTP: need username and password ...
framirezac's user avatar
0 votes
1 answer
40 views

Locally ran Python StableDiffusionXL outputting noisy image

I am running StableDiffusionXLPipeline from the diffusers python package and am getting an output that is a png full of colorful noise, the png has dimensions 128x128. The SDXL model I am referencing ...
ProfessionalFrog's user avatar
1 vote
1 answer
27 views

gh actions cli - failed to set variable ...: HTTP 403: Must have admin rights to Repository

I tried to set a value to the repository variable RUN_ID with the gh actions cli: below the code: name: test3 on: workflow_dispatch: inputs: runid: required: false ...
Motti C's user avatar
  • 43
0 votes
0 answers
21 views

HuggingFacePipeline With AutomodelForCausalLLM 'str' object has no attribute 'shape'

If i use the following code, i get an error message: AttributeError: 'str' object has no attribute 'shape'. Normally im running it with llm chain, but i think something is wrong with my model. The ...
LazyTurtle's user avatar
0 votes
0 answers
25 views

Unity URP, how to disable MSAA in a custom renderpass?

I have a custom render pass. I re-render the entire screen overriding a few renderer layers with different materials. This new RT is then blitted through a material that uses this new colour data to ...
J_M's user avatar
  • 101
0 votes
0 answers
106 views

ChromeDriver: 'DevToolsActivePort file doesn't exist' error

I'm running Codeception tests in our Pipeline using Google Chrome and ChromeDriver on Linux. When I was using for this Chrome version installed from the downloaded .deb package, it was working fine, ...
mk55k's user avatar
  • 1
1 vote
1 answer
40 views

Is there anyway to name the columns of dataframe by using pipeline operator? [duplicate]

Sample dataset is as below: a = data.frame(c(1:3), c(4:6)) #a %>% `names <-` ('w', 'q') #The code did not work... If I want to rename the columns as 'w' and 'q', what should I do to get the ...
doraemon's user avatar
  • 453
2 votes
1 answer
32 views

Disabling git hub actions on Fridays for PROD Deployment

I am pretty new to Git Hub actions. We have a requirement to disable release to PROD on Fridays and keep it enabled for the rest of the days. Is there a way to achieve that in GitHub Actions(GHA). ...
Makruzz's user avatar
  • 127
0 votes
0 answers
13 views

PCF autoscaler is duplicating data in each instance

I have a Java Rest API with Azure Database. I need to use the autoscaler to keep it performing well. Here is the way I create the Autoscaler service (using pipeline and VMWare Apps Manager): ...
Paulo C. Peixoto's user avatar
0 votes
1 answer
22 views

Passing pipeline object as input to external application

Is it possible to pass the object from the PowerShell pipeline as an argument to an external application? I'm trying to rewrite the following bash statement in PowerShell: git show-ref | cut -d' ' -f2 ...
Simon Elms's user avatar
  • 17.9k
0 votes
2 answers
58 views

How to send mail if ADF Pipeline runs more then 10mins

I need to send an email whenever my pipeline runs longer then 10mins. For sending mail I am using logic app but how to check if the time exceeds then 10mins? How can we check and do this in the ...
Nezko1's user avatar
  • 15
-1 votes
0 answers
37 views

connection to k8s cluster using pipeline in Azure Devops [closed]

I need to establish a connection in a pipeline to my Kubernetes cluster in Azure that was just created using another pipeline. I work in Azure DevOps. How can I do this? I tried the service connection,...
Jan's user avatar
  • 1
0 votes
0 answers
20 views

What is the common way of automating image compression for front-end development?

I'm working on a project of campaign pages which often contain many static image files. Manually compress them during development is a pain in the ass. So, I've created a script to compress images ...
Henry Han's user avatar
1 vote
0 answers
28 views

Whats the difference when i put the simple imputer on fit or transform def?

I'm trying to understand what the methods fit and transform do, but the tutorials from YouTube and GPT are both in an opposite way. I want to create a pipeline but I don't know whether SimpleImputer ...
Razark's user avatar
  • 7
0 votes
0 answers
29 views

Azure DevOps / Pipeline & Artifacts / Unable to publish packages with @changesets/cli

i try to manage npm packages with @changesets/cli in a monorepo project, and i try to make it works but i got errors when changesets try to find branch : + npx changeset status 🦋 error Error: Failed ...
Jijon's user avatar
  • 3
0 votes
1 answer
16 views

How to Update Bitbucket Build Status from Azure Pipeline with Custom Message and Values?

How can I update the build status from Azure Pipeline to Bitbucket with a custom message and custom values? I've tried below API, but they didn't update the build status as expected. My goal is to see ...
sajo sam's user avatar
0 votes
1 answer
62 views

Azure DataFactory Foreach Copy Upsert, how to create and use key column

I have multiple tables, and I want to create a key column for each table that will be used dynamically for upsert This is a preview of a list of all tables. In all these tables, we need to create key ...
Shiraz Hussain's user avatar
0 votes
1 answer
20 views

Is the Veracode Update and Scan task available in the ADO Pipeline marketplace?

I need to use the 'Veracode Update and Scan' task inside an ADO pipeline. Unfortunately the task is not available in the Maketplace. Is the task public or I need to contact the Veracode support or ...
AAtanasov's user avatar
0 votes
1 answer
64 views

How to get the HttpContext in a razor component without inheriting from PageModel

I have an issue replacing the deprecated Microsoft.AspNetCore.Http library in my Blazor Server web app, and was looking for a way to get the IHttpContextAccessor. The way I have it now is I've created ...
Jack Dnls's user avatar
0 votes
0 answers
17 views

GitLab CI/CD doesn't allow to push code after authentication with SSH

I’m trying to make a job that merges to TEST branch after merging to master, but I’m having problems with pushing code to the repository. Heres the code: deploy_test: stage: deploy image: ubuntu:...
Cubex's user avatar
  • 37
0 votes
1 answer
23 views

spring-data-mongodb dependency for @Aggregation annotation for aggregation pipeline

import org.springframework.data.mongodb.repository.Aggregation; Following import is not resolved for <dependency> <groupId>org.springframework.data</groupId> <artifactId>...
Sameer Makwana's user avatar
1 vote
0 answers
33 views

PowerShell, the process block, and garbage collection

I have an application that reads the contents of lots of (potentially large) text files and updates a BLOB field in a database. There is a function that accepts information about individual files from ...
JTDotNet's user avatar
0 votes
0 answers
47 views

Strapi deploy in Azure pipeline Error: Unknown dialect undefined

I’m having this error while deploying my Strapi app to Azure. [2023-08-29 09:58:09.863] debug: ⛔️ Server wasn't able to start properly. [2023-08-29 09:58:09.866] error: Unknown dialect undefined Error:...
mike87's user avatar
  • 309
0 votes
1 answer
8 views

Azure pipeline - error: pathspec 'main' did not match any file(s) known to git

I do get following error when running a release pipeline with maven-release plugin in background: Starting: Reattach detached head =====================================================================...
Splioo's user avatar
  • 400
0 votes
1 answer
15 views

Taipy Scenarios not found after a rerun

I created a Taipy application to create scenarios with predictions and metrics, but when I rerun my code after stopping it, I lose all my scenarios and data. Where does it come from? How can I keep my ...
user avatar

1
2 3 4 5
110