Questions tagged [ssis]

SSIS (Microsoft SQL Server Integration Services) is a platform for building enterprise-level data integration and data transformations solutions. SSIS is used to perform ETL operations; i.e. extract, transform and load data.

Filter by
Sorted by
Tagged with
0 votes
1 answer
35 views

SSIS how to read today's file with wildcard

In our folder, we have file names in this format myFile_yyyyMMddHHmmss.txt, for ex: 20230920095749.txt, 20230919051704.txt. If today is 09/20/2023, in SSIS package, I only want to read today's file, ...
faujong's user avatar
  • 981
-1 votes
0 answers
20 views

Failure inserting into the read-only column [duplicate]

the problem is that the column that contain date and time in csv have a validation error with read-only column in my sql DB I have try to add a data conversation component to fix data incompatibility ...
Safouen Bensidhom's user avatar
1 vote
1 answer
64 views

SSIS Audit Logs DB

I have several SSIS packages created to transfer data and process a SQL merge in tables that then feed some views. To assist in resolving errors going forward I am trying to build an audit database ...
AJF's user avatar
  • 1,821
2 votes
1 answer
43 views

Connecting to Azure SQL Database Using Either Service Principal or Managed Identity

Using SSIS (Visual Studio 2019 Community), on my home PC I am trying to create a DB connection to the Azure SQL Database using either an AZ Service Principal or Managed Identity. Not sure if this is ...
Ian Carrick's user avatar
-1 votes
0 answers
10 views

SSIS makes DT_NTEXT from varchar(256) in PostgreSQL and cries then on destination [duplicate]

how to bypass/fix this? conn: ADO.NET:System.Data.Odbc.OdbcConnection, System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089 driver: psqlodbc_15_00_0000.zip unicode source: ...
SKK's user avatar
  • 37
0 votes
0 answers
21 views

failed to load or find registered .net data provider MySql connector/NET

I have installed Connector/.NET 8.1.0 on my machine. Installation succeeded. When I open VS 2019 SSIS project and trying to create connect manager(ADO.NET source) I am getting error after selecting ...
rajkm's user avatar
  • 1
0 votes
0 answers
37 views

Why do I keep getting a "Directory not empty" error in SSIS packages that aren't using File System Tasks?

I am in charge of a Data Warehouse that is populated nightly from a database using SQL Server Integration Services. We have A TON of packages that run overnight to build out our DWH, the vast majority ...
Matt Prime's user avatar
-1 votes
0 answers
25 views

Execute Process Task WinSCP Error "The process cannot access the file because it is being used by another process"

I have a simple ssis package. First is a script task which creates a file. "file.txt" That part works. The second is an execute process task for winscp scripting which sends that file to an ...
Junsh's user avatar
  • 35
0 votes
2 answers
53 views

Using SQL Server table values for variable values in a Visual Studio SSIS package

I have a SQL Server table with only two single-column rows in it, those two values will change from time to time. As an example, the table right now might look like this: ThisIsMyColumnName ...
user2716086's user avatar
0 votes
1 answer
37 views

Bugs with ETL project Visual Studio 2017

Trying to create an integration services project where I use an "OLE DB source" object in which I execute an SQL query that extracts 120,000 rows and 120 columns. I want to dump that data ...
Tomás Luna Ulloa's user avatar
0 votes
0 answers
12 views

SSIS OnError Event Handler finishes but does not continue the tasks within the For Loop Container

I have a package that updates a large set of tables when executed. On occasions the package will fail due to a mismatch in column numbers between the old version of the tables and the new updated ...
SeanLearningSQL's user avatar
-1 votes
1 answer
33 views

What SQL Server version is my SSIS Package?

Is there a list of PackageFormatVersion of SSIS packages and their SQL Server version compatible? I have a .dtsx package to be run in SQL Server 2012 from a job in SQL Server 2008. But it shows this ...
Jose Rosales's user avatar
0 votes
0 answers
9 views

SSIS OData Detecting decimal precision wrong

I am reading data.from OData Feed, but while reading the data read with wrong precision, it completely avoid any decimal part, ie, I am getting 125 instead of 125.25. Please help us to resolve thi ...
Jabir C Sageer's user avatar
0 votes
1 answer
37 views

How to map input columns in custom SSIS destination component

Ok, my issue is very similar to this one but the answer doesn't work for me: How do you create destination columns in a custom SSIS component? I'm building a custom SSIS destination component to ...
Suxsem's user avatar
  • 98
0 votes
1 answer
33 views

Parameterizing Database Connection in SQL Server Integration Services

I have been struggling with the creation of testing environment for my existing SSIS solution (Visual Studio) and I can't figure out the right approach. My current solution is based on a production ...
Pepper1991's user avatar
0 votes
1 answer
26 views

SSIS How to drop a table assigned to a variable + a suffix

I'm trying to drop a table assigned to a variable name @Table_Name and the corresponding _staging table along with it during a task on the package. Example; [dbo].[Customers] [dbo].[Customers_Staging]...
SeanLearningSQL's user avatar
0 votes
1 answer
17 views

SSIS Event Handler sends me message, even when there is no error

I have a SSIS package and set Event Handler (OnError) to send me a message with logs: "Package: " + @[System::PackageName] + "\n" +"Start Timet: " + (DT_WSTR, 40) @[...
Houman Fathi's user avatar
0 votes
1 answer
42 views

I am exporting to a flat file using SSIS. Why do some of my columns contain the result and 4 decimal places?

I am new to using Visual Studio. I have my data goin to a flat file. There are 4 columns, all numerical values and 1 date. 2 of the numerical values keep exporting to the file as #.0000 What do I need ...
Rylan Demers's user avatar
0 votes
0 answers
26 views

Read multiple CSV files from multiple folder and import to a SQL table through SSIS

I have a main folder(Digikala) and every day, a new folder by date name will be added to the main folder. In these folders I have multiple CSV files, I need to read the folder named with the current ...
PaDideh's user avatar
1 vote
0 answers
70 views

How could I create a Data Lineage solution for SQL Server? [closed]

I posted this question https://softwareengineering.stackexchange.com/questions/447452/how-can-i-trace-back-the-original-table-of-a-column on StackExchange Software Engineer and I made some progress on ...
Elzardi's user avatar
  • 33
0 votes
0 answers
26 views

sp_send_dbmail resulting Excel attachment to include merged cells

My need is to output the query result of a stored procedure as an Excel attachment to a selected audience using sp_send_dbmail. while I am able to achieve this I prefer to have few headers merged ...
Thilini's user avatar
0 votes
0 answers
12 views

SSIS appverifUI.dll getting picked up in Foreach Loop task

I'm trying to run a foreach container task and running into an issue where this file is being picked up as the filename when I go to archive the file I just processed. The weird thing is the previous ...
Jakki Macfadyen's user avatar
0 votes
2 answers
35 views

Script task failing in Deployment only in SQL Server 2019

so I ran my SSIS Job on my local machine with no errors and deployed it to SQL Agent 2019 and I'm using Visual Studio 2019 and the TargetVersion is set to SQL Server 2019 and I'm getting the ...
Steven's user avatar
  • 21
0 votes
0 answers
48 views

How can i copy tables+content from db A to db B when db B is being rebuild every night?

I have two databases: A and B. I have read only access to Database A, full control on Database B. They are on the same server. Database A is rebuild every night. Using BIML Express all schemas and ...
Henrov's user avatar
  • 1,610
0 votes
2 answers
40 views

Add Date from Source A to Source B

I have two OLE DB Source for an Excel file with two different sheet. Sheet A and Sheet B. Sheet A cell I6 contained the date, and I would like combine the two sources and add a column in Sheet B to ...
DataRookie's user avatar
0 votes
0 answers
44 views

How to retrieve SSIS Packages and the associated tables from SQL Server?

I'm currently working on a documentation project related to SQL Server Integration Services (SSIS) packages that are executed through SQL Server Agent jobs. In other words, I want to create a mapping ...
Vishnu R Nair's user avatar
0 votes
0 answers
26 views

Script Task in SSIS failing to connect to SFTP using WinSCP [duplicate]

I used script task using c# code to do an if else logic to determine the existence of the file on the remote system before pulling the file out. At first I created the c# code to run on its own to ...
Junsh's user avatar
  • 35
0 votes
1 answer
29 views

Could not load file or assembly 'Newtonsoft.Json, Version=6.0.0.0 in SSIS 2016

I am trying to use newtonsoft.Json in SSIS C# component as a source. I am getting the below error. System.IO.FileNotFoundException: Could not load file or assembly 'Newtonsoft.Json, Version=6.0.0.0, ...
sree's user avatar
  • 1
0 votes
1 answer
17 views

Cannot parameterize a stored procedure inside an SSIS

I'm creating an export ssis that takes a list of codes via Execute SQL Task, then the list is used in a Foreach Loop Container that has a data Flow Task inside. The Data flow task consists of two ...
BROTH3RCAST's user avatar
-1 votes
1 answer
29 views

How to generate UTC datetimeoffset in SSIS derived column transformation?

I am using derived column transformation in SSIS dataflow. The datatype for CreatedDate and LastModifiedDate in derived column transformation is DT_DBTIMESTAMP The GETUTCDATE() function in derived ...
CleanBold's user avatar
  • 1,579
1 vote
0 answers
18 views

Microsoft OData connector in SSIS gives "(401)Unauthorised" error when trying connecting to AZURE-DEVOPS Workitems

Good day to all, I am new on the forum. I am trying to connect SSIS to Azure Devops Workitems but it is giving the error above. I am trying to provide a consolidated list of all Workitems over several ...
Fishey's user avatar
  • 11
0 votes
2 answers
39 views

SSMS Login Password getting DELETED when the SSIS package is run using that login

I have created a SQL Login on a server (given SysAdmin permission to a single database on that server). And I am using this SQL Login in the SSIS package which will be basically truncating all the ...
PrettyCode's user avatar
0 votes
1 answer
24 views

SSIS Package Metadata

can I extract metadata from ssis package contains which tables or databases using to build Datawarehouse? I want to extract lineage of database, which columns generated by which tables and columns. I ...
Yegane's user avatar
  • 11
0 votes
0 answers
9 views

Re-Register Microsoft Runtime Configuration Manager

Previously it was Register Microsoft Runtime Configuration Manager was configured. Now we need to re-register the different Azure Integration run time. But I am facing the below screenshot How it can ...
Rohit Kulkarni's user avatar
0 votes
1 answer
8 views

SSIS logging to package report

I'm a C# / BizTalk developer, but I inherited 2 SSIS packages, one on Sql Server 2016 and one on Sql Server 2017. Both packages use an FTP task to send collected data to the same destination. In the ...
Patrick's user avatar
  • 31
-1 votes
1 answer
35 views

How to loop through dynamic txt files in SSIS?

I have a folder that automatically receives different .txt files on a daily basis. There are many different .txt files with different names, but the files I'm interested in loading are the same format,...
Josh Berner's user avatar
0 votes
0 answers
10 views

Using Script Task How to Read only half of a text in one line from a file

There is a code that generates a log file which has info on it based on what happens after after package execution. In that log file if a piece of the code fails that log file one of the lines will ...
Junsh's user avatar
  • 35
0 votes
0 answers
13 views

SSIS control flow Precedence Constraint Editor Failure Value package executed failure despite completing the desired path code

I have two code pieces. One is an execute process task which connects to an ftp using winscp scripting. In the code there will be get file.txt Now if the file isn't there it should fail which is ...
Junsh's user avatar
  • 35
0 votes
0 answers
46 views

SSMS SSIS Execution Reports Not Loading

I recently lost the ability to run execution reports on all SSIS packages in SSMS. In addition to this I am no longer able to run SSIS packages in Visual Studio. I have reinstalled SSMS to a more ...
GandalfTheFoolish's user avatar
-1 votes
1 answer
34 views

Is there an alternative way for lookup in ssis for mariadb?

Suppose we have two tables with the following values: ID Name Fname 1 aaaa aaaa 2 bbbb bbbb 3 cccc cccc 4 dddd dddd ID AnotherId 1 3 2 5 3 4 4 2 I'd like to add the AnotherId column to the ...
Arani's user avatar
  • 923
0 votes
1 answer
55 views

SSIS Data Flow Architecture

This might seem like an obvious answer, but I would like to confirm. If we have an SSIS package (2016 or 2019) that moves data from database A to database B does the data move through the SSIS Server. ...
James's user avatar
  • 31
0 votes
0 answers
55 views

While making changes to the SSIS package, is it possible to keep the GUIDs stable?

As a built-in mechanism, the Microsoft SSIS (SQL Server Integration Services) package automatically assigns one GUID for every object in the package. As a result, a simple modification with Visual ...
James's user avatar
  • 1,383
0 votes
1 answer
17 views

SSIS Component In integration Package Fails to Run

I have an SSIS package that runs a few file system tasks and has been running successfully without issue for month. Lately I updated a step to add an additional file system task, tested it to make ...
SomekindaRazzmatazz's user avatar
0 votes
0 answers
26 views

How to resolve issue I am getting while creating oracle connection in SSIS project?

I am creating one SSIS project where I am supposed to fetch data from my sql server dev environment to my local oracle server. I tried creating oracle connection with the help of OLEDB DB Source's ...
Mukesh Tiwari's user avatar
0 votes
0 answers
43 views

SSIS/Microsoft Connector for Oracle ORA-01861

I am having trouble with an SSIS package that pulls data from Oracle using the Microsoft Connector for Oracle v1.2. For one particular query inside of a Data Flow I am using a SQL command that queries ...
sethchev's user avatar
0 votes
0 answers
31 views

IIS SMTP Relay to gmail fails occasionally

I'm using IIS SMTP relay to gmail to send outbound emails. I create this email text file with SSIS script task and place the file in the Pickup directory. This script runs every 15 minutes. It works ...
btorkelson's user avatar
-1 votes
0 answers
21 views

Execute Process Task WinSCP Log File Creation Not being created in right directory and fails execute process task despite completing task

From a ssis package there is an execute process task where it runs a .script file to connect to winscp and gets a file. open ftptest cd %1% lcd Package\%2% get script.txt close exit In the execute ...
Junsh's user avatar
  • 35
0 votes
1 answer
33 views

How to import Excel file and skip dynamic footer?

I have to upload an Excel template needed to skip header and footer rows. It's easier to skip header but I have been struggled to skip the footer because not fixed at a particular number of rows. ...
S Sum's user avatar
  • 1
0 votes
1 answer
39 views

Use Foreach Loop in SSIS to see if a condition is met then move to next container

Trying to use a query like this: Select * from MyTable where CompletedDate >= [@PackageStartTime] Query I have in my SQL Task: Select * from MyTable where CompletedDate >= ? Need to loop ...
Chris's user avatar
  • 1
-1 votes
0 answers
10 views

How to Schedule a Job in sql server between two days [migrated]

How To schedule a job in SQL Server that starts on Wednesday afternoon and it should end on thursday eod and between this the ssis package should execute for every one hour if any error occurs in ...
Charan G's user avatar

1
2 3 4 5
423