Questions tagged [azure-table-storage]
Azure Table storage is a cloud-based NoSQL service which is ideal for large amounts of structured, non-relational data.
2,369
questions
0
votes
2
answers
53
views
update storage table from azure function
I have a function, triggered off a service bus. The bus contains data from several sources, which I want to process and write to a storage table. I can't guarantee there won't be duplicate entries in ...
0
votes
1
answer
50
views
How to retrieve logging config in Azure Storage Blob, Queue and Table Service with Python Azure SDK
Can someone guide me to retrieve logging information of Storage Queue Service similar to the part I have circled in red as instructed in this article?
Image:
Article link: https://www.trendmicro.com/...
0
votes
1
answer
33
views
Azurite local tables aren't permenant when checked with Azure Storage Explorer
I installed azurite locally to use it for my personal app development. I always launch it with the same set of ports for blob/queue/table.
I created a table and entered some data and then I checked ...
0
votes
1
answer
71
views
mltable client insists on using interactive authentication
I can't get the mltable client to stop using interactive authentication to load or save data. The folowing code:
registered_data_asset = ml_client.data.get(
'Dataset',
label='latest')
...
0
votes
1
answer
122
views
Data conversion in Azure Table storage
I have a simple Azure function that takes previous data from the table storage, uses it for producing a new row which is then recorded back to the same table.
These rows have many different fields, ...
0
votes
1
answer
68
views
Azure Table JavaScript issue
I'm trying to access Azure Storage Table's with JavaScript but I'm getting the following error. Unsure why this happening, I've seen many examples online where this works. I'm typing more here as it's ...
0
votes
2
answers
70
views
.NET how resolve needed genericity between layers
I have a question that may be quite trivial for some. I'm making an application in .NET where I'm trying to have split layers. Application (abstraction only) and Infrstructure (implementation). My ...
0
votes
1
answer
70
views
How to update the connection string in TableServiceClient
I am using this code
TableServiceClient serviceClient = new TableServiceClient("ConnectionString");
How can I update the connection string after the TableServiceClient creation?
0
votes
1
answer
95
views
Is it possible to connect using the CosmosDB connector to Table Storage?
I'm uploading data to Table Storage, but I need to use the CosmosDB connector to be able to do a full insert of a large Spark Dataframe to my Table Storage table, as I don't want to use TableClient ...
1
vote
2
answers
42
views
ADF Copy activity skips Table Storage rows which have different values than the inferred schema
I want to copy a table from one storage account to another with the Copy activity in ADF. I just need a simple copy of my table, preferably 100% identical to the source table.
There is a field in the ...
0
votes
1
answer
19
views
Why are columns in Azure Table Storage retrieved as "keys" in my function?
[FunctionName("GetInfo")]
public static async Task<IActionResult> Run(
[HttpTrigger(AuthorizationLevel.Function, "get", "post", Route = null)] ...
2
votes
1
answer
78
views
Inserting batches in Azure table storage using the Azure.Data.Tables SDK does not appear to be doable
I am upgrading all my azure table storage functionality to Azure.Data.Tables library since the Microsoft.Azure.Cosmos.Table SDK is being deprecated.
I loaded batches of data easily using this code ...
0
votes
1
answer
109
views
Blob Storage Sink Timeout During Azure Data Factory Copy Activity
I am trying to backup Azure Table Storage tables to Azure Blob Storage using the Copy data activity in an Azure Data Factory pipeline.
This is mostly working fine, but for a few of my storage accounts,...
0
votes
2
answers
133
views
I am able to write data to Azure table storage, but I'm not able to read from table
I am using Nodejs - TS Express server. I am trying to read the data from the table called tracker which also has the partition name as tracker. I am able to write to the table with no issues, but when ...
1
vote
0
answers
57
views
ADF Copy activity ignores explicit data type mapping with Table Storage source and sink
I'm trying to copy a a TS table from one storage account to another with an ADF pipeline, using a Copy activity. I want a copy that is 100% identical with the source table.
The table does not have a ...
1
vote
1
answer
116
views
Azure Tables and Blobs Tests
So I'm trying to do Azure Tables and Blobs tests related to service I'm implementing. But when I do the tests it says 'Cannot mock TableServiceClient / TableClient because they are final classes' (...
2
votes
1
answer
163
views
Azure Table Storage query retrieving no entities from valid filter when records are present in table
I am using the Azure.Data.Tables library version 12.8.
The ITableEntity is as follows:
public sealed class DailyEventEntity : ITableEntity
{
private const string Format = AzureConstants....
1
vote
1
answer
23
views
Using LINQ query two tables bases on matching Ids and return a data structure that has the the id
Imagine a table structure like the above in Azure Table storage.
Table 1
Column A
Column B
Column C
"partitionkey1"
101
test
"partitionkey1"
102
test
"partitionkey1"
...
1
vote
1
answer
60
views
Golang aztables Authorization failure with az login
I'm trying to follow along the tutorial at https://learn.microsoft.com/en-us/azure/cosmos-db/table/how-to-use-go?tabs=bash, and the credential I get from azidentity.NewDefaultAzureCredential is able ...
0
votes
1
answer
22
views
Azure SWA Function response is incorrect when Azure Table storage called
I have an api in an Azure SWA which needs to retrieve data from Azure Table Storage.
I am running local development using VSCode on an M1 MAC w/ the Function and SWA extensions, a dev-container, with ...
0
votes
0
answers
44
views
Counting existing entries in an Azure storage table using a partial row key
I'm storing some entities in an Azure storage table. I need to know the version number of each entity, and this comes from the number of entities already present with the same row key prefix.
For ...
0
votes
1
answer
63
views
Azure SWA Development - Accessing Storage during local development
I'm developing an SWA app and would like for an API in my app to access Azure Storage.
Ultimately, I'd prefer to use a Managed Entity for this.
I am using AD authentication, but when developing ...
0
votes
1
answer
68
views
Azure TableClient ConnectionString update_request TypeError on dict
I'm creating the table client like so:
with TableClient.from_connection_string(self.connection_string, table_name=self.table_name) as table_update_entity:
table_update_entity.update_entity(_entity,...
0
votes
1
answer
161
views
Azure Table Storage : Saving and retrieving complex structure
I'm trying to store a complex object in the Azure table storage.
I have implemented ITableEntity interface for my entity.
And I have done the implementation for the ReadEntity and WriteEntity methods ...
0
votes
1
answer
134
views
Azure functions table binding with filter query
Filter query currently throwing an exception when attempting to retrieve a list that match the query
The documentation implies its OData, putting an oData string in doesn't fix it
public async Task ...
0
votes
1
answer
60
views
Query with custom object type fails to convert custom fields in Azure Table Storage
I'm trying to query an Azure Table Storage instance from an Azure Function to retrieve either a single or multiple entities according to particular conditions (filters).
According to Microsoft's ...
0
votes
1
answer
51
views
Remove Azure Table Storage EntityProperty from TableClient.query_entities() Results Before Writing to Pandas DataFrame in Python
I'm fairly new to using Azure Table Storage and am trying to pull data from it with Python into a Pandas DataFrame. I am using TableClient .query_entities() from the azure-data-tables package, and it ...
0
votes
1
answer
34
views
Azure table storage python client return not implement when query the entity
I have this code:
table_client = TableClient(
endpoint=AZURE_TABLE_URL,
credential=AzureSasCredential(AZURE_TABLE_SAS_TOKEN),
table_name=AZURE_TABLE_NAME
)
entities = ...
0
votes
1
answer
240
views
Access Storage Account Tables via Azure.Data.Tables results in 403
I am currently writing an Azure Function App that scans the data in Storage Account blobs and tables to delete data older than a given time period. I am utilising the Azure.Data.Tables v12.8.0 ...
0
votes
1
answer
188
views
Azure Storage authorization failure (Excel and Power BI)
I am getting "Access to the resource is forbidden." when trying to connect to an Azure Storage Table using either Excel or Power BI. both applications are logged into the Azure with my ...
0
votes
0
answers
179
views
Unable to update a retrieved Azure storage table entity - "The specified resource does not exist"
I have some code which queries an Azure storage table, then returns a collection of results/entities.
These results/entities are then used in another method, and if a result in that method is false, ...
1
vote
1
answer
84
views
How can I list all partition keys in Azure Table Storage?
I'm trying to look at what's inside an Azure Table Storage from the CLI.
If I try to list all entites, it says it requires the partition key:
az storage entity show --table-name Device
the following ...
0
votes
2
answers
230
views
Azure Data Factory, table storage copy Binary data results in System.Byte[] output
We are moving large amounts of data from one table store to another table store in other region and subscription.
I have set up a pipeline for copying the data in Azure Data Factory, which seemed like ...
0
votes
1
answer
108
views
Azure function to query specific dates in Azure Table via node.js
For some reason the code below in Azure nodejs via odata does not return any data in the array. An example date format should be like 2023-06-29T08:38:27.92Z
What I want to get is to get those dates 1 ...
0
votes
0
answers
155
views
Unit test code on Azure.Data.Tables methods
getting below error while writing unit test cases for azure table storage functions.
Mock does not contain a definition for 'GetTableClient' and no accessible extension method 'GetTableClient' ...
0
votes
1
answer
26
views
TableStorage Namespace
If I use this namespace, it works fine
using Microsoft.WindowsAzure.Storage;
using Microsoft.WindowsAzure.Storage.Auth;
using Microsoft.WindowsAzure.Storage.Table;
namespace TableStorage
{
public ...
0
votes
1
answer
149
views
Using FakeItEasy to fake an AsyncPageable
I've run into a problem while testing an Azure Function which runs on top of Azure Tables: How can I fake the result of a table query which returns an AsyncPageable?
Here's the code under test...
...
0
votes
1
answer
185
views
Total record count for Azure page pagination
If we take the follow bit of code
var pages = TableClient.QueryAsync<Entity>(maxPerPage: 10).AsPages(continuationToken);
await foreach (var page in pages)
{
return page;
}
This brings back ...
0
votes
1
answer
226
views
What is the difference between merge and replace in ADF copy activity insert type for table storage dataset
What is the difference between merge/replace/dynamic content for insert type option in ADF copy activity for table storage datasets
0
votes
0
answers
106
views
Compare 2 date time column in azure table storage and copy to destination using ADF copy activity only if there is difference
I have 2 table storages . I need to copy data using ADF from Table 1 to Table 2 only if ActualTime == Timestamp. How can I achieve this?
Basically I need to copy rows to Table 2 only if there is no ...
0
votes
1
answer
137
views
NotImplemented Error when retrieving an entity from Azure Table Storage
I'm using Azure table storage from a nodejs projects and interacting with the service through the @azure/data-tables module.
I am able to write data to the table but I am unable to retrieve or ...
0
votes
1
answer
194
views
Contain and Sort in Azure Table Storage with Node JS
All,
I am trying to fetch some records via Azure Function using Node JS from a Table Storage.
let result = await tableClient.listEntities({
queryOptions: {filter: odata`PartitionKey eq ${...
0
votes
1
answer
203
views
Insert Entity in Azure table storage using Web Activity ADF- Authentication Issue
Currently, I am trying to insert an entity into an Azure table using web activity in adf,
https://learn.microsoft.com/en-us/rest/api/storageservices/insert-entity
but after multiple attempts, I keep ...
0
votes
1
answer
408
views
How can I configure Azure Data Factory to create Table Storage tables during a copy activity (using SAS token)?
I'm creating a data factory pipeline to copy data from blob storage to table storage. The table may or may not exist in table storage and needs to be created if it doesn't exist. The Authentication ...
0
votes
2
answers
241
views
Azure Function / C# / Azure Table: cannot store my data
I'm trying to store some monitoring data into an Azure Table.
I've added the Azure Table Client to my C# Azure Function (running on .NET 6, isolated), and I'm trying to store this data into my Azure ...
0
votes
1
answer
487
views
How to update a row in an Azure storage table using an Azure Function out binding
I'm using an Azure Function to process data stored in an Azure Storage table. The Azure Function is written in PowerShell and is triggered by a timer to run each minute. On each run it will take the ...
0
votes
1
answer
103
views
Struggling with batch processing in Azure Table Storage locally
I have these batches that contain more than 100 entities that I'm trying to split to send in my local Azure storage account (Azurite):
def save_results_in_database(self, operations, table_name):
...
0
votes
2
answers
220
views
Unable to use string-based methods on a string property inside an Azure storage table query lambda
While querying an Azure storage table I get an exception.
Here is my query:
tableClient.QueryAsync<Resource>(resource => resource.PartitionKey == projectId.ToString()
&& ...
0
votes
1
answer
40
views
Filtering the Data storage table using PartitionKey and Date time
I want to get the data over a time period using both PartitionKey and datetime filter.
https://sa.table.core.windows.net/ABC()?$filter=Timestamp%20gt%20datetime'2023-04-03T13:47:52.083669Z'...
0
votes
1
answer
79
views
Azure Storage REST API POST request
I am trying to write a POST request in Swift 5 using CryptoKit and following the AccessKey scheme for Azure Storage -> Table Service -> Insert Entity but I am getting a 403 error with a failed ...