Questions tagged [publish-subscribe]

Publish/subscribe is a messaging pattern where senders (publishers) of messages do not program the messages to be sent directly to specific receivers (subscribers). Rather, published messages are characterized into channels, without knowledge of what, if any, subscribers there may be.

Filter by
Sorted by
Tagged with
0 votes
0 answers
4 views

Google Pub/Sub notification message voidedPurchaseNotification?

I scraped and parsed the notification message and found this data attribute. Google Pub/Sub notification message voidedPurchaseNotification attribute only appears when refunding? If not, please list ...
Shutian.Ka's user avatar
0 votes
0 answers
7 views

ZMQ general visibility / debuggiing suggestions

I have beeen using ZMQ (via pyzmq) recently for setting up publish/subscribe between nodes on a single machine. However, when things go wrong, I have no visibility into what is causing the issue, and ...
Jordan's user avatar
  • 33
0 votes
1 answer
36 views

Python Pubsub Subscriber client not pulling messages when filter is applied on subscription

I am using Pubsub streaming pull subscription in my Python web application. When I am not applying any subscription filter, the subscriber client is able to successfully pull messages from the ...
Sumit Desai's user avatar
  • 1,558
0 votes
0 answers
10 views

Process queues at different rates in shared codebase

I'm managing an autoscalable service (gke) that consumes from various queues (processing across queues shares 95% of the same business logic). We want to scale up consumption on these queues ...
lf215's user avatar
  • 1,265
0 votes
0 answers
25 views

PUB/SUB not sending data

I'm sending data in python between two connect machines within the same network (successfully connected). The publisher code is defined as: def senderzmq(self, lat, lon): sock = zmq.Context()....
Raul Parada Medina's user avatar
0 votes
1 answer
109 views

Getting asyncio.run() cannot be called from a running event loop

I have a python application which is running inside a uvicorn server. I have created a Pub/sub subscriber and trying to enable it from my main.py. I am using a streaming-pull subscription. Now, my ...
Sumit Desai's user avatar
  • 1,558
1 vote
0 answers
36 views

Dapr pubsub with redis

With Dapr pub-sub using redis can we limit the rate/interval at which dapr will check if there is a new message in redis? I have been looking for a way to limit that in the yaml file. Here is a sample ...
David Sagang's user avatar
0 votes
0 answers
11 views

Elastic Agent ECK not receiving logs from GCP PubSub Topic

i have created Elasticsearch Cluster along with the Fleet and Elastic Agent in ECK under GCP Project. The objective is to send the firewall and load balancer logs to Elastic Agent so it can be seen in ...
Melvin's user avatar
  • 1
0 votes
1 answer
57 views

Is the subscribe() method blocking?

I'm starting with Project Reactor and I cant understand why is this code infinitely prints "Hello" and never returns the Disposable object. Flux<Object> flux = Flux.generate(sink -> ...
Mr Pikls's user avatar
0 votes
0 answers
12 views

AWS SNS - Failing to add Entries to PublishBatch Via Postman

I am trying to use the PublishBatch action with REST Api Via Postman. when trying to add the "publishBatchRequestEntries", getting the error: 'Top level element may not be treated as a list' ...
Gilad's user avatar
  • 3
0 votes
0 answers
41 views

How to create producer with dynamic topic in quarkus with quarkus-smallrye-reactive-messaging-pulsar?

I am implementing pub/sub based microservices using quarkus and apache pulsar. Quarkus microservice should publish message to the pulsar topic when new entity created (say enitity A). Topic format is ...
Sharofiddin's user avatar
0 votes
0 answers
20 views

How to implement a structured message for subscribing queue sent from python requests?

For development purpose I am using ntfy.sh for publish and subscribe messages, since this queue system is not part of my main project, I not currently focusing on implementation of a queue but just ...
Ciasto piekarz's user avatar
0 votes
1 answer
35 views

How to get all messages from GCloud Pubsub?

I am writing a scheduled cloud function, which subscribes to a pubsub topic and pulls all the messages from the pubsub until the queue is free. I want to ack some messages but nack the others so they ...
Abdullah Sheikh's user avatar
0 votes
1 answer
19 views

How ordering is maintained for multiple instance of the same same subscription in GCP Pub Sub

What happens when you have an ordered topic and a scalable subscriber. I understand that for the ordered topic the ordering (with order key) will be maintained for that subscription. Can we have ...
Saumabha Majumdar's user avatar
0 votes
0 answers
10 views

Receiving a message back on user computer running the agent which is also sending the message

I have an agent running on user's local computer, he makes changes to a file locally, or some other process update a file locally. Agent sends message to a messaging queue, messaging queue updates the ...
Ciasto piekarz's user avatar
0 votes
0 answers
64 views

What's the best solution for "Publishing changes from background threads is not allowed?"

After looking through other posts and Apple doc on this, I can't find a tidy solution that even compiles. I would think my situation is typical: My app does queries over a network asynchronously, gets ...
Oscar's user avatar
  • 2,069
0 votes
0 answers
41 views

How to share data between microfrontends with pub/sub and single-spa framework

I'm implementing a microfrontends architecture, with the single-spa framework, in the scenario I'm implementing I need to share some data, this data will be posted in the topic by an angular ...
Jucileudo Lima's user avatar
0 votes
0 answers
40 views

unable to connect to thingspeak/mqtt/esp32

#include <PubSubClient.h> #include <WiFi.h> const char* ssid = "Singh"; const char* password = "12345678"; const char* mqtt_server = "mqtt3.thingspeak.com"; ...
Lakhwinder Singh's user avatar
0 votes
0 answers
19 views

How to handle number of threads increasing linearly with number of topics in streaming pull?

I have a Python script that takes a list of topics from the user and listens for events published to any of those topics. When an event is received, the script executes a specified action, such as ...
Harsh Nasit's user avatar
0 votes
0 answers
14 views

(Google Cloud) Is there any way to remedy a very large bill that has accrued due to a mistaken operation for several hours?

We are a small company using the cloud, spending tens of thousands to around a million won per month. Due to an erroneous operation in Google Pubsub, there were a very large number of requests, ...
Aru Kim's user avatar
1 vote
0 answers
43 views

Multiple Subscriptions causing slow write to clustered topic

We have two IBM MQ Queue Managers in AWS (EC2, EFS, multi-instanced). They are in a cluster, and have clustered topics (Direct, not Topic Hosts) defined. There about forty topics in all, but only ...
simonalexander2005's user avatar
0 votes
0 answers
42 views

Dynamically subscribe to Servicebus topics in a not-shared, non-durable way in .Net 7

I need some help figuring out how to connect a web app pool of varying size, to a servicebus topic in a dynamic way. I am using .Net 7. The application needs the messages to be received by all ...
Canis's user avatar
  • 4,170
1 vote
0 answers
42 views

Redis pub/sub with database

I'm new to Redis. In my app, I have several servers, and I want to use Redis to share updates between them. My idea is that each server will subscribe to a certain channel in the Redis instance and in ...
user11204821's user avatar
0 votes
0 answers
28 views

Can't create Google Cloud Pub/Sub subscription to receive notifications from Reseller console

I'm following this tutorial from Codelabs (https://cloud.google.com/channel/docs/codelabs/pubsub). According to the tutorial, I should create a topic using the Reseller console as a Super Admin with ...
Ronald's user avatar
  • 1
0 votes
1 answer
21 views

Can kafka function like pubsub by dynamically create consumergroup on demand?

If you have tens of thousands of consumer each needing its own copy of latest message, and consumer number fluctuates by going in and out constantly, can kafka support this usecase? The only way I can ...
olaf's user avatar
  • 253
1 vote
1 answer
124 views

#include <TBPubSubClient.h>

Even though I've downloaded all the necessary libraries, I'm still getting an error during compilation. The code I'm trying to compile is from the example library of ThingsBoard. What could be the ...
Ali Riza's user avatar
2 votes
0 answers
30 views

OPCUA PubSub MQTT ClientID

I'm using the OPCUA UA-.NETStandard-1.4.372.56 libraries to test PubSub components and include it in my client that already has been working for years. I tested and understood the logic behind PubSUb ...
Frank's user avatar
  • 21
1 vote
0 answers
35 views

can pubsubclient connect over ssl using public certs?

I have an esp32 development board and I'm using the pubsubclient version 2.8 from this website here: https://www.arduino.cc/reference/en/libraries/pubsubclient/ I also have a mosquitto broker set up ...
John's user avatar
  • 32.7k
0 votes
0 answers
54 views

ROS topic and ROS INFO publishes different format for same data

I am reading camera extrinsic parameter from a .yaml file and publishing it to a topic named extrinsic. After the node launched, I am getting the parameters and data published on the same terminal as ...
MManuel's user avatar
0 votes
0 answers
41 views

ReactiveRedisMessageListenerContainer doesn't manage the number of subscribers for each subscription but always creates a new one

I'm using ReactiveRedisMessageListenerContainer but need help with some questions, in particular how subscriptions are handled with Lettuce. In the class there is a map: Map<ReactiveSubscription, ...
Asyncrono's user avatar
0 votes
1 answer
18 views

How to wait until subscription from SUB socket is registered on PUB side when using ZeroMQ?

I have message bus that only forwards messages from its PULL socket to PUB socket. It works as a communication medium for other pieces of the system that use PUSH socket to send messages and SUB ...
Afkaaja's user avatar
  • 47
0 votes
0 answers
17 views

Implement pub sub solution for single logout

I am new to pubsub but I believe it's the best way to deal with a problem I have in my applications. Context: I have multiple web applications. Each one with its own domain. As an example: ...
Henry Peregrino's user avatar
0 votes
1 answer
312 views

React Context API can't support efficient pub sub pattern

I'm using React's Context API to implement a simple pub-sub pattern. I have a list of 100 items with a few duplicates, and there's a like button on each of them, when I press the like button on an ...
Arch1tect's user avatar
  • 4,150
0 votes
0 answers
31 views

Redis Pub/Sub memory consumption

I’m currently reading System Design Interview, an insider guide vol2 by Alex Xu & Sahn Lam and I’m a bit struggling on understanding the way they calculated Redis Pub/Sub memory consumption The ...
Nikita Krasnopolskii's user avatar
0 votes
1 answer
190 views

DAPR pubsub - subscribe to an azure service bus queue

I created an azure service bus queue, named: product with sessions enabled as I must use the session feature. I created a C# console app to send messages to an Azure Service Bus using DAPR. I use ...
Zoltan Hernyak's user avatar
0 votes
1 answer
135 views

non-retriable error returned from app while processing pub/sub event when using declarative way

I'm getting an error like this when i try to consume a topic using DAPR pub/sub. It looks like the message is consumed successfully, but an error is logged just before. Couldn't identify the root-...
Kiran Sankar's user avatar
0 votes
0 answers
37 views

DAPR publish with metadata - where is the metadata?

I tried to publish a message with metadata using DAPR. The producer is like this: public class Message { [JsonPropertyName("messageId")] public Int32 MessageId { get; set; } [...
Zoltan Hernyak's user avatar
0 votes
1 answer
34 views

could not create pg-notify extension in pgadmin

CREATE EXTENSION IF NOT EXISTS pg_notify; could not execute this command in pgadmin . I am getting the following error: ERROR: could not open extension control file "C:/Program Files/PostgreSQL/...
Priya M's user avatar
0 votes
0 answers
64 views

FIlter Gmail API label ids with AND condition

I set up a workflow to trigger an appscript when some emails are received. At a high level, the steps are: New - i.e. unread - messages that match some criteria are automatically starred using a ...
Luca's user avatar
  • 61
1 vote
1 answer
171 views

How to handle acknowledging a Pubsub streampull subscription message?

I am trying to streampull messages that I receive from cloudrun source which is sending the messages to a topic, while I am trying to process and acknowledge the messages back to pubsub I am receiving ...
akshay dirisala's user avatar
0 votes
1 answer
134 views

How to listen events from all azure subscription using Azure Event Grid?

I have a list of azure subscriptions, where i would like to listen to the events (e.g. virtual machine created) from those azure subscriptions (i am not the owner) with Azure Event Grid. Is that ...
hades's user avatar
  • 4,396
0 votes
1 answer
61 views

Node.js PubSub new v1.SubscriberClient() pull request pulls very few messages

I need to pull 2500 messages so I have set maxMessages to 2500, but still it pulls only 500 messages maximum and often it pulls less then 10 messages also. Given that I concurrently pull messages in ...
ANISH DUTTA's user avatar
0 votes
1 answer
56 views

How to stop python running in parallel execution

I am using the below script to get the message from Google Pub/Sub. When I execute the code, it is not waiting for the sleep time mentioned in the function time_sleep(). My expected result is, Message ...
Moses's user avatar
  • 226
0 votes
0 answers
58 views

How to realise a pub/sub alert system with Prometheus and Grafana

I am new to monitoring with Prometheus and Grafana. At the moment we can configure an alert channel to send emails when critical events occur. But in our requirement we need to publish to a pub/sub ...
Tsognong Fidèle's user avatar
0 votes
1 answer
67 views

architecture guidance for multiple messages in an array

We are building a simple pub-sub system using Kafka. The publisher is a service that receives an array of messages (called a Block) from a client app that is published to Kafka topic. We have 4 ...
Viking22's user avatar
  • 557
0 votes
0 answers
18 views

How to trigger action in different platforms / applications

I am trying to build a process to notify all my applications about a user who changed his information. At the moment I have a web application (React), an iOS application (Swift) and an Android ...
Henry Peregrino's user avatar
0 votes
0 answers
100 views

StackExchange.Redis with Redis Cluster: PubSub always consuming from one shard

I am using the StackExchange.Redis library in C# and have come across an issue related to Redis Cluster and PubSub functionality. Setup Redis Cluster with multiple shards. Many subscribers in the ...
Martin Obrátil's user avatar
0 votes
0 answers
12 views

Google Pub/Sub Middle Ware Rest/API integrations

Trying to use Pub/Sub as a middleware to stream data for customer consent management, as customer accounts are created, or privacy preferences are updated, we want to stream the data to our Customer ...
Thaddeus Woods's user avatar
0 votes
1 answer
61 views

how to send images and binary documents using Azure Pub Sub ? is it supported?

how to send images and binary documents using Azure Pub Sub ? is it supported or only text ? trying to send images and documents to azure pub sub. is there any limitation about it ? any example using ...
jonyp's user avatar
  • 1
2 votes
1 answer
63 views

Dapr - Quarkus Run/Build Error java.lang.ClassNotFoundException: javax.ws.rs.ext.MessageBodyReader

I'm trying to build a very simple Pub/Sub demo based on this using Dapr & Quarkus & Gradle and I'm facing this error: [error]: Build step io.quarkiverse.dapr.deployment.DaprProcessor#...
oMG's user avatar
  • 323

1
2 3 4 5
60