Questions tagged [aeron]
Aeron is a reliable UDP unicast, UDP multicast, and IPC message transport
56
questions
0
votes
1
answer
22
views
What ports do I need to open for firewall for Aeron Cluster to work?
I have an Aeron Cluster working at AWS nodes and I also have a cluster client locally (ie my box) and I try to talk to it... In terms of security, I only opened the cluster Ingress UDP port to allow ...
1
vote
1
answer
19
views
How do we read from the Cluster's replicated log?
I'm currently trying to replay the inbound messages to the cluster. While the live inbound messages using a simple subscription on the logChannel and logStreamId works, I'm wondering if there's a way ...
0
votes
1
answer
52
views
Connect Aeron between two separated machines
Is it possible to send messages with aeron between 2 separated machines that are not in the same local network?
If so, how do you connect to the Media driver remotely.
Thanks
0
votes
1
answer
46
views
Is it possible to reduce the timeout (10s?) during cluster update by actively shutting down the leader?
If AeronCluster wants to update the leader node when running, the cluster will face the heartbeat timeout (10s?) unavailability. Is it possible to add a signal to ClusterTools to make the leader node ...
0
votes
0
answers
38
views
Aeron spy subscriptions and flow control
I want to record a publication with SourceLocation.LOCAL to benefit from the zero-copy spy archive subscriptions. However the documentation says that spy subscriptions do not factor in receiver flow ...
0
votes
1
answer
52
views
Aeron ReplayMerge never merges
My ReplayMerge gets stuck in state ATTEMPT_LIVE_JOIN, then times out due to no progress. It adds the live destination with no issues (I see the corresponding subscription appear in aeron-stat and the ...
0
votes
0
answers
30
views
Should aeron-cluster egress API be circumvented in a "persistent event log" scenario?
In aeron-cluster, the egress API materializes in the following way:
cluster clients specify an egress channel + streamId in configuration
cluster clients provide an EgressListener
the clustered ...
0
votes
1
answer
47
views
Aeron ArchiveException
I have a problem in loading cluster nodes on aeron . when node start to load logs from archive , the following error occurs:
io.aeron.exceptions.TimeoutException: ERROR - Archive connect timeout: step=...
0
votes
0
answers
16
views
Specify a sender port
I'm guessing that there is a way to specify a port for Aeron to use when sending data over, but I can't find it.
Let's say for example that Machine A has a publication to 2.2.2.2:12345.
Machine B has ...
1
vote
1
answer
71
views
aeron 1.37 pingpong(c) test gets a slightly higher latency number compare to 1.31.2
I've been using real-logic/Aeron(c/c++ version) for almost 2 years.
Recently I was thinking of upgrading Aeron from 1.31.2 to 1.37.0.
But after run the pingpong test, I got a slightly higher latency ...
0
votes
1
answer
48
views
Publisher starts to receive constants back pressure
I start to use Aeron but faced the issue that over the time (exactly 3-4 hours after start) broadcast publishers receive constant backpressure.
My setup is the following:
Both publishers and ...
0
votes
1
answer
87
views
session recovery best practice in Aeron
How to recover a closed session from the client-side in Aeron? Imagine that our Aeron server-side is down and killed, now clients need to have a proper plan to re-connect when the server is available. ...
0
votes
1
answer
50
views
how config aeron channel by udp multicast, all subs can receive messages?
I am trying to run a Basic Publisher/Subscriber pair on the same Multicast/Port.
I want to know how config channel for udp multicast, special the "interface" paramter, all subs can receive ...
1
vote
1
answer
64
views
Aeron Archive - extend existing recording
I have an Aeron Archive and want to extend the existing recording, i.e. that it continuse to append messages after the service restart.
I wasn't able to find any actual example how to do that, so I ...
0
votes
1
answer
128
views
Logging In the Aeron
I'm looking for a solution to log all requests/errors in a log file to parse logs with ELK
Is there any best practice or sample? or what's the Aeron recommendation for this requirement?
0
votes
0
answers
37
views
spy-aeron broadcast subscriber doesn't send message
I have c++ publishers and subscribers, and want to use this aeron-spy feature. It successfully works with unicast publisher
aeron-spy:aeron:udp?endpoint=0.0.0.0:4007
and fails
for broadcast ...
0
votes
1
answer
90
views
Aeron cluster intercommunication
i want to understand aeron cluster inter communication
Hi,
I am new in Aeron Cluster and I try to understand the relations between the various cluster's components.
From https://github.com/real-logic/...
0
votes
0
answers
25
views
Aeron Archive fails to start due to mark file version mismatch
My Aeron Archive process is failing to start, apparently due to the following error:
Exception in thread "main" java.lang.RuntimeException: java.lang.IllegalArgumentException: mark file ...
0
votes
3
answers
93
views
Aeron publication side concurrency issue on singleton request buffer
is there any best practice to handle concurrency on publish side??
assume that we have a client that wants to handle 1 Million concurrent requests, these requests must send to the Aeron server-side ...
1
vote
1
answer
69
views
C++ Build Windows build fatal error LNK1104 gmock.lib
I'm trying to build Aeron on Windows with VS2022. I have all requirements stated in README.md (eg I've installed JDK etc) and have run the build script in Developer PowerShell VS2022 using the ...
0
votes
1
answer
99
views
What is the purpose of snapshot in Aeron Cluster?
I started learning about Raft as well as Aeron Cluster lately. One thing I come across is Aeron has the notion of taking snapshot to save the state of the machine. According to Raft, all the followers ...
0
votes
1
answer
33
views
How to pass payload to Aeron handler?
I use the Aeron client implementation in C. And I need to make closure. But there are no closures in C...
For example:
void poll_handler(void *clientd, const uint8_t *buffer, size_t length, ...
2
votes
1
answer
102
views
Aeron cluster gets blocked when taking a big snapshot
I've been experimenting with aeron cluster, and one thing that is unclear to me is how do you deal with applications where nodes have 10s of gigabytes of state... this state is in memory and is ...
0
votes
0
answers
60
views
Aeron Archive and MDC (Multi-Destination-Cast) work in same channel
I have a udp channel with one subscriber and archive also startRecording on this channel.
When archive works as a spy subscriber(SourceLocation.LOCAL), there are many backpressures with 50MB/s network ...
0
votes
1
answer
115
views
Aeron MDC (Multi-Destination-Cast) performance
I'm playing with Aeron mdc and find that the publication performance degrades with the increase of subscribers before reaching the network capacity.
The case is that 1 publication in 1 node, sending ...
1
vote
1
answer
71
views
Aeron publication suddenly stops message transmission
I have the stream which suddenly (after number of successfully transmitted messages) stops sending|receiving messages.
The output of AeronStat for it is:
47 : 8,452,864 - pub-pos (sampled): 9 -...
0
votes
1
answer
82
views
Is it safe to set file sync level 0 in aeron cluster in production?
I know it's unsafe to set file sync level 0 in a single node aeron cluster, because, in case of a crash, some data can be lost.
But what if we have at least 5 nodes in the cluster? I guess it is quite ...
1
vote
1
answer
104
views
when using Aeron for Android
I create client Aeron on the Android app.
Unfortunately, Aeron is using Agrona which relies on sun.misc.Unsafe. Android don't support sun.misc.Unsafe.
Log error:
I/ientapplicatio: Rejecting re-init on ...
0
votes
1
answer
159
views
Can Aeron lose messages?
If I offer a message via Publication to some channel (IPC or UDP) and this operation returns a positive value (new position) that means that data were written on disk (fsynced to /dev/shm) or not? In ...
0
votes
2
answers
210
views
What type of message delivery guarantees Aeron can provide?
What message delivery guarantees Aeron give me as a messaging framework (at least once, at most once, exactly once)?
0
votes
1
answer
149
views
Does the Aeron C Media Driver support Clustering capabilities?
Previously I read in docs that the C Media Driver is in development and doesn't support Aeron Cluster like the Java Media Driver does.
Is this still the case? Is it a goal for C Media Driver to be on ...
1
vote
1
answer
110
views
How to persist the egress messages of Aeron cluster
My Aeron cluster clients share an identical output stream, and I want to be able to persist it for playback at a later time.
Can anyone offer some ideas?
-1
votes
1
answer
133
views
Can I have 2 different Egress from AeronCluster?
Can I have 2 different Egress from AeronCluster?
0
votes
1
answer
163
views
Is it possible to add members to Aeron Cluster w/o reconfiguring existing ones?
I'm looking for a way to add new members to existing Aeron cluster without reconfiguring existing ones.
It seems cluster members are defined statically during startup as described in the Cluster ...
5
votes
1
answer
204
views
Is it possible to replay from Aeron Cluster?
We would like to use Aeron as persistent queue.
Is it possible to setup Aeron Cluster to provide
replication, and
possibility to replay (like Aeron Archive)
for the clients?
2
votes
2
answers
678
views
What is the difference between RSocket + TCP and RSocket + WebSocket?
I am completely new to RSocket.
I read the FAQ and the motiviations page (and skimmed the Protocol page) and understand that RSocket can be used on top of TCP, WebSocket and Aeron. But what I don't ...
1
vote
1
answer
209
views
Aeron - Issues with Multicast across Switches
I am trying to run a Basic Publisher/Subscriber pair on the same Multicast/Port. It works perfectly when the hosts are connected to the same Switch, but not if the subscriber is on a different Switch.
...
0
votes
1
answer
152
views
Aeron getting rates from CME UDP multicast using RateSubscriber.cpp
I can easily get rates from the New release UDP stream using winsockets, but for some reason I can't get any rates using aeron. I am using the RateSubscriber project and the following URI:
const ...
0
votes
1
answer
124
views
Aeron: should Archive taggedReplicate work with C Media Driver?
I'm getting a timeout exception on my even basic tests with taggedReplicate, while with Java MD everything is just fine.
I tested with a stand alone MD versions 1.27.0 and 1.31.1
2
votes
1
answer
157
views
How can I embed the Aeron driver JAR in a Rust program and start it later?
I have a Rust program that uses Aeron through the aeron-rs crate.
Every time I want to run my program, I need to manually start the driver first. In fact, the crate explicitly states that it works ...
5
votes
1
answer
445
views
Different results for transport benchmarks
I made some benchmarks for my presentation about Aeron, but I found out that if I use different tools for the same transport I got slightly different results.
For example, if I use HDR histograms I ...
1
vote
2
answers
703
views
Aeron Messaging Pattern for Pub/Sub, One Way and Competing Consumer
Currently i'm in the process of assessing Aeron for our High-frequency trading use case. As i see from the documentationm Aeron is basically the transport. Is that some higher level implementation ...
2
votes
2
answers
270
views
Aeron basic pub/sub pair connects on same host, fails across hosts
I am running the BasicPublisher/BasicSubscriber pair from https://github.com/real-logic/aeron binding them to the same multicast group+port. When they run on the same host they connect, but when they ...
3
votes
1
answer
185
views
OneToManyRingBuffer implementation in agrona
This may be a stupid question but there's a OneToOneRingBuffer and a ManyToOneRingBuffer available in aeron (agrona). I have a single producer and many consumers I'm wondering how to achieve the ...
2
votes
1
answer
1k
views
How to replace Kafka with Aeron
At present, the trading system of our production environment is using Kafka. Because Kafka latency is too high, we hope to replace Kafka with Aeron. How can I use Aeron correctly?
0
votes
1
answer
56
views
How to set limit on Aeron subscriber and publisher count while Running Aeron Samples
I'm running the Aeron samples as given here.
Steps to run the test:
git clone --branch 1.27.0 https://github.com/real-logic/aeron.git
gradle --console='plain' --stacktrace assemble
$JAVA_HOME/bin/java ...
1
vote
1
answer
197
views
How to dynamically designate and Aeron Cluster leader node?
I would like to direct any node in Aeron Cluster to become leader, no elections. The previous leader automatically becomes a follower, never attempting to assume leadership (unless directed externally)...
3
votes
1
answer
582
views
Using Aeron with RSocket
Good morning,
I am trying to use RSocket on top of the Aeron transport protocol. However, it appears that there is no documentation on the topic - did anyone successfully integrate those two ...
3
votes
1
answer
506
views
Aeron MQ : Multiple subscription
I am currently working on a PoC about Aeron MQ. As per PoC, i have 2 subscriptions and 1 publisher for a local channel with embedded media driver. The messages published are received in both the ...
1
vote
1
answer
132
views
akka cluster- aeron not deleting temporary files
I'm working on akka cluster. Every time when akka creates an Actor system instance, it is creating huge aeron-{user}-clustersystem files under temporary directory, which consumes a lot of space.
What ...