Questions tagged [protocol-buffers]
For questions about Google's protocol buffers
7,680
questions
0
votes
0
answers
19
views
layers.Input in tensorflow -- TypeError: list indices must be integers or slices, not str
TLDR: I need this to work with the exact version of tensorflow
(EfficientPose) mona@ada:~/EfficientPose$ python evaluate.py --phi 0 --weights weights/Weights/Linemod/object_8/phi_0_linemod_best_ADD.h5 ...
-2
votes
0
answers
18
views
Are there any proto packages with Datetime with timezone? [closed]
Unfortunately, google.protobuf.timestamp provides only UTC datetime. I need proto datetime type with a timezone (or even without it at all) with C# and Go packages.
0
votes
0
answers
19
views
+250
Create single .proto file to create message for pub/sub
We are using protocol buffers (version 3) for our microservices communications.
We now want to start ingesting those messages into our data storage via sending messages to Google's Pub/Sub.
As best as ...
-1
votes
0
answers
41
views
Map Java Class to Proto Class Using Mapstruct
While performing mapping from a Java class to an automatically generated protobuf class using MapStruct in Java, I encounter an error. The details of the error are as follows:
If I were to give an ...
0
votes
1
answer
35
views
Grpc file is missing when using protoc to generate code
I'm learning grpc. This is a simple hello world example:
syntax = "proto3";
option java_multiple_files = true;
option java_package = "io.grpc.helloworld";
option ...
-2
votes
0
answers
22
views
Akka grpc multi protobuf how to setup the grpc call one after another [closed]
I am implementing akka grpc call in scala programming. I can able to do one GRPC call in AKKa.
But actual scenorio is i need to do multiple GRPC calls in akka, also i need to know how to do in Apache ...
0
votes
0
answers
45
views
Cannot cross-compile proto files for ARM but its working for x86_64
I'm working on a C++ project where I need to cross-compile .proto files for ARM. I work with Yocto so I have a SDK with the rootfs and also a shell script which sets up the environment variables. When ...
0
votes
1
answer
35
views
When I using kubernetes api to health check grpc server, need proto? or not?
from kubernetes import client, config
from grpc_health.v1 import health_pb2, health_pb2_grpc
import grpc.experimental.aio as aio
import asyncio
async def check_grpc_health(ip, port):
try:
...
0
votes
0
answers
50
views
Unresolved external symbol error from generated protobuf C++ code on Windows
I am building a shared library (DLL) that includes Protobuf generated C++ code.
Below is the example proto.
Sample.proto
message Request {
float id = 1;
float name = 2;
}
The protobuf C++ code ...
0
votes
0
answers
12
views
Can I serialize a protobuf object in multiple chunks?
I want to send my serialized protobuf object in chunks no larger than MAX_SIZE bytes.
If I call SerializeToArray(buff, MAX_SIZE) multiple times, will it keep serializing the first MAX_SIZE bytes each ...
0
votes
0
answers
25
views
Writing a gradle task to generate gRPC files for java and javascript
I'm new to gradle and I would like to generate gRPC files for both java, javascript and typescript from a single build.gradle file. However, I can generate the proto files for messages in both java ...
0
votes
0
answers
14
views
Googles Protobuf without deserialization
Normally google protobuf or the nanopb implementation is intended to serialize/deserialize messages on the server respectively the client side.
However, I'm faced with a case where the serialization ...
0
votes
1
answer
36
views
Resize function missing from repeated field in protobuf
Current protoc version: 25.0
I am trying to add x elements into a repeated field at once, and I thought the best way to do it was to use the Resize function. However When I try to compile the ...
0
votes
0
answers
33
views
Protoc regen commands requires different proto imports for generating java and dart files?
I have a directory that looks like this:
protos
user
user_service.proto
user_context.proto
user.proto
The user_service.proto imports my user_context.proto and user.proto.
user_service.proto:
...
0
votes
1
answer
25
views
ClassCast error when using org.springframework.messaging.Message with Protobuf object as kafka message
I am using spring-kafka with producer property as below
key-serializer: org.apache.kafka.common.serialization.StringSerializer
value-serializer: io.confluent.kafka.serializers.protobuf....
0
votes
0
answers
32
views
Can't pickle repeated scalar fields, convert to list firs
I am trying to parallelize a protobuf application
one instance in each thread, but I am getting this error
/usr/local/lib/python3.10/dist-packages/google/protobuf/internal/containers.py", line ...
0
votes
0
answers
19
views
NestJS gRPC freezes for ~10-~15 seconds before accepting new requests
I'm testing out gRPC within the NestJS framework but am stumbling onto an issue. When I try to send out a lot of requests at once the client and receiver become idle and wait for about 10 to 15 ...
1
vote
2
answers
41
views
How to include an error field in gRPC protobuf message using go-grpc
I have a gRPC service written with Go that plays a proxy-like role by wrapping a gRPC message it receives into another gRPC message to a separate backend service. That backend service can return ...
-1
votes
0
answers
29
views
libprotobuf.dll loadlibrary 3765269347 in XP
I built Protobuf as a dynamic library using:
vs2015 update3 v140_xp windows10
When I attempt to 'loadlibrary()' on an windows XP, it returns 'null' with 'GetLastError()' reporting '3765269347'. This ...
0
votes
1
answer
56
views
Use of protobuf in a C++ project spanning 3 repositories
I have three repositories, (re)using a set of protobuf files:
repo1
+ hello.proto
+ goodbye.proto
repo2
+ hello.proto
+ goodbye.proto
repo3
+ hello.proto
+ goodbye.proto
The .proto ...
0
votes
0
answers
37
views
com.google.protobuf.Descriptors$FileDescriptor and com.google.protobuf.Descriptors$Descriptor are in unnamed module of java.net.URLClassLoader
I am getting the below error when the pyflink streaming pipeline tries to start. Source is protobuf coming from Kafka.
Caused by: java.lang.ClassCastException: class
com.google.protobuf.Descriptors$...
0
votes
1
answer
24
views
How to receive protobuf messages sent by the Foxglove server and then save them as MCAP?
I have customized some protobufs, processed them on the server using C++, and published them through the localhost port using the Foxglove server. I hope to save these messages as mcap files for ...
2
votes
1
answer
99
views
How to reverse UTF-8 encoding in a byte array?
I have the following problem:
A certain producer sends Protobuf messages as binary data (byte array).
These binary data enter a misconfigured Kafka cluster which deserializes the byte array as ...
1
vote
1
answer
29
views
protobuf webhook with no fixed request structure
I am using Golang as my backend and proto3 as my API definitions. I have grpc-gateway to support http along with grpc.
My use case is To have a webhook API which gets in some payload and processes it. ...
0
votes
0
answers
35
views
Cannot deserialize protobuf
I am having trouble de-serializing a protobuf. I am confident that it is serialized properly, as serialization works in all other cases.
Here's a simplified proto file:
syntax = "proto3";
...
-1
votes
0
answers
6
views
PROTO nodes (Current Project) does not exist instead there is a PROTO nodes (Current world)
I'm new to webots. I was following the youtube guidline but when i try to add a PROTO, I can't see this section "PROTO nodes (Current Project)" after clicking on "+".
I I tried to ...
-2
votes
0
answers
74
views
"optional" field of proto3 not supported by protobuf-c compiler
We recently started using proto3 and the protobuf/protobuf-c compiler gives us this error message:
Filename.proto: is a proto3 file that contains optional fields, but code generator protoc-gen-c hasn'...
0
votes
0
answers
30
views
How to properly serialize message protobuf when sending to kafka (Python)?
I'm trying to send a message to kafka. I create messages imitating protobuf (using the proto-plus library) where there is a message attached to another, serialize it, but in fact something is sent ...
-1
votes
0
answers
34
views
gRPC is slower than http1.1 multipart-form
gRPC use HTTP/2 protocol, it should be a lillt faster than HTTP1.1. But I get 0.5s for Http1.1 and 0.8s for gRPC for 70MB data, and 0.05s/0.08s for 7MB data. Am I missing some important setup/config?
...
2
votes
0
answers
19
views
Kafka stream with protobuf messages
I have stream of protobuf messages with one type AccountHolder.proto with {name,balance,time} as fields and doing some aggregations on the data content and writing the result as protobuf message of ...
0
votes
1
answer
89
views
What is the correct way of passing data through Unix sockets?
I'm working on a personal project to try to better understand inter-process communications on Unix. I have two binaries i compiled in C and I am attempting to pass data from one process to another ...
0
votes
1
answer
38
views
Proto import from another project in Bazel
My directory structure is as follows:
├── proto
│ ├── BUILD
│ └── hello.proto
├── src
│ ├── BUILD
│ └── outer.proto
└── WORKSPACE
The proto/hello.proto file:
syntax = "proto3";
...
0
votes
0
answers
11
views
installing protobuf-compiler using yum in .gitlab-ci.yml
I am trying to install protobuf-compiler for version 3.0 of protobuf as part of my pipeline. I am using the following command.
yum install -y protobuf-compiler-3.19.6-1.amzn2023.0.1.x86_64.rpm
I'm ...
0
votes
0
answers
35
views
http_archive: Build file is not a regular file
Source Code: https://github.com/abitofhelp/hellobzlmod.git
Hello,
I am fairly new to Bazel & Gazelle and am creating a simple proof-of-concept app. It is the ubiquitous "hello world" ...
0
votes
0
answers
38
views
Creating a protobuf factory for a dynamically generated message?
Based on Dynamically create a new protobuf message, I have this Python code which dynamically generates a protobuf containing two ints and a string. (Context: a dynamic data server will transfer ...
0
votes
0
answers
42
views
Protocol buffer data to python dictionary , gRPC message to Dictionary
I have data from gRPC.
Which is type of protocol buffer,
It looks like to dictionary, but it is not.
For my case:
The type of data: <class 'google._upb._message.RepeatedCompositeContainer'>
data:...
2
votes
0
answers
40
views
How to transform Google protobuf message into JSON
when I try to use Google.Protobuf.JsonFormatter and call formatter.Format(response) I receive en error with message:
System.InvalidOperationException: 'Value message must contain a value for the oneof....
1
vote
0
answers
47
views
Google.Protobuf.JsonFormatter fails when formatting PredictResponse to JSON
We use Google.Cloud.AIPlatform.V1 (v 2.19.0) library for making calls to Vertex AI in .NET application
Here is an example of how we use it:
var builder = new PredictionServiceClientBuilder
{
...
0
votes
0
answers
35
views
Can't make unit tests for reading parquet files created from protobuf messages
I wrote a parquet file from a protobuf message as such
ProtobufData model = ProtobufData.get();
Schema schema = model.getSchema(ExampleMessage.class);
Configuration conf = new Configuration();
...
0
votes
0
answers
17
views
SerializeToCodedStream to serialize msg and parse it using ParseFromCodedStream. The parsed result is inconsistent with the content of msg
I use SerializeToCodedStream to serialize msg and parse it using ParseFromCodedStream. The parsed result is inconsistent with the content of msg. Please help me find the reason.
Below is my code:
...
0
votes
1
answer
26
views
no such target '//external:protocol_compiler': target 'protocol_compiler' not declared when I use bzlmod to compile proto
MODULE.bazel
module(
name = "proto_test"
)
bazel_dep(name = "grpc", version = "1.41.0", repo_name = "com_github_grpc_grpc")
BUILD:
load("@...
0
votes
0
answers
29
views
How to convert a JSON data back to protobuf message in javascript?
I am using protobuf-javascript library to compile proto files. Now, since it is not very well documented I am not able to find the way to convert my JSON response from the server back to the protobuf ...
0
votes
0
answers
23
views
Convert Protobuf schema to Avro
I want to convert Protobuf schemas to Avro schemas in runtime in my Java application. What is the best way to do it? Is there any library that could help me?
-1
votes
0
answers
27
views
Downgrade from proto3 to proto2
We are using protocol buffers and gRPC for our data communication.
We are using version 3, since it has been around for nearly a decade. However, we learned that BigQuery is still not yet compatible ...
0
votes
1
answer
42
views
Autogenerate .proto files in dart
I have a flutter app with a client which sends data to a server. For this I convert my data to json. At a certain point this data will need to be saved to disk as well. Someone pointed out that it ...
0
votes
3
answers
61
views
Why the list of objects is not set as list rather than have repeated key for each value while working with proto files in java
I have a below proto file
syntax = "proto3";
option java_multiple_files = true;
option java_package = "com.anusoft";
message Request {
repeated string subjects = 1;
}
When I ...
0
votes
1
answer
32
views
Cannot run two different CompilationTask from one JavaCompiler
Why we can't run two different compilation tasks twice?
I use Java compiler API but when i try to get another task from java compiler and then call it - thrown IllegalStateException.
As described in ...
0
votes
0
answers
19
views
How to drop unset fields in protobuf response?
I have a message with multiple fields, but one of them isn't always set, how can I omit it in my response?
The field by default gets the null value but doesn't get omitted.
How can I omit the field ...
1
vote
3
answers
102
views
Python gcld3 installation on Windows 11
In midst of writing a script in python I came across a problem I still cannot solve. The problem being accurate language detection of latin, specifically medical-latin terms. I understand google ...
2
votes
0
answers
28
views
Is it possible to maintain backward compatibility with DynamicType in protobuf-net?
We recently made the decision to update the version of protobuf-net used in some projects.
With the update we noticed that the Dynamic Type feature was discontinued.
We would like to continue using ...