Questions tagged [protocol-buffers]

For questions about Google's protocol buffers

Filter by
Sorted by
Tagged with
0 votes
0 answers
19 views

layers.Input in tensorflow -- TypeError: list indices must be integers or slices, not str

TLDR: I need this to work with the exact version of tensorflow (EfficientPose) mona@ada:~/EfficientPose$ python evaluate.py --phi 0 --weights weights/Weights/Linemod/object_8/phi_0_linemod_best_ADD.h5 ...
Mona Jalal's user avatar
  • 35.5k
-2 votes
0 answers
18 views

Are there any proto packages with Datetime with timezone? [closed]

Unfortunately, google.protobuf.timestamp provides only UTC datetime. I need proto datetime type with a timezone (or even without it at all) with C# and Go packages.
Shpot's user avatar
  • 1
0 votes
0 answers
19 views
+250

Create single .proto file to create message for pub/sub

We are using protocol buffers (version 3) for our microservices communications. We now want to start ingesting those messages into our data storage via sending messages to Google's Pub/Sub. As best as ...
Mike Williamson's user avatar
-1 votes
0 answers
41 views

Map Java Class to Proto Class Using Mapstruct

While performing mapping from a Java class to an automatically generated protobuf class using MapStruct in Java, I encounter an error. The details of the error are as follows: If I were to give an ...
noname's user avatar
  • 9
0 votes
1 answer
35 views

Grpc file is missing when using protoc to generate code

I'm learning grpc. This is a simple hello world example: syntax = "proto3"; option java_multiple_files = true; option java_package = "io.grpc.helloworld"; option ...
victorli's user avatar
-2 votes
0 answers
22 views

Akka grpc multi protobuf how to setup the grpc call one after another [closed]

I am implementing akka grpc call in scala programming. I can able to do one GRPC call in AKKa. But actual scenorio is i need to do multiple GRPC calls in akka, also i need to know how to do in Apache ...
Christina's user avatar
0 votes
0 answers
45 views

Cannot cross-compile proto files for ARM but its working for x86_64

I'm working on a C++ project where I need to cross-compile .proto files for ARM. I work with Yocto so I have a SDK with the rootfs and also a shell script which sets up the environment variables. When ...
31ank's user avatar
  • 21
0 votes
1 answer
35 views

When I using kubernetes api to health check grpc server, need proto? or not?

from kubernetes import client, config from grpc_health.v1 import health_pb2, health_pb2_grpc import grpc.experimental.aio as aio import asyncio async def check_grpc_health(ip, port): try: ...
Tae In Kim's user avatar
0 votes
0 answers
50 views

Unresolved external symbol error from generated protobuf C++ code on Windows

I am building a shared library (DLL) that includes Protobuf generated C++ code. Below is the example proto. Sample.proto message Request { float id = 1; float name = 2; } The protobuf C++ code ...
pree's user avatar
  • 2,297
0 votes
0 answers
12 views

Can I serialize a protobuf object in multiple chunks?

I want to send my serialized protobuf object in chunks no larger than MAX_SIZE bytes. If I call SerializeToArray(buff, MAX_SIZE) multiple times, will it keep serializing the first MAX_SIZE bytes each ...
Lolo's user avatar
  • 3,975
0 votes
0 answers
25 views

Writing a gradle task to generate gRPC files for java and javascript

I'm new to gradle and I would like to generate gRPC files for both java, javascript and typescript from a single build.gradle file. However, I can generate the proto files for messages in both java ...
gloop2000's user avatar
0 votes
0 answers
14 views

Googles Protobuf without deserialization

Normally google protobuf or the nanopb implementation is intended to serialize/deserialize messages on the server respectively the client side. However, I'm faced with a case where the serialization ...
Wör Du Schnaffzig's user avatar
0 votes
1 answer
36 views

Resize function missing from repeated field in protobuf

Current protoc version: 25.0 I am trying to add x elements into a repeated field at once, and I thought the best way to do it was to use the Resize function. However When I try to compile the ...
Dávid Tóth's user avatar
  • 2,842
0 votes
0 answers
33 views

Protoc regen commands requires different proto imports for generating java and dart files?

I have a directory that looks like this: protos user user_service.proto user_context.proto user.proto The user_service.proto imports my user_context.proto and user.proto. user_service.proto: ...
toast's user avatar
  • 1
0 votes
1 answer
25 views

ClassCast error when using org.springframework.messaging.Message with Protobuf object as kafka message

I am using spring-kafka with producer property as below key-serializer: org.apache.kafka.common.serialization.StringSerializer value-serializer: io.confluent.kafka.serializers.protobuf....
JITHIN_PATHROSE's user avatar
0 votes
0 answers
32 views

Can't pickle repeated scalar fields, convert to list firs

I am trying to parallelize a protobuf application one instance in each thread, but I am getting this error /usr/local/lib/python3.10/dist-packages/google/protobuf/internal/containers.py", line ...
fred's user avatar
  • 1
0 votes
0 answers
19 views

NestJS gRPC freezes for ~10-~15 seconds before accepting new requests

I'm testing out gRPC within the NestJS framework but am stumbling onto an issue. When I try to send out a lot of requests at once the client and receiver become idle and wait for about 10 to 15 ...
Enthys's user avatar
  • 311
1 vote
2 answers
41 views

How to include an error field in gRPC protobuf message using go-grpc

I have a gRPC service written with Go that plays a proxy-like role by wrapping a gRPC message it receives into another gRPC message to a separate backend service. That backend service can return ...
BearsEars's user avatar
  • 929
-1 votes
0 answers
29 views

libprotobuf.dll loadlibrary 3765269347 in XP

I built Protobuf as a dynamic library using: vs2015 update3 v140_xp windows10 When I attempt to 'loadlibrary()' on an windows XP, it returns 'null' with 'GetLastError()' reporting '3765269347'. This ...
dearwangsen's user avatar
0 votes
1 answer
56 views

Use of protobuf in a C++ project spanning 3 repositories

I have three repositories, (re)using a set of protobuf files: repo1 + hello.proto + goodbye.proto repo2 + hello.proto + goodbye.proto repo3 + hello.proto + goodbye.proto The .proto ...
Lorah Attkins's user avatar
0 votes
0 answers
37 views

com.google.protobuf.Descriptors$FileDescriptor and com.google.protobuf.Descriptors$Descriptor are in unnamed module of java.net.URLClassLoader

I am getting the below error when the pyflink streaming pipeline tries to start. Source is protobuf coming from Kafka. Caused by: java.lang.ClassCastException: class com.google.protobuf.Descriptors$...
Gagan's user avatar
  • 1,805
0 votes
1 answer
24 views

How to receive protobuf messages sent by the Foxglove server and then save them as MCAP?

I have customized some protobufs, processed them on the server using C++, and published them through the localhost port using the Foxglove server. I hope to save these messages as mcap files for ...
iif eve's user avatar
2 votes
1 answer
99 views

How to reverse UTF-8 encoding in a byte array?

I have the following problem: A certain producer sends Protobuf messages as binary data (byte array). These binary data enter a misconfigured Kafka cluster which deserializes the byte array as ...
PravlesRedneckoff's user avatar
1 vote
1 answer
29 views

protobuf webhook with no fixed request structure

I am using Golang as my backend and proto3 as my API definitions. I have grpc-gateway to support http along with grpc. My use case is To have a webhook API which gets in some payload and processes it. ...
Tilak Raj's user avatar
  • 1,399
0 votes
0 answers
35 views

Cannot deserialize protobuf

I am having trouble de-serializing a protobuf. I am confident that it is serialized properly, as serialization works in all other cases. Here's a simplified proto file: syntax = "proto3"; ...
Oliver's user avatar
  • 1,553
-1 votes
0 answers
6 views

PROTO nodes (Current Project) does not exist instead there is a PROTO nodes (Current world)

I'm new to webots. I was following the youtube guidline but when i try to add a PROTO, I can't see this section "PROTO nodes (Current Project)" after clicking on "+". I I tried to ...
Syed Hamza's user avatar
-2 votes
0 answers
74 views

"optional" field of proto3 not supported by protobuf-c compiler

We recently started using proto3 and the protobuf/protobuf-c compiler gives us this error message: Filename.proto: is a proto3 file that contains optional fields, but code generator protoc-gen-c hasn'...
Junhe Liu's user avatar
0 votes
0 answers
30 views

How to properly serialize message protobuf when sending to kafka (Python)?

I'm trying to send a message to kafka. I create messages imitating protobuf (using the proto-plus library) where there is a message attached to another, serialize it, but in fact something is sent ...
KarimovAnton's user avatar
-1 votes
0 answers
34 views

gRPC is slower than http1.1 multipart-form

gRPC use HTTP/2 protocol, it should be a lillt faster than HTTP1.1. But I get 0.5s for Http1.1 and 0.8s for gRPC for 70MB data, and 0.05s/0.08s for 7MB data. Am I missing some important setup/config? ...
Johnson Lai's user avatar
2 votes
0 answers
19 views

Kafka stream with protobuf messages

I have stream of protobuf messages with one type AccountHolder.proto with {name,balance,time} as fields and doing some aggregations on the data content and writing the result as protobuf message of ...
Jyothi Siva's user avatar
0 votes
1 answer
89 views

What is the correct way of passing data through Unix sockets?

I'm working on a personal project to try to better understand inter-process communications on Unix. I have two binaries i compiled in C and I am attempting to pass data from one process to another ...
BigBurger's user avatar
0 votes
1 answer
38 views

Proto import from another project in Bazel

My directory structure is as follows: ├── proto │   ├── BUILD │   └── hello.proto ├── src │   ├── BUILD │   └── outer.proto └── WORKSPACE The proto/hello.proto file: syntax = "proto3"; ...
tinkerbeast's user avatar
  • 2,029
0 votes
0 answers
11 views

installing protobuf-compiler using yum in .gitlab-ci.yml

I am trying to install protobuf-compiler for version 3.0 of protobuf as part of my pipeline. I am using the following command. yum install -y protobuf-compiler-3.19.6-1.amzn2023.0.1.x86_64.rpm I'm ...
Jonathan's user avatar
  • 2,328
0 votes
0 answers
35 views

http_archive: Build file is not a regular file

Source Code: https://github.com/abitofhelp/hellobzlmod.git Hello, I am fairly new to Bazel & Gazelle and am creating a simple proof-of-concept app. It is the ubiquitous "hello world" ...
A Bit of Help's user avatar
0 votes
0 answers
38 views

Creating a protobuf factory for a dynamically generated message?

Based on Dynamically create a new protobuf message, I have this Python code which dynamically generates a protobuf containing two ints and a string. (Context: a dynamic data server will transfer ...
Mark Harrison's user avatar
0 votes
0 answers
42 views

Protocol buffer data to python dictionary , gRPC message to Dictionary

I have data from gRPC. Which is type of protocol buffer, It looks like to dictionary, but it is not. For my case: The type of data: <class 'google._upb._message.RepeatedCompositeContainer'> data:...
Fahim Ashab's user avatar
2 votes
0 answers
40 views

How to transform Google protobuf message into JSON

when I try to use Google.Protobuf.JsonFormatter and call formatter.Format(response) I receive en error with message: System.InvalidOperationException: 'Value message must contain a value for the oneof....
Юрій Ізьо's user avatar
1 vote
0 answers
47 views

Google.Protobuf.JsonFormatter fails when formatting PredictResponse to JSON

We use Google.Cloud.AIPlatform.V1 (v 2.19.0) library for making calls to Vertex AI in .NET application Here is an example of how we use it: var builder = new PredictionServiceClientBuilder { ...
Юрій Ізьо's user avatar
0 votes
0 answers
35 views

Can't make unit tests for reading parquet files created from protobuf messages

I wrote a parquet file from a protobuf message as such ProtobufData model = ProtobufData.get(); Schema schema = model.getSchema(ExampleMessage.class); Configuration conf = new Configuration(); ...
ANIMO's user avatar
  • 15
0 votes
0 answers
17 views

SerializeToCodedStream to serialize msg and parse it using ParseFromCodedStream. The parsed result is inconsistent with the content of msg

I use SerializeToCodedStream to serialize msg and parse it using ParseFromCodedStream. The parsed result is inconsistent with the content of msg. Please help me find the reason. Below is my code: ...
Sham Dorus's user avatar
0 votes
1 answer
26 views

no such target '//external:protocol_compiler': target 'protocol_compiler' not declared when I use bzlmod to compile proto

MODULE.bazel module( name = "proto_test" ) bazel_dep(name = "grpc", version = "1.41.0", repo_name = "com_github_grpc_grpc") BUILD: load("@...
hole's user avatar
  • 31
0 votes
0 answers
29 views

How to convert a JSON data back to protobuf message in javascript?

I am using protobuf-javascript library to compile proto files. Now, since it is not very well documented I am not able to find the way to convert my JSON response from the server back to the protobuf ...
Ghostop's user avatar
  • 43
0 votes
0 answers
23 views

Convert Protobuf schema to Avro

I want to convert Protobuf schemas to Avro schemas in runtime in my Java application. What is the best way to do it? Is there any library that could help me?
And390's user avatar
  • 1,550
-1 votes
0 answers
27 views

Downgrade from proto3 to proto2

We are using protocol buffers and gRPC for our data communication. We are using version 3, since it has been around for nearly a decade. However, we learned that BigQuery is still not yet compatible ...
Mike Williamson's user avatar
0 votes
1 answer
42 views

Autogenerate .proto files in dart

I have a flutter app with a client which sends data to a server. For this I convert my data to json. At a certain point this data will need to be saved to disk as well. Someone pointed out that it ...
jas's user avatar
  • 5
0 votes
3 answers
61 views

Why the list of objects is not set as list rather than have repeated key for each value while working with proto files in java

I have a below proto file syntax = "proto3"; option java_multiple_files = true; option java_package = "com.anusoft"; message Request { repeated string subjects = 1; } When I ...
anurag tripathi's user avatar
0 votes
1 answer
32 views

Cannot run two different CompilationTask from one JavaCompiler

Why we can't run two different compilation tasks twice? I use Java compiler API but when i try to get another task from java compiler and then call it - thrown IllegalStateException. As described in ...
Yaroslav Paramonov's user avatar
0 votes
0 answers
19 views

How to drop unset fields in protobuf response?

I have a message with multiple fields, but one of them isn't always set, how can I omit it in my response? The field by default gets the null value but doesn't get omitted. How can I omit the field ...
7Pawns's user avatar
  • 1
1 vote
3 answers
102 views

Python gcld3 installation on Windows 11

In midst of writing a script in python I came across a problem I still cannot solve. The problem being accurate language detection of latin, specifically medical-latin terms. I understand google ...
standard's user avatar
2 votes
0 answers
28 views

Is it possible to maintain backward compatibility with DynamicType in protobuf-net?

We recently made the decision to update the version of protobuf-net used in some projects. With the update we noticed that the Dynamic Type feature was discontinued. We would like to continue using ...
WARLEY ANDRADE's user avatar

1
2 3 4 5
154