How protocolbuffers/protobuf works
Protocol Buffers provides a schema-driven compiler and language-specific runtimes for serializing structured data. The principal workflow is: users define .proto schemas, protoc parses them and dispatches language generators, generated message types run on a language runtime, and applications serialize or parse wire-format data. Reflection and descriptor databases support schema introspection and lookup. The README documents additional language runtimes, but this tree sample does not expose all implementations, so those are represented only where repository paths support them; several internal runtime links are omitted rather than inferred.
Main entry points: Program.cs C# conformance runner · main.cc protoc CLI · Message.java Java messages · IMessage.cs C# message API
Components 27
Compiler and generation
- Proto schemas
- protoc CLI
src/google/protobuf/compiler/main.cc - upb mini-table generator
upb_generator/minitable/main.cc - Generated message types
Schema reflection
- C++ descriptor database
src/google/protobuf/descriptor_database.cc - Python descriptor database
python/google/protobuf/pyext/descriptor_database.cc - Java descriptors
java/core/src/main/java/com/google/protobuf/Descriptors.java - C# reflection
csharp/src/Google.Protobuf/Reflection/MessageDescriptor.cs - C# field metadata
csharp/src/Google.Protobuf/Reflection/FieldDescriptor.cs - C# type registry
csharp/src/Google.Protobuf/Reflection/TypeRegistry.cs
Language runtimes
- Java messages
java/core/src/main/java/com/google/protobuf/Message.java - Java lite messages
java/core/src/main/java/com/google/protobuf/MessageLite.java - Java coded input
java/core/src/main/java/com/google/protobuf/CodedInputStream.java - Java byte strings
java/core/src/main/java/com/google/protobuf/ByteString.java - C# message API
csharp/src/Google.Protobuf/IMessage.cs - C# coded input
csharp/src/Google.Protobuf/CodedInputStream.cs - C# byte strings
csharp/src/Google.Protobuf/ByteString.cs - C# JSON conversion
csharp/src/Google.Protobuf/JsonParser.cs - C# JSON formatter
csharp/src/Google.Protobuf/JsonFormatter.cs - upb runtime
upb/mem/arena.c - Rust upb bindings
rust/upb_kernel/mod.rs
Services and conformance
- Java service API
java/core/src/main/java/com/google/protobuf/Service.java - JRuby service descriptors
ruby/src/main/java/com/google/protobuf/jruby/RubyServiceDescriptor.java - C# conformance runner
csharp/src/Google.Protobuf.Conformance/Program.cs - Conformance protocol
conformance/conformance.proto
Other components
- Application developer
- Schema author
Connections 22
- Schema author → Proto schemas: defines schema
- Application developer → protoc CLI: invokes compiler
- Proto schemas → protoc CLI: compiles schema
- protoc CLI → Generated message types: generates code
src/google/protobuf/compiler/main.cc - protoc CLI → upb mini-table generator: supports plugins
- Generated message types → Java messages: uses runtime
- Generated message types → C# message API: uses runtime
- Generated message types → Rust upb bindings: uses runtime
- Application developer → Java messages: uses runtime
- Application developer → C# message API: uses runtime
- Java messages → Java descriptors: exposes descriptors
java/core/src/main/java/com/google/protobuf/Message.java - Java messages → Java coded input: parses wire data
java/core/src/main/java/com/google/protobuf/Message.java - C# message API → C# coded input: merges input
csharp/src/Google.Protobuf/IMessage.cs - C# message API → C# reflection: exposes descriptor
csharp/src/Google.Protobuf/IMessage.cs - C# reflection → C# field metadata: describes fields
- C# type registry → C# conformance runner: resolves message types
csharp/src/Google.Protobuf.Conformance/Program.cs - C# conformance runner → Conformance protocol: reads requests
csharp/src/Google.Protobuf.Conformance/Program.cs - C# conformance runner → C# JSON conversion: parses JSON
csharp/src/Google.Protobuf.Conformance/Program.cs - C# conformance runner → C# JSON formatter: formats JSON
csharp/src/Google.Protobuf.Conformance/Program.cs - Python descriptor database → C++ descriptor database: uses descriptor types
python/google/protobuf/pyext/descriptor_database.cc - Java service API → Java descriptors: uses service descriptors
java/core/src/main/java/com/google/protobuf/Service.java - JRuby service descriptors → Java descriptors: wraps service metadata
ruby/src/main/java/com/google/protobuf/jruby/RubyServiceDescriptor.java