Repo Fetcher

Pulls source code and binaries from GitHub, Helm, Docker, and Artifactory.

Pulling symbol files generated by prior iterations of compile pipeline runs enables it avoid processing unchanged source code and binary input files, identified by stable checksums.

Default Symbols

The 10x runtime comes with a built-in symbol library that includes symbols for industry-standard frameworks and infrastructure components. This pre-compiled symbol library enables immediate log optimization capabilities without requiring users to scan and compile symbols for common technologies and popular open-source projects.

Container Images (Helm Charts)

Symbols extracted from Docker container images and their source code dependencies via Helm chart scanning.

Helm Chart	Components
open-telemetry/opentelemetry-demo	Polyglot microservices demo (14 services in Go, Java, Node.js, Python, .NET, Rust, PHP, Ruby, C++)
ingress-nginx/ingress-nginx	NGINX binary, HTTP error codes, upstream timeouts, load balancer logs
prometheus-community/kube-prometheus-stack	Prometheus, Alertmanager, Grafana, node-exporter, kube-state-metrics

Java Frameworks

Repository	Description
spring-projects/spring-boot	REST APIs, auto-config, extensive logging
spring-projects/spring-framework	Core DI, AOP, transactions, error handling
apache/tomcat	Servlet container, HTTP access logs
qos-ch/logback	Logging framework, defines log patterns
qos-ch/slf4j	Logging facade, common log interfaces
apache/logging-log4j2	Logging framework, pattern layouts
eclipse-vertx/vert.x	Reactive toolkit, event loop logs
quarkusio/quarkus	Cloud-native, startup and request logs
micronaut-projects/micronaut-core	Microservices, DI, data access logs
apache/kafka	Distributed streaming, broker logs
apache/spark	Big data, job execution logs
apache/flink	Stream processing, job/task manager
hibernate/hibernate-orm	ORM, SQL generation, transaction logs
apache/camel	Integration routes, message flow
dropwizard/dropwizard	REST, health checks, metrics
reactor/reactor-core	Reactive streams, error handling
spring-cloud/spring-cloud-gateway	API gateway, modern replacement for Zuul
grpc/grpc-java	RPC framework, client/server logs
apache/dubbo	RPC framework, service invocation
netty/netty	Async networking, channel logs
apache/pulsar	Pub/sub messaging
elastic/elasticsearch	Search engine, indexing logs
apache/cassandra	NoSQL database, query logs
mybatis/mybatis-3	Persistence, SQL execution
apache/activemq	Message broker, queue operations
alibaba/nacos	Service discovery and configuration
jetty/jetty.project	Web server, HTTP requests, servlet context
hazelcast/hazelcast	Distributed computing, cluster membership
apache/shiro	Security, authentication/authorization

Node.js / JavaScript

Repository	Description
nodejs/node	Runtime core, errors, module loading
expressjs/express	Web framework, HTTP middleware
nestjs/nest	Enterprise framework, exceptions
vercel/next.js	React SSR, routing, build logs
fastify/fastify	Web framework, request lifecycle
koajs/koa	Middleware framework, error handling
hapijs/hapi	Server framework, validation
socketio/socket.io	WebSocket, connection events
winstonjs/winston	Logging library, transports
pinojs/pino	Logging library, fast JSON logs
log4js-node/log4js-node	Logging framework, appenders
debug-js/debug	Debugging utility, namespaced logs
adonisjs/core	MVC framework, exception handling
grpc/grpc-node	gRPC for Node.js
typeorm/typeorm	ORM, query execution logs
sequelize/sequelize	ORM, SQL query logs
prisma/prisma	ORM, database queries
axios/axios	HTTP client, request/response logs
Automattic/mongoose	MongoDB ODM, query execution
jaredhanson/passport	Authentication, OAuth flows
OptimalBits/bull	Job queue, job lifecycle

Python Frameworks

Repository	Description
django/django	Web framework, request/response
tiangolo/fastapi	Async web framework, validation
pallets/flask	Micro web framework, routing
encode/starlette	ASGI framework, middleware
aio-libs/aiohttp	Async HTTP client/server
tornadoweb/tornado	Async networking, request handling
Pylons/pyramid	Web framework, traversal logs
falconry/falcon	REST API framework, hooks
celery/celery	Distributed task queue, worker logs
apache/airflow	Workflow orchestration, task execution
sqlalchemy/sqlalchemy	ORM, SQL execution logs
requests/requests	HTTP library, request logs
python/cpython	Python runtime, core exceptions
Delgan/loguru	Popular structured logging library
hynek/structlog	Structured logging for production
scrapy/scrapy	Web scraping, spider lifecycle
benoitc/gunicorn	WSGI server, worker lifecycle
encode/uvicorn	ASGI server, access logs
boto/boto3	AWS SDK, service operations
encode/httpx	HTTP client, HTTP/2 multiplexing

Go Frameworks

Repository	Description
gin-gonic/gin	Web framework, HTTP logs
gofiber/fiber	Web framework, request handling
labstack/echo	Web framework, middleware
go-gorm/gorm	ORM library, SQL logs
beego/beego	Web framework, MVC logs
revel/revel	Web framework, controller logs
gorilla/mux	HTTP router, request logs
go-kratos/kratos	Microservices, service logs
valyala/fasthttp	HTTP library, connection logs
grpc/grpc-go	gRPC for Go
uber-go/zap	Structured logging library
sirupsen/logrus	Logging library
etcd-io/etcd	Distributed KV store, raft logs
temporalio/temporal	Workflow orchestration, activity execution

C++ / Core Libraries

Repository	Description
grpc/grpc	RPC framework, channel logs
protocolbuffers/protobuf	Serialization, parsing errors
mongodb/mongo	Database, query execution
facebook/rocksdb	Key-value store, compaction logs
ClickHouse/ClickHouse	OLAP database, query logs
duckdb/duckdb	Emerging analytical database
apache/thrift	RPC framework, service calls
gabime/spdlog	High-performance logging library

Scala Frameworks

Repository	Description
akka/akka	Actor concurrency, message logs
playframework/playframework	Web framework, action logs
zio/zio	Concurrent effects, fiber logs

Rust Frameworks

Repository	Description
tokio-rs/tokio	Async runtime, task spawn/complete events
actix/actix-web	Rust web framework, middleware chain logs
tokio-rs/axum	Rust web framework, Tower service spans
rwf2/Rocket	Rust web framework, route mounting logs
tokio-rs/tracing	Structured logging, span hierarchy

Ruby Frameworks

Repository	Description
rails/rails	Web framework, controller actions, SQL logs
sidekiq/sidekiq	Ruby background jobs, worker lifecycle
puma/puma	Web server, thread pool stats

.NET / C# Frameworks

Repository	Description
dotnet/aspnetcore	Web framework, HTTP pipeline, auth events
dotnet/efcore	.NET Entity Framework, SQL query logging
serilog/serilog	.NET structured logging, message templates
NLog/NLog	Logging framework, layout renderers

Kubernetes / Cloud-Native

Repository	Description
prometheus/prometheus	Monitoring, scrape lifecycle, TSDB operations
istio/istio	Service mesh, xDS config, mTLS events
envoyproxy/envoy	Proxy, access logs, circuit breakers
argoproj/argo-cd	GitOps, sync events, health status
helm/helm	Package manager, chart lifecycle
grafana/loki	Log aggregation, ingester operations
jaegertracing/jaeger	Distributed tracing, span collection
containerd/containerd	Container runtime, image pulls, task execution

Databases and Messaging

Repository	Description
redis/redis	In-memory store, command logs, persistence
postgres/postgres	Relational DB, SQLSTATE codes, query logs
cockroachdb/cockroach	Distributed SQL, raft consensus, range splits
mysql/mysql-server	Relational DB, InnoDB engine, replication
rabbitmq/rabbitmq-server	Message broker, AMQP frames, queue lifecycle
nats-io/nats-server	Messaging, JetStream ops, cluster routing
pingcap/tidb	Distributed SQL, optimizer, TiKV events
vitessio/vitess	MySQL sharding, tablet state, vreplication

Security and Identity

Repository	Description
hashicorp/vault	Secrets management, audit logs, seal/unseal
keycloak/keycloak	IAM, authentication events, token issuance

ML / AI Frameworks

Repository	Description
pytorch/pytorch	Deep learning, training epochs, CUDA events
huggingface/transformers	NLP models, tokenization, inference logs

Modules

GitHub Repositories

Pull folders from GitHub repositories to scan for symbol content.

More info
Docker Image

Pull Docker image files to scan for symbol content.

More info
Helm Chart

Pull GitHub repositories and Docker images to scan for symbol content from Helm charts.

More info
Artifactory Repositories

Pull files from Artifactory repositories to scan for symbol content.

More info

This module is defined in pull/module.yaml.