Repo Fetcher
Pulls source code and binaries from GitHub, Helm, Docker, and Artifactory.
Pulling symbol files generated by prior iterations of compile pipeline runs enables it avoid processing unchanged source code and binary input files, identified by stable checksums.
Default Symbols
The 10x runtime comes with a built-in symbol library that includes symbols for industry-standard frameworks and infrastructure components. This pre-compiled symbol library enables immediate log optimization capabilities without requiring users to scan and compile symbols for common technologies and popular open-source projects.
The library's manifest lists each source with the commit or digest it was built from. From container images the library takes the strings in their binaries. Test files, vendored copies and log files inside the repositories are left out. Each project keeps its own license: the library holds hashes of its strings and the names of its files, classes and methods, not its source text.
Container Images (Helm Charts)
Symbols extracted from Docker container images and their source code dependencies via Helm chart scanning.
| Helm Chart | Components |
|---|---|
| open-telemetry/opentelemetry-demo | Polyglot microservices demo (14 services in Go, Java, Node.js, Python, .NET, Rust, PHP, Ruby, C++) |
| ingress-nginx/ingress-nginx | NGINX binary, HTTP error codes, upstream timeouts, load balancer logs |
| prometheus-community/kube-prometheus-stack | Prometheus, Prometheus Operator, node-exporter, kube-state-metrics |
Java Frameworks
| Repository | Description |
|---|---|
| spring-projects/spring-boot | REST APIs, auto-config, extensive logging |
| spring-projects/spring-framework | Core DI, AOP, transactions, error handling |
| apache/tomcat | Servlet container, HTTP access logs |
| qos-ch/logback | Logging framework, defines log patterns |
| qos-ch/slf4j | Logging facade, common log interfaces |
| apache/logging-log4j2 | Logging framework, pattern layouts |
| eclipse-vertx/vert.x | Reactive toolkit, event loop logs |
| quarkusio/quarkus | Cloud-native, startup and request logs |
| micronaut-projects/micronaut-core | Microservices, DI, data access logs |
| apache/kafka | Distributed streaming, broker logs |
| apache/spark | Big data, job execution logs |
| apache/flink | Stream processing, job/task manager |
| hibernate/hibernate-orm | ORM, SQL generation, transaction logs |
| apache/camel | Integration routes, message flow |
| dropwizard/dropwizard | REST, health checks, metrics |
| reactor/reactor-core | Reactive streams, error handling |
| spring-cloud/spring-cloud-gateway | API gateway, modern replacement for Zuul |
| grpc/grpc-java | RPC framework, client/server logs |
| apache/dubbo | RPC framework, service invocation |
| netty/netty | Async networking, channel logs |
| apache/pulsar | Pub/sub messaging |
| elastic/elasticsearch | Search engine, indexing logs |
| apache/cassandra | NoSQL database, query logs |
| mybatis/mybatis-3 | Persistence, SQL execution |
| apache/activemq | Message broker, queue operations |
| alibaba/nacos | Service discovery and configuration |
| jetty/jetty.project | Web server, HTTP requests, servlet context |
| hazelcast/hazelcast | Distributed computing, cluster membership |
| apache/shiro | Security, authentication/authorization |
Node.js / JavaScript
| Repository | Description |
|---|---|
| nodejs/node | Runtime core, errors, module loading |
| expressjs/express | Web framework, HTTP middleware |
| nestjs/nest | Enterprise framework, exceptions |
| vercel/next.js | React SSR, routing, build logs |
| fastify/fastify | Web framework, request lifecycle |
| koajs/koa | Middleware framework, error handling |
| hapijs/hapi | Server framework, validation |
| socketio/socket.io | WebSocket, connection events |
| winstonjs/winston | Logging library, transports |
| pinojs/pino | Logging library, fast JSON logs |
| log4js-node/log4js-node | Logging framework, appenders |
| debug-js/debug | Debugging utility, namespaced logs |
| adonisjs/core | MVC framework, exception handling |
| grpc/grpc-node | gRPC for Node.js |
| typeorm/typeorm | ORM, query execution logs |
| sequelize/sequelize | ORM, SQL query logs |
| prisma/prisma | ORM, database queries |
| axios/axios | HTTP client, request/response logs |
| Automattic/mongoose | MongoDB ODM, query execution |
| jaredhanson/passport | Authentication, OAuth flows |
| OptimalBits/bull | Job queue, job lifecycle |
Python Frameworks
| Repository | Description |
|---|---|
| django/django | Web framework, request/response |
| tiangolo/fastapi | Async web framework, validation |
| pallets/flask | Micro web framework, routing |
| encode/starlette | ASGI framework, middleware |
| aio-libs/aiohttp | Async HTTP client/server |
| tornadoweb/tornado | Async networking, request handling |
| Pylons/pyramid | Web framework, traversal logs |
| falconry/falcon | REST API framework, hooks |
| celery/celery | Distributed task queue, worker logs |
| apache/airflow | Workflow orchestration, task execution |
| sqlalchemy/sqlalchemy | ORM, SQL execution logs |
| requests/requests | HTTP library, request logs |
| python/cpython | Python runtime, core exceptions |
| Delgan/loguru | Popular structured logging library |
| hynek/structlog | Structured logging for production |
| scrapy/scrapy | Web scraping, spider lifecycle |
| benoitc/gunicorn | WSGI server, worker lifecycle |
| encode/uvicorn | ASGI server, access logs |
| boto/boto3 | AWS SDK, service operations |
| encode/httpx | HTTP client, HTTP/2 multiplexing |
Go Frameworks
| Repository | Description |
|---|---|
| gin-gonic/gin | Web framework, HTTP logs |
| gofiber/fiber | Web framework, request handling |
| labstack/echo | Web framework, middleware |
| go-gorm/gorm | ORM library, SQL logs |
| beego/beego | Web framework, MVC logs |
| revel/revel | Web framework, controller logs |
| gorilla/mux | HTTP router, request logs |
| go-kratos/kratos | Microservices, service logs |
| valyala/fasthttp | HTTP library, connection logs |
| grpc/grpc-go | gRPC for Go |
| uber-go/zap | Structured logging library |
| sirupsen/logrus | Logging library |
| etcd-io/etcd | Distributed KV store, raft logs |
| temporalio/temporal | Workflow orchestration, activity execution |
C++ / Core Libraries
| Repository | Description |
|---|---|
| grpc/grpc | RPC framework, channel logs |
| protocolbuffers/protobuf | Serialization, parsing errors |
| mongodb/mongo | Database, query execution |
| facebook/rocksdb | Key-value store, compaction logs |
| ClickHouse/ClickHouse | OLAP database, query logs |
| duckdb/duckdb | Emerging analytical database |
| apache/thrift | RPC framework, service calls |
| gabime/spdlog | High-performance logging library |
Scala Frameworks
| Repository | Description |
|---|---|
| akka/akka | Actor concurrency, message logs |
| playframework/playframework | Web framework, action logs |
| zio/zio | Concurrent effects, fiber logs |
Rust Frameworks
| Repository | Description |
|---|---|
| tokio-rs/tokio | Async runtime, task spawn/complete events |
| actix/actix-web | Rust web framework, middleware chain logs |
| tokio-rs/axum | Rust web framework, Tower service spans |
| rwf2/Rocket | Rust web framework, route mounting logs |
| tokio-rs/tracing | Structured logging, span hierarchy |
Ruby Frameworks
| Repository | Description |
|---|---|
| rails/rails | Web framework, controller actions, SQL logs |
| sidekiq/sidekiq | Ruby background jobs, worker lifecycle |
| puma/puma | Web server, thread pool stats |
.NET / C# Frameworks
| Repository | Description |
|---|---|
| dotnet/aspnetcore | Web framework, HTTP pipeline, auth events |
| dotnet/efcore | .NET Entity Framework, SQL query logging |
| serilog/serilog | .NET structured logging, message templates |
| NLog/NLog | Logging framework, layout renderers |
Kubernetes / Cloud-Native
| Repository | Description |
|---|---|
| prometheus/prometheus | Monitoring, scrape lifecycle, TSDB operations |
| istio/istio | Service mesh, xDS config, mTLS events |
| envoyproxy/envoy | Proxy, access logs, circuit breakers |
| argoproj/argo-cd | GitOps, sync events, health status |
| helm/helm | Package manager, chart lifecycle |
| grafana/loki | Log aggregation, ingester operations |
| jaegertracing/jaeger | Distributed tracing, span collection |
| containerd/containerd | Container runtime, image pulls, task execution |
Databases and Messaging
| Repository | Description |
|---|---|
| redis/redis | In-memory store, command logs, persistence |
| postgres/postgres | Relational DB, SQLSTATE codes, query logs |
| cockroachdb/cockroach | Distributed SQL, raft consensus, range splits |
| mysql/mysql-server | Relational DB, InnoDB engine, replication |
| rabbitmq/rabbitmq-server | Message broker, AMQP frames, queue lifecycle |
| nats-io/nats-server | Messaging, JetStream ops, cluster routing |
| pingcap/tidb | Distributed SQL, optimizer, TiKV events |
| vitessio/vitess | MySQL sharding, tablet state, vreplication |
Security and Identity
| Repository | Description |
|---|---|
| hashicorp/vault | Secrets management, audit logs, seal/unseal |
| keycloak/keycloak | IAM, authentication events, token issuance |
ML / AI Frameworks
| Repository | Description |
|---|---|
| pytorch/pytorch | Deep learning, training epochs, CUDA events |
| huggingface/transformers | NLP models, tokenization, inference logs |
Modules
-
GitHub Repositories
Pull folders from GitHub repositories to scan for symbol content.
-
Docker Image
Pull Docker image files to scan for symbol content.
-
Helm Chart
Pull GitHub repositories and Docker images to scan for symbol content from Helm charts.
-
Artifactory Repositories
Pull files from Artifactory repositories to scan for symbol content.
This module is defined in pull/module.yaml.