Skip to content

docs(integration): add ClickHouse, Doris, Zeppelin, OpenDAL, Jenkins, OpenTelemetry, and Fluentd guides - #158

Merged
majinghe merged 1 commit into
rustfs:mainfrom
majinghe:docs/clickhouse-doris-7integrations
Sep 21, 2026
Merged

majinghe merged 1 commit into
rustfs:mainfrom
majinghe:docs/clickhouse-doris-7integrations

Conversation

@majinghe

Copy link
Copy Markdown
Collaborator

Summary

Batch of 11 candidate integrations. 7 verified and documented, each slotted into an existing category (all 5 locales):

Data Analytics

  • ClickHouse (clickhouse/clickhouse-server:25.8) — S3 disk storage policy for MergeTree tables; parts land as content-addressed blobs, verified through insert/query, system.parts.disk_name, and a restart-persistence check.
  • Apache Doris (apache/doris:all-in-one-4.1.3) — S3 backup repository; full BACKUP SNAPSHOT → drop table → RESTORE SNAPSHOT → count(*) round-trip. Doris 4.1 needs an IP-based endpoint with AWS_PATH_STYLE_ACCESS (documented in troubleshooting).
  • Apache Zeppelin (apache/zeppelin:0.12.0) — S3NotebookRepo with custom endpoint and path-style flag; notes persist as .zpln under user/notebook/ and survive a restart.
  • OpenDAL (opendal Python 0.46) — s3 service operator; write/read/stat/list/delete lifecycle verified.

DevOps

  • Jenkins (jenkins/jenkins:lts-jdk17 + artifact-manager-s3) — "Artifact Management for Builds" with Amazon S3 provider; archived artifact lands at artifacts/<job>/<build>/artifacts/report.txt. The Disable-Session-Token and path-style/insecure-HTTP options are required for a plain endpoint (documented in troubleshooting).

Observability

  • OpenTelemetry (otelcol-contrib:0.138.0) — awss3 exporter with filelog receiver; log lines uploaded under year=.../month=.../logs/applogs_*.txt partitions. Documents the 0.138 nested s3uploader schema.
  • Fluentd (fluentd:v1.17-1 + fluent-plugin-s3 1.8.6) — tail source with buffered gzip uploads; force_path_style true is mandatory.

Skipped after evaluation (Notes)

  • n8n — S3 binary data mode (N8N_DEFAULT_BINARY_DATA_MODE=s3) requires an Enterprise license; Community Edition refuses to start in S3 mode (n8n docs).
  • SkyWalking — OAP storage backends are BanyanDB/MySQL/PostgreSQL/OpenSearch/Elasticsearch only; "S3" in its docs refers to cloud-service monitoring, not storage.
  • Jaeger — no S3 storage backend (spans need ID lookup and indexing; ES/OpenSearch/Cassandra/Badger only).
  • Spinnaker — not verifiable: front50 service images are no longer resolvable on any registry we tried (us-docker.pkg.dev/spinnaker-community, Docker Hub, ghcr.io) following the GCR shutdown.

Localization

  • en + zh fully written/translated (code fences byte-identical to English; mermaid labels English).
  • de/fr/ja: English source copies pending translation (consistent with existing practice); navigation and landing pages localized in all 5 locales.

Validation

  • npm run docs:check — PASS (750 pages, 175 meta.json)
  • npm run build — PASS (3015 files)
  • Locale audit — no new findings for changed files beyond the expected de/fr UNTRANSLATED_FILE notices.
  • Screenshots: Chinese-locale Console shots in zh, English shots shared by en/de/fr/ja.

… OpenTelemetry, and Fluentd guides

- ClickHouse: S3 disk storage policy for MergeTree tables
  (table parts stored on RustFS, restart persistence verified)
- Doris: S3 backup repository (BACKUP/RESTORE round-trip verified)
- Zeppelin: S3 notebook storage (note persisted, restart verified)
- OpenDAL: s3 service via the Python binding (full object lifecycle)
- Jenkins: Artifact Manager on S3 plugin (archived artifacts verified)
- OpenTelemetry: awss3 exporter for logs (partitioned uploads verified)
- Fluentd: out_s3 plugin (buffered gzip uploads verified)
- Skipped after evaluation: n8n (S3 binary data mode is enterprise-
  licensed), SkyWalking and Jaeger (no S3 storage backend), Spinnaker
  (service images no longer published after the GCR shutdown)
- All guides slotted into existing categories, 5 locales
@vercel

vercel Bot commented Sep 21, 2026

Copy link
Copy Markdown

@majinghe is attempting to deploy a commit to the overtrue's projects Team on Vercel.

A member of the Team first needs to authorize it.

@majinghe
majinghe merged commit c0c6b99 into rustfs:main Sep 21, 2026
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant