Skip to content

Expand guided paths, roles, famous apps and stack types for the 3,000-node atlas - #31

Merged
rushilrawat merged 1 commit into
mainfrom
data/content-layers-3000
Nov 21, 2026
Merged

rushilrawat merged 1 commit into
mainfrom
data/content-layers-3000

Conversation

@rushilrawat

@rushilrawat rushilrawat commented Nov 21, 2026 •

Copy link
Copy Markdown
Owner

Requested by Rush · project thread

The content layers on top of the graph catch up with the 3,122-node atlas from #30. The graph itself is unchanged: no new nodes or edges, and no layout churn.

What's new

Layer Before After
Guided paths 145 257
Role paths 11 32
Famous apps 22 40 (+ new entries on 8 existing apps)
Stack recommender project types 10 18

Guided paths (+112). Every top-level field now has at least one path (a new backend test enforces this). Before, 8 fields had none: Programming Languages, Data Science, Enterprise Software, Mainframes, Audio & Music, Automotive & Aerospace, Geospatial, CMS & E-commerce. Thin fields got more too (mobile, games, observability, cloud, testing, gen AI, crypto, frontend). There are also company open-source tours: Netflix resilience tools, Meta's PHP/C++/React stacks, LinkedIn streaming, Uber to Temporal, Cloudflare's Rust networking, big-tech data orchestrators, monorepos at Google and Meta, Alibaba's microservices and more. Every consecutive step is a real edge.

Role paths (+21): data scientist, data analyst, SRE, cloud architect, MLOps, QA/test automation, blockchain, mainframe, enterprise apps (Salesforce/SAP), audio software, automotive & aerospace, GIS, e-commerce/CMS, compiler engineer, penetration tester, robotics, quantum software, product designer, bioinformatician, quant developer, hardware design.

Famous apps (+18): Facebook, WhatsApp, X (Twitter), YouTube, Google Search, Stack Overflow, Etsy, Monzo, Roblox, Taobao, Zalando, Mastodon, Basecamp/HEY, Coinbase, Canva, Bluesky, Pokémon GO, Fortnite. Existing apps got the company-built nodes that now exist: Netflix (EVCache, Hystrix, Spinnaker, Chaos Monkey, Conductor, Metaflow), Uber (H3, M3, Hudi, Horovod, deck.gl), LinkedIn (DataHub, Gobblin, Rest.li, Cruise Control), Spotify (Annoy, Scio), Airbnb (visx), Shopify (YJIT, Liquid, Hydrogen, Toxiproxy), GitHub (Actions, CodeQL, Dependabot) and Cloudflare (quiche).

Stack recommender: new project types are online store, content site/blog, data analysis & BI, internal tool, workflow automation, blockchain app, maps & location, and audio software. They come with 18 new slots (CMS, commerce, BI, charts, stats, low-code, chain/contract tooling, map rendering, PostGIS, audio framework...). Existing slots got wider candidate lists (Phoenix, Ktor, Quarkus, Axum, Meilisearch/Typesense, Fly.io, Plausible, Phaser, Wails...). "blog" now points to content sites and "bi"/"reporting" to analytics.

Payload

The paths, roles and apps used to be bundled into the entry JS, which was at 166 of 168 KB. They now load as their own chunk (src/content/). It starts in main.tsx and is awaited next to the graph fetch, so it adds no extra round trip. If the chunk fails to load, the atlas still draws.

Asset (gzip) Before After
Entry JS 166.4 KB 144.4 KB
Content chunk (in entry) 48.9 KB (new budget 55 KB)
Graph snapshot 269.0 KB 269.0 KB

How it's built

  • Content is in scripts/expand/content_3000_{paths,roles,apps}.py. content_3000.py checks every slug and path edge against data/graph.json before writing the seed files, and --check fails while changes are left to apply. backend/tests/test_content_3000.py runs it.
  • App sources are https engineering posts or docs. Things the atlas lacks (TAO, Manhattan, Bigtable, Luau...) go in not_in_atlas.

Testing

  • Backend: 275 passed
  • Frontend: lint, typecheck, 161 vitest tests (including a new recommender test that covers each new project type), npm run size
  • Pages build + smoke e2e (playwright.config.ts, run with the local Chromium): 11 of 11 passed. I didn't run the overview, xray or stackview suites because the graph and layout are unchanged.

For review

These facts come from memory plus the cited pages. I couldn't fetch most source URLs from the container, so a quick look is worth it:

  • Etsy on Vitess
  • Bluesky's ScyllaDB app view
  • Stack Overflow on .NET Core

https://claude.ai/code/session_01EMFEENGLDbHDh9Hp3Nkefk


Generated by Claude Code

…-node atlas

- 112 new guided paths (145 -> 257): every top-level field now has at least one,
  including programming languages, data science, enterprise software, mainframes,
  audio, automotive/aerospace, geospatial and CMS/e-commerce, plus company
  open-source tours (Netflix, Meta, LinkedIn, Uber, Cloudflare, Lyft, Alibaba...).
- 21 new role paths (11 -> 32), from data scientist and SRE to mainframe,
  GIS, audio, compiler and hardware design engineers.
- 18 new famous apps (22 -> 40) and company open-source nodes added to 8
  existing ones.
- Stack recommender: 8 new project types (online store, content site, data
  analysis/BI, internal tool, workflow automation, blockchain app, maps, audio)
  with 18 new slots and wider candidate lists.
- Content data lives in scripts/expand/content_3000*.py; content_3000.py
  checks every reference and edge against data/graph.json, and a backend test
  fails if it has changes left to apply.
- Paths, roles and apps now load as their own lazy chunk next to the graph
  instead of in the entry bundle (entry JS 166 -> 144 KB gzip; content chunk
  49 KB, budgeted at 55 KB).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01EMFEENGLDbHDh9Hp3Nkefk
@rushilrawat rushilrawat self-assigned this Nov 21, 2026
@rushilrawat
rushilrawat merged commit da4fceb into main Nov 21, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants