Skip to content

split LLMA into three products#16941

Open
edwinyjlim wants to merge 9 commits into
masterfrom
llma-split
Open

split LLMA into three products#16941
edwinyjlim wants to merge 9 commits into
masterfrom
llma-split

Conversation

@edwinyjlim
Copy link
Copy Markdown
Member

Changes

LLMA is split into AI Observability, Evaluations, Prompt Management

  • New docs sections for each product
  • Add placeholder home pages and placeholder content for Evaluations and Prompt Management
  • Update redirects and internal links

@edwinyjlim edwinyjlim marked this pull request as draft May 20, 2026 19:37
@edwinyjlim edwinyjlim requested a review from a team May 20, 2026 19:37
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Deploy preview

Status Details Updated (UTC)
🟢 Ready View preview May 21, 2026 12:35AM

Comment thread contents/docs/ai-engineering/index.mdx Outdated
@PostHog PostHog deleted a comment from github-actions Bot May 20, 2026
Comment thread contents/handbook/cs-and-onboarding/new-hire-onboarding.md Outdated
Comment thread contents/handbook/docs-and-wizard/changelog.mdx Outdated
Copy link
Copy Markdown
Member

@Radu-Raicea Radu-Raicea left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Links look good. Many references to LLM Analytics still, we should replace those.

Once we ship this, docs links from the app will break until we fix those too. Could be okay if we move fast, otherwise we'd need redirects.

@Radu-Raicea
Copy link
Copy Markdown
Member

Also still need to see the full preview of how it now looks like.

@Radu-Raicea Radu-Raicea marked this pull request as ready for review May 20, 2026 20:02
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Vale prose linter → found 445 errors, 2401 warnings, 52 suggestions in your markdown

Full report → · Copy the Job Summary code block into an LLM to batch-fix issues.

Note: Too many findings to show inline. See the Job Summary linked above.

File Errors Warnings Suggestions
contents/blog/8-learnings-from-1-year-of-agents-posthog-ai.mdx 5 14 0
contents/blog/best-analytics-stack-for-vibe-coded-apps.mdx 1 74 0
contents/blog/best-contentsquare-alternatives.mdx 0 147 0
contents/blog/best-hipaa-compliant-analytics-tools.md 2 72 0
contents/blog/best-matomo-alternatives.mdx 1 135 0
contents/blog/best-microsoft-clarity-alternatives.mdx 0 185 0
contents/blog/best-mobile-app-session-replay-tools.mdx 1 108 0
contents/blog/best-open-source-llm-observability-tools.md 0 49 0
contents/blog/best-product-analytics-tools-for-startups.mdx 0 143 0
contents/blog/llm-analytics-clustering-how-it-works.mdx 31 24 0
contents/blog/optimizing-agent-cost.mdx 5 15 0
contents/blog/posthog-alternatives.mdx 0 152 0
contents/blog/posthog-vs-amplitude.mdx 2 85 1
contents/blog/posthog-vs-ga4.mdx 0 43 0
contents/blog/posthog-vs-heap.mdx 1 73 0
contents/blog/posthog-vs-matomo.mdx 0 53 0
contents/blog/posthogs-next-chapter.md 0 9 7
contents/blog/standup-bot-revenge.mdx 46 23 0
contents/blog/stop-ai-slop.md 1 7 0
contents/blog/testing-ai-agents.md 0 4 0
contents/customers/11x.md 0 8 1
contents/customers/cloudpeek.md 1 17 1
contents/customers/juicebox.md 0 15 0
contents/customers/lovable.md 3 12 2
contents/customers/zealot.md 4 11 3
contents/docs/advanced/proxy/_snippets/managed-reverse-proxy.mdx 0 6 0
contents/docs/ai-engineering/index.mdx 0 6 0
contents/docs/ai-evals/evaluations.mdx 6 7 2
contents/docs/ai-evals/trace-reviews.mdx 0 2 0
contents/docs/ai-observability/basics.mdx 0 2 0
contents/docs/ai-observability/calculating-costs.mdx 3 0 0
contents/docs/ai-observability/clusters.mdx 4 0 0
contents/docs/ai-observability/collect-user-feedback.mdx 0 2 1
contents/docs/ai-observability/custom-properties.mdx 0 4 0
contents/docs/ai-observability/dashboard.md 0 1 0
contents/docs/ai-observability/demos.mdx 0 17 0
contents/docs/ai-observability/embeddings.mdx 4 0 0
contents/docs/ai-observability/errors.mdx 2 0 0
contents/docs/ai-observability/generations.mdx 2 1 0
contents/docs/ai-observability/installation/_snippets/llma-next-steps.mdx 0 1 0
contents/docs/ai-observability/installation/autogen.mdx 0 1 0
contents/docs/ai-observability/installation/aws-bedrock.mdx 0 1 0
contents/docs/ai-observability/installation/cerebras.mdx 0 2 0
contents/docs/ai-observability/installation/claude-code.mdx 10 6 0
contents/docs/ai-observability/installation/cloudflare-ai-gateway.mdx 0 1 0
contents/docs/ai-observability/installation/crewai.mdx 0 1 0
contents/docs/ai-observability/installation/dedalus.mdx 0 2 0
contents/docs/ai-observability/installation/deepseek.mdx 0 1 0
contents/docs/ai-observability/installation/dspy.mdx 0 2 0
contents/docs/ai-observability/installation/groq.mdx 0 1 0
contents/docs/ai-observability/installation/helicone.mdx 0 2 0
contents/docs/ai-observability/installation/hugging-face.mdx 0 1 0
contents/docs/ai-observability/installation/langgraph.mdx 0 1 0
contents/docs/ai-observability/installation/litellm.mdx 0 1 0
contents/docs/ai-observability/installation/llamaindex.mdx 0 1 0
contents/docs/ai-observability/installation/mastra.mdx 0 2 0
contents/docs/ai-observability/installation/mirascope.mdx 0 2 0
contents/docs/ai-observability/installation/ollama.mdx 0 1 0
contents/docs/ai-observability/installation/openclaw.mdx 3 5 0
contents/docs/ai-observability/installation/opentelemetry.mdx 0 1 0
contents/docs/ai-observability/installation/pi.mdx 3 7 0
contents/docs/ai-observability/installation/portkey.mdx 0 2 0
contents/docs/ai-observability/installation/pydantic-ai.mdx 0 1 0
contents/docs/ai-observability/installation/semantic-kernel.mdx 0 1 0
contents/docs/ai-observability/installation/smolagents.mdx 0 1 0
contents/docs/ai-observability/installation/vercel-ai.mdx 0 1 0
contents/docs/ai-observability/installation/xai.mdx 0 1 0
contents/docs/ai-observability/integrations/helicone-posthog.mdx 0 6 0
contents/docs/ai-observability/integrations/index.mdx 0 6 0
contents/docs/ai-observability/integrations/keywords-ai-posthog.mdx 0 1 0
contents/docs/ai-observability/integrations/langfuse-posthog.mdx 0 9 0
contents/docs/ai-observability/integrations/traceloop-posthog.mdx 0 19 0
contents/docs/ai-observability/link-error-tracking.mdx 0 6 0
contents/docs/ai-observability/link-session-replay.mdx 2 6 2
contents/docs/ai-observability/playground.mdx 19 2 0
contents/docs/ai-observability/sentiment.mdx 2 0 1
contents/docs/ai-observability/sessions.mdx 1 1 0
contents/docs/ai-observability/spans.mdx 5 1 0
contents/docs/ai-observability/start-here.mdx 0 8 0
contents/docs/ai-observability/tools.mdx 8 1 0
contents/docs/ai-observability/traces.mdx 4 2 0
contents/docs/ai-observability/troubleshooting.mdx 0 1 0
contents/docs/ai-observability/tutorials.mdx 0 2 0
contents/docs/ai-observability/user-feedback/manual-event-capture.mdx 0 3 0
contents/docs/ai-observability/user-feedback/use-thumb-survey.mdx 0 2 1
contents/docs/data-warehouse/sources/posthog.mdx 1 14 2
contents/docs/libraries/node/index.mdx 2 28 1
contents/docs/libraries/python/index.mdx 0 24 1
contents/docs/libraries/vercel.mdx 0 7 0
contents/docs/model-context-protocol/_snippets/shared.mdx 5 18 1
contents/docs/posthog-ai/example-prompts.mdx 0 15 0
contents/docs/posthog-ai/modes.mdx 17 27 0
contents/docs/posthog-ai/tools.mdx 2 18 0
contents/docs/posthog-code/posthog-integration.mdx 0 9 0
contents/docs/product-analytics/dashboards.mdx 0 4 0
contents/docs/product-analytics/tutorials.mdx 0 3 0
contents/docs/prompt-management/prompts.mdx 3 4 0
contents/docs/prompt-management/skills-store.mdx 40 7 0
contents/faq.mdx 1 30 0
contents/handbook/company/goal-setting.md 13 5 1
contents/handbook/content/brand-message.mdx 0 9 0
contents/handbook/content/metadata.md 10 14 0
contents/handbook/cs-and-onboarding/new-hire-onboarding.md 3 20 0
contents/handbook/docs-and-wizard/changelog.mdx 0 11 0
contents/handbook/docs-and-wizard/how-to-publish-changelog.mdx 0 8 0
contents/handbook/docs-and-wizard/onboarding-docs.mdx 0 6 0
contents/handbook/engineering/posthog-com/presentations.mdx 0 2 0
contents/handbook/exec/responsibilities.md 0 3 0
contents/handbook/growth/cross-selling/cross-sell-motions.md 24 68 0
contents/handbook/growth/sales/communications-templates-feature-adoption.md 0 9 0
contents/handbook/growth/sales/customer-training.md 14 11 0
contents/handbook/growth/sales/how-we-work.md 36 34 3
contents/handbook/growth/sales/product-enablement.md 6 31 0
contents/handbook/growth/sales/product-led-lead-qualification.md 0 6 0
contents/handbook/growth/sales/professional-services.md 0 8 0
contents/handbook/growth/sales/running-trials.md 8 7 0
contents/handbook/marketing/influencers.md 4 28 3
contents/handbook/support/support-smes.md 4 19 0
contents/newsletter/agent-first-product-engineering.md 0 16 0
contents/newsletter/ai-coding-mistakes.md 1 29 1
contents/newsletter/best-of-2025.mdx 9 11 6
contents/newsletter/building-ai-agents.md 0 5 0
contents/newsletter/building-ai-features.md 2 16 1
contents/newsletter/hidden-danger-of-shipping-fast.md 0 10 0
contents/newsletter/how-to-not-breakup-with-your-cofounder.md 0 13 6
contents/newsletter/pricing-advice.md 0 11 0
contents/product-engineers/llm-product-metrics.md 0 3 0
contents/spotlight/startup-krea.md 5 12 4
contents/teams/irl-events/objectives.mdx 4 7 0
contents/teams/llm-analytics/index.mdx 0 4 0
contents/teams/llm-analytics/objectives.mdx 24 15 0
contents/teams/llm-gateway/index.mdx 1 0 0
contents/teams/llm-gateway/objectives.mdx 18 1 0
contents/teams/youtube/objectives.mdx 0 2 0
contents/tutorials/analyze-surveys-with-chatgpt.md 0 8 0
contents/tutorials/anthropic-analytics.md 0 2 0
contents/tutorials/api-capture-events.mdx 0 5 0
contents/tutorials/cohere-analytics.md 0 1 0
contents/tutorials/llm-ab-tests.md 0 24 0
contents/tutorials/monitor-llama-index-with-langfuse.md 0 22 0
contents/tutorials/openai-observability.md 0 2 0
contents/tutorials/openrouter-observability.md 0 1 0
contents/tutorials/web-redact-properties.md 0 5 0
static/stripe/llm-context.md 6 17 0

@ivanagas
Copy link
Copy Markdown
Contributor

I will politely differ to @natalia-amorim for SEO-related impacts of this change 😅

@ivanagas ivanagas removed their request for review May 20, 2026 20:36
Comment thread contents/blog/best-analytics-stack-for-vibe-coded-apps.mdx Outdated
Comment thread contents/blog/standup-bot-revenge.mdx Outdated
Comment thread contents/blog/standup-bot-revenge.mdx Outdated
Copy link
Copy Markdown
Contributor

@natalia-amorim natalia-amorim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Evals and Prompt Management slugs specifically look a bit odd to me, given they'll become their own products; I'd make sure those make sense first before merging cc @Radu-Raicea

Otherwise @corywatilo @smallbrownbike ideally we also redirect the product page from /llm-analytics to /ai-observability

There will be an inevitable drop in SEO traffic as these pages get re-crawled and re-index but hopefully this will be better in the long run so let it rip I guess hahah

Comment thread contents/blog/testing-ai-agents.md Outdated
@@ -2,7 +2,7 @@
title: Evaluations
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Like these pages should just be /ai-evals no? Rather than /ai-evals/evaluations @Radu-Raicea @edwinyjlim

Comment thread contents/docs/ai-evals/trace-reviews.mdx Outdated
Comment thread contents/docs/ai-evals/index.mdx Outdated
Comment thread contents/docs/ai-evals/trace-reviews.mdx Outdated
Comment thread contents/docs/ai-observability/generations.mdx Outdated
Comment thread contents/docs/ai-observability/playground.mdx Outdated
Comment thread contents/docs/ai-observability/playground.mdx Outdated
Comment thread contents/docs/ai-observability/playground.mdx Outdated
Comment thread contents/newsletter/agent-first-product-engineering.md Outdated
Comment thread contents/newsletter/building-ai-agents.md Outdated
Comment thread contents/blog/stop-ai-slop.md Outdated
@smallbrownbike smallbrownbike added the no-cache Force a fresh Gatsby build with no cache on deploy previews label May 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

no-cache Force a fresh Gatsby build with no cache on deploy previews

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants