Skip to content

feat: GenAI integration - #150

Draft
Neo-Super-Express wants to merge 41 commits into
HeZeBang:masterfrom
Neo-Super-Express:codex/genai-foundation
Draft

Neo-Super-Express wants to merge 41 commits into
HeZeBang:masterfrom
Neo-Super-Express:codex/genai-foundation

Conversation

@Neo-Super-Express

@Neo-Super-Express Neo-Super-Express commented Oct 27, 2026 •

Copy link
Copy Markdown

This pull request adds a basic integration of GenAI.

Core features

  1. Chat interface with tool support.
  2. Custom message marking protocol to take advantage of GenAI's own session management, syncing chats across all logged-in instances without the need for another server.
  3. An image generation tab for users to generate custom images with GPT-image-2.5.
  4. ASR and TTS from GenAI.
  5. Generative UI providing embedded interactive visuals.

Next steps

  • More tools (campus-related, generative-UI, etc.)
  • Better compaction
  • Safety features
  • Better UI/UX design
image image

Water-Buckets and others added 30 commits October 20, 2026 12:33
Add a bounded campus-tool loop with typed, nonce-bound calls, approvals,
mutation receipts, mode-aware prompts, and an ordered activity timeline.
Persist account-scoped conversations and safely restore tool history,
attachments, images, and interrupted operations.

Improve responsive chat controls, image sizing and reference images,
platform capability handling, and cancellation across account changes.
Prevent history reopening from silently selecting a paid replacement model.

Keep the experimental IDS campus-data preview bridge and local QA-only
material out of this commit. Retain regressions for protocol boundaries,
account races, durable storage, approvals, and user-visible failures.

Validation: 1003 Flutter tests, 22 proxy tests, flutter analyze --no-pub,
and formatting checks for all changed Dart files passed.
Bound chat context using original user records and typed tool evidence, preserve recoverable histories, validate extracted document uploads, and avoid cumulative transcript duplication. Split the workspace into focused UI components and refine the composer, rendering feedback, and context ring.

Refresh the API and agent documentation, remove stale TODO guidance and redundant tests, and retain coverage for compaction, archive recovery, uploads, rendering errors, and responsive behavior. Test-only IDS academic integration is excluded.

Validation: Flutter 3.41.9 analysis is clean; all 1040 tests pass. Full TechPie web fixture rebuilt and browser-verified.
Replace local conversation persistence with versioned server records and source-validated compaction boundaries. Enforce nonce-framed agent decisions, stream final answers, and support explicit inspection of earlier generated images.

Preserve scoped confirmations and mutation recovery, remove web search, enable native document selection, and update recovery documentation and regression coverage.

Validation: 1017 tests passed; flutter analyze --no-pub and formatting checks passed.
Use compact versioned server records with injected agent controls, receipt references, and recoverable context estimates. Keep legacy records readable and preserve operation approval and retry state.

Add shared image copy, share, save, and link actions across chat and galleries with native platform integration. Simplify stopped feedback and remove the context popup.

Retain focused recovery, mutation-safety, image-selection, and accessibility regressions. Validation: 1,019 tests passed, analysis clean, changed Dart files formatted; live Kimi-K3 tool flow and server-history follow-up verified.
Reuse verified timetable data and reject stale semester or account responses. Consolidate code-font selection without extra font assets, shorten the integration docs, and prune constant-only assertions while retaining recovery regressions.
Add complete-turn editing, deletion and reversion with server reconciliation. Streamline the agent protocol and history, preserve mutation recovery, and harden uploads and transport handling.

Improve Mermaid sizing and bounded fullscreen navigation. Simplify documentation, remove superficial tests, and retain regressions for recovery, protocol parsing, approvals and diagram geometry.
@Honahec Honahec mentioned this pull request Nov 2, 2026
Separate model exchange, execution policy, and context projection; preserve server recovery and handle Azure streaming and image follow-ups.

Unify adaptive chat and image controls, simplify rendering and lifecycle handling, and retain regression coverage for protocol, session, cancellation, and UI failures.
Keep editing inline and prioritize composer and image actions across screen sizes. Preserve partial answers and mutation receipts on recovery, bound repeated reads, and refresh missing venue contact details before approval.
Merge upstream 65ec296 while retaining GenAI picker pins. Add file_selector_ohos to the direct dependency graph so Flutter 3.41 registers its platform implementation.
Preserve GenAI runtime lifecycle and assignment ownership checks alongside upstream deadline widgets and identity-epoch guards.
Consolidate agent execution, upload ownership, cancellation and rich-answer controls while preserving server recovery and approval boundaries. Align model catalog and input handling with the school API.

Use Apple URLSession and cross-platform native audio with required permissions and plugin registrations. Keep behavior-focused regressions, prune duplicate styling tests, and align assignment-cache assertions with upstream unbinding behavior. Exclude local demos, diagnostic proxies and test-only IDS wiring.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Backlog

Development

Successfully merging this pull request may close these issues.

2 participants