Skip to content

Replace ONNX Runtime with Kitten Inference Engine#143

Open
haaziq-sl wants to merge 16 commits into
KittenML:kitten-inferencefrom
haaziq-sl:native-engine-runtime-pr
Open

Replace ONNX Runtime with Kitten Inference Engine#143
haaziq-sl wants to merge 16 commits into
KittenML:kitten-inferencefrom
haaziq-sl:native-engine-runtime-pr

Conversation

@haaziq-sl

Copy link
Copy Markdown

Summary

Replaces the ONNX Runtime backend with the Kitten Inference Engine.

What changed

  • Removes the ONNX model wrapper.
  • Adds the Kitten Inference Engine wrapper.
  • Updates model loading for native architecture JSONs and hosted weights.
  • Replaces onnxruntime with kitten-inference==0.1.0.
  • Updates README install notes and CPU benchmark comparison against ONNX.

Scope

This PR focuses on the Python package runtime path and README.

Wheel-building workflows, CUDA packaging, and release automation are intentionally left out and can be handled separately.

Validation

  • SVG benchmark asset parses successfully.
  • git diff --check passes.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your free trial has ended. If you'd like to continue receiving code reviews, you can add a payment method here.

@haaziq-sl haaziq-sl changed the base branch from main to kitten-inference June 11, 2026 00:10

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your free trial has ended. If you'd like to continue receiving code reviews, you can add a payment method here.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your free trial has ended. If you'd like to continue receiving code reviews, you can add a payment method here.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your free trial has ended. If you'd like to continue receiving code reviews, you can add a payment method here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant