Feat/mlflow inference - #58
Merged
Merged
Conversation
…tract. - Implemented LocalResource and model deployment contract
…or deployment configuration
…ndling and initialization
…odel loading methods
…logging for lazy loading
…on for JSON bytes and allow initialization from raw data or local file paths in LocalResource
… ensure necessary dependencies are included
…upport multiple resources; add detailed docstring for set_project function in fluent.py
…emove duplicate tags
…e tracking and improved validation checks
- Expanded introduction to outline key steps in the pipeline. - Added detailed sections for dataset overview, structure, and annotation creation. - Improved clarity in code comments and markdown explanations. - Introduced a Datamint model adapter for deployment. - Included model testing and serving instructions with example requests. - Enhanced experiment tracking and logging details.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request introduces several improvements and refactorings to the annotation entity structure, configuration handling, and resource management in the DataMint codebase. The main objective is to enable deployment and model inference on our MLFlow server.
Annotation entity refactor and improvements:
Annotationclass has been moved todatamint/entities/annotations/annotation.pyand split into a minimalAnnotationBaseclass (for creation) and a fullAnnotationclass (for general use). The new structure allows for easier extension and creation of specific annotation types, such asImageClassification. Optional fields inAnnotationnow have default values, improving robustness when handling partial data. [1] [2] [3] [4]Entity base class and missing field handling:
BaseEntityclass now automatically removes attributes set to theMISSING_FIELDsentinel during initialization and when converting to a dictionary, ensuring cleaner entity representations and preventing accidental use of placeholder values. The method for checking missing attributes has been improved, and a newhas_missing_attrs()method has been added. [1] [2] [3]Resource entity and file handling:
Resourceclass has been updated to set more fields as optional with default values, and logic has been added to instantiate aLocalResourcewhen appropriate. Thefetch_file_datamethod now uses the staticBaseApimethods for determining mimetype and converting file formats, improving maintainability and clarity. [1] [2] [3] [4]Configuration system improvements:
API and documentation enhancements:
AnnotationsApi.createmethod documentation has been expanded to clarify its intended (internal) use and to guide users toward the appropriate public methods for annotation creation.Additionally, these changes improve modularity, clarity, and robustness of the DataMint codebase, especially around annotation handling and entity management.