-
Notifications
You must be signed in to change notification settings - Fork 4.7k
AI starter kit chart #579
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Draft
volatilemolotov
wants to merge
16
commits into
kubernetes:master
Choose a base branch
from
volatilemolotov:ai-starter-kit-chart-2
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
AI starter kit chart #579
Changes from all commits
Commits
Show all changes
16 commits
Select commit
Hold shift + click to select a range
c01a078
init ai-starter-kit
volatilemolotov d57a1ea
Updated PVCs. added GPU support, added MacOS support
volatilemolotov 05c0644
remove example values and ci
volatilemolotov 6995e3c
clean up makefile
volatilemolotov 74322fc
changes to readme
volatilemolotov 2755940
update readme and change default password
volatilemolotov 2781c92
remove output from ray.ipynb
drogovozDP a871088
Merge pull request #29 from volatilemolotov/ai-starter-kit-2-remove-blob
volatilemolotov 7d7df31
update readme
volatilemolotov 6bf740d
add pre delete hook for singleuser env
volatilemolotov ceb424e
readme fixes, added hook to delete singleuser pod
volatilemolotov 42ca138
Applying fixes to resolve PR comments
alex-akv b20d943
Merge pull request #30 from volatilemolotov/comment-resolve
volatilemolotov 0672f83
remove mlflow enabled from doc
volatilemolotov ced46e9
Applying fixes to resolve PR comments
alex-akv 78a03d7
Updating readme with makefile command description
alex-akv File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,62 @@ | ||
| .PHONY: check_hf_token check_OCI_target package_helm lint dep_update install install_gke start uninstall push_helm | ||
|
|
||
| check_hf_token: | ||
| ifndef HF_TOKEN | ||
| $(error HF_TOKEN is not set) | ||
| endif | ||
|
|
||
| check_OCI_target: | ||
| ifndef OCI_HELM_TARGET | ||
| $(error OCI_HELM_TARGET is not set) | ||
| endif | ||
|
|
||
| package_helm: | ||
| helm package helm-chart/ai-starter-kit/ --destination out/ | ||
|
|
||
| push_helm: check_OCI_target | ||
| helm push out/ai-starter-kit* oci://$$OCI_HELM_TARGET | ||
|
|
||
| lint: | ||
| helm lint helm-chart/ai-starter-kit | ||
|
|
||
| dep_update: | ||
| helm dependency update helm-chart/ai-starter-kit | ||
|
|
||
| install: check_hf_token | ||
| helm upgrade --install ai-starter-kit helm-chart/ai-starter-kit --set huggingface.token="$$HF_TOKEN" --timeout 10m -f helm-chart/ai-starter-kit/values.yaml | ||
|
|
||
| start: | ||
| mkdir -p /tmp/models-cache | ||
| minikube start --cpus 4 --memory 15000 --mount --mount-string="$$HOME/models-cache:/tmp/models-cache" | ||
|
|
||
| start_gpu: | ||
| mkdir -p $HOME/models-cache | ||
| minikube start --driver krunkit --cpus 4 --memory 15000 --mount --mount-string="$HOME/models-cache:$HOME/models-cache" | ||
|
|
||
| uninstall: | ||
| helm uninstall ai-starter-kit | ||
|
|
||
| destroy: | ||
| minikube delete | ||
|
|
||
| validate_jupyterhub: | ||
| kubectl get pods; \ | ||
| kubectl wait --for=condition=Ready pods -l 'component!=continuous-image-puller' --timeout=1800s; \ | ||
| kubectl get pods; \ | ||
| kubectl get services; \ | ||
| kubectl port-forward service/ai-starter-kit-jupyterhub-proxy-public 8081:80 & \ | ||
| PID=$$!; \ | ||
| echo "Port-forward PID=$${PID}"; \ | ||
| sleep 5s; \ | ||
| python3 ./ci/test_hub.py "127.0.0.1:8081"; \ | ||
| kill $$PID | ||
|
|
||
| validate_ray: | ||
| kubectl wait --for=condition=Ready pods -l 'app.kubernetes.io/created-by=kuberay-operator' --timeout=1800s; \ | ||
| kubectl get pods; \ | ||
| kubectl get services; \ | ||
| kubectl port-forward service/ai-starter-kit-kuberay-head-svc 8265:8265 & \ | ||
| PID=$$!; \ | ||
| sleep 10s; \ | ||
| ray job submit --address=http://127.0.0.1:8265 -- python -c "import ray; ray.init(); print(ray.cluster_resources())"; \ | ||
| kill $$PID | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,23 @@ | ||
| # Patterns to ignore when building packages. | ||
| # This supports shell glob matching, relative path matching, and | ||
| # negation (prefixed with !). Only one pattern per line. | ||
| .DS_Store | ||
| # Common VCS dirs | ||
| .git/ | ||
| .gitignore | ||
| .bzr/ | ||
| .bzrignore | ||
| .hg/ | ||
| .hgignore | ||
| .svn/ | ||
| # Common backup files | ||
| *.swp | ||
| *.bak | ||
| *.tmp | ||
| *.orig | ||
| *~ | ||
| # Various IDEs | ||
| .project | ||
| .idea/ | ||
| *.tmproj | ||
| .vscode/ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,45 @@ | ||
| apiVersion: v2 | ||
| name: ai-starter-kit | ||
| description: A Helm chart for Kubernetes | ||
|
|
||
| # A chart can be either an 'application' or a 'library' chart. | ||
| # | ||
| # Application charts are a collection of templates that can be packaged into versioned archives | ||
| # to be deployed. | ||
| # | ||
| # Library charts provide useful utilities or functions for the chart developer. They're included as | ||
| # a dependency of application charts to inject those utilities and functions into the rendering | ||
| # pipeline. Library charts do not define any templates and therefore cannot be deployed. | ||
| type: application | ||
|
|
||
| # This is the chart version. This version number should be incremented each time you make changes | ||
| # to the chart and its templates, including the app version. | ||
| # Versions are expected to follow Semantic Versioning (https://semver.org/) | ||
| version: 0.1.0 | ||
|
|
||
| # This is the version number of the application being deployed. This version number should be | ||
| # incremented each time you make changes to the application. Versions are not expected to | ||
| # follow Semantic Versioning. They should reflect the version the application is using. | ||
| # It is recommended to use it with quotes. | ||
| appVersion: "0.1.0" | ||
|
|
||
|
|
||
| dependencies: | ||
| - name: kuberay-operator | ||
| condition: ray-cluster.enabled | ||
| version: "1.3.0" | ||
| repository: "https://ray-project.github.io/kuberay-helm" | ||
| - condition: ray-cluster.enabled | ||
| name: ray-cluster | ||
| version: "1.3.0" | ||
| repository: "https://ray-project.github.io/kuberay-helm" | ||
| - name: jupyterhub | ||
| version: "4.2.0" | ||
| repository: "https://hub.jupyter.org/helm-chart/" | ||
| - name: mlflow | ||
| version: "0.12.0" | ||
| repository: "https://community-charts.github.io/helm-charts" | ||
| - name: ollama | ||
| condition: ollama.enabled | ||
| version: "1.27.0" | ||
| repository: "https://helm.otwld.com" |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What is the usage of the make commands?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You want me to document each?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just in general in README. User can still following the current README to install via helm, so not sure when these make commands should be used.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Documented in commit: 78a03d7