Skip to content

[docs] Document the purpose of, and how to update, the worker VM base image#15272

Open
cjllanwarne wants to merge 9 commits into
hail-is:mainfrom
cjllanwarne:cjl_worker_image_doc
Open

[docs] Document the purpose of, and how to update, the worker VM base image#15272
cjllanwarne wants to merge 9 commits into
hail-is:mainfrom
cjllanwarne:cjl_worker_image_doc

Conversation

@cjllanwarne
Copy link
Copy Markdown
Collaborator

Change Description

Note: Generated doc. We should review this carefully and not just rubber stamp it.

Security Assessment

  • This change cannot impact the Hail Batch instance as deployed by Broad Institute in GCP

@cjllanwarne cjllanwarne requested a review from grohli February 11, 2026 16:00
@cjllanwarne cjllanwarne requested a review from a team as a code owner February 11, 2026 16:00

This comment was marked as resolved.

Comment thread batch/worker-vm-image.md Outdated
NAMESPACE=default $HAIL/batch/gcp-create-worker-image.sh
```

## Azure
Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Azure is legacy. We don't need to document it

Comment thread batch/worker-vm-image.md Outdated

- Google logging agent and Cloud Ops agent
- Docker CE + `docker-credential-gcr`
- NVIDIA drivers (535.183.01) and `nvidia-container-toolkit`
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suppose note that this isn't used by every VM down the road, just the ones that have GPUs attached

@cjllanwarne cjllanwarne force-pushed the cjl_worker_image_doc branch from 5cdfdc2 to e71aa1e Compare April 30, 2026 15:59
cjllanwarne and others added 3 commits April 30, 2026 12:41
Emphasize the importance of incrementing the version before running the script to avoid replacing the production image.
Clarify steps for running the build script and updating image references.
Comment thread dev-docs/services/batch/worker-vm-image.md Outdated
Comment thread dev-docs/services/batch/worker-vm-image.md Outdated
Comment thread dev-docs/services/batch/worker-vm-image.md
cjllanwarne and others added 4 commits April 30, 2026 17:41
Updated instructions for building worker VM image, including new steps for identifying a base image and monitoring the build process.
Co-authored-by: graphite-app[bot] <96075541+graphite-app[bot]@users.noreply.github.com>
Added steps for identifying new base images and checking GPU drivers during version incrementing.
@cjllanwarne cjllanwarne requested review from grohli and kush-chandra and removed request for a team May 18, 2026 19:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants