Submitting On-prem Jobs
Contents
Submitting On-prem Jobs¶
Registering local clusters¶
To register a local cluster in SkyPilot, users should follow two steps.
For the first step, regular users should obtain a distributable cluster YAML from the system administrator or follow the steps in the prior section.
The cluster YAML must have user credentials filled out and should be stored in ~/.sky/local/. An example is shown in the cluster config docs.
For the second step, regular users should run the following command:
$ sky launch -c my-local-cluster -- ''
This ensures that SkyPilot can fully register and profile the local cluster.
Listing registered clusters¶
To list all registered local clusters, run:
$ sky status
This may show multiple local clusters, if you have created several:
Listing all local clusters:
NAME CLUSTER_USER CLUSTER_RESOURCES COMMAND
my-local-cluster my_user [{'V100': 4}, {'V100': 4}] sky launch -c my-local-cluster ..
ml-research daniel [{'K80': 8}] sky exec ml-research ..
test - - -
Local clusters that have ben ran with sky launch have all table columns populated.
Launching task YAML¶
Let’s define a simple task to be submitted to the local cluster my-local-cluster.
In this example, the user has already registered the local cluster my-local-cluster (by moving the cluster YAML to ~/.sky/local/my-local-cluster.yaml).
Copy the following YAML into a local_example.yaml file:
resources:
# (Optional) Specifies that the task is run in the local cloud.
cloud: local
# Task resources: 1x NVIDIA V100 GPU
accelerators: V100:1
# Working directory (optional) containing the project codebase.
# Its contents are synced to ~/sky_workdir/ on the cluster.
workdir: .
# Invoked under the workdir (i.e., can use its files).
setup: |
echo "Running setup."
# Invoked under the workdir (i.e., can use its files).
run: |
echo "Hello, SkyPilot On-prem!"
conda env list
This defines a task to be run. The task takes up 1 V100 GPU.
To connect to the local cluster my-local-cluster and run a task, use sky launch:
$ sky launch -c my-local-cluster local_example.yaml
Here, the name of the cluster must match the name of the local cluster. The cloud field in the YAML is optional. SkyPilot will automatically detect if the cloud is local when the user specifies the name of the local cluster in sky launch.
Executing multiple jobs¶
Tasks can be quickly submitted via sky exec. Each task submitted by sky exec is automatically managed by SkyPilot’s cluster manager.
# Launch the job 5 times.
sky exec my-local-cluster task.yaml -d --gpus=V100:1
sky exec my-local-cluster task.yaml -d --gpus=V100:3
sky exec my-local-cluster task.yaml -d --gpus=V100:4
sky exec my-local-cluster task.yaml -d --gpus=V100:2
Refer to Job Queue for more details regarding job submission.