If the need arises to use a Mesos executor other than the Thermos executor, the scheduler can be
configured to utilize a custom executor by specifying the -custom_executor_config flag.
The flag must be set to the path of a valid executor configuration file.
The configuration file must be a valid JSON array and contain, at minimum,
one executor configuration including the name, command and resources fields and
must be pointed to by the -custom_executor_config flag when the scheduler is
started.
| Property | Description |
|---|---|
| executor (required) | Description of executor. |
| task_prefix (required) ) | Prefix given to tasks launched with this executor’s configuration. |
| volume_mounts (optional) | Volumes to be mounted in container running executor. |
| Property | Description |
|---|---|
| name (required) | Name of the executor. |
| command (required) | How to run the executor. |
| resources (required) | Overhead to use for each executor instance. |
| Property | Description |
|---|---|
| value (required) | The command to execute. |
| arguments (optional) | A list of arguments to pass to the command. |
| uris (optional) | List of resources to download into the task sandbox. |
| shell (optional) | Run executor via shell. |
A note on the command property (from mesos.proto):
1) If 'shell == true', the command will be launched via shell
(i.e., /bin/sh -c 'value'). The 'value' specified will be
treated as the shell command. The 'arguments' will be ignored.
2) If 'shell == false', the command will be launched by passing
arguments to an executable. The 'value' specified will be
treated as the filename of the executable. The 'arguments'
will be treated as the arguments to the executable. This is
similar to how POSIX exec families launch processes (i.e.,
execlp(value, arguments(0), arguments(1), ...)).
| Property | Description |
|---|---|
| value (required) | Path to the resource needed in the sandbox. |
| executable (optional) | Change resource to be executable via chmod. |
| extract (optional) | Extract files from packed or compressed archives into the sandbox. |
| cache (optional) | Use caching mechanism provided by Mesos for resources. |
| Property | Description |
|---|---|
| name (required) | Name of the resource: cpus or mem. |
| type (required) | Type of resource. Should always be SCALAR. |
| scalar (required) | Value in float for cpus or int for mem (in MBs) |
| Property | Description |
|---|---|
| host_path (required) | Host path to mount inside the container. |
| container_path (required) | Path inside the container where host_path will be mounted. |
| mode (required) | Mode in which to mount the volume, Read-Write (RW) or Read-Only (RO). |
A sample configuration is as follows:
[
{
"executor": {
"name": "myExecutor",
"command": {
"value": "myExecutor.a",
"shell": "false",
"arguments": [
"localhost:2181",
"-verbose",
"-config myConfiguration.config"
],
"uris": [
{
"value": "/dist/myExecutor.a",
"executable": true,
"extract": false,
"cache": true
},
{
"value": "/home/user/myConfiguration.config",
"executable": false,
"extract": false,
"cache": false
}
]
},
"resources": [
{
"name": "cpus",
"type": "SCALAR",
"scalar": {
"value": 1.00
}
},
{
"name": "mem",
"type": "SCALAR",
"scalar": {
"value": 512
}
}
]
},
"volume_mounts": [
{
"mode": "RO",
"container_path": "/path/on/container",
"host_path": "/path/to/host/directory"
},
{
"mode": "RW",
"container_path": "/container",
"host_path": "/host"
}
],
"task_prefix": "my-executor-"
}
]
It should be noted that if you do not use Thermos or a Thermos based executor, links in the scheduler’s Web UI for tasks will not work (at least for the time being). Some information about launched tasks can still be accessed via the Mesos Web UI or via the Aurora Client.
To launch tasks using a custom executor,
an ExecutorConfig object must be added to
the Job or Service object. The name parameter of ExecutorConfig must match the name of an executor
defined in the JSON object provided to the scheduler at startup time.
For example, if we desire to launch tasks using myExecutor (defined above), we may do so in
the following manner:
jobs = [Service(
task = task,
cluster = 'devcluster',
role = 'www-data',
environment = 'prod',
name = 'hello',
executor_config = ExecutorConfig(name='myExecutor'))]
This will create a Service Job which will launch tasks using myExecutor instead of Thermos.