Plugins
Azkaban job type plugin design provides great flexibility for developers to create any type of job executors which can work with essentially all types of systems -- all managed and triggered by the core Azkaban work flow management.
Here we provide a common set of plugins that should be useful to most hadoop related use cases, as well as sample job packages. Most of these job types are being used in LinkedIn's production clusters, only with different configurations. We also give a simple guide how one can create new job types, either from scratch or by extending the old ones.
command job type (built-in)
Instructions on how to use command job type.
java job type
Instructions on how to use java job type.
hadoop java job type
Instructions on how to use java job type that talks to secure hadoop installation.
pig job types
Instructions on how to use pig job types.
hive job types
Instructions on how to use hive job type.
voldemort build and push job types
Instructions on how to use VoldemortBuildandPush job types.
create new job types
Instructions on how to create new job types.