Linux command
luigi 命令
文本
复制后可按需替换文件名、目录或参数。
常用示例
Run task
luigi --module [mymodule] [MyTask]
Run with parameters
luigi --module [mymodule] [MyTask] --[param]=[value]
Run local scheduler
luigid
Run with workers
luigi --module [mymodule] [MyTask] --workers [4]
Run with local scheduler
luigi --module [mymodule] [MyTask] --local-scheduler
说明
Luigi is a Python workflow engine for building complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, and failure handling. Tasks define dependencies via requires(), and Luigi ensures tasks run in correct order.
参数
- --module _name_
- Python module containing tasks.
- --workers _n_
- Number of workers.
- --local-scheduler
- Use local instead of central scheduler.
- --scheduler-host _host_
- Central scheduler hostname.
- --scheduler-port _port_
- Central scheduler port (default 8082).
- --log-level _level_
- Logging level (DEBUG, INFO, WARNING, ERROR, CRITICAL).
- --help
- Display available options and task parameters.
FAQ
What is the luigi command used for?
Luigi is a Python workflow engine for building complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, and failure handling. Tasks define dependencies via requires(), and Luigi ensures tasks run in correct order.
How do I run a basic luigi example?
Run `luigi --module [mymodule] [MyTask]` in a terminal, then adjust file names, paths, flags, or remote targets for your system.
What does --module _name_ do in luigi?
Python module containing tasks.