0
点赞
收藏
分享

微信扫一扫

airflow

基于airflow官方镜像制作自己的镜像,如给镜像安装pymongo

FROM        10.60.10.119:5000/common/air_grpc:0.0.2
MAINTAINER  zhangchunyang@goldwind.com.cn

USER 0
RUN  pip install pymongo
USER airflow

镜像里都装了啥,可以通过docker history + 镜像来查看

airflow_sed

 

LocalExecutor executes tasks locally in parallel. It uses the multiprocessing Python library and queues to parallelize the execution of tasks.

​CeleryExecutor​​  is one of the ways you can scale out the number of workers. For this to work, you need to setup a Celery backend (RabbitMQRedis, …) and change your ​​airflow.cfg​​​ to point the executor parameter to ​​CeleryExecutor​​ and provide the related Celery settings

SequentialExecutor:This executor will only run one task instance at a time, can be used for debugging. It is also the only executor that can be used with sqlite since sqlite doesn’t support multiple connections

 

举报

相关推荐

0 条评论