How to SSH and run PythonOperator in Airflow

Question

Is there a way to ssh to a server and run a PythonOperator with Airflow? I am looking something like SSHExecuteOperator but instead of executing a bash command execute a python callable.

Where you able to solve this?

Tsume
– Tsume

2018-07-27 13:06:55 +00:00
Commented Jul 27, 2018 at 13:06 — Tsume
– Tsume, Commented Jul 27, 2018 at 13:06

vipul sharma · Accepted Answer · 2017-03-16 12:31:19Z

2

Its ssh privacy issue

goto your host ssh server and run ssh-keygen -t rsa and press enter all the way
You will get 2 rsa files.copy that file to airflow env and copy its full path
The Just add the below in your connection from the airflow UI
```
 {"key_file": "/usr/local/airflow/.ssh/id_rsa.pub", "no_host_key_check": true}
```
Recompile the DAG and run it

answered Mar 16, 2017 at 12:31

vipul sharma

811 silver badge3 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

hky404 Over a year ago

where (in which field) would you add this in airflow UI connections?

Neil Over a year ago

extra field in Airflow UI connection

Collectives™ on Stack Overflow

How to SSH and run PythonOperator in Airflow

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related