Your Python script or notebook may have requirements on external libraries. Datapane supports the ability to add local folders and files, which you can deploy alongside your script, the ability to include
pip requirements, which are made available to your script when it is run on Datapane, and the ability to specify a Docker container which your script runs in. These are all configured in your
If we were building a reporting tool to pull down financial data, we may want to use the yfinance library in Python. To do this, we could add it to a
requirements list in our
Additionally, we may want to include a local Python folder or file. Imagine we have a separate Python file,
stock_scaler.py which helps us scale the values of our stocks, and which we want to use in our script, or a folder of SQL scripts which we want to use in Python.
~/C/d/d/my-new-proj> lsdp-script.py datapane.yaml stock_scaler.py
To include this in the deploy, we could add it to
By default scripts on Datapane run using our default Docker image, which, in addition to including Datapane and its supported visualisation libraries, includes the following libraries,
# datapane cli includes plotting and basic DS libs, e.g. pandas# additional visualisationsseaborn == 0.11.*altair-recipes ~= 0.9.0git+https://github.com/altair-viz/[email protected]#egg=altair-pandas# analytics librariesscipy == 1.5.*scikit-learn == 0.23.*patsy ~= 0.5.1lightgbm ~= 3.1.0lifetimes == 0.11.*lifelines == 0.25.*./wheels/fbprophet-0.7.1-py3-none-any.whladtk ~= 0.6.2# data accesssqlalchemy ~= 1.3psycopg2-binary ~= 2.8PyMySQL ~= 0.10.1google-cloud-bigquery[pandas, pyarrow] ~= 2.4.0boto3 ~= 1.16.19requests ~= 2.25.0ftpretty ~= 0.3.2pymongo ~= 3.11.0# miscdnspython ~= 2.0.0sh ~= 1.13.0
If you want your script to run in your own Docker container, you can specify your own.
Although you can use any base for your Docker image, we would recommend inheriting off ours. To do this, create a Docker image which inherits from the our base image (
nstack/datapane-python-runner) and adds your required dependencies.
from nstack/datapane-python-runner:latestCOPY requirements.txt .RUN pip3 install --user -r requirements.txt
If you build this and push it to Dockerhub, you can then specify it in your
datapane.yaml as follows:
When you run a script, it will run inside this Docker container. Note that the first run may take a bit longer, as it needs to pull the image from Dockerhub. Once it pulls it once, it's cached for future runs.