A.19 Python Libraries for Predefined Conda Environment
Compliance Studio comes with predefined Conda environments as follows:
- default_<CS version>
- ml4aml_<CS version>
- sane_<CS version>
Table A-9 Default Conda Python Environment
| Package | Version |
|---|---|
| asttokens | 2.2.1 |
| backcall | 0.2.0 |
| certifi | 2022.12.7 |
| cffi | 1.15.1 |
| charset-normalizer | 2.0.12 |
| click | 8.1.3 |
| cloudpickle | 2.2.1 |
| conda-pack | 0.6.0 |
| contourpy | 1.0.6 |
| cryptography | 41.0.1 |
| cx-Oracle | 8.3.0 |
| cycler | 0.11.0 |
| Cython | 0.29.32 |
| dask | 2023.6.1 |
| dataclasses | 0.6 |
| decorator | 5.1.1 |
| distributed | 2023.6.1 |
| ds-interpreter-client | 23.4.2 |
| evidently | 0.1.50.dev0 |
| executing | 1.2.0 |
| fonttools | 4.38.0 |
| fsspec | 2022.3.0 |
| greenlet | 1.1.2 |
| hivejdbc | 0.2.3 |
| idna | 3.3 |
| imbalanced-learn | 0.8.1 |
| importlib-metadata | 6.7.0 |
| ipython | 8.14.0 |
| jedi | 0.18.2 |
| Jinja2 | 3.1.2 |
| joblib | 1.2.0 |
| JPype1 | 1.3.0 |
| kafka-python | 2.0.2 |
| kiwisolver | 1.4.4 |
| locket | 1.0.0 |
| MarkupSafe | 2.1.3 |
| matplotlib | 3.6.2 |
| matplotlib-inline | 0.1.6 |
| mmg | 8.1.2.5.0 |
| modin | 0.18.1 |
| msgpack | 1.0.5 |
| nltk | 3.6.7 |
| numpy | 1.24.0 |
| oracle-pypgx-client | 23.4.2 |
| oracledb | 1.2.2 |
| packaging | 21.3 |
| pandas | 1.5.3 |
| parso | 0.8.3 |
| partd | 1.4.0 |
| patsy | 0.5.2 |
| pexpect | 4.8.0 |
| pickleshare | 0.7.5 |
| Pillow | 9.3.0 |
| pip | 23.2.1 |
| platformdirs | 3.8.0 |
| plotly | 5.8.0 |
| prompt-toolkit | 3.0.38 |
| protobuf | 4.23.3 |
| psutil | 5.9.0 |
| ptyprocess | 0.7.0 |
| pure-eval | 0.2.2 |
| py4j | 0.10.9.5 |
| pyarrow | 6.0.1 |
| pybars3 | 0.9.7 |
| pycparser | 2.21 |
| pydantic | 1.10.5 |
| Pygments | 2.15.1 |
| pyjdbc | 0.2.2 |
| PyMeta3 | 0.5.1 |
| pyparsing | 2.4.7 |
| python-dateutil | 2.8.2 |
| pytz | 2022.6 |
| PyYAML | 5.4.1 |
| regex | 2022.10.31 |
| requests | 2.28.2 |
| scikit-learn | 1.2.2 |
| scipy | 1.10.1 |
| seaborn | 0.12.1 |
| setuptools | 68.0.0 |
| six | 1.16.0 |
| sortedcontainers | 2.4.0 |
| SQLAlchemy | 2.0.3 |
| sqlparams | 3.0.0 |
| stack-data | 0.6.2 |
| statsmodels | 0.13.5 |
| tblib | 2.0.0 |
| tenacity | 8.0.1 |
| threadpoolctl | 3.1.0 |
| toolz | 0.12.0 |
| tornado | 6.3.2 |
| tqdm | 4.65.0 |
| traitlets | 5.9.0 |
| types-requests | 2.31.0.1 |
| types-urllib3 | 1.26.25.13 |
| typing_extensions | 4.4.0 |
| urllib3 | 1.26.6 |
| wcwidth | 0.2.6 |
| wheel | 0.41.2 |
| whylabs-client | 0.5.2 |
| whylogs | 1.2.0 |
| whylogs-sketching | 3.4.1.dev3 |
| xgboost | 1.5.2 |
| zict | 3.0.0 |
| zipp | 3.15.0 |
Table A-10 ml4aml Conda Environment
| Package | Version |
|---|---|
| sqlalchemy | 2.0.19 |
| xgboost | 1.7.6 |
| seaborn | 0.12.2 |
| scikit-learn | 1.2.2 |
| SHAP | 0.42.1 |
| ELI5 | 0.13.0 |
| PDPbox | 0.3.0 |
| Imbalanced learn | 0.10.1 |
| py4j | 0.10.9.7 |
| scikit-optimize | 0.9.0 |
| statsmodels | 0.14.0 |
| pyod | 1.1.0 |
| oracledb | 1.2.2 |
| numpy | 1.24.4 |
| scipy | 1.11.1 |
| pandas | 1.5.3 |
| matplotlib | 3.7.2 |
| requests | 2.31.0 |
| minisom | 2.3.1 |
| Matplotlib-venn | 0.11.9 |
Note:
The Pyspark python package is not part of the default environment.Install Pyspark for ml4aml Conda Python Environment
To use this feature, download the pyspark python package from the deployed spark distribution and install the package in the conda python environment of the Compliance Studio.
To install the pyspark python package, follow these steps:
- Log in to the UNIX machine where Compliance Studio is installed.
- Navigate to
<COMPLAINACE_STUDIO_INSTALLED_PATH>/deployed/python_packages/ ml4aml/bindirectory. - If the machine is connected to the internet then install by
executing the following command:
./python3 -m pip install pyspark - If the machine is not connected to the internet then download the available package from the deployed spark.
- Copy the package to any location in the UNIX machine and
install by executing the following
commands:
/python3 -m pip install pyspark --no-index --findlinks $FULL_PATH_INCLUDING_PYSPARK_PACKAGE_NAME
Table A-11 Sane Conda Environment
| Package | Version |
|---|---|
| catboost | 1.2 |
| certifi | 2021.10.8 |
| cffi | 1.15.1 |
| conda-pack | 0.6.0 |
| contourpy | 1.1.0 |
| cryptography | 41.0.1 |
| cx-Oracle | 8.3.0 |
| cycler | 0.11.0 |
| deprecation | 2.1.0 |
| ds-interpreter-client | 23.4.2 |
| fonttools | 4.40.0 |
| globalparty | 8.1.2.7.0rc8 |
| graphviz | 0.20.1 |
| importlib-resources | 5.12.0 |
| jaro-winkler | 2.0.3 |
| jellyfish | 0.11.2 |
| kiwisolver | 1.4.4 |
| Levenshtein | 0.21.1 |
| matplotlib | 3.7.1 |
| mmg | 8.1.2.5.0 |
| numpy | 1.22.4 |
| oracle-pypgx-client | 23.4.2 |
| oracledb | 1.3.2 |
| packaging | 21.3 |
| pandas | 1.5.3 |
| Pillow | 9.5.0 |
| pip | 23.2.1 |
| plotly | 5.15.0 |
| py4j | 0.10.9.5 |
| pycparser | 2.21 |
| pyparsing | 3.1.0 |
| python-dateutil | 2.8.2 |
| python-Levenshtein | 0.21.1 |
| pytz | 2021.3 |
| pyxDamerauLevenshtein | 1.7.1 |
| rapidfuzz | 3.1.1 |
| retrying | 1.3.4 |
| sane-common | 0.2.4 |
| scipy | 1.11.0 |
| setuptools | 68.0.0 |
| six | 1.16.0 |
| tenacity | 8.2.2 |
| textdistance | 4.5.0 |
| urllib3 | 1.26.16 |
| wheel | 0.41.2 |
| zipp | 3.15.0 |