Hello All.
In our platform, we are extensively using Oracle data integrator for ETL/ELT. We've recently started with machine learning / data mining implementations wherein we are looking into possibilities of using ODI procedures to run our implementation of Machine learning in Python. The issue is, even if we've installed packages like PANDAS or SCIKIT-LEARN in our Python installations, we are not able to use them in ODI, since ODI is not able to recognize these external packages and libraries. This can either be a lack of configuration in ODI which we have not done, or a missing configuration of Jython, since this is the technology that we are using to perform such activities.
If anyone can provide any guidelines or share their experiences on this matter, it'd be great! .
Needless to say, the reason of integrating everything in ODI is to make sure that both Data engineering (ETL/ELT) as well as Data Mining/Machine Learning pipelines in our platform can be Productionized using the same software, which removes the hassles of using multiple components to be integrated.
Thanks,
Suddhasatwa