SQL & PL/SQL

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

What is the best way to read the large dataset from oracle DB into pandas dataframe ?

User_CK8A6May 13 2021

In the production DB, we have few txn tables which have more 400 millions of records. I have to read the data and do the data processing for preparing the analytics report? I have tried to use the pandas.read_sql or pandas.read_sql_query with chunk size but this is very slow. Please suggest if we have different ways to do this optimally.

Thanks,
Manoj Kumar

Locked Post

New comments cannot be posted to this locked post.

Locked on Jun 10 2021

Added on May 13 2021

#sql

1 comment

10,768 views