Filter Huge Data

[tiger19]

Hi, I am extracting excel file from web report. After extract, require to exclude one of the columns with criteria. Example ColumnA <> 'sample'

I manage to use Utility Collection --> Filter Collection. Then I use MS Excel VBO to write the collection and save it after filtered.

Is working fine for smaller files bout 1000-3000 rows. It crash/hang files more than 20,000 rows.

Is there any other method to filter out and save it?

 

[sahil_raina_91]

Hi, I am extracting excel file from web report. After extract, require to exclude one of the columns with criteria. Example ColumnA <> 'sample'

I manage to use Utility Collection --> Filter Collection. Then I use MS Excel VBO to write the collection and save it after filtered.

Is working fine for smaller files bout 1000-3000 rows. It crash/hang files more than 20,000 rows.

Is there any other method to filter out and save it?

There are few ways to write large collections in excel:
1. Use OLEDB's INSERT statement
2. Follow this : https://www.rpaforum.net/threads/write-a-large-collection-into-an-excel.9163/#post-29521
3. Create a custom code. Copy whole xml and paste this as new page into Excel VBO (click after last tab and pick paste) - should be much faster that default, although behaves a bit different in some cases:
https://pastebin.com/4cm2J4A7