Forum

Combine or append -...
 
Notifications
Clear all

Combine or append - which is efficient?

3 Posts
2 Users
0 Reactions
155 Views
(@raman)
Posts: 33
Trusted Member
Topic starter
 

Hi friends

I have around 5 files each in two folders in excel.  I may get more files in future.  The files are of same nature.

I have to combine files from each of the folder.

I have two options:

1. I create a query for one file in a folder.  Duplicate queries and change the data source/name.  Append queries.

2. Get data from folder.

Which is the best option in terms of efficiency?

Personally I am not in favour of get data from folder, as it creates additional queries like sample file, transformation etc., which makes the query list clumsy.  But I don't want to compromise on efficiency as I will get more files in future.  

I request experts to suggest.

Thanks....Thulasiraman

 
Posted : 15/11/2021 8:12 pm
(@mynda)
Posts: 4761
Member Admin
 

Hi MJ,

Someone else asked this the other day. In Power Query you cannot establish whether a process is more or less efficient based on the number of queries or steps in a query. I agree, the From Folder connector creates a load of additional queries, but then so does creating a separate query for each file and then appending them.

You'd have to do some timed tests on your data to see if one is faster/slower than the other and I'm not aware of anyone who has done this. If I were you, I'd use From Folder as this is less work to set up.

Mynda

 
Posted : 16/11/2021 12:29 am
(@raman)
Posts: 33
Trusted Member
Topic starter
 

Thanks for your suggestion Mynda.

Still I am little bit jittery in using From Folder, as I encountered few problems in the past when the sheet name changes, etc

I will try and learn that way as you said it is easier to set up.

Thanks a lot.

 
Posted : 16/11/2021 10:10 am
Share: