How To Automatically Pull In New Report Data Into Excel Using PowerQuery

One common situation most users of Excel face in making recurrent reports — daily reports, weekly reports, monthly reports etc — is that of updating the raw data part of the report with the new data for the period they are creating report for.


As simple as this looks, it is often a boring, repetitive and time consuming task. It could mean having to copy and paste data from the new source data files every day. For some people who get data from different sources (branches, sales people, departments etc), that coping and pasting can easily become a 20 mins task with potentials for human errors.

How do you set up your report to automatically pull in new data from source files? PowerQuery is the answer.

And if you are wondering if this will work for data that you get over emails daily/weekly/monthly. Yes, it works for them too.

The major step is to always save the source files in a dedicated folder. Have a folder on your computer than will hold only those source data files. The files can be Excel files or text files (CSV, TSV etc).


Also, ensure that the files have same table column structure — same table headers arranged in a consistent manner.

With all these done, you are half way.

In demonstrating this, I have a folder where I put in sales data from different branches of a Pizza restaurant. Everyday, I am required to do sales reports, trend analysis and target/KPI dashboards from all these sales data for management. Before, I would copy paste all the source data in a particular sheet on my daily report template. This could take between 5 to 15 mins depending on how tired/refreshed I was and if any interruption that makes me forget where I stopped.




Now with PowerQuery, all those boring aspect of the reports are fully automated away.

Instead of copying and pasting the content of the different source files into Excel, I go to Data menu, Get & Transform, Get Data, From File and From Folder.


Browse to the folder destination and select it.


You’ll see all the files in the folder. Select Combine and Load, in the Combine options.


Pick the sheet that’s got the data. That sheet name must be consistent across all the source data files.


Wait a couple of seconds while PowerQuery does its magic.

Notice how all the branches data have been pulled in.


And that’s not the best part. The whole essence of my proposing PowerQuery is to handle tomorrow’s source data and the days after.

So how does it work?

Very easy.

Just replaced the data files in the folder with tomorrow’s data files. Then right click anywhere in the combined table data and select Refresh.

What if there’s a new branch that just sent me their data after I had done all of these, what should I do to bring in that new branch’s data? 

Again, very easy.

Include/save the new branch’s data file in the dedicated folder. And click on Refresh in the combined table.

See an example below. 



We launched a new branch in Lokoja and after creating my report for the day, I suddenly got an email of the sales data for that branch and asked to include it in the daily report.

I simply add the branch data file to the dedicated folder and click on Refresh in my already existing combined table.


And that’s all!

No more zombie-like copying and pasting.

You can watch the short video demonstration: https://youtu.be/mKEHb0OWuP8



Enjoy!

For all your Excel training needs, you can check us out at https://urbizedge.com/Excel or call 01-6311885 or email team@urbizedge.com


Leave a Reply

Business Data Analysis
close slider
[]
1 Step 1

Interested in our Business Data Analysis Training?

keyboard_arrow_leftPrevious
Nextkeyboard_arrow_right