Back to Blog

Creating Reports in Power BI with Copilot - What It Actually Does

September 16, 20268 min readMichael Ridland

There is a particular kind of Monday morning that Power BI Copilot is built for. Someone has just dumped a fresh dataset into a workspace, a manager wants "something to look at" by lunchtime, and the analyst who normally builds the report is on leave. You open the report, type a sentence about what you want, and a few seconds later there is a page of visuals sitting in front of you. That moment feels close to magic the first time you see it.

Then you look a bit harder, and you notice the chart picked the wrong measure, the date field is being treated as text, and one of the cards is summing a column that should never be summed. That is the honest experience of Copilot in Power BI right now. It is genuinely useful and it is not a replacement for someone who understands the data. Microsoft's own documentation on creating reports with Copilot walks through the mechanics. What follows is what we have learned putting it in front of real Australian teams who have to trust the numbers.

What Copilot is doing under the hood

The thing to understand first is that Copilot is not inventing analysis. It reads your semantic model, the tables, the relationships, the measures, the field names, and it uses that structure to decide what a reasonable report looks like. When you ask it to "create a report showing sales performance by region and month", it looks for fields that resemble sales, region and month, picks visuals that suit those shapes, and lays them out across one or more pages.

This matters because the quality of what comes out is almost entirely a function of the quality of what goes in. A well-built model with clear table names, sensible measures, and proper data types gives Copilot something to work with. A model where columns are called Column1 and Field_3, where everything is a generic number with no aggregation defined, gives Copilot noise, and it will confidently produce a report that looks fine and means nothing.

We tell clients to think of Copilot the same way you would think of a sharp graduate on their first day. Give them a tidy, well-labelled dataset and clear instructions and they will produce something good quickly. Give them a mess and no context and they will produce something that looks like work but needs redoing. The tool amplifies whatever state your model is in.

Where it genuinely saves time

The first-draft problem is real, and this is where Copilot earns its place. Staring at a blank report canvas is where a lot of people lose an hour deciding what to build before they build anything. Copilot gets you to a starting layout in seconds, and editing a draft is much faster than creating from nothing. Even when half of what it produces is wrong, having a page to react to beats an empty screen.

It is also handy for the "I don't know this dataset yet" situation. When you inherit a model someone else built and you are not sure what is even in it, asking Copilot to summarise the data or suggest what is worth reporting is a fast way to orient yourself. It surfaces fields and relationships you might not have noticed, a bit like a table of contents for the model.

The narrative summaries are the other feature worth knowing about. Copilot can write a plain-language paragraph describing what a visual shows, which is useful for the executive who wants the "so what" without reading a chart. In practice these summaries are decent at describing what happened and weak at explaining why, so treat them as a caption rather than analysis. Still, for a dashboard that busy people skim, a good caption earns its keep.

For teams that are new to Power BI, this lowers the barrier a lot. We do a fair amount of hands-on Power BI enablement with clients, and Copilot has changed the shape of those early sessions. People who would previously freeze up now have a way to get a report started and learn by editing it, which is a better way to learn than watching someone else build.

Where it still falls over

Now the honest part. Copilot gets things wrong in ways that are quiet, and quiet mistakes in a report are the dangerous ones because nobody catches them until a decision has been made on bad numbers.

The most common failure is aggregation. Copilot will happily sum a column that should be averaged, or average something that should be counted. If your model has properly defined measures, this is far less of a problem, because Copilot uses the measure rather than guessing an aggregation off a raw column. This is the single strongest argument for building explicit measures instead of letting people drag raw columns onto visuals. It is good practice anyway, and it also happens to be what makes Copilot reliable.

The second issue is that it does not understand your business. It knows the field is called Margin. It does not know that your finance team defines margin after rebates and that the rebate adjustment lives in a separate table nobody told it about. It will produce a margin chart that is technically a chart of a field called margin and is not the number your CFO recognises. No amount of prompting fixes this if the logic is not encoded in the model.

Ambiguity is the third one. Ask for "top customers" and Copilot has to guess whether you mean by revenue, by volume, by count of orders, or by margin. It picks one, and it will not always tell you clearly which. The fix is to be specific in your prompt, but the deeper fix is that a lot of these ambiguities are really signs your model needs clearer, named measures so there is only one sensible interpretation.

There is also a data governance angle people forget in the excitement. Copilot respects row-level security, which is exactly right. It also makes the data much easier to interrogate for anyone with access, which means any weakness in how you have set up who-sees-what gets exposed faster. If your security was quietly wrong, a natural-language layer helps someone discover that in a hurry. Worth getting the security model right before you turn everyone loose with plain-English querying.

How to use it without getting burned

The pattern that works, from watching a lot of teams try this, is to treat Copilot as a drafting tool inside a disciplined process rather than a shortcut around one.

Start by getting the model right before you let anyone loose with Copilot on it. Clear table and field names. Proper data types, so dates are dates and numbers are numbers. Explicit measures for anything that matters, with the business logic baked in. This is not extra work invented for Copilot. It is the same modelling discipline that makes any Power BI report trustworthy, and Copilot just raises the cost of skipping it.

Then use Copilot for the first draft and the boring layout work, and keep a human in the loop for anything that will drive a decision. Someone who knows the data has to look at what Copilot produced and ask the obvious questions. Is that the right measure? Is the aggregation correct? Does that number match what we already know to be true? This review takes minutes when the model is good and it is not optional.

Be specific in your prompts. "Show revenue" is a coin toss. "Show total revenue by state for the last twelve months as a bar chart, sorted descending" gives Copilot far less room to guess wrong. The habit of writing a clear prompt is worth building, and it doubles as documentation of what the report is meant to show.

Finally, do not ship the narrative summaries unread. They are usually fine and occasionally they say something subtly wrong with total confidence, which is worse than saying nothing. Read them the way you would proofread anything going in front of a client.

Is it worth turning on?

Yes, with eyes open. For organisations already invested in Power BI, Copilot shortens the path from data to a first draft and lowers the barrier for people who find the tool intimidating. That is real value and it compounds across a team.

What it does not do is remove the need to understand your data, build a proper model, or check the output. If anything it raises the stakes on the model, because a good model makes Copilot reliable and a bad one makes it confidently wrong. The organisations that get the most out of it are the ones that already had their modelling discipline sorted. The ones that hoped Copilot would let them skip that step tend to learn the hard way.

If you are rolling Power BI out across a business and want the model, the governance and the enablement done so that features like Copilot actually help rather than hurt, that is squarely the kind of work we do. Have a look at our services or get in touch and we will give you a straight assessment of where your setup stands.

For the current feature details and how to enable it, Microsoft's guide to creating reports with Copilot is the reference to keep handy.