Skip to main content

3. Confirm Data Is Arriving

The third step of the Quickstart: prove that the source you just connected is actually delivering data, before you spend time searching for events that were never ingested. This page is for the administrator who has just installed an application.

It is built around three independent checks in three different places (application health, ingress volume, and storage-side queueing) because each one fails differently, and knowing which of the three is wrong tells you where to look.

Before You Begin​

You have completed step 2, and some time has passed. How much depends on the feed:

FeedIndexExpect first data
Entra sign-insAzureSigninLogsWithin about an hour
Entra directory auditMSEntra (AzureAudit on an older deployment)Within about an hour
Office 365 unified audit logOffice365Up to 12 hours on a new subscription

The Office 365 figure is Microsoft's own warning about newly created Management Activity API subscriptions, not a Fluency delay. It is the single most common reason a correct install is mistaken for a broken one. Run the three checks below now (they will tell you the pipeline is healthy), then come back for the data.

The Three Checks, and Why There Are Three​

The application status tells you whether the platform is trying. The ingress charts tell you whether bytes are arriving. The data lake tells you whether they are being written. A problem shows up in exactly one of the three, which is what makes the diagnosis quick: an application in error (v1: Aborted) is a credential or configuration problem, an application that is Running with no ingress is a source-side problem, and ingress with a growing queue is a storage-side problem.

Check 1: Application Status​

  1. In the navigation rail, open Applications. It lists every installed application as a table row, below a row of status counters.
  2. Locate your application. Each row names the template with the instance's display name beneath it (Office365-Audit over Default for this quickstart, unless you changed the display name), so the same template installed twice appears twice under different display names. Type in the Search field to narrow the list.
  3. Click the application's row to open its details page.

Applications page with the Installed, Egress out, Running, Error and Inactive counters, the All, Running, Attention, Error and Disabled filters, a search field, Table and Board view buttons, and a table of eight installed applications with their status badges

The status filters above the table (All, Running, Attention, Error, and Disabled) narrow the list to the applications in one state, and Board shows the same applications as cards.

What a healthy application looks like​

A healthy application carries a green Running badge, and its row's Signals column shows a strip of activity bars with how long ago it last reported, such as 0s ago. In / Out gives the data it has received and sent.

Its details page opens with a summary card: the application, its status badge, and its In / Out, Error Bytes, Drop Rate, and Last Event. Below it, the Pipeline card draws the components the install created, left to right in the direction data flows: each Source with its type, the Router with the Pipes it runs, and the Destinations, with the data lake indexes the application writes to in a row beneath the diagram.

At the bottom, Parameters shows the values the application was installed with, in the wording of the install form, with the client secret masked (******), and Actions lists every setup step the install carried out, one addDatalakeIndex line per index it created among them.

Application details page for an Azure Directory Audit (Event Hub) instance, showing the summary card with In / Out, Error Bytes, Drop Rate, and Last Event, the Pipeline card from source through router to its destinations, and the Parameters and Actions cards

Nothing an install records can be edited afterwards. Changing a credential means uninstalling the application and installing it again; to uninstall, click Uninstall at the top right of the application's details page.

What an unhealthy application looks like​

  • A red Error badge means the application stopped on an error, or has reported errors in the last hour. Its details page shows the error message beneath the summary figures, a data lake index name already taken in that lake being the usual cause of an application that stops straight after install. A source that cannot start, a rejected credential for example, is listed there under Data source errors with the error the source reported. The Error counter and the Error filter on Applications gather the applications in this state.
  • Non-zero Error Bytes on an otherwise-Running application means some of its data is failing even though the application as a whole is still running. Error bytes by component, a collapsed section in the details page's summary card, lists the error bytes per pipeline component, which tells you which stage to look at.
  • Running, with a dash under In / Out and Last Event, is the "running but idle" case: the application is trying and nothing is arriving. That is normal inside the first-content window described above. Once past it, move on to check 2.

Check 2: Ingress Charts​

  1. In the navigation rail, open Reports, and on its Dashboard tab click the Event Ingress Report card.
  2. Set the time range with the buttons in the upper left: 1H, 12H, 1D, 3D, 7D, 30D, or Custom. The report opens on 7D; 1H is the right choice for a source connected minutes ago.
  3. Read the headline figures and the Ingress activity chart.
  4. Read Top indexes and Ingress by index to confirm the data landed in the indexes you expected.

Event Ingress Report over seven days, with time-range buttons, four headline figures, the Ingress activity chart, the Top indexes list, and the Ingress by index table

Reading the charts​

The report has a Back to Reports link above its title and a Download report button in the upper right. Below the time-range buttons and the refresh button beside them:

  • Headline figures: Ingress volume, Events stored, Datalake indexes (the number of indexes in the report), and EPR, the ingress rate per hour.
  • Ingress activity: a line chart of ingress over the range, bucketed as the label above it says (for example Volume per 6 hours). Volume and Events switch what it plots, and the index drop-down (All indexes by default) limits it to one index.
  • Top indexes: the busiest indexes, each with its volume, a bar, and its share of the total. Click an index to chart it alone.
  • Ingress by index: every index with its Data volume, Events, EPR, and Volume share, sorted by data volume. Search indexes narrows it.

The per-index views are the useful ones here, because they answer a question the totals cannot: on a multi-index application, they tell you which of its indexes is actually contributing. Index names carry the lake as a prefix: managed-Office365 is the Office365 index of the managed lake. One index filling while another stays flat is the expected shape in the first few hours, and the sign-in index staying empty is also the expected steady state on a tenant with no premium Entra licence.

When a chart has nothing to show​

When nothing arrived in the range, Ingress by index reads No ingress metrics in this date range. in place of its rows.

Distinguish three cases before concluding anything is wrong: a time range too narrow to include the first delivery, a first poll that has not completed, and a source that is genuinely sending nothing. The first two are answered by widening the range to 1D or 7D and waiting; the third is a source-side question.

Check 3: Data Lake Index State​

  1. In the navigation rail, open Configuration and click the Data Lakes card.
  2. Find the lake and the indexes your application writes to (for Office365-Audit, Office365 among them). Its details page from check 1 names them all: the datalake and index-name Parameters, and one addDatalakeIndex line per index under Actions.
  3. Read each index card.

Data Lakes page showing the managed lake panel with its 24-hour totals and a grid of index cards, each with stored count, estimated rate, a sparkline, and queue, merged and imported details, followed by a Create New Index tile

The page shows one panel per data lake, headed with the lake name and its totals, holding a grid of index cards. Each card summarizes one index:

  • The index name and the schema it uses (Schema: followed by the schema name).
  • Stored (24H), the events the index stored in the last 24 hours, and Est. Rate, its estimated ingest rate in events per hour.
  • An activity sparkline of recent ingest volume.
  • A footer with Queue (the number of items waiting to be imported), Merged (when the index was last merged), and Imported (when data was last imported into it).

Reading the card, carefully​

Read the Merged and Imported timestamps, which report two different things: Imported is when data last arrived in the index, and Merged is when it was last merged into it. An index that nothing has reached yet shows a placeholder date for both instead of a real one: Dec 31, 1 in the example above, on an index with Stored (24H) at 0.

So for a brand-new install, the sequence you should expect to see on each index card is:

  1. Both timestamps at the placeholder date: the index exists, nothing has arrived yet.
  2. A real Imported, Merged still at the placeholder: data is arriving but has not yet been merged. This is a healthy intermediate state.
  3. Both timestamps recent: data has arrived and been merged, and Stored (24H) counts it.

What queue length tells you​

Queue counts the items waiting to be imported. A queue that rises during a burst and drains is normal, and on a first backfill it is what you want to see. A queue that only ever grows is the signal that ingestion is outrunning writing; capture the number and raise a support ticket rather than changing anything.

Queue 0 is the normal steady state, meaning nothing is waiting. It is only good news if checks 1 and 2 also show activity: an index with an empty queue and no ingress is simply an index nothing is reaching.

How to Tell It Worked​

All three checks agreeing is the pass condition:

  • The application is installed and badged Running, with traffic under In / Out and a recent Last Event.
  • The Event Ingress Report shows non-zero Ingress volume and Events stored within the last day, attributed to the expected indexes.
  • The Data Lakes page shows the application's indexes, with a real Imported time on at least one and no persistently growing Queue.

Two of three passing is enough to continue if the third is the Office 365 index still inside its first-content window.

If It Did Not Work​

What you seeWhat it meansWhere to go
Application in Error (v1: Aborted)A credential or configuration error; the error message names the causeBack to step 2
Application Running, no ingress, and it is past the first-content windowThe platform is connected and the source is producing nothing it can readVerify unified audit logging is on, and that the nine permissions all read Granted
Ingress present, but in the wrong indexA sink pointed at the wrong destination, or an index name changed at installCheck the application's Parameters in its details
Ingress present, queue only ever growsA storage-side or capacity problemCapture the counter value and raise a support ticket
Everything looks right, but the volume is implausibly smallFiltering in a pipe, or a source scoped more narrowly than intendedNo data arriving
AzureSigninLogs alone is emptyThe tenant has no Entra ID P1 or P2 licenceExpected: nothing to fix

Next Step​

4. Run Your First Search: go find the events you just confirmed.