Ingest third-party datasets to your crawl reports and monitor new and strategic SEO KPIs

We are pleased to announce that we have unleashed a brand new feature that will let you enrich your crawl analysis with third-party datasets at scale. You can now integrate any CSV files into our interface and add new fields to your SEO analysis.

How does OnCrawl Data Ingestion work?

OnCrawl Data Ingestion lets add custom fields from a third-party dataset to each URL of a crawl report and thus enrich your analysis.
Before launching a crawl, you can supply one or more files containing the third party data set fields you want to add to your report. The Data Ingestion feature is available when setting up a new crawl at your project home. Click on ‘Launch a new crawl’.

launch-crawl

Then, select ‘Data ingestion’ in the ‘Analysis’ part.

oncrawl-data-ingestion

And tick the ‘Enable data ingestion’ box.

data-ingest-file

If it is the first time that you are using this feature, directly click on ‘Upload files’. Once you will have uploaded a file, you will be able to select it here when launching a new crawl.
Simply drag and drop the CSV file(s) you would like to upload.

upload-file-data-ingestion

Then, we process and parse your files. Depending on their size, processing time can fluctuate.

file-parcing-data-ingest

At the end of the crawl, the ingested data are merged into the crawl on the URL field. We have written a guide dedicated to required files format.

How to use the Data Ingestion feature?

Following the crawl, you can visualize the ingested third-party data on:

  • The Data Explorer interface
  • The Segmentation setup interface

The Data Explorer interface

Use the third-party custom fields to extract and visualize data using queries or by adding columns to datasets.
To browse your newly-created custom fields, look for data prefixed by the term “User data”.

data-explorer-field

According to their format, they can be associated with filters ‘Greater Than’, ‘Less Than’, ‘Equals’.. for numerical values for example.

Use Cases

  • Ingest data from your Google Search Console to detect URLs with impressions on Google but which are not crawled by OnCrawl.
  • Ingest data from ranking tools (beside Google Analytics and AT Internet that already have built connectors in OnCrawl) to analyze revenues by visits, average sales, signups conversions, etc.
  • Ingest data from Adwords to measure conversions by URLs.
  • Etc

The segmentation setup interface

Use the third-party datasets to create Pages Segmentations (groups of pages) and obtain new insights regarding your website.
Just as in the Data Explorer, you can create segments that take these fields into account and categorize groups of pages according to the values taken by these fields.

How to activate the feature

OnCrawl Data Ingestion is available from a Business plan. Send us a message using the chat or an email to activate the functionality or if you have further question.

 Start your Free Trial