Home > Oncrawl Genius > Oncrawl Developer
Oncrawl Developer picto

Oncrawl Developer

Explore, aggregate and export your data in big data volumes for use in custom solutions to business and marketing problems.

30mn custom demo tailored for your needs
automate-seo-API-oncrawl

Unlimited access to OnCrawl's data

The Oncrawl API offers unlimited access to data produced through by the crawler. Our different datasets allow you to explore fine-grained metrics and dimensions from analyzed pages, discovered links and structured data, crawl comparison reports and processed log files. Oncrawl’s powerful aggregation engine allows you to compile tabular data tailored to your needs throughout an unforeseen variety of dimensions – such as titles and headings – and all the extraordinary metrics we provide – such as Inrank, load time and status codes. Easily compute averages, min, max and sums through massive datasets, and pivot the numbers across segmentations or any dimension.

oncrawl tools

Big Data exports like never before

Our API route lets you export millions of pages in a few minutes. Depending on your bandwidth, it only takes 5 minutes to export 600+ metrics for each of over 50M crawled pages. You can export data in CSV and JSON format but also in Apache Parquet format for superior data compression and encoding schemes. It offers enhanced performance to handle complex data in bulk.

oncrawl - cube

A vendor-agnostic approach

Oncrawl’s API allows you to explore, aggregate and export your crawl and logs data without restriction. Oncrawl is currently the only SEO platform to provide a vendor-agnostic approach. In other words, Oncrawl gives you access to all of your raw data, in fully readable formats used by data warehouses and data science tools. When used with Oncrawl BI, Oncrawl’s API can also make data available for cloud export to Google Bucket, Amazon S3 or Microsoft Blob platforms.

oncrawl - crawling

Custom analyses and reports

Oncrawl’s API gives you access to 1000+ data points to play with. Use Oncrawl’s API to build your very own dashboards and combine Oncrawl’s data with company’s data and third party solutions in a Data Studio dashboard for instance.

oncrawl - success list

Automated tasks & actions

The OnCrawl REST API is used for accessing your crawl data as well as managing your projects and your crawls outside of Oncrawl. We offer ready-to-use codes to launch new crawls, pilot a crawl’s state, create new projects, check the progression of your crawls and many other actions that can be automatized at scale. Integrate with OnCrawl using webhooks and automation solutions like Zapier to build complex event-driven workflows to leverage your favorite SEO KPIs.

oncrawl puzzle

Fully documented code and procedures

Oncrawl’s API offers a fully documented interface with definitions of Oncrawl’s Query Language and explanations of how to use each endpoint.

Visit the Oncrawl API documentation
oncrawl - rules
" I have no doubt that data science will become a strong asset for every digital marketer, especially SEO specialists. This technology makes reliable decisions based on actual data possible, bringing a real competitive advantage to all companies that use it. "
Vincent Terrasi Product Director at Oncrawl

Oncrawl Developer unveils your site’s potential

Scale SEO reporting

Easily optimize your entire SEO process for multi-sites projects

Make accurate predictions for SEO

Make accurate predictions in the fields of search and SEO to better understand which projects to prioritize and when

Track market trends

Align your strategy to online market search trends and increase your profitability

Oncrawl Developer is a product in the Oncrawl Genius suite

Oncrawl BI picto

Oncrawl BI

Drive better strategic decision-making through business intelligence and data analysis by making your OnCrawl data available wherever you need it.
Learn more about Oncrawl BI
Oncrawl Developer picto

Oncrawl Developer

You are here!
oncrawl labs picto

Oncrawl Labs

Bridge the gap between your needs and standard SEO tools with ready-to-use machine learning algorithms for SEO prediction, creation and automation.
Learn more about Oncrawl Labs