User-agent: Googlebot
Disallow: /ads.txt
Disallow: /wp-admin/
Disallow: /search/
Disallow: /*&sa=*
Disallow: /&sa=*
Disallow: /?s=*
Disallow: /.well-known*
Disallow: /wp-json/contact-form*
Disallow: /wp-includes/wlwmanifest.xml
Disallow: /wp-content/plugins/*
Disallow: /?author=*
Disallow: /*feed/
Disallow: /*hubs*
Allow: /tag/content-hubs/

User-agent: *
Disallow: /ads.txt
Disallow: /wp-admin/
Disallow: /search/
Disallow: /*&sa=*
Disallow: /&sa=*
Disallow: /?s=*
Disallow: /.well-known*
Disallow: /wp-json/contact-form*
Disallow: /wp-includes/wlwmanifest.xml
Disallow: /wp-content/plugins/*
Disallow: /?author=*


Sitemap: https://www.oncrawl.com/sitemap_index.xml
Sitemap: https://fr.oncrawl.com/sitemap_index.xml