User-agent: AhrefsBot
Allow: /
User-agent: AhrefsSiteAudit
Allow: /

User-Agent: *
Disallow: /graphql/*
Disallow: /en/private/*
Disallow: /es/private/*
Disallow: /en/archived$
Disallow: /en/archived/
Disallow: /es/archived$
Disallow: /es/archived/