# *
User-agent: *
Allow: /

# Host
Host: https://www.agentql.com

# Sitemaps
Sitemap: https://www.agentql.com/sitemap.xml
Sitemap: https://www.agentql.com/scraping-sitemap.xml