How to scrape c
URL
with AgentQL

Looking for a better way to scrape cURL? Say goodbye to fragile XPath or DOM selectors that easily break with website updates. AI-powered AgentQL ensures consistent web scraping across various platforms, from cURL to any other website, regardless of UI changes.

Not just for scraping cURL

Smart selectors work anywhere

https://curl.haxx.se

URL

Input any webpage.

{
  curl_version {
    version_number
    version_string
  }
}

Query

Describe data in natural language.

{
  "curl_version": {
    "version_number": "7.88.1",
    "version_string": "curl 7.88.1 (x86_64-pc-linux-gnu) libcurl/7.88.1 OpenSSL/1.1.1q zlib/1.2.11 libidn2/2.3.4 libpsl/0.24.1 (+libidn2/2.3.4) libssh2/1.10.0"
  }
}

Returns

Receive accurate output in seconds.

How to use AgentQL on cURL

A dotted lineA blue lineA blue line
1

Install the SDK

Install code for JS and Python

npm install agentql

pip3 install agentql

2

Test and refine

Use the query debugger

3

Run your script

Install code for both JS and Python

agentql init

python example.py

Get started

Holds no opinions on what’s and how’s. Build whatever makes sense to you.