How to scrape N
BER
with AgentQL

Looking for a better way to scrape NBER? Say goodbye to fragile XPath or DOM selectors that easily break with website updates. AI-powered AgentQL ensures consistent web scraping across various platforms, from NBER to any other website, regardless of UI changes.

Not just for scraping NBER

Smart selectors work anywhere

https://nber.org

URL

Input any webpage.

{
  working_papers[] {
    title
    authors[]
    date
    abstract
  }
}

Query

Describe data in natural language.

{
  "working_papers": [
    {
      "title": "The Impact of AI on Employment",
      "authors": [
        "John Smith",
        "Jane Doe"
      ],
      "date": "2024-07-26",
      "abstract": "This paper investigates the impact of AI on employment in various sectors."
    },
    {
      "title": "Macroeconomic Effects of Climate Change",
      "authors": [
        "David Lee",
        "Sarah Jones"
      ],
      "date": "2024-07-26",
      "abstract": "This paper analyzes the macroeconomic effects of climate change and proposes policy recommendations."
    },
    {
      "title": "The Role of Monetary Policy in Inflation Control",
      "authors": [
        "Michael Brown",
        "Emily Green"
      ],
      "date": "2024-07-26",
      "abstract": "This paper investigates the role of monetary policy in controlling inflation and maintaining price stability."
    }
  ]
}

Returns

Receive accurate output in seconds.

How to use AgentQL on NBER

A dotted lineA blue lineA blue line
1

Install the SDK

Install code for JS and Python

npm install agentql

pip3 install agentql

2

Test and refine

Use the query debugger

3

Run your script

Install code for both JS and Python

agentql init

python example.py

Get started

Holds no opinions on what’s and how’s. Build whatever makes sense to you.