How to scrape S
urface Transportation Board
with AgentQL

Looking for a better way to scrape Surface Transportation Board? Say goodbye to fragile XPath or DOM selectors that easily break with website updates. AI-powered AgentQL ensures consistent web scraping across various platforms, from Surface Transportation Board to any other website, regardless of UI changes.

Not just for scraping Surface Transportation Board

Smart selectors work anywhere

https://stb.gov/

URL

Input any webpage.

{
  news_items[] {
    headline
    date
    summary
  }
}

Query

Describe data in natural language.

{
  "news_items": [
    {
      "headline": "New Grants Available for Small Businesses",
      "date": "2024-07-26",
      "summary": "The Small Business Administration is offering new grants to help small businesses grow and succeed.  Apply today!"
    }
  ]
}

Returns

Receive accurate output in seconds.

How to use AgentQL on Surface Transportation Board

A dotted lineA blue lineA blue line
1

Install the SDK

Install code for JS and Python

npm install agentql

pip3 install agentql

2

Test and refine

Use the query debugger

3

Run your script

Install code for both JS and Python

agentql init

python example.py

Get started

Holds no opinions on what’s and how’s. Build whatever makes sense to you.