Scala Web Scraping with Sttp + Jsoup: JVM Scraping in 2026

Scala sits in an odd spot for web scraping: powerful enough for production data pipelines, yet rarely the first tool engineers reach for when they need to pull structured data from the web. That gap is worth closing. With sttp 4.x and Jsoup 1.17+, you get a type-safe HTTP client, a battle-tested HTML parser, and the full JVM ecosystem under one roof — a legitimate choice for teams already running Scala microservices or Spark-based data infrastructure in 2026.

Why Scala for Scraping in 2026

The honest case for Scala scraping is not that it beats Python on ergonomics — it doesn’t. the case is integration: if your pipeline ends in Spark, Flink, or a Scala-based data lake, keeping the scraper in the same language eliminates a serialization boundary and a runtime dependency. you also get strong typing on your extracted models, which catches schema drift at compile time rather than at 2am when a site redesign breaks your production job.

Compared to async Rust scrapers (covered in depth in Web Scraping with Reqwest + Tokio in Rust: Async Patterns (2026)), Scala trades raw throughput for a richer ecosystem and easier team onboarding. compared to Go’s Colly (Go Web Scraping with Colly v2: Production Patterns for 2026), it’s more verbose but gives you cats-effect or ZIO for principled concurrency.

Setting Up sttp + Jsoup

Add these to your build.sbt:

libraryDependencies ++= Seq(
  "com.softwaremill.sttp.client4" %% "core"              % "4.0.0-RC1",
  "com.softwaremill.sttp.client4" %% "okhttp-backend"    % "4.0.0-RC1",
  "org.jsoup"                      % "jsoup"             % "1.17.2"
)

sttp 4 ships a synchronous backend (OkHttp, Apache HttpClient 5) and async backends for cats-effect, ZIO, and Pekko. for a simple scraper, OkHttp synchronous is the least ceremony. for a crawler that hits hundreds of URLs concurrently, wire in the cats-effect backend with a semaphore-controlled rate limiter.

A minimal fetch-and-parse loop looks like this:

import sttp.client4.*
import sttp.client4.okhttp.OkHttpSyncBackend
import org.jsoup.Jsoup

val backend = OkHttpSyncBackend()

val response = basicRequest
  .get(uri"https://example.com/products")
  .header("User-Agent", "Mozilla/5.0 (compatible; DataBot/1.0)")
  .send(backend)

response.body match {
  case Right(html) =>
    val doc   = Jsoup.parse(html)
    val items = doc.select(".product-title").eachText()
    items.forEach(println)
  case Left(err) =>
    System.err.println(s"request failed: $err")
}

Jsoup’s CSS selector API (select, attr, text, eachText) covers 95% of extraction tasks. for sites that serialize data into