DEV Community

Crawler Bros
Crawler Bros

Posted on

Unlock Football Insights: Scraping FBref Statistics

#football #data #scraping #sports

The Challenge of Comprehensive Football Analysis

For sports journalists, fantasy league managers, data analysts, and even dedicated football fans, having access to accurate and up-to-date football statistics is crucial. Whether you're researching player performance, predicting match outcomes, or simply digging into historical data, the sheer volume of information can be overwhelming. Manually sifting through websites like FBref (fbref.com), one of the most comprehensive football statistics databases, to extract specific data points for multiple players, seasons, or leagues is not only time-consuming but also prone to human error.

Imagine needing to compare the "xg" (expected goals) of every striker in the Premier League for the current season, alongside their "assists" and "goals". Or perhaps you want to track the "minutesPlayed" and "passCompletion" of a specific player like Erling Haaland across his entire career. Doing this manually would involve countless clicks, copy-pasting, and organizing, taking hours away from actual analysis.

Introducing the FBref Football Statistics Scraper

This is where the Apify FBref Football Statistics Scraper actor comes in. This powerful automation tool is designed specifically to extract the exact football data you need from FBref, saving you invaluable time and effort. It automates the process of navigating FBref and collecting detailed statistics, providing them in a structured, easy-to-use format.

What Data Can You Scrape from FBref?

The FBref Football Statistics Scraper offers three distinct "mode" options to cover your data needs, all derived directly from FBref's extensive database:

1. League Statistics

Need a bird's-eye view of an entire league? The leagueStats mode allows you to scrape all player statistics for a full season. You can specify the league (e.g., premier-league, bundesliga) and the season (e.g., 2024-2025). The output includes granular data such as "goals", "assists", "xg", "minutesPlayed", "passCompletion", and "yellowCards" for each player in the selected league and season.

This is invaluable for analysts building predictive models, fantasy football enthusiasts looking for player trends, or journalists compiling season reviews. You can even fetch historical seasons by setting the season field to any past season like 2020-2021.

2. Match Results

For those focused on individual fixtures, the matchResults mode delivers detailed information about past games. This includes "scores", "xg" for each team, "venues", "attendance", and "referees". Just select your desired league and season to get a comprehensive list of game outcomes. This data can be critical for post-match analysis, understanding team performance against specific opponents, or even tracking referee tendencies.

3. Player Statistics

Dive deep into an individual's career with the playerStats mode. By providing a playerName (e.g., 'Erling Haaland'), the actor fetches their career statistics by season. You get a chronological breakdown of their performance, including metrics like "appearances", "goals", "assists", "redCards", and more, aggregated by season and "team". This mode is perfect for scouting, player comparison, or tracking the career trajectory of your favorite footballers.

Supported Leagues: Europe's Top Competitions

The FBref Football Statistics Scraper focuses on the "Big 5" European leagues, ensuring you have access to data from the most popular and competitive football environments:

  • Premier League (England)
  • La Liga (Spain)
  • Bundesliga (Germany)
  • Serie A (Italy)
  • Ligue 1 (France)

A Use Case: Uncovering Underperforming Strikers in the Premier League

Let's say you're a fantasy football manager or a sports analyst preparing for the next transfer window. You want to identify strikers in the Premier League who are underperforming their "xg" (expected goals) – perhaps they're getting into great positions but failing to convert, suggesting they might be due for an upswing in goals, or conversely, that their finishing is consistently poor.

Manually collecting this data for dozens of players would be a nightmare. With the FBref Football Statistics Scraper, it's straightforward.

Here's how you'd use it:

  1. Set the mode: You'd choose leagueStats to get all player stats for the entire league.
  2. Specify the league: Enter 'premier-league'.
  3. Define the season: Use the current or most recent season, e.g., '2024-2025'.
  4. (Optional) Limit Results: If you only want to quickly check the top performers, you could set maxItems to 20 or 50.

The actor would then return a dataset containing each player's "goals", "xg", "appearances", "minutesPlayed", and other vital statistics. You could then easily import this data into a spreadsheet or analysis tool, calculate the difference between "goals" and "xg" (Goals - xG), and sort to find players with the largest negative difference. This provides immediate, actionable insights into player performance, all thanks to automated data collection.

How to Use the FBref Football Statistics Scraper

Getting started with the FBref Football Statistics Scraper is simple:

  1. Find the Actor: Navigate to the Apify platform and search for "FBref Football Statistics Scraper" or "fbref-scraper".
  2. Define Your Input: In the actor's input interface, you'll specify what data you want to extract. For example, to get Premier League stats for the current season, your input might look like this:
    • mode: 'leagueStats'
    • league: 'premier-league'
    • season: '2024-2025'
    • maxItems: 50 (to get data for the top 50 players)
  3. Run the Actor: Click the "Start" button. The actor will then begin scraping data directly from FBref.
  4. Download Your Data: Once the run is complete, you can download your extracted data in various formats like JSON, CSV, or Excel. The output will include fields such as "playerName", "team", "position", "goals", "assists", "xg", and "playerUrl".

Why Automate FBref Scraping?

Beyond the specific use case above, automating your data collection from FBref offers several key advantages:

  • Efficiency: Eliminate manual copy-pasting and data entry errors. Get comprehensive datasets in minutes, not hours.
  • Accuracy: The actor retrieves data live from FBref on each run, ensuring it's as fresh as FBref's updates (typically within 24-48 hours of matches).
  • Scalability: Easily collect data for multiple leagues, seasons, or players in a single run or a series of runs.
  • Structured Output: Data is provided in a clean, consistent format, ready for immediate analysis, database import, or integration into other applications.

Ready to supercharge your football analysis? Give the FBref Football Statistics Scraper a try today and unlock a world of detailed football insights at your fingertips.

Ready to try it yourself? Run *FBref Football Statistics Scraper** on the Apify Store -- no setup required.*

Top comments (0)