DEV Community: Julia

Analysis of PDF file size for 2006-2025 by Dual Lab

Julia — Fri, 21 Aug 2026 07:55:59 +0000

Analysis of PDF file size for 2006-2025 by Dual Lab

Dual Lab analyzed the complete June 2026 Common Crawl dataset (CC-MAIN-2026-25), comprising 20,578,394 PDF documents. In the second part of the analysis we analyze the evolution of the median PDF file size over the past 20 years.

Executive Summary

One of the reasons for the ongoing development of the Brotli compression in PDF format is the growing size of modern documents. It would be reasonable to assume, therefore, that PDF files are growing substantially larger. However, our analysis indicates otherwise.

Brotli compression has been introduced into the PDF specification to improve compression efficiency and reduce file sizes, particularly for modern workflows that embed large amounts of data and resources.

Despite these technological advances, our analysis tells a different story about the actual size of PDF documents published on the web.

This publication in no way diminishes the importance of Brotli. We fully recognize its value, while noting that PDF archive sizes remain an important consideration for storage, transfer, and processing efficiency.

Use median instead of arithmetic mean

Because PDF file sizes span several orders of magnitude, the arithmetic mean can be strongly affected by a relatively small number of exceptionally large files.

Figure 1 below compares the mean with the median file size per each month for the past 20 years. It shows that the monthly mean is roughly 3-5 times the median for much of the period. More importantly, the mean has large isolated excursions, most dramatically around 2012-2013, where it jumps to almost 5 MiB, while the median hardly reacts.

Figure 1. Arithmetic mean versus median

Figure 2 quantifies this particularly well: the largest 1% of PDFs account for roughly 25-35% of all bytes in a typical month, with occasional values around 40%. One percent of observations contributing around one third of the quantity being averaged means the arithmetic mean is inherently highly sensitive to that 1%.

Figure 2. Share of largest 1% of PDFs

To account for the skewed distribution and the influence of outliers, we complement the mean with the median, 25th–75th percentiles (interquartile range), and 10th–90th percentiles. This combination distinguishes changes in the overall average file size from changes in the size of a typical PDF.

Use Logarithmic scale for PDF File sizes

PDF document sizes vary by several orders of magnitude, from small text documents to publications containing thousands of pages and high-resolution images. To understand this distribution, Figure 3 presents PDF file sizes using exponentially increasing bins (powers of two).

Figure 3. Size of PDF files

Using powers of 2 for the bins reveals an approximately log-normal distribution, making logarithmic scales more suitable than linear ones for analyzing PDF file sizes. Since file sizes grow multiplicatively, this approach provides a more accurate view of the distribution across the full range of document sizes.

This again reconfirms the reason why we use the mean to examine overall changes in average file size, and the median and quartiles to assess long-term changes in typical PDF size.

Evolution of monthly median and quartiles

Based on the above reasons, we perform long term analysis of the median file size together with the 25th–75th percentiles (interquartile range).

Figure 4. Monthly PDF file size distribution

Figure 4 shows the monthly evolution of PDF file sizes over the past 20 years using the median and the 25-75 quartiles on a logarithmic scale. The median and interquartile range provide a more robust representation of typical PDF sizes and their variation over time.

Use quadratic regression instead of linear

Figure 4 suggests that the growth in median PDF file size is nonlinear. The increase was most pronounced between 2006 and 2016, after which the trend gradually flattened and even showed a slight decline in recent years. To model this behavior more accurately, we fitted a quadratic regression using the formula

log_median ~ years + years^2

The standard regression analysis shows that both the linear and quadratic terms are highly statistically significant (p < 0.001), confirming that the evolution of PDF file sizes cannot be adequately described by a simple linear trend. The regression results are presented in Figure 5.

Figure 5. Regression results

Figure 6 illustrates the monthly median PDF file size together with the fitted quadratic trend. The gray line shows the observed monthly median values, while the blue curve represents the fitted regression model.

Despite noticeable month-to-month variation, the long-term trend is clear. The monthly median PDF file size increased steadily from approximately 0.20 MB in 2006 to just over 0.40 MB around 2021–2022, after which the trend leveled off and began to decline slightly. This suggests that the continuous growth in PDF file sizes observed over the previous decade has slowed, indicating that the typical size of PDF documents published on the web has stabilized in recent years.

Figure 6. Trends in PDF file-size median

Annual growth of median file size in values (percentage)

The quadratic regression model also reveals a clear slowdown in the annual growth of median PDF file size. The median increased by approximately 9.2% between 2006 and 2007, but the annual growth rate gradually declined over time, falling below 1% by 2020–2021. Since 2022, the trend has become slightly negative, indicating that the median PDF file size has stabilized and is beginning to decrease modestly. These results suggest that the long-term growth in PDF file sizes observed during the 2000s and 2010s has largely reached a plateau.

Annual increase of median file size (percentage):

2006-2007: 9.21%
2007-2008: 8.59%
2008-2009: 7.97%
2009-2010: 7.36%
2010-2011: 6.75%
2011-2012: 6.14%
2012-2013: 5.54%
2013-2014: 4.94%
2014-2015: 4.34%
2015-2016: 3.75%
2016-2017: 3.16%
2017-2018: 2.57%
2018-2019: 1.99%
2019-2020: 1.41%
2020-2021: 0.83%
2021-2022: 0.26%
2022-2023: -0.31%
2023-2024: -0.88%
2024-2025: -1.44%
2025-2026: -2.00%

Median file size of Tagged vs. Untagged PDFs

During the reserch we have analyzed the median file size of Tagged versus Untagged PDFs. Initial guess was that Tagged PDFs should be larger in average, as PDF structure tree adds more objects to the document. However, this turned completely wrong! Figure 7 shows that Tagged PDFs are systematically smaller than Untagged ones.

Figure 7. Tagged vs Untagged PDFs

To be absolutely sure, we applied the Wilcoxon signed-rank test, a non‑parametric statistical test, which shows statistically significant difference in median file sizes between tagged and untagged PDFs per month (P-value = 1.65875e-13).

It is not clear why Tagged PDFs turn out to be smaller in average. One of the conjectures is that Tagged PDFs are mostly digitally born and do not include scanned files, which tend to be larger. We shall analyze this conjecture in the next parts of our analysis report.

Conclusions

Analysis of more than 20.5 million PDF documents from June 2026 Common Crawl collection leads to several key findings.

PDF file sizes follow an approximately log-normal distribution, making logarithmic visualization and median-based statistics more appropriate than arithmetic averages.
Median file size increased steadily until approximately 2021, after which growth flattened and became slightly negative.
Quadratic regression confirms that this slowdown is highly statistically significant.
The evidence suggests that the typical PDF published on the web has not become substantially larger over time.
Despite initial guesses, Tagged PDFs turn out to be smaller in average than Untagged ones.

These findings demonstrate the value of large-scale empirical analysis. Although technologies such as Brotli address the needs of increasingly sophisticated PDF documents, the overall characteristics of publicly available PDFs have remained remarkably stable.

In the next parts of our PDF analysis we shall discuss distribution of PDFs by Producer and the statistics on the use of structure elements and the validity of the structure tree against schemas defined in PDF standards.
Contact us : info@duallab.com

Website:

https://pdf4wcag.com/company/

https://duallab.com/

Your LLM is not a PDF parser: use OpenDataLoader first

Julia — Tue, 11 Aug 2026 11:29:53 +0000

Large Language Models (LLMs) have become remarkably powerful at understanding documents. Many modern AI platforms can accept PDF files directly, creating the impression that PDFs are ready-to-use inputs for AI workflows.

A PDF is not a plain text document. It is a complex format that contains layout information, text objects, images, tables, fonts, annotations, metadata, and sometimes a logical structure tree. The visual appearance of a PDF page does not always represent the correct reading order or semantic relationships between elements.
If PDF content is extracted incorrectly before reaching the LLM, the model receives incomplete or disorganized information. Problems such as broken reading order, corrupted tables, missing hierarchy, and lost relationships between elements directly affect the quality of AI-generated answers.

Even the best prompt cannot fix incorrect document parsing.

The solution is simple:

Parse the PDF first, then send structured content to the LLM.

Parse first, prompt second

A common mistake in AI workflows is sending a raw PDF directly into an LLM or RAG pipeline.

A better approach is:
PDF ⇒ OpenDataLoader ⇒ Structured Data ⇒ LLM

OpenDataLoader PDF converts PDF documents into AI-ready formats while preserving the original semantics of the document.

Supported output formats include:

Markdown, JSON, HTML, plain text.

Instead of forcing an LLM to interpret a complex PDF file, developers may provide clean, structured information optimized for AI processing.

Example: Convert a PDF for LLM processing

We provide a Python Installation guide

**Requires: **Java 11+ and Python 3.10+

Before you start: run java -version. If not found, install JDK 11+ from Adoptium.

Installing OpenDataLoader:

pip install -U opendataloader-pdf

Python script to convert multiple PDFs into AI-friendly formats:

import opendataloader_pdf opendataloader_pdf.convert( input_path=["document.pdf"], output_dir="output/", format="json,html,pdf,markdown" )

Code from OpenDataLoader.com
https://github.com/opendataloader-project/opendataloader-pdf
The user can run it from a Python shell or can create a Python script file first and then run it from the shell.
Instructions for Node.js | Java is also available on OpenDataloader official website.

The generated Markdown can be used directly for LLM conversations and summarization, while the JSON output is suitable for RAG pipelines, vector databases, and AI agents that require structured document information.

Figure 1. Results with PDF

Figure 2. Results with Markdown

In the first Figure, the LLM had to interpret the 1.4 MB, 16-page PDF file directly, relying on its vision capabilities. In the second example, the same file was provided as structured Markdown, allowing the model to immediately understand the document hierarchy and data relationships. By separating document parsing from LLM reasoning, OpenDataLoader produces more reliable, consistent, and efficient AI workflows.

Conclusion

Using OpenDataLoader to convert the 1.4 MB, 16-page PDF file into Markdown before sending it to an LLM significantly reduces both processing time and cost.

Compared with processing the PDF directly:

API processing was approximately 2.4× faster (38 s - 16 s).
Inference cost was approximately **2.9× lower ($0.35 - $0.12), a 66% cost reduction.
Input token usage decreased **by approximately 64% (29.2k - 10.6k tokens).
The LLM received structured Markdown instead of having to reconstruct the document layout itself, allowing it to focus on reasoning rather than PDF parsing.

While the exact savings depend on the document and the LLM, this example demonstrates that preprocessing PDFs with OpenDataLoader can substantially improve the efficiency of AI workflows while reducing both latency and inference costs. To perform this operation, users should have basic scripting skills.

Why Raw PDF Parsing Breaks AI Applications

PDF files are designed primarily for visual presentation, not direct machine understanding. A document can appear perfect to a human reader while still being difficult for an AI system to interpret correctly.

This is especially important for RAG systems, where incorrect extraction can lead to incomplete or misleading context. OpenDataLoader preserves document structure and converts PDFs into structured outputs optimized for AI workflows, including LLM applications, Retrieval-Augmented Generation (RAG), semantic search, knowledge bases, and document automation.

The key difference is that OpenDataLoader provides structured understanding of documents, not just extracted text.

Tell your LLM to use OpenDataLoader

For AI assistants, agents, and custom GPT workflows, OpenDataLoader can become the default PDF preprocessing step.

Instead of:
Analyze this PDF.

Use instructions such as:
Whenever a PDF is provided, first process it with OpenDataLoader. Use the generated Markdown or JSON output as the source for all analysis, retrieval, and reasoning. Do not rely on built-in PDF parsing unless OpenDataLoader output is unavailable.

This creates a consistent workflow where every PDF is processed before the LLM starts generating answers.

Clean Markdown for Chat, JSON for RAG

Different AI applications require different output formats.

Markdown

Markdown is ideal for: AI assistants; document summarization; question answering; conversational workflows.
It keeps headings, paragraphs, and lists structured while remaining easy for LLMs to process.

JSON

JSON is recommended for: RAG pipelines; vector databases; AI agents; structured extraction; document search.

OpenDataLoader JSON includes structured elements together with bounding box information. This allows applications to connect retrieved information back to its original location in the PDF, improving transparency and citation workflows.

Local, Deterministic Processing for AI Pipelines

One of the important advantages of OpenDataLoader is that it can run locally.

This provides:

deterministic results : the same PDF produces the same output;
improved privacy : documents do not need to be uploaded to external services;
predictable processing pipelines;
no dependency on external APIs for basic parsing.

For organizations processing confidential documents such as contracts, financial reports, technical documentation, or research papers, local processing is often an important requirement.

Conclusion

The quality of an LLM response depends heavily on the quality of the information provided to it. Feeding raw PDFs directly into an LLM often transfers the hardest part of the problem document understanding to the model.

A more reliable workflow is:
PDF → OpenDataLoader → Markdown / JSON → LLM

By using OpenDataLoader as the PDF parsing layer, developers can provide LLMs with structured, layout-aware, and machine-readable content. This improves retrieval accuracy, reduces parsing errors, and creates more reliable AI applications built on PDF documents.

Contact us

Website: https://opendataloader.org/docs
GitHub: https://github.com/opendataloader-project/opendataloader-pdf

PDF trends 2026Q2 by Dual Lab company

Julia — Mon, 03 Aug 2026 14:38:16 +0000

PDF trends 2026Q2 by Dual Lab company

Analysis of 20.6 Million PDF Documents from the June 2026 Common Crawl Dataset

Executive Summary

PDF remains one of the most widely used formats for publishing digital information, yet accessibility continues to be a major challenge. To better understand the current state of PDF accessibility, Dual Lab analyzed the complete June 2026 Common Crawl dataset (CC-MAIN-2026-25), containing 20,578,394 PDF documents.

This report extends our previous study of approximately 15 million PDFs from CC-MAIN-2026-04 and presents new data on encryption, permission flags, document size, page counts, annotations, PDF versions, and document age.

The analysis provides a large-scale view of how PDF technology is used across the public web and establishes a foundation for future reports on PDF in general with focus on Tagged PDF, PDF/UA adoption, and accessibility trends.

Research Scope and Methodology

The study analyzed every PDF referenced in the June 2026 Common Crawl (CC-MAIN-2026-25) dataset.

Because Common Crawl stores only the first 5 MB of each PDF, documents exceeding this size were downloaded directly from their original URLs to enable complete analysis.

The final dataset contains:

20,578,394 PDF documents
approximately 38 TB of source data

For each PDF we extracted:

basic metadata:
- page count
- file size
- creation and modification dates
- PDF version (including Version entry in the document catalog)
- producer and creator
encryption information and permissions
annotations
presence of interactive forms
presence of optional content layers
presence of digital signatures
image only (scanned) pages
Tagged PDF information:
- stats on the use of structure element types
- logical structure tree validation against ISO 32005

The dataset contains:

1,905,490 PDFs (9.26%) with interactive forms
419,069 PDFs (2.04%) with digital signatures
888,237 PDFs (4.32%) with optional content (layers)

Distribution of PDF documents by date

To understand the distribution of documents by timeline we analyzed document dates using ModDate when available; otherwise, CreationDate was used.

Because PDF metadata is not always reliable, the analysis was limited to documents dated between 1990 and June 2026. Approximately 974,000 files (about 5%) were excluded because their dates were missing, had invalid syntax, or were outside this range.

Figure 1. Distribution of PDF modification date, 1990–2026

Most publicly available PDFs from June 2026 Common Crawl dataset were created or modified within the last several years.

Distribution of page counts in PDF Files

Figure 2. Number of pages in PDFs

Most PDFs published on the web are relatively short.

Single-page documents represent the largest group (5.8 million files), followed by:

2–3 pages (4.9 million), 4–7 pages (3.4 million), 8–15 pages (2.7 million).

Document frequency decreases steadily as page count increases.

Methodological note. Around 8000 PDFs had malformed page trees resulting in missing page information. They were excluded from the page-count analysis.

Distribution of PDF Files by PDF Version

The reported PDF version was determined using both the document header and the optional /Version entry in the Catalog, as defined in PDF 2.0 ( ISO 32000-2).

Only valid PDF versions were included. During processing, 81 documents with invalid version numbers (for example, 1.8, 1.9, 2.3, 7.0, 112.0, and 990.0) were excluded.

PDF 1.7 remains the dominant version with more than 6 million documents, followed by: PDF 1.4, PDF 1.5, PDF 1.6. Together these four versions account for the majority of PDFs on today's web.

Figure 3. PDF files by by header+catalog version (1.0-2.0)

Total Number of Annotations by Type

Annotations are one of the most widely used interactive features of the PDF format. Across the 20.6 million PDF documents analyzed, we identified hundreds of millions of annotations of different types.

The three most common annotation types are:

Link — 265.3 million
Widget — 20.4 million
Square — 6.4 million

Other frequently used annotation types include Popup, FreeText, Stamp, Ink, Highlight, Watermark, and Text.

Figure 4. Top 20 Annotation types total count

Figure 4 presents the total number of annotations of each type across all analyzed PDF documents. The Figure is displayed on a logarithmic scale, allowing less frequent annotation types to remain visible and enabling meaningful comparison across the full distribution.

Figure 5. Top 20 Annotation Types by Document Count

Figure 5 shows Top 20 Annotation Types by the number of documents in which they appear. The vertical axis is plotted on a logarithmic scale.

Besides the annotation types defined by the PDF specification (such as Link, Text, Highlight, or Stamp), the dataset contains dozens of proprietary subtypes created by specific PDF applications and workflows, such as BatesN, InstaSign, MultiSig, SILANIS_SIGNATURE, GoldGrid:AddSeal, TrapNet, and numerous specific annotations generated by products such as GdPicture, BJCA, FICL, and others.

Figure 6. Full list of annotation types by document count

PDF Encryption and Permission Flags

Figure 7. Percentage of Permission Flags

Only 513,342 documents (2.5%) were encrypted with an empty open password. The page-count analysis excludes malformed PDFs with missing page information and 80,062 password-protected PDFs with unknown passwords. For encrypted documents with empty open passwords we analyzed the permission flags stored in the PDF encryption dictionary.

The majority of encrypted PDFs permit normal document use.

Printing — 91.8%
High-resolution printing — 84.1%
Accessibility text extraction — 83.9%

The high percentage of documents allowing accessibility extraction is encouraging because the PDF specification defines this permission independently of general content copying, allowing assistive technologies to access document text even when copying is prohibited.

However, approximately 16% of encrypted PDFs, or 0.4% of the total analyzed document count, disable accessibility extraction (this permission flag was deprecated in PDF 2.0), potentially creating unnecessary barriers for users of screen readers and other assistive technologies.

Overall, encrypted PDFs on the public web are primarily configured to prevent document modification rather than document access.

Implications of analysis

This first part of the June 2026 Common Crawl PDFs analysis reveals several long-term characteristics of PDF usage on the public web:

Most PDFs remain relatively small, short documents.
Encryption is uncommon and generally does not prevent document access.
Accessibility text extraction is enabled in most encrypted documents, although a significant minority still disables it.
PDF 1.7 continues to dominate document production.
Proprietary extensions remain common, particularly in annotation workflows.
Link annotations dominate all other annotation types combined.

Conclusion

This first part of the report provides an initial statistical overview of more than 20.5 million PDF documents collected from the June 2026 Common Crawl dataset.

The findings establish a baseline for understanding how PDFs are created, distributed, and protected on today's web.

Stay tuned. In the next parts we analyse the evolution of a median size of PDF documents for the past 20 years, top producers of PDFs, and Tagged PDF trends.

Structure Tree in PDF4WCAG Accessibility Checker

Julia — Fri, 24 Jul 2026 05:38:50 +0000

What is a Structure Tree?

The Structure Tree represents the logical structure of a tagged PDF document. It consists of structure elements such as headings, paragraphs, lists, tables, and figures, organized in a hierarchical tree that is interpreted by assistive technologies. It also defines the reading order of the document content.

Accessibility validation is performed against these logical structure elements rather than the document's visual appearance, making the Structure Tree an essential component of PDF accessibility analysis.

The Structure Tree defines how assistive technologies interpret and navigate a tagged PDF. In PDF4WCAG Accessibility Checker, users can inspect this hierarchy to verify that headings, paragraphs, lists, and other structure elements are organized correctly and follow a logical reading order.

Accessibility Checker and the Structure Tree

Accessibility checkers can detect an empty paragraph (<P>), but without a Structure Tree it is often impossible to determine which paragraph caused the error. Unlike many visual accessibility issues, an empty structure element usually has no visible representation on the page and therefore cannot be highlighted in the document view. As a result, users are often left searching through the document to locate the offending element.

PDF4WCAG Accessibility Checker 1.10 addresses this problem by introducing an interactive Structure Tree. When a validation error is selected, the corresponding structural element is highlighted in the Structure Tree panel, allowing users to quickly locate the issue within the document hierarchy. An empty paragraph is just one example; the same approach can be used to investigate other structural accessibility problems.

So, when an empty paragraph is detected, users can navigate directly to the corresponding <P> structure element in the tree. This makes it immediately clear where the error occurs and allows users to inspect the element's parent and child nodes, understand its context within the document hierarchy, and resolve the issue more efficiently.

Structure Tree and Roadmap Navigation

PDF4WCAG Accessibility Checker 1.10 also enhances navigation through both the Structure Tree and the Roadmap.

The Structure Tree provides a hierarchical view of the document's logical organization, while the Roadmap presents the logical reading sequence of the document. Together, these complementary views help users understand both the document hierarchy and its reading order, making it easier to investigate and remediate accessibility issues in complex PDF documents.

Conclusion

The Structure Tree is one of the most valuable tools for PDF accessibility remediation. While validation reports identify what is wrong, the Structure Tree shows where the problem exists within the document's logical structure.

By combining synchronized navigation between the validation results, Structure Tree, Roadmap, and document view, PDF4WCAG Accessibility Checker 1.10 enables accessibility specialists to locate and understand structural issues such as empty paragraphs much more quickly than with traditional validation reports alone. For large and complex tagged PDFs, this significantly reduces remediation time and improves the efficiency and accuracy of accessibility corrections.

The Fonts Panel in PDF4WCAG: supporting PDF accessibility and compliance

Julia — Thu, 16 Jul 2026 13:07:31 +0000

When it comes to PDF accessibility, fonts are far more than a design choice. They are an important technical component that affects how text is represented and interpreted by assistive technologies. One of the key additions in PDF4WCAG Accessibility Checker 1.10 is the new Fonts inspection panel, which provides a detailed analysis of embedded fonts, font types and subsets, and encoding information.

For textual content, PDF/UA and Well-Tagged PDF (WTPDF) require text to be represented in a way that supports reliable Unicode extraction and interpretation by assistive technologies.

Proper font implementation helps ensure:

Reliable text extraction
Searchable and selectable text
Accurate Unicode mapping
Reliable interpretation by assistive technologies

If font encoding or accurate Unicode character mapping is incorrect, text may appear correctly on screen while being interpreted incorrectly by assistive technologies or accessibility validation tools.

What the Fonts panel shows

The new Fonts panel in PDF4WCAG 1.10 provides detailed technical information about every font used in the document, including:

Embedded fonts – displays information about fonts embedded in the document
Font type and subset information – displays the font type and whether a font is embedded as a subset or in full
Encoding information – provides information about font encoding to assist in diagnosing Unicode mapping issues

Users can immediately inspect all font resources from a single location. This makes troubleshooting much faster, especially in complex documents containing multiple embedded fonts.

Screen readers rely primarily on correctly encoded text, Unicode mappings, and the tagged PDF structure. Incorrect font encoding or missing ToUnicode mappings can prevent assistive technologies from interpreting text correctly, even when the document appears visually correct. This results in unreadable or skipped content for users with visual disabilities.

The new Fonts panel in PDF4WCAG Accessibility Checker 1.10 gives users direct access to essential font information that previously required specialized PDF inspection tools. By exposing embedded fonts, font types, subset status, and encoding information, it helps accessibility professionals diagnose problems more quickly and improve the technical quality of accessible PDF documents.

Combined with PDF4WCAG's validation engine, powered by the veraPDF architecture, the Fonts panel makes version 1.10 a more comprehensive accessibility validation solution.

Together with the new Metadata and Annotations panels introduced in version 1.10 PDF4WCAG, the Fonts panel provides deeper insight into the technical structure of PDF documents and supports more efficient accessibility analysis.

Contact us:

email: info@pdf4wcag.com

website: https://pdf4wcag.com/

New Annotations Panel in PDF4WCAG

Julia — Thu, 09 Jul 2026 13:00:29 +0000

Annotations are a general mechanism for adding an interactive layer to PDF documents. They include elements such as links, comments, interactive form fields, multimedia, and more. Like all other content, annotations may or may not be accessible. PDF4WCAG checks also cover a number of PDF/UA and WCAG requirements on annotations.

PDF4WCAG Accessibility Checker 1.10 introduces a dedicated Annotations panel that gives users deeper insight into interactive elements critical for accessibility compliance.

The panel inspects all types of PDF annotations relevant to usability evaluation, including:

Comments – user notes and markup
Hyperlinks – navigation and reference links
Form controls – interactive form fields
Other interactive elements – additional dynamic content

The importance of annotation inspection

The Annotations panel provides visibility into the most common accessibility failures related to PDF annotations, including:

Untagged links: users can identify untagged links annotations, which lead to accessibility issues: screen readers treat it as plain text or ignore it entirely.
Missing form labels: users can identify forms with missing labels.
Incorrect inclusion of annotations into the structure tree: users can identify annotations whose parent tags are missing or not in the correct position within the document structure.
Alt text: users can quickly see which annotations have missing or empty alt text.
Forbidden annotation types: users can identify annotation types that are not allowed in the accessible PDF documents.

The new annotations panel helps users quickly identify these issues, supporting compliance with WCAG and PDF/UA requirements.

Persistent preferences

Configuration settings are now persisted between sessions, meaning any custom filtering or view states the user applies to his annotation checks will be remembered the next time the user opens the tool.

email: info@pdf4wcag.com

website: https://pdf4wcag.com/

accessibility #pdf #duallab #dev

OpenDataLoader PDF: one tool and so many options!

Julia — Tue, 30 Jun 2026 07:05:53 +0000

TL;DR: OpenDataLoader PDF is the first open-source tool to auto-tag untagged PDFs into screen-reader-ready Tagged PDFs and the most performant open-source PDF parser for RAG pipelines. But it offers many options because not all PDFs are the same. The heuristic engine processes 60+ pages per second on CPU with 0.91 reading order accuracy; hybrid AI mode boosts accuracy to 0.934 for complex documents. Outputs include JSON with bounding boxes for RAG pipelines or Markdown for human readability. Auto-tagging is free (Apache 2.0); full PDF/UA-1 & PDF/UA-2 export is an enterprise add-on. You choose what fits your documents, compliance needs, and infrastructure.

Core technical options & their meanings
OpenDataLoader PDF gives many choices not to complicate things, but because different use cases and different document types need different approaches. Here's what each option does and why it matters.

Output Format: JSON Markdown HTML Annotated PDF Text

When you run OpenDataLoader, you choose between these output formats.

JSON gives structured, machine-readable data. Every element heading, paragraph, table, list, caption is tagged with a semantic type and a bounding box. Users get exact coordinates for every piece of content. This is the foundation for RAG pipelines, because users can map extracted text back to its exact location on the page.

Markdown offers human-readable text. It's cleaner, simpler, and works well when you just need to read or preview the extracted content.

Advice: Choose JSON when you need precision and structure. Choose Markdown when you need readability.

HTML output transforms your PDF content into a styled, web-ready document. The structure is preserved headings, paragraphs, lists, and tables are rendered with appropriate HTML tags and inline styling.
Annotated PDF output generates a visual overlay on the original document. Every detected element: heading, paragraph, table, list, image is highlighted with a colored bounding box and labeled with its semantic type.

Annotated PDF gives confidence to the users visually, instantly, and without reading a single line of raw JSON.

Text output format strips away everything except the raw text content. No bounding boxes. No semantic types. No formatting. Just the extracted text in the correct reading order.
Comparison of output formats

Layout Analysis: The XY-Cut++ Algorithm

Reading order is one of the hardest problems in PDF extraction. A page may look perfect to a human, but a machine, for example, can easily confuse multi-column page layout with a table or mix up footnotes with body text.

OpenDataLoader solves this with the XY-Cut++ algorithm. It analyzes the page geometry, finds the gaps between columns and blocks, recursively splits the page until every element is in the right order. The result is a logical reading order that mimics how a human would read the page.

This matters because incorrect reading order breaks information retrieval. If the RAG pipeline gets the order wrong, the answers it generates will be wrong too.

In OpenDataLoader this algorithm is enabled by default, and there is an option to disable it.

Processing engine: Heuristic vs. Hybrid

OpenDataLoader's default engine is heuristic, a fast, deterministic, rule-based system that runs entirely on CPU. It processes 60+ pages per second, requires no GPU, and is 100% local. No data ever leaves your machine.

The heuristic engine is ideal for most text-based PDFs. It's private, fast, and predictable.

For complex documents: scanned pages, borderless tables, mathematical formulas, charts OpenDataLoader offers a hybrid AI mode. This routes difficult pages to a local AI backend that handles what the heuristic engine cannot.

The result: table accuracy jumps from 0.49 to 0.93, and reading order accuracy improves from 0.91 to 0.934.

Users choose the engine based on their documents and their performance needs. Also the choices are designed to balance speed (CPU-only, 60+ pages/sec), privacy (100% local), and accuracy (bounding boxes, correct reading order). You select the output and rely on the engine's built-in intelligence for layout and structure, making it a powerful tool for high-throughput, local RAG pipelines.

Two algorithms for table detection: border and cluster

In the process of table extraction in heuristic mode, OpenDataLoader uses two different methods. By default, only the 'border' algorithm is used, which focuses only on table borders. Users can also enable a second algorithm, 'cluster', which divides content into clusters to identify tables (including tables without borders).

Noise filtering in OpenDataLoader

PDFs are full of small text, invisible text, hidden layers, and text outside the page. If users pass all of this to their LLM, they pollute the context with irrelevant information.

OpenDataLoader automatically filters out small text, invisible text, hidden layers, and text outside the page. Only the main body content is extracted and passed to the user’s pipeline. Cleaner input means better outputs.

Filters are also customizable. By default, they're all enabled, removing all content: small text, invisible text, hidden layers, and text outside the page. However, the user can disable these filters in any combination.

Tagged PDF Support: using native structure

When a PDF is "Tagged" it already contains native structural information: headings, paragraphs, lists, reading order. This is often the case with accessible PDFs that comply with PDF/UA or WCAG standards.

ODL can use the existing document structure instead of re-analyzing the layout. This is faster and more accurate, as it relies on the document's existing tags. We recommend using this option only if the PDF is properly tagged.

OpenDataLoader is one tool. Multiple workflows. You decide.

hancom #opendataloader #pdf

Website: https://opendataloader.org/

GitHub: https://github.com/opendataloader-project/opendataloader-pdf

Privacy Policy differences between the Web and Desktop versions of PDF4WCAG

Julia — Tue, 23 Jun 2026 11:41:19 +0000

TL;DR: This article explains the Privacy Policy of PDF4WCAG. How PDF4WCAG collects, uses, and protects information when a user performs the validation on the website or works with the Desktop version.

Organizations that process PDF documents often face strict requirements for data privacy, confidentiality, and regulatory compliance. To meet different operational needs, PDF4WCAG is available in both Web and Desktop versions giving users the opportunity to choose the deployment that best fits security and workflow requirements.

Privacy is a major concern

PDF accessibility validation involves sensitive content, including corporate reports, legal documents, financial statements, educational materials and government publications. Before selecting PDF accessibility checker, organizations should understand where their documents are processed and what information may be transmitted outside their environment.

PDF4WCAG Web version and privacy policy

The Web version of PDF4WCAG is designed for convenience and accessibility. Users can access the service through a web browser without installing any software. Users access Web versions instantly, regardless of their operating system, making onboarding fast and effortless. Automatic updates mean there is no need to manage versions or worry about outdated functionality.

Document processing in the Web version

Files are saved in the browser and then sent to the PDF4WCAG server, where they are deleted immediately after the end of the session. PDF4WCAG doesn’t send files anywhere else. PDF4WCAG uses files just for analysis in case of problems when a user requests.

Web version integrates with veraPDF validation engine. PDF4WCAG doesn’t store its own cookies in the browser. However, it does utilize Google Analytics and collects cookies required by the Google Agent itself. PDF4WCAG also stores basic application settings in the browser (language, selected profile, document zoom, and whether to open the right-hand panel by default).

Use cases of web version

Individual accessibility specialists.
Small and medium-sized organizations.
Small PDF remediation projects.
Remote teams requiring browser-based access.

PDF4WCAG Desktop version and privacy policy

PDF4WCAG provides Desktop version for all major platforms, offering an identical user experience across operating systems (Windows, Linux, macOS). PDF4WCAG Desktop transfers the functionality of the web-based PDF4WCAG Accessibility Checker into a local environment keeping the same visual experience. It represents a desktop wrapper for the web application, enabling users to perform PDF accessibility validation directly on their computers without relying on an internet connection.

Document processing in Desktop version

Desktop version of PDF4WCAG operates offline. It does not send or collect any data to the Internet or outside. As Web version, the desktop version also integrates with veraPDF validation engine, providing the same error previews, compliance reports, and interactive issue visualization as the online tool.

This approach reduces exposure to third-party infrastructure and supports environments with strict confidentiality requirements.

Use cases of Desktop version

Government agencies.
Financial institutions.
Healthcare organizations.
Legal firms.
Enterprises handling confidential or regulated information.

Comparing the two versions

🌐 Web Version

Installation required: No
Browser access: Yes
Document storage location: PDF4WCAG server
Local processing: No
Sensitive docs: Depends on policies
Files auto-delete after session: Yes

💻 Desktop Version

Installation required: Yes
Browser access: No
Document storage location: Local directory
Local processing: Yes
Sensitive docs: Highly suitable
Files auto-delete after session: Yes

Conclusion

Both PDF4WCAG Web and Desktop editions deliver powerful PDF accessibility capabilities. The key difference lies in where document processing takes place. Organizations handling confidential, proprietary, or regulated information may prefer the Desktop version for its local-processing architecture, while users seeking flexibility and ease of deployment may find the Web version the more practical choice.

Understanding these privacy distinctions helps organizations select the deployment model that best aligns with their security, compliance, and operational requirements.

Contact us:

email: info@pdf4wcag.com
website: https://pdf4wcag.com/

How tags are saved in the initial PDF. OpenDataLoader experience

Julia — Mon, 15 Jun 2026 07:15:03 +0000

TL;DR: OpenDataLoader’s auto-tagging engine analyzes the document’s layout, detecting headings by visual text properties, identifying tables by grid patterns, recognizing lists by bullet positions and then writes this structural information directly into the PDF’s internal structure tree.

PDF accessibility begins with mapping document content (headings, paragraphs, tables, lists) into a logical structure tree that assistive technologies can navigate. Manual tagging is slow, error-prone, and impractical for large document volumes.

⁉️ How OpenDataLoader Implements Tag Writing
OpenDataLoader is the first open-source tool which adds tags directly into the initial PDF file without altering the visual appearance of the document. The AI analyzes document structure, distinguishes components such as titles, tables, lists, and images, and inserts the corresponding tags into the source PDF.

Key characteristics of OpenDataLoader’s approach:

No proprietary SDK dependency: most existing tools rely on commercial SDKs for the tag-writing step;
#OpenDataLoader does it all under Apache 2.0 license.
On-premise processing : sensitive documents never leave your network
No page caps or watermarks unlimited use without document quantity restrictions

OpenDataLoader’s auto-tagging was built in collaboration with the
Dual Lab (Member of PDF Association, supports veraPDF, developers of
PDF4WCAG Accessibility checker.

OpenDataLoader’s auto-tagging preserves visual integrity by design. The technology adds semantic structure without touching the presentation layer, follows industry specifications validated by PDF accessibility experts, and has been built specifically to solve the accessibility problem without creating new ones.

GitHub:
https://github.com/opendataloader-project/opendataloader-pdf

Metadata and PDF accessibility checker PDF4WCAG

Julia — Fri, 12 Jun 2026 11:13:33 +0000

PDF accessibility is always associated with tags, headings and alternative text. But there's another critical component: metadata.

PDF documents may include general information, such as the document’s title, author, and creation and modification dates. Such information about the document (as opposed to its content or structure) is called metadata and is intended to assist in cataloguing and searching for documents in external databases.

Metadata plays a tremendous role in modern PDF files, especially in accessibility, document management and AI-based document processing. In PDF files metadata is commonly stored using XMP (Extensible Metadata Platform) package, directly embedded into the document.

Document title and accessibility
Well-Tagged PDF (WTPDF) declarations are metadata, embedded in PDF 2.0 files within the XMP metadata, that assert a document's conformity with WTPDF 1.0 requirements for accessibility or content reuse. Developed by the PDF Association, these declarations allow software to identify if a file is optimized for assistive technology (similar to PDF/UA-2) or for structured data extraction.

The title helps users understand the purpose of the document before reading its content. Screen readers and other assistive technologies often announce the title when the PDF is opened.

For example:

“Accessibility Report 2026”
“PDF4WCAG PDF Accessibility Checker”

are significantly more useful than:

“doc.pdf”
“pic001.pdf”

PDF/UA identification metadata
In accessible PDFs, XMP metadata may also contain identification information about conformance standards. There are several mechanisms at work here: one used by PDF/UA, another by WCAG. Both are important, as the document may conform to both PDF/UA and PDF/UA, as the latest LaTeX-generated Tagged PDFs do.

This metadata allows validators and accessibility tools to determine whether the document claims compliance with standards such as: PDF/UA and WCAG.

Additional metadata fields
XMP metadata also may contain valuable document information, including: creation and modification date, author or organization, producer and creator tool, language information.

Metadata provides assistive technologies with an initial description of the document before content navigation begins. Without proper metadata, accessible PDFs lose important semantic and usability information.

What PDF4WCAG checks
PDF4WCAG checks:

dc:title is present and not empty.
The PDF/UA or WCAG compliance declarations, if the document is validated against PDF/UA or WCAG profiles respectively. These declarations are recommended, but not mandatory for WCAG.
The XMP package is properly attached to the document catalog.

Accessible PDFs should contain a meaningful dc:title. More advanced workflows should also include standardized identification metadata and descriptive document properties to support both human users and machine processing systems.

You can open discussions and submit issues in our public GitHub https://github.com/duallab/PDF4WCAG-public/issues repository or start the discussion https://github.com/duallab/PDF4WCAG-public/discussions to propose improvements or share ideas.

Dual Lab releases PDF4WCAG Accessibility Checker 1.10

Julia — Fri, 05 Jun 2026 06:28:39 +0000

Dual Lab announces the release of PDF4WCAG Accessibility Checker 1.10, introducing usability enhancements, expanded localization support, and new document inspection panels.

PDF4WCAG is a professional accessibility validation solution for PDF documents, designed to support compliance with PDF/UA, WCAG, and WTPDF accessibility requirements. It is powered by the veraPDF validation architecture and is identical to veraPDF in Machine verifiable checks of PDF/UA and WTPDF validation profiles.

What’s new in Version 1.10

Enhanced localization and user experience

PDF4WCAG 1.10 improves interface usability and multilingual support:

Redesigned switching between technical terminology and user-friendly language, providing a more intuitive experience for both accessibility experts (developers) and non-technical users.

Added support for German and Dutch interface localizations.

Improved zoom and navigation controls
Accessibility issue navigation has been refined for better usability:

Enhanced zoom behavior for small issue regions and error highlights.

New inspection panels

PDF4WCAG 1.10 introduces several new analysis panels to provide deeper document insights:

Annotations panel

Inspects PDF annotations, comments, hyperlinks, form controls, and other interactive elements relevant to accessibility and usability evaluation.

Metadata panel

Displays document metadata including:

document title
author information
document language
accessibility properties
PDF/UA-related metadata entries

Fonts panel

Provides detailed analysis of:

embedded fonts
font types and subsets
encoding information

Persistent user preferences

PDF4WCAG now preserves user configuration settings between sessions, improving workflow continuity and efficiency. Persisted settings include:

selected interface language
active filters
right-side panel state and opened sections
structure tree role map visibility
auto-scaling preferences

CLI enhancements

The command-line interface has been extended with initial support for additional validation profiles:

WCAG Machine
WCAG Machine & Human

These profiles are now available under paid commercial licenses on the PDF4WCAG website.

Public API documentation
A new public documentation section is now available. API is available under paid commercial licenses on the PDF4WCAG website.

Integration API Beta testing

The PDF4WCAG Integration API is in the process of beta testing. The API is designed to simplify integration of accessibility validation workflows into enterprise systems, document processing pipelines, and third-party accessibility platforms.

About Dual Lab
Founded in 2008, Dual Lab specializes in science- and technology-intensive software development across multiple domains including PDF Technologies, complex Document Management workflows, 3D Modelling, Fintech and others. Dual lab is a partner member of PDF Association.

For more information, visit the website.

duallab #pdf4wcag #wcag #accessibility

Auto-Tagging in OpenDataLoader PDF: How Visual Integrity Is Guaranteed

Julia — Wed, 03 Jun 2026 09:23:55 +0000

OpenDataLoader’s auto-tagging guarantees that the document remains visually unchanged because it separates structure from presentation.

How do we do it?

The Core Principle: Tags vs. Visuals

PDFs are ambivalent documents. They contain:

A visual layer: the exact positioning of text, images, and graphics on each page.
A structural layer (optional): tags that describe what each element means (heading, paragraph, table, etc.)

Untagged PDFs have only the visual layer. When screen readers encounter these, they see a mess of text with no hierarchy like reading a magazine where someone has cut every article into individual words and thrown them on a table.

Auto-tagging adds the structural layer without touching the visual layer. It’s like adding an invisible table of contents and semantic labels to a book without changing a single word on the pages.

How OpenDataLoader Preserves Visual Integrity

1. Structure is written, not rendered

OpenDataLoader’s auto-tagging engine analyzes the document’s layout, detecting headings by visual text properties, identifying tables by grid patterns, recognizing lists by bullet positions and then writes this structural information directly into the PDF’s internal structure tree.

Critically, this structural information exists alongside the existing visual instructions, not instead of them.

The tags are simply additional data that assistive technologies can use.

2. The Guarantee of preserve appearance

OpenDataLoader produces a screen-reader-ready PDF with structure tags (headings, paragraphs, lists, tables, reading order). The output is a Tagged PDF, not a reformatted or redrawn document.

This means:

No repositioning: text stays exactly where it was
No reformatting: fonts, spacing, and layout remain identical
No content removal: everything visible stays visible
No visual additions: tags are invisible metadata.

3. Validated against industry standards

OpenDataLoader’s auto-tagging was built in collaboration with the Dual Lab (Member of PDF Association, supports veraPDF, developers of PDF4WCAG Accessibility checker.

4. Two Engine Options for Accuracy

OpenDataLoader offers two processing modes:

Both modes operate on the same principle: analyze the visual layer, infer structure, write tags. Neither mode alters the underlying visual instructions.

How Hybrid Mode Works for Auto-Tagging

Hybrid mode combines fast local Java processing with AI backends. Simple pages stay local (0.02s); complex pages route to AI for +90% table accuracy.

Simple pages — processed locally (approximately 0.02s per page)

Complex pages — routed to AI backend for enhanced accuracy

What Hybrid Mode Enables

Hybrid mode specifically handles content types that deterministic local processing struggles with:

Accuracy Improvements

The results show dramatic accuracy improvements with hybrid mode:
Table extraction accuracy: Jumps from 0.489 (local mode) to 0.928 (hybrid mode)
Overall benchmark score: 0.907 overall #1 overall, leading in reading order (0.934) and table extraction (0.928)
Reading order accuracy: 0.934

OpenDataLoader’s auto-tagging preserves visual integrity by design. The technology adds semantic structure without touching the presentation layer, follows industry specifications validated by PDF accessibility experts, and has been built specifically to solve the accessibility problem without creating new ones.

Official website: https://opendataloader.org/?utm_source=medium

GitHub: https://github.com/opendataloader-project/opendataloader-pdf?utm_source=medium