Skip to content
This repository was archived by the owner on Feb 16, 2023. It is now read-only.

change pdfminer's word_magin=1 for better text extraction results #1735

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

change pdfminer's word_magin=1 for better text extraction results #1735

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
882653e
Prototype: change pdfminer's word_magin=1 for better text extraction …
tmbinc Oct 2, 2022
40ce3fa
Fix whitespace, maximum line length
tmbinc Oct 2, 2022
8e7f66f
Satisfy pycodestyle rules
tmbinc Oct 2, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 8 additions & 1 deletion src/paperless_tesseract/parsers.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -115,9 +115,16 @@ def extract_text(self, sidecar_file, pdf_file):

from pdfminer.high_level import extract_text as pdfminer_extract_text
from pdfminer.pdftypes import PDFException
from pdfminer.layout import LAParams

# Experimentally, word_magin < 1.0 (default: 0.1) inserts spaces
# between letters in some documents.
laparams = LAParams()
laparams.word_margin = 1

try:
stripped = post_process_text(pdfminer_extract_text(pdf_file))
stripped = post_process_text(pdfminer_extract_text(pdf_file,
laparams=laparams))

self.log("debug", f"Extracted text from PDF file {pdf_file}")
return stripped
Expand Down