- add _text_extraction/_layout_mode subpackage (initial version)
- expose new subpackage functionality via new PageObject methods _layout_mode_fonts() and _layout_mode_text()
- add "extraction_mode" parameter and layout_mode kwargs to existing PageObject.extract_text() method for experimental usage

Remove unnecessary "any()" wrapper after refactoring for python 3.7

- DOC: standardize language. use "layout", not "structure/structural".
- BUG: address bug introduced by ruff refactoring (remove "TYPE_CHECKING" block for Literal import)
- DEV: use sys.version_info based import switch (not try/except) for Literal and TypedDict to correct vscode colors and prevent odd mypy errors
- TST: add test created by @MartinThoma in py-pdf#2390
- ENH: add remaining standard fonts and aliases

- PI: move json imports (debug only)
- DEV: move `_set_state_param()` definition nearer to usage
- MAINT: use `PdfReadError` vs `ValueError`
- DOC: Comment/docstring improvements per review

- DEV: add LAYOUT_NEW_BT_GROUP_SPACE_WIDTHS constant to _text_extraction __init__.py

- DEV: disambiguate "XformStack" and "xform" language in layout mode from existing extract_xform_text:
  - "xform" --> "transform"
  - "XformStack" --> "TextStateManager"
  - "xform_stack" --> "text_state_mgr" or "state_mgr"
- DEV: move "TextStateParams" to its own file for easier discoverability and cross referencing during development
- PI: reduce overhead of TextStateParams by eliminating unnecessary dataclass fields
- DEV: rename _fonts.py to _font.py to properly reflect internal class name (Font)
- DEV: rename "opands" to "operands" for all usages in _fixed_width_page.py
- ENH: Use font.space_width * 2 as a fallback for assigning space_tx during TextStateParams.__post_init__()
  - applies when a font assigns width 0 for the " " char and uses TJ int operators for fine grained inter-word spacing as shown in crazyones.pdf
- ENH: correct calculation for triggering a new BTGroup in recurs_to_target_op(). Remove abs() to prevent triggering on TJ spacing operators
- ENH: rotation handling:
  - add "layout_mode_strip_rotated" kwarg to PageObject.extract_text() to assign new layout mode "strip_rotated" parameter.
  - produce a logger_warning if rotated text is found.
  - if strip_rotated == True, remove text that is rotated with respect to the page with warning "Rotated text discovered. Output will be incomplete."
  - if strip_rotated == False, include all text, rotated or not, and warn with "Rotated text discovered. Layout will be degraded."

Main

- correct submodule name in test_text_extraction.py
- resolve indirect objects in /DescendantFonts
- add "layout_mode_strip_rotated" explanation to extract-text.md
- prevent double spacing for the first tj element of a bt group

…into text-layout-mode

- add toy.pdf and toy.layout.pdf and associated test case for handling T*, ', ", TD, Tc, Tw, Tz, TL, and Ts operators
- correct bugs associated with TL impacting T*, ', and " (sign is reversed from 1.7 standard, side effect of layout mode algorithm)
- make "_set_state_param" and "decode_tj" methods of the TextStateManager class rather than passing the text state manager to them manually

- cover both Type0 DecendantFonts /W formats in tests
- add `set_font()` to TextStateManager instead of setting font/font_size attributes directly

Co-authored-by: Stefan <[email protected]>