ldenoue

weekend project that uses the latest Chrome Summarizer API, but also YOLO to process PDF pages and find images, tables, and math formulas.

Readability (Mozilla) is used when you open regular web pages, but PDF.JS (also Mozilla!!) is used to render each page, run YOLO region detection and then generate a clean HTML. Math formulas are rendered as Latex, and tables are rendered into HTML by detecting their structure using Texo/FormulaNet.

Finally, you can read out loud the readable articles/PDFs using another local TTS (I prefer PocketTTS personally, but wanted to try the newly released and tiny Inflect TTS as well, so it's an option).

Let me know if you find this useful.

I should probably publish them to the Chrome and Firefox stores.

do you have sample PDFs?

this app runs entirely in your browser. thanks to Codex, it now uses a YOLO detector using ONNX to detect regions in each rendered PDF page image (text, pictures, formulas, tables). based on this analysis, PDF Reflow then cuts out TEXT regions into tiny little word images and adds back the original text from the PDF (when available) so you can still select and find text in the reflowed HTML render.

Hope you find this useful. The original version used heuristics, but frankly it was breaking on many more PDF that I'd want to admint.

This new AI-based version that uses a YOLO detector trained specifically on Doc Layout dataset seems to do a very very good job.