Uses Playwright to drive Chromium when the primary requests-based
fetch fails (e.g., Cloudflare, JS-required pages). Hybrid approach:
try fast path first, fall back to Chromium only on failure.
Dockerfile: add playwright==1.52.0 pip package, run playwright
install-deps chromium + playwright install chromium to download
the browser and all system libraries.
scrape-recipe: add fetch_with_chromium() that tries Playwright
first, then chromium --headless --dump-dom as a subprocess fallback.
Modify main() to catch primary fetch errors and call Chromium
fallback before giving up.
- scripts/scrape-recipe: Python script using recipe-scrapers to extract
schema.org JSON-LD from a recipe URL (or local HTML file for testing)
- Dockerfile: add Python3 + recipe-scrapers in virtualenv, install the
scrape-recipe script at /usr/local/bin/scrape-recipe
- scripts/run now takes a recipe directory as its first argument,
resolves it to an absolute path, and mounts it at /recipes in the
Docker container
- Parses --port flag to map container port 8080 to the requested
host port (default 8080)
- Passes --recipe-dir /recipes --port 8080 to the server
- Passes --host and any additional args through to the server
- Exits with an error if the recipe directory doesn't exist
- Also accept --host flag and pass remaining args through
Example: ./scripts/run ~/my-recipes --port 9090
jbrechtel