DevJobsScraper

DevJobsScraper Scrapes developer job listings from Emploitic and exposes them via a paginated, filterable REST API. Quickstart Server starts at http://localhost:8000. On first launch, it downloads ChromeDriver, scrapes all sources, stores results in SQLite, and repeats every 30 minutes. The API is available immediately while scraping runs in the background. Usage API mode (default) Starts a FastAPI server with Uvicorn (hot-reload enabled). A background asyncio task runs an infinite loop: Instantiate each scraper from the SCRAPERS registry Call scraper.run() — scrapes the site and saves jobs to SQLite Run maincleaner() — normalizes tags and removes old listings Sleep 1800 seconds (30 minutes), then repeat The background loop is managed via FastAPI's lifespan context, so it starts with the server and is cancelled cleanly on shutdown. Scraper mode (one-shot) Runs every scraper exactly once, cleans the data, and exits. Useful for debugging or cron-based scheduling. API Reference GET /jobs Returns paginated, filterable job listings from the SQLite database. Query Parameters Param Type Default Constraints Description --- --- --- --- --- page int 1 >= 1 Page number