Project Overview
A workflow automation system that identifies staffing partner opportunities by scraping job
postings, extracting company data, and generating communication-ready summaries using AI.
Challenges
- Difficulty in accurately locating LinkedIn company URLs from job listings across multiple websites.
- Need to extract and structure company details from LinkedIn for outreach relevance.
- Requirement to summarize job descriptions clearly for internal review.
- Need to automatically draft outreach emails to company stakeholders.
- Ensuring smooth data management and workflow coordination across multiple tools.
Solutions
- Implemented a job scraping pipeline to collect job postings from Indeed and format
them into structured data.
- Used Google Search API to automatically identify and retrieve company LinkedIn
profile URLs.
- Scraped company details from LinkedIn, storing all structured results in an internal
database.
- Integrated Airtable to manage, monitor, and process company + job data efficiently.
- Utilized ChatGPT API to:
- Summarize job descriptions into easy-to-understand briefs.
- Generate personalized outreach emails for company owners or HR contacts.
- Created a single, repeatable workflow, allowing faster lead qualification and
communication.
Technology Used
- Data Scraping: Python, Selenium, Requests, BeautifulSoup, Pyppeteer, Playwright
- APIs: Google Search API, Airtable API, ChatGPT API
- Database & Data Handling: Airtable + Custom structured data store
