Scrape & Analyze Company Data from Indeed

# Scrape and analyze company data from Indeed using Bright Data and Google Gemini

This workflow automates the extraction of company information from Indeed, cleans and summarizes it using AI, enabling HR professionals and analysts to quickly build structured employer profiles. Data is scraped via Bright Data, processed and summarized with Google Gemini, then delivered to any system via HTTP webhook.

## Who it´s for
- HR specialists gathering information about employer companies
- Recruiters analyzing company profiles for candidate matching
- Labor market analysts tracking changes on career pages
- Researchers systematizing data on corporate culture
- Automation engineers integrating external data sources into CRM

## What the automation does
- Triggered manually, fetching company URLs from an Airtable base
- Uses Bright Data Web Unlocker API to bypass protection and scrape Indeed pages
- Converts raw Markdown responses into clean text and parallel HTML output
- Processes text with Google Gemini to generate concise summaries
- Applies a LangChain AI agent to structure and format final output
- Sends structured JSON results via HTTP webhook
- Simultaneously forwards HTML version for archiving or BI analysis

## What´s included
- Ready-to-use n8n workflow
- Trigger and handler logic based on manual_trigger
- Integrations with Airtable, Bright Data, Google Gemini, and HTTP webhooks
- Basic textual instructions for setup and adaptation

## Requirements for setup
- n8n instance (cloud or self-hosted)
- Bright Data API key
- Access to Google Gemini with API enabled
- Airtable base containing company URLs
- Target HTTP webhook endpoint (e.g., Webhook.site, internal API)

## Benefits and outcomes
- Saves time on manual data collection about employers
- Automatically creates standardized company profiles
- Supports decision-making in recruitment and hiring
- Enables integration into knowledge bases, CRMs, or BI systems
- High data accuracy through AI-powered processing and cleaning
- Scalable: process hundreds of companies sequentially
- Flexible: output can be adapted for various use cases

## Important: template only
Important: you are purchasing a ready-made automation workflow template only. Rollout into your infrastructure, connecting specific accounts and services, 1:1 setup help, custom adjustments for non-standard stacks and any consulting support are provided as a separate paid service at an individual rate. To discuss custom work or 1:1 help, contact via chat