# Monitor competitors and get a weekly digest

Watch competitors' public pricing pages, changelogs and blogs, and get a weekly email listing only what changed.

- Category: Research
- Runs on: n8n
- Level: Intermediate
- Audience: both
- Setup time: about 60 minutes
- Evidence: Documented (each step backed by official docs; not tested by us)
- Last updated: 2026-10-31
- Named sources: 11
- Canonical URL: https://crimsonbot.com/use-cases/competitor-weekly-digest

> **Warning:** Terms of service. Watch only public pages that a normal visitor can see, and respect each site's terms and robots.txt. Do not monitor social accounts by scraping: X's Terms ban crawling or scraping without written consent, and LinkedIn's User Agreement bans scraping. For social posts, read them yourself or use the platform's official API under its terms. Keep request volume low.

## You will need

- A list of competitors' public pages: pricing, changelog, blog or RSS feed
- Firecrawl (free plan: 1,000 credits a month) or the open-source changedetection.io (self-hosted)
- n8n for the weekly summary email (n8n Cloud is paid after a free trial; self-hosting is free)
- A model API key for the summary (billed per token)

## You will end up with

- A weekly email listing only pages that changed, with a short summary and a link to each

## Steps

### 1. List the pages to watch

For each competitor, list their pricing page, changelog and blog (an RSS feed is better than scraping if they have one). Leave out social media accounts (see the warning). Check each site's terms and robots.txt; robots.txt tells crawlers what they are asked not to fetch.

Sources:
- [RFC 9309: Robots Exclusion Protocol](https://www.rfc-editor.org/rfc/rfc9309.html)
- [X Terms of Service](https://x.com/en/tos)
- [LinkedIn User Agreement](https://www.linkedin.com/legal/user-agreement)

### 2. Track changes with Firecrawl

Scrape each page with Firecrawl's changeTracking format. It compares the page with the last time you scraped it and marks it new, same, changed or removed, with an optional git-style diff. Firecrawl's Monitoring feature can run these checks on a schedule for you. Prefer self-hosting? changedetection.io is an open-source alternative.

Sources:
- [Firecrawl docs: Change Tracking](https://docs.firecrawl.dev/features/change-tracking)
- [Firecrawl docs: Monitoring](https://docs.firecrawl.dev/features/monitoring)
- [dgtlmoon/changedetection.io on GitHub (Apache-2.0)](https://github.com/dgtlmoon/changedetection.io)

### 3. Run it weekly in n8n

Add a Schedule Trigger for once a week, then the Firecrawl node (or an HTTP Request node) for each URL. Keep only results whose status is changed or removed.

Sources:
- [n8n docs: Schedule Trigger node](https://docs.n8n.io/integrations/builtin/core-nodes/n8n-nodes-base.scheduletrigger)
- [Firecrawl docs: n8n guide](https://docs.firecrawl.dev/integrations/n8n)
- [n8n docs: HTTP Request node](https://docs.n8n.io/integrations/builtin/core-nodes/n8n-nodes-base.httprequest)

### 4. Summarize only what changed

Pass the diffs to a Basic LLM Chain node.

```text
Here are the changes found this week on competitor pages, as diffs with URLs: {{changes}}.
For each page, write one line on what changed (for example a new price, plan or feature) and include the URL. Use only what is in the diff. If a diff is only layout or wording, say 'minor wording change'.
```

Sources:
- [n8n docs: Basic LLM Chain node](https://docs.n8n.io/integrations/builtin/cluster-nodes/root-nodes/n8n-nodes-langchain.chainllm)

### 5. Email the digest and check it (human checkpoint)

Send the summary with the Send Email or Gmail node. Before acting on a change, open the page and confirm it yourself.

Sources:
- [n8n docs: Send Email node](https://docs.n8n.io/integrations/builtin/core-nodes/n8n-nodes-base.sendemail)

## Tools used

- [Firecrawl](https://www.firecrawl.dev): Turn websites into clean data for agents.
- [n8n](https://n8n.io): Workflow automation with AI agent nodes.

## Next

- [Our tool: Scrub a PDF locally before you paste it into AI →](https://crimsonbot.com/go/p/pdf-scrubber)
- [Get an email when the newsletter launches →](https://crimsonbot.com/#newsletter)