Rank tracking used to mean a bookmark folder and a spreadsheet you updated when you remembered. Now your competitors’ positions shift daily across desktop, mobile, local packs and AI-generated answers, and most tools that promise to watch that for you are priced for agencies or collect data in ways that carry real risk. This guide explains what you can legally observe, what is merely against a site’s terms, and how to build a routine for tracking competitors’ rankings that survives a real budget — whether you spend nothing at all or subscribe to a professional platform.
🚫 Why Tracking Competitors’ Rankings Got Harder in 2026
Competitor rank tracking used to be simple because the result page was simple. Ten blue links, one position per keyword, a weekly glance at who moved. In 2026 a single search result can contain a featured snippet, an image pack, a local pack, a video carousel, shopping units and an AI-generated answer above the classic listings. Your competitor may sit at position four and still own the click, because the answer a user actually reads belongs to them.
That changes what you are measuring. A raw position number no longer tells you whether you are winning or losing — the SERP feature above the link matters more than the link itself. At the same time the set of competitors worth tracking has drifted: the domains outranking you for commercial keywords are frequently not the brands you compete with offline, and the pages winning AI citations are often third-party reviews rather than vendor sites.
The honest baseline
Before you buy anything, write down 20 to 50 keywords you genuinely care about and record your current position for each one by hand. That snapshot costs an afternoon, and it is the only data you will never be able to buy retrospectively.
⚖️ What Legal Actually Means When Tracking Competitors’ Rankings
“Is it legal to track competitors’ rankings?” is really three separate questions, and mixing them up is what gets people into trouble. The first is whether the data itself is public: search positions are observable facts, and observing them once as a human visitor is unremarkable. The second is how you collect them at scale: automated queries against a search engine or a competitor’s server are governed by terms of service, robots directives and rate limits rather than by copyright. The third is what you do with what you collect, which is where data protection and copyright genuinely bite.
In practice the risk ladder looks like this. Permitted: reading public pages as a normal visitor, checking positions manually, using an official API, or buying licensed data from a vendor who carries the collection burden for you. Grey and contractually risky: scripting bulk queries against search result pages, or crawling a competitor’s site at rates their infrastructure notices. Clearly over the line: logging in as someone else, bypassing CAPTCHAs or bot protections, harvesting personal data without a lawful basis, or republishing substantial parts of someone else’s content.
Not legal advice
Rules differ by jurisdiction and by site. Treat this as a map of the questions to ask your own lawyer, not as a substitute for one — especially if you plan to collect data about identifiable people.
📜 The Rules in Plain English: Robots.txt, Terms of Service and Rate Limits
Google’s own terms of service prohibit using automated means to access content from its services in violation of the machine-readable instructions on its pages — robots.txt files that disallow crawling — and they separately prohibit scraping content that does not belong to you. The public robots.txt for google.com disallows /search for every user agent, which is why scripts that hammer search result pages are both the most common shortcut and the most obviously contrary to the rules.
It helps to know that robots.txt is no longer folklore. The Robots Exclusion Protocol was published as an internet standard in RFC 9309 in September 2022, and it defines how an Allow or Disallow rule must be evaluated, matched and cached. That cuts both ways: the file is a real, machine-readable instruction that crawlers are expected to honour, and an “Allow” line is not a licence to ignore a site’s terms or to collect personal data.
The sanctioned route is an API. Google Search Console exposes queries, impressions, clicks and average position for properties you own, free of charge, through an official API. Bing Webmaster Tools offers an equivalent for its index. Neither will hand you a competitor’s daily positions, but together they tell you which keywords you are genuinely close to winning — the only ranking data you can act on immediately.
It is worth separating what courts have said from what you are allowed to do. US decisions have narrowed the reach of the federal computer-misuse statute over publicly available data, but those rulings concern one law only. They say nothing about the contract you accepted by using a site, about copyright in what you copied, or about privacy rules covering personal data.
💰 Free Ways to Track Competitors’ Rankings Without a Budget
1. Google Search Console for your own position. It reports the queries you already appear for, your average position, impressions and click-through rate. You cannot see competitors there, but it tells you exactly which keywords are one improvement away from page one — which is more actionable than a competitor’s number two position.
2. A fixed manual keyword list. Pick 20 to 30 commercial terms, check them once a week in a clean logged-out session from the same location and device type, and record position plus which SERP features appeared. It takes about 15 minutes and produces a genuinely honest trend line.
3. Alerts as an early-warning system. Set alerts for competitor brand and product names. Ranking shifts usually follow indexing, launches and press coverage, so alerts frequently tell you what a rank tracker would only confirm a fortnight later.
See the keyword, backlink and ranking data behind every competitor
A professional suite replaces your spreadsheet with daily positions, SERP-feature tracking and the keyword gaps your competitors are quietly winning.
📈 Affordable Paid Rank Trackers: What You Actually Get for the Money
Paid tracking is priced along four axes: keywords monitored, sites or projects, users, and history. Almost every upgrade is triggered by hitting one of those limits rather than by needing a new feature, so work out which axis will bind for you before comparing prices. The figures below come from Semrush, the platform we use as the reference point in our own review, and from approximate entry pricing at comparable trackers.
| Plan tier | Advertised annual price | What the tier covers |
|---|---|---|
| Free | $0 | One demo project, 10 reports per day — evaluation only |
| SEO | $117.33/mo | 5 sites, 500 tracked keywords, daily positions, site audit |
| Starter | $165.17/mo | Adds AI-visibility tracking and platform integrations |
| Pro+ | $248.17/mo | 15 sites, 1,500 keywords, historical data unlocked |
| Advanced | $455.67/mo | 40 sites, 5,000 keywords, API access for reporting |
Those are advertised annual-billing figures — monthly billing costs roughly 18 per cent more, and add-ons such as extra user seats are billed on top. Entry pricing at other established trackers sits in a similar band; in our own comparison, approximate starting points ran from about $65 per month for the value-focused option to roughly $129 for the specialist backlink index. Vendors change prices often, so confirm on their own page before budgeting.
For the frugal buyer, three tactics consistently work. First, run the free tier or trial with your real keyword list rather than a demo one, so the decision rests on your data. Second, pick the tier whose tightest limit sits above your actual usage — paying for 1,500 keywords while tracking 60 is the most common waste. Third, buy annual only after a month of monthly billing proves you open the tool weekly. Historical data is the one feature worth upgrading for: trend lines turn a position into a diagnosis.
🤖 Trends, SERP Features and AI Answers: Beyond Position Tracking
Position is a symptom, not a score. Two pages can both rank fourth for the same keyword with completely different commercial outcomes, depending on whether the query returns a local pack, a comparison table or an AI answer that the user never scrolls past. So track occupancy alongside position: for each keyword, note which SERP features appeared and which domain owns them. Movement in feature ownership is often the first visible sign that a competitor has restructured a page.
The newer frontier is AI-generated answers. Assistants such as ChatGPT, Perplexity and Gemini summarise a handful of sources per question, and being cited there is a visibility surface that traditional rank trackers were never designed to see. Purpose-built monitoring now exists: the platform we reviewed reports brand-citation tracking across more than 317 million monitored prompts, which is the kind of sample size no manual routine can match.
⚙️ A Repeatable Monthly Workflow for Competitive Rank Tracking
A tracking routine fails for organisational reasons far more often than technical ones. This sequence is deliberately boring, because boring is what produces comparable data month after month.
Step 1 — Fix the keyword set. Choose 20 to 50 terms, tag each by funnel stage, and treat the list as frozen. Any keyword you track fewer than six times is trivia.
Step 2 — Freeze the competitor set. Pick three to five domains and keep them for at least a quarter. Rotating competitors every month produces a chart that cannot be read.
Step 3 — Snapshot weekly, review monthly. Daily data is noise outside fast-moving niches. Compare month over month and watch for changes across the whole set rather than a single keyword.
Step 4 — Log SERP features and their owners. A featured snippet gained by a competitor is worth more information than a two-place slide in the classic listings.
Step 5 — Convert insight into work. Every competitor gap you find becomes one specific page improvement with an owner and a date. Tracking without an output queue is a hobby.
Step 6 — Re-baseline quarterly. Retire keywords you no longer sell against and add the new ones. The list should change slowly and deliberately, not weekly.
Two rules that save months
Never change your keyword list and your content in the same week, or you will not know which one moved the numbers. Always record the exact date and conditions of every check, because search results are not reproducible from memory.
📊 How to Read Ranking Data Without Fooling Yourself
Record the conditions. Logged-in state, location, device type and even the time of day change what a SERP looks like. A position that moved because you checked from a hotel network did not move.
Respect the estimates. Third-party traffic and revenue figures for sites you do not own are modelled, not measured, and they can lag or miss smaller domains entirely. Use them for direction, never as a financial input.
Watch sets, not single keywords. One term dropping three places under a fluctuating SERP layout is normal. A 5 to 10 per cent decline across your tracked set is a signal worth investigating.
🔒 Practical Hygiene: Staying on the Right Side of the Rules
Whatever method you choose, a few habits keep it defensible. Prefer licensed or API-sourced data over do-it-yourself crawling; if you must collect public data yourself, identify your client honestly, honour robots.txt disallow rules, throttle requests to a non-disruptive rate, cache what you fetch, and stop if the operator asks you to. Never authenticate as anyone else, never defeat CAPTCHAs or bot protections, and do not collect personal data you have no lawful basis to hold.
Keep a provenance record: what you collected, from which source, at what time, and under which licence or agreement. If a question ever arises, that record is worth more than any argument about intent. When you publish, quote briefly and attribute rather than reproducing chunks of a competitor’s page, and if you operate under European or UK data protection rules, treat any personal information as a separate regime with its own obligations.
❓ Frequently Asked Questions
Is it legal to track my competitors’ rankings?
Observing public search results is not the problem; the method is. Manual checks, official APIs and licensed vendor data are the safe routes. Real exposure comes from bypassing a site’s terms, defeating bot protections, or collecting personal data without a lawful basis — risks that are separate from whether the rankings themselves are public.
Do I need a paid tool to track competitors?
Not for a handful of keywords. Manual weekly checks on 20 to 30 terms inside Search Console plus a spreadsheet will carry a small site for a long time. Paid tracking earns its price when you need scale, daily snapshots, competitor domains, SERP-feature history or AI-answer monitoring — things manual work cannot produce reliably.
How many keywords should I track?
Small sites usually stop at 20 to 50 commercial terms. Agencies and in-house teams running several campaigns typically need several hundred to a few thousand, which is exactly where plan limits start to matter: the entry professional tier covers 500 tracked keywords across five sites, and the top tier covers 5,000 across 40.
Can I track rankings without scraping Google?
Yes. Google Search Console’s official API reports your own queries, impressions and average position for free, licensed third-party data supplies competitor positions, and manual logged-out checks give you an honest sample. Scraping search result pages is both brittle, because bot detection adapts, and contrary to the terms of service that govern those pages.
Is AI-answer tracking worth paying for?
It is worth watching, and it is worth paying for only if AI citations affect your revenue. Manual monthly checks of 10 to 20 prompts reveal whether you are cited at all; paid monitoring adds scale and competitor comparison, with some platforms reporting coverage across hundreds of millions of prompts. Treat the results as a trend sample rather than a precise metric.
Then decide how much of the work to buy back. If your tracking is already limited by keyword caps, missing history or unmeasured AI visibility, the platform we reviewed is worth understanding before you subscribe — we went through its databases, every plan tier and its keyword, site and prompt limits in our full Semrush review. If your need is smaller, the free tier and a disciplined spreadsheet will carry you further than most people expect.
Disclosure: this article contains an affiliate link. If you subscribe through it, we may earn a commission at no additional cost to you. It does not influence what we recommend, and all pricing and plan limits above were taken from the vendors’ published information.
⭐ READ OUR FULL REVIEWFeatures, pricing and our honest verdict →
Read next
Travel Hacks Guide Editorial Standards & Testing Methodology
At Travel Hacks Guide, we independently evaluate car rentals, international eSIMs, flight booking engines, and travel insurance. We never accept payment for ranking or recommendations. When you book via links on our site, we may earn an affiliate commission at no extra cost to you.