How to vet any stock-alert service: the 7 checks most services fail

Most stock-alert services show you a wall of winning trades and ask you to trust it. Here are seven checks that separate a service telling the truth from one selling you a screenshot — every one you can apply yourself, for free, before you pay a cent.

Independent trackers who follow signal services in real time keep finding the same pattern: the advertised win rate is materially higher than the tracked one — in documented cases by 10 to 20 percentage points. That gap is the whole game, and none of the checks below require you to trust anyone to see it.

Why the wall of green screenshots means nothing

A screenshot proves one thing: that a trade once looked good on someone's screen. It doesn't prove the trade was taken, held, exited where they say, or that the ten losers around it were shown to you. Three tricks do almost all the damage:

Survivorship. Post the winners, quietly delete the losers. The record looks 90% accurate because the other 90% was never published.

Hindsight (look-ahead) rules. "Our system would have caught this" is a claim made after the move happened. A rule invented to fit past winners always looks brilliant on the data it was built from and falls apart on anything new.

Un-realizable fills. "Sold at +40%" — at a price that printed for two seconds on a stock you couldn't actually get filled on. The advertised return and the return you'd have banked are different numbers.

Regulators have noticed. A December 2025 SEC exam alert flagged cherry-picked and misleading performance among the most common deficiencies it finds, and FINRA has issued six-figure fines over misleading influencer promotion. But enforcement moves slowly and mostly touches registered firms — so for now, protecting yourself comes down to knowing what to look for.

The 7 checks

1 · Were the picks published before the outcome was known?

The one that matters most. A real record timestamps every call before the market can prove it right or wrong. If the "record" is a summary posted after the fact, it's marketing, not evidence. Look for a public, dated log you can scroll back through — not a highlights reel.

✓ Green flag: every pick has a timestamp earlier than its result.

✕ Red flag: results described in the past tense with no pre-dated entry.

2 · Are the losers shown right next to the winners?

An honest service publishes the full distribution — every pick, graded, winners and losers alike. If you can only find wins, you're not looking at a track record; you're looking at the survivors.

✓ Green flag: a complete log where the worst calls sit next to the best.

✕ Red flag: "featured trades," testimonials, and no way to see the ones that failed.

3 · Is a "win" defined as a return you could actually get?

Ask how a win is scored. The honest definition is a realizable result: enter at a price you could actually get (the next open, not the pre-market spike), exit at a real price, and subtract trading costs and slippage. The dishonest definition is "the stock touched +20% at some point" — which you could almost never have captured.

✓ Green flag: wins are open-to-close or exit-rule based, net of costs.

✕ Red flag: wins are "ever touched +X%" — an untradeable high-water mark.

4 · Were the rules fixed in advance — or fitted to the past?

Any strategy can be made to look perfect on the data it was designed against. The only honest test is out-of-sample: register the rule with a date, then judge it only on picks that came after. If a service can't tell you when a rule was frozen, assume it was reverse-engineered from its own winners.

✓ Green flag: rules are dated and scored only on later picks.

✕ Red flag: "backtested" results with no forward, out-of-sample record.

5 · Is there enough of a sample to mean anything?

Ten winning trades prove nothing — a coin can flip heads ten times. You want a record with a real number of picks behind it — our own rule of thumb is at least a couple hundred graded picks (n > 200) — before you trust a win rate or an average return.

✓ Green flag: a track record with hundreds of graded picks.

✕ Red flag: a dazzling percentage built on a dozen trades.

6 · Is the record immutable — or could it be quietly edited?

Ask: could they delete an embarrassing pick tomorrow? If the log lives somewhere they fully control and can rewrite, the past is negotiable. The strongest form is an append-only log — new picks can be added, but nothing already logged can be changed or removed.

✓ Green flag: an append-only, never-edited log; grading done by an automated job, not by hand. Strongest form: a published hash chain, so any edit to history is provable by a stranger — not just promised.

✕ Red flag: a curated page that can be reshaped at will.

7 · Can a total stranger verify it without trusting anyone?

The final test wraps up the other six: could someone who has never heard of this service, and has no reason to believe it, confirm every claim from public data? If verification requires taking their word for anything, it isn't verification.

✓ Green flag: raw data published; numbers re-derivable by anyone.

✕ Red flag: "trust our verified results" with nothing to check.

And one that catches the honest ones too. Not every bad number is dishonest — some are a data bug nobody noticed. The most common one silently rewrites price history whenever a company splits, and in cheap stocks it always makes results look better. We found it in our own code after it had been inflating our numbers for weeks. If a service shows you a backtest, this is worth understanding before you judge it: the bug that makes your backtest look good →

The 60-second version

  1. Picks timestamped before the result?
  2. Losers shown next to winners?
  3. "Win" = a return you could actually get, net of costs?
  4. Rules frozen with a date and judged only on later picks?
  5. Hundreds of picks, not a dozen?
  6. Log is append-only and machine-graded?
  7. A stranger could verify it all from public data?

Seven yeses: rare, and worth your attention. Any hard no on #1, #2, or #7: keep your money.

Why we wrote this — and where we stand on it

We run ThePickLog, a research project built around one uncomfortable rule: every pick is logged before the open and graded automatically five trading days later — winners and losers alike — in a log we can't edit. We hold ourselves to all seven checks above, publicly, including the ones that make us look bad. We also publish our own failures of that discipline: in August 2026 we found our scanner had logged 128 picks after the opening bell and wrote up the correction. Our own honest answer right now is that bought-and-held, the picks as a group have lost money — and we publish that, because a record you can only trust when it's flattering isn't a record at all.

We think the whole category should be held to this standard, so we wrote it down as an open one. If you run an alert service and you're one of the honest ones tired of being lumped in with the screenshot factories, the standard is here — the same yardstick we grade ourselves against.

Either way: run the seven checks on us too. That's the point.

Read the Verified-by-ThePickLog standard → See our public record →

Educational / informational only. Not investment advice, not a recommendation to buy or sell any security. Low-priced and low-float stocks are highly volatile and carry a substantial risk of loss. Past performance does not predict future results.
About · Trust & Data · Method · Disclaimer · Privacy
Build 2026-08-04 01:43 ET · fa46a8a