Skip to content

How it works

Retrieved, verified, then quoted. Never written.

Plumbline is a search engine over the text of occupational health and safety law. The useful thing to understand about it is not the search — it is what the system is structurally unable to do.

01

Your words are bridged to the drafter's words

Legislation is a controlled vocabulary, and nobody asks a question using it. “How high before I tie off” shares no words at all with “fall protection system”. So a question is expanded through a table of trade-to-statute bridges before it is matched — tie off reaches fall protection, anchorage and fall arrest; swing stage reaches suspended work platform.

Your own words are weighted more heavily than the ones we infer for you, and the bridges that fired are listed under “why this ranked here” on every result.

02

Two independent searches, then a merge

Keyword matching (BM25) catches the exact statutory vocabulary, which matters because users often quote the law back at us. Meaning-based matching catches the far more common case where the words differ entirely.

The two are merged by reciprocal rank fusion rather than by adding their scores together, because those scores are not on comparable scales and normalising one against the other would invent a precision neither has. When both methods pick the same provision, that agreement raises the confidence figure — it is a stronger signal than either alone.

A section whose only job is to define a word is ranked down unless the question is itself definitional. Definitions match keyword-dense queries extremely well and are almost never what someone asking “what do I have to do” wants.

Meaning-based matching is currently unavailable on this deployment, so results come from keyword matching alone. Rather than hide that, every answer subtracts 8 points from its confidence and names it in the breakdown. Questions phrased in trade language are easier to miss this way.

03

A model may reorder the results. It may not write them.

This is the part worth being precise about. A language model is handed the provisions retrieval already found and asked to return them in a better order. Its response is parsed as section identifiers and relevance numbers.

  • Identifiers it returns that were not in the candidate set are discarded, so it cannot introduce a provision — and therefore cannot introduce text.
  • Candidates it leaves out are appended in their original order, so it cannot bury a provision either.
  • The response type has no field for a summary, an explanation or a recommendation. There is nowhere in the data structure for an interpretation to live.

A prompt is a request. The parser is the guarantee.

04

Every quotation is checked before you see it

Before an answer is returned, each quoted passage is matched against the section text stored at ingestion. The only tolerance is typographic — curly quotes, dash widths, non-breaking spaces. Capitalisation is not normalised, because legal drafting distinguishes a defined term from an ordinary word by its capital letter.

If any single passage fails, the entire answer is withheld rather than partly served. That is deliberate: if the tool got one passage wrong, its handling of the others is not something you should be asked to trust on the spot.

A quote that drops a “not”, softens “must” to “should”, changes a threshold, or splices two real fragments into one continuous passage all fail this check. Those cases are covered by tests that run on every build.

05

Ingestion refuses more often than it accepts

Documents are fetched from official consolidation services, parsed per source, and then checked back against the source text. A document is withheld from answers entirely if it falls below 99.5% fidelity, or if the parser found fewer sections than the document contains.

The second check matters more than it sounds. A parser that finds a third of a regulation at perfect fidelity is more dangerous than one that finds all of it imperfectly, because the sections it missed reach you as silence — and silence reads as “there is no such rule”.

34 documents are indexed and 7,191 sections are searchable. Coverage lists every one, including the documents currently held back and why.

Two claims that fail separately

Word for word

Claims: The text shown was checked against the official government consolidation and matches it.

Does not claim: It says nothing about whether this is the provision you need. Transcription and selection are different jobs that fail in different ways, and this badge only speaks to the first.

Current to

Claims: The date the official document states about itself, and the date we last confirmed the source still shows it.

Does not claim: This is a periodically rebuilt index, not a live feed. Currency is recorded per document rather than per jurisdiction, because a province will happily publish a brand-new Act alongside a regulation nobody has touched since 2008.

Selection is the harder failure, and the one a badge cannot help with. A perfectly transcribed section looks exactly as authoritative when it is the wrong section. That is what the confidence figure speaks to instead.

What the confidence figure is

How well your question matched the provision we returned.

Not a probability that you are compliant, and not a view on what the provision means. A high score on the wrong section is still the wrong section, which is why every score opens up into the factors behind it.

Every score opens into the factors that produced it, each with its signed contribution. Some are capped regardless of the arithmetic: a question bundling several requirements cannot read “High”, because one section’s match cannot certify a multi-part answer. On a multi-jurisdiction question the figure shown is the weakest jurisdiction’s, not the average — a confident result for Alberta must not mask a poor one for Nevada.

A reference, not an opinion

  • It will not tell you whether a requirement applies to your job.
  • It will not tell you whether what you built complies.
  • It will not recommend a method, a product, or a course of action.

Those are judgements about your situation, and a search engine is not entitled to make them. The provision is the authority; reading it is the work.

For a judgement, go to the regulator for your jurisdiction, or to a qualified safety professional or lawyer who can look at your actual site.

What it declines, in detail