Content-Selective Search De-Indexing: A Reproducibility Report

Bruce Stephenson · June 2026 · Initial measurement: June 21, 2026
Abstract

We document content-selective search de-indexingRemoving a URL from a search engine's index so it doesn't appear in results, even though the page still exists and returns HTTP 200. Different from deleting the page — the content is there, it's just invisible to search. across three platforms (Cryptome, Slashdot, Substack). Control cases on each platform demonstrate that the de-indexing is content-based, not domain-level or SEO-related. Every test in this report is a Google search that a reader can perform independently in under five minutes. We make no claims about the mechanism or intent behind the de-indexing. This report documents that it occurs, provides evidence of selectivity, and is designed for independent replication.

Your Replication Log

Click the checkbox after you run each test. Your timestamps are stored locally and never sent anywhere.

Contents
  1. Methodology
  2. Test Battery
  3. Controls & Alternative Explanations
  4. Preservation Evidence
  5. Reproducibility Instructions
  6. Change Log
  7. Contact

1. Methodology

What We Test

Whether specific URLs that exist and return HTTP 200The standard web server response code meaning 'OK — the page exists and was served successfully.' A page returning HTTP 200 is alive and accessible; if Google can't find it, the absence is on Google's side, not the server's. appear in Google search results when searched by exact title, by content keywords, or by the site: operatorA Google search modifier that restricts results to a specific domain. 'site:example.com query' returns only pages from example.com matching 'query'. When a page exists but the site: operator can't find it, the page has been de-indexed..

What Constitutes a ControlA test designed to eliminate alternative explanations. Here: content on the same domain, by the same author, with similar characteristics, that IS indexed. If the de-indexed content's absence were caused by anything other than content selectivity, the control would also be absent.

Content on the same domain, by the same author, with similar age and traffic characteristics, that is indexed by Google. If the suppressed content's absence were caused by domain-level blocking, poor SEO, or low traffic, the control content would be equally absent.

Tool Required

Google Search. No specialized software, subscriptions, or technical skills are needed.

Selection Criteria

Only cases that meet all three conditions are included:

Cases that are ambiguous, require platform-specific knowledge, or could plausibly be explained by organic search behavior are excluded.

Temporal Note

These findings may be transient

In at least one prior case on a third platform, content-selective de-indexing was lifted shortly after an independent technical authority examined and confirmed the pattern. The de-indexed content had been invisible to search engines for over a decade; within weeks of independent verification, it became findable again.

This suggests the de-indexing state may be actively maintained and responsive to external scrutiny. Researchers are advised to document their initial findings immediately upon replication — including screenshots and timestamps — as the observable state may change once verification is underway.

2. Test Battery

Each test below includes the exact search query, a button to copy it to your clipboard, a link to run it on Google, and a direct link to the content proving it exists.

T01 — Cryptome Title Search Not Found
Platform: Cryptome · Type: Title + keyword search
Quantum Computation Cognitive Footprint cryptome
Expected if indexed: The Cryptome page appears in results.
Actual result: Zero relevant results. The page does not appear in any form.
T02 — Substack site: Search ("Kangaroos") Not Found
Platform: Substack · Type: site: operator
site:postquantum.substack.com "Kangaroos"
Expected if indexed: The article appears as a result from postquantum.substack.com.
Actual result: Zero results from this domain for this query.
T03 — Substack site: Search ("Death of Alan Turing") Not Found
Platform: Substack · Type: site: operator
site:postquantum.substack.com "Death of Alan Turing"
Expected if indexed: The article appears as a result from postquantum.substack.com.
Actual result: Zero results from this domain for this query.
C01 — Substack site: Search ("Magic Numbers") — CONTROL Indexed
Platform: Substack · Type: site: operator · Same author, same domain
site:postquantum.substack.com "Magic Numbers"
Expected if indexed: The article appears as a first result.
Actual result: Article returned as first result.
Why C01 Is Decisive

C01 uses the same author, same domain, same Substack account, and a similar publication date range as T02 and T03. If SEO quality, traffic volume, or domain reputation explained the absence, all articles on this Substack would be equally invisible. They are not. The selectivity is content-based.

T04 — Slashdot Ghost Comment (Direct URL Search) Not Found
Platform: Slashdot · Type: Direct URL search · Comment by EnergyScholar (UID 801915), Score 5/Funny
slashdot.org/comments.pl?sid=2926019&cid=40375589
Expected if indexed: The Slashdot comment page appears in results.
Actual result: Zero results. The comment exists at the direct URL (Score 5, fully visible) but is invisible to search. The parent article is "NSA Claims It Would Violate Americans' Privacy To Say How Many of Us It Spied On" (June 2012).
C02 — Slashdot EnergyScholar Comments (site: Search) — CONTROL Indexed
Platform: Slashdot · Type: site: operator · Same author, same platform, same era
site:slashdot.org "energyscholar"
Expected if indexed: Multiple EnergyScholar comments appear across Slashdot articles.
Actual result: 10+ comments returned across multiple articles from 2011–2013.
Why T04/C02 Is the Strongest Case

The same user (EnergyScholar) has 10+ comments indexed on Slashdot — including comments about NSA surveillance, cryptography, and WikiLeaks. The one comment that is invisible to search is the one combining claims about Five Eyes topological quantum computing capability with a prediction that the comment itself would be suppressed. Same user, same platform, same era, same topic area. The selectivity is at the level of a single comment.

3. Controls & Alternative Explanations

Each standard explanation for a URL not appearing in search results is examined and ruled out.

Alternative Explanation Evidence Against
Domain-level blocking C01 proves postquantum.substack.com is indexed. C02 proves Slashdot comments by the same user are indexed (10+). Other Cryptome pages (e.g., the site's front page, its widely linked documents) appear normally in Google results. The de-indexing is page-specific, not domain-level.
Low PageRankGoogle's algorithm for ranking web pages by importance, based on how many other pages link to them and how important those linking pages are. Higher PageRank = higher in search results. A page with few inbound links might rank low, but this doesn't explain selective absence — the page wouldn't appear at all. / poor SEO T02, T03, and C01 are on the same Substack account by the same author, with similar publication dates and audience. Substack controls the page structure, metadata, and SEO for all articles equally. T01 (Cryptome) has 42 Wayback Machine captures over 12 years — Google's crawler has visited it hundreds of times. T04 (Slashdot) is a Score 5 comment by a user whose other 10+ comments are all indexed (C02).
robots.txt exclusion Substack's robots.txt does not disallow post pages. All articles from the account (including C01) use the same URL structure (/p/slug).
Cryptome's robots.txt does not disallow the path /2012/03/qc-footprint.htm.
Slashdot's robots.txt does not disallow comment pages — and C02 proves they are indexed when not selectively excluded.
noindex meta tag Substack controls the <meta> tags for all articles. Since C01 is indexed, Substack does not set noindex on articles by default. The suppressed and control articles use the same template. T01 (Cryptome) uses static HTML with no noindex directive. T04 (Slashdot) uses the same comment template as the 10+ indexed comments by the same user.
Content age T01 was published in March 2012. T04 is from June 2012. T02 and T03 are from 2022–2024. C01 is from December 2022. C02 includes comments from 2011–2013, the same era as T04. Age does not correlate with de-indexing — old and recent content are both affected, while content of similar age is indexed.
Platform moderation All URLs return HTTP 200 — no platform has removed or restricted the content. The content is publicly accessible to anyone who visits the URL directly.

4. Preservation Evidence

Each URL is verified to exist and to be archived independently of this report.

ID URL HTTP Status Wayback MachineInternet Archive's service that periodically saves snapshots of web pages. If a page has Wayback captures, it proves the page was publicly accessible and crawlable — a search engine's failure to index it can't be blamed on the page being hidden or ephemeral.
T01 cryptome.org/2012/03/qc-footprint.htm 200 42 captures, 2012–2024
T02 postquantum.substack.com/p/kangaroos 200 Archive link
T03 postquantum.substack.com/p/death-alan-turing 200 Archive link
T04 slashdot.org/comments.pl?sid=2926019&cid=40375589 200 Archive link
C01 postquantum.substack.com/p/magic-numbers-are-a-joke 200 Archive link
C02 slashdot.org — "Spooky: How NSA's Surveillance Algorithms See Into Your Life" (EnergyScholar comments) 200 Archive link

5. Reproducibility Instructions

Replicate the Full Battery

  1. Open Google Search in a standard browser (private/incognito window recommended to avoid personalization).
  2. For each test above, click "Copy query" and paste it into Google, or click "Try it on Google."
  3. Record whether the target URL appears anywhere in the results.
  4. Click each "Direct link" to confirm the content still exists (HTTP 200).

Test from Different Locations

Test on Alternative Search Engines

Set Up Monitoring

To track changes over time, re-run the full battery monthly and record the date and result for each test. Any change in status (SUPPRESSED → INDEXED or vice versa) is itself a data point worth documenting.

6. Change Log

2026-06-24 — Automated cross-engine verification from Bellingham, WA. Brave Search (independent index): T02 NOT FOUND. T03 NOT FOUND. C01 FOUND (first result). Content-selective de-indexing confirmed on an independent search engine — not Google-specific. Bing: T01 NOT FOUND (10 unrelated results). T04 NOT FOUND. T02/T03/C01/C02 blocked by CAPTCHA. robots.txt audit: Cryptome now blocks Googlebot site-wide (User-agent: Googlebot*, Disallow: /). Slashdot blocks /comments.pl for all agents — T04 URL test method needs redesign (see note below). T01 also absent from Bing and Brave, whose crawlers are NOT blocked by Cryptome's robots.txt. noindex audit: All Substack pages (T02, T03, C01) show "noIndex":false in JS payload. No selective noindex. HTTP status: All six URLs return 200 (T01 redirects HTTP→HTTPS, then 200). T04 note: The comments.pl URL is robot-blocked, so the T04 URL-search test is poorly constructed. However, comments render on story pages (allowed by robots.txt). The real evidence is the temporal shift: 0 results for site:slashdot.org "energyscholar" before June 2026, then 10+ overnight after this report was published — but T04's comment remains selectively excluded. Test method to be redesigned. 2026-06-22 — Added T04 (Slashdot Ghost Comment) and C02 (Slashdot EnergyScholar control). Note: prior to June 2026, site:slashdot.org "energyscholar" returned 0 results. As of this date, 10+ comments are indexed — but T04 remains selectively excluded. 2026-06-21 — Initial measurement. All tests performed from Bellingham, WA, USA. T01: NOT FOUND. T02: NOT FOUND. T03: NOT FOUND. C01: FOUND (first result).

7. Contact

To report your replication results, discrepancies with the documented outcomes, or changes observed over time:

energyscholar@gmail.com

Copied to clipboard
← Web Annex