Skip to content
Back to optimize-for-genai

Traditional link building focuses on accumulating inbound links to improve domain authority. That approach still matters for traditional SEO. But for generative engine optimization, the question is not how many links you have — it is where your domain sits in the web’s link graph relative to everything else.

This is the concept of web graph topology, and it directly determines how much of your content ends up in AI training data.

Why Topology Matters More Than Volume

Common Crawl — the primary data pipeline feeding LLM training — uses Harmonic Centrality to decide which domains to crawl most frequently. Harmonic Centrality measures how close your domain is to all other domains in the web graph, weighted by inverse distance. It is fundamentally a topological metric — it rewards domains that are well-connected across the graph, not just domains with many incoming links.

Consider the difference: a domain with 10,000 backlinks from small, isolated blogs has a very different graph position than a domain with 200 links from Reddit, GitHub, Wikipedia-adjacent sources, and major industry publications. The second domain is reachable from more of the web in fewer hops. Common Crawl visits it more frequently, archives more of its pages, and LLMs train on more of its content.

PageRank can be inflated by creating interconnected pages that point to a target. Harmonic Centrality resists this because it measures your position in the entire web graph, not just your immediate link neighborhood. As Common Crawl’s documentation notes, Harmonic Centrality is “better for reducing spam, because it is harder to game or exploit through artificial link patterns.”

The Network Hub Strategy

To improve your web graph topology, focus on earning links from domains that function as network hubs — sites that are deeply embedded in the web’s structure and reachable from nearly everywhere.

Tier 1: Infrastructure-Level Hubs

These are the most structurally connected domains on the web. Getting a presence here — even a single mention — creates a high-value graph edge.

  • Reddit — One of the lowest Harmonic Centrality ranks. Active participation in relevant subreddits (r/SEO, r/SaaS, r/startups, industry-specific communities) creates organic links. Reddit’s community rules penalize spam, so contribute genuine value.
  • GitHub — Contribute to open-source projects, publish useful repositories, or engage in discussions. GitHub’s deep structural connectivity means a link from there shortens your path to thousands of other well-connected domains.
  • Wikipedia — Ranked 14th in Harmonic Centrality. Direct inclusion is difficult, but being cited by sources that Wikipedia references is achievable and creates indirect topological benefits.

Tier 2: High-Authority Verticals

  • SaaS directories — Product Hunt, G2, and Capterra have strong web graph positions because they are embedded in technology and business ecosystems.
  • Industry publications — Search Engine Journal, Moz, TechCrunch, and vertical-specific outlets are well-connected hubs in their domains.
  • Professional platforms — LinkedIn articles, Medium, and Substack each create web graph nodes that link back to your primary domain.

Tier 3: Content Syndication Nodes

Publishing across multiple platforms does not just increase audience reach — it creates additional nodes in the web graph that all point to you. Each syndication platform (Dev.to, Medium, LinkedIn, Substack) acts as a separate graph node, shortening the average path between your domain and the rest of the web. This is why syndication strategies matter for training data visibility, not just content distribution.

Avoiding Common Topology Mistakes

Several practices that work for traditional SEO can actually harm or waste effort from a topology perspective.

Guest posts on low-connectivity sites. A guest post on a small blog with few inbound links of its own adds a graph edge that barely moves your structural position. The same effort spent earning a mention on a Tier 1 or Tier 2 hub produces dramatically better topological results.

Ignoring crawl accessibility. The most common and most damaging mistake is blocking CCBot through robots.txt or CDN defaults. If Common Crawl cannot reach your site, your domain does not appear in the web graph at all. No amount of link building can compensate for a domain that is invisible to the crawler. Verify access through server logs, and check Cloudflare’s bot management settings if you use their CDN.

Measuring Your Topology

You can track your web graph position using freely available tools. The Common Crawl Web Graph Statistics page provides interactive charts and domain lookups for the top 1,000 domains. For domains ranked beyond 1,000, the CC Rank Checker allows you to check any domain’s Harmonic Centrality and PageRank across 607 million domains, view rank history across five time periods from 2023 to 2025, and compare up to 10 domains simultaneously.

Monitor your rank over time. A rising Harmonic Centrality rank (meaning your score is dropping relative to others) may indicate you are losing structural connectivity — perhaps because a linking hub removed your mention or a syndication platform changed its linking policy. A falling rank (improving position) confirms your topology-building efforts are working.

Platforms like PhantomRank track the retrieval layer — whether AI search engines are actually citing your brand in real-time responses. Combining retrieval-layer tracking with web graph topology monitoring gives you visibility into both layers of AI visibility: the one that responds in days and the one that compounds over months.

For the full picture of how these layers interact, see the two layers of AI visibility. For the broader discipline, explore our complete guide to generative engine optimization.