API

Similar sites and the technology stack of an indexed domain, as JSON.

GET https://beta.similarsitesearch.com/api/similar/stripe.com?limit=10

limit is 1–50 (default 10). Domains we haven’t indexed return 404; open /site/<domain> once to crawl them. In this prototype the API is open; a paid plan would add keys, higher limits, bulk lookups and alerts for new competitors.

{
  "domain": "stripe.com",
  "title": "Stripe | Financial Infrastructure to Grow Your Revenue",
  "rank": 120,
  "technologies": [
    { "slug": "nextjs", "name": "Next.js", "category": "JavaScript frameworks" },
    { "slug": "google-workspace", "name": "Google Workspace", "category": "Email hosting" }
  ],
  "similar": [
    { "domain": "paypal.com", "title": "…", "similarity": 0.912, "rank": 85 }
  ]
}

Our crawler

It identifies itself as SimilarSiteSearchBot and reads robots.txt first; a site that disallows it for / isn’t fetched.
It fetches only a site’s homepage and favicon, once per lookup, and at most once every 30 days for a lookup by a visitor.
It also reads public DNS records (MX, NS, TXT) for the domain.
It never connects to private or internal addresses.