Use SimilarWeb Traffic & AI Chatbot Analytics Scraper with Python
Look up website traffic estimates, rankings, traffic-source breakdown, top keywords, and AI-chatbot traffic share for any list of domains, with no login or API key needed.
1. Choose the data you need
Review the published README for supported collection modes, examples, and limits. The recipe below uses the current published input definition.
2. Prepare a source-based input
This JSON contains published prefills and required-field defaults. Review every value for your task before running it; it is not a promise of successful collection.
{
"category": "all",
"country": "worldwide",
"domains": [
"google.com"
],
"includePrompts": false,
"includeRankChange": true,
"includeSimilarSites": false,
"maxItems": 1,
"mode": "aiTraffic"
}
Download input.example.json and save your reviewed copy as input.json.
| Field | Type | Required | Description |
|---|---|---|---|
mode | string | optional | What to fetch. Full report combines deep website analytics with AI chatbot traffic for each domain. |
domains | array | optional | Domains or URLs to analyze. Accepts bare domains, full URLs and www hosts; duplicates and invalid entries are skipped. |
maxItems | integer | optional | Maximum domains or rows to process. Deep reports are capped at 1,000; top-website lists at 50 (5 for a country plus category). |
includePrompts | boolean | optional | Add SimilarWeb's three example AI prompts when a domain has AI chatbot traffic. |
includeSimilarSites | boolean | optional | Add the 20 similar sites to each full report. Costs one extra request per domain. |
category | string | optional | Category for topWebsites mode. Pick all categories or a SimilarWeb category or subcategory. |
country | string | optional | Country for topWebsites mode. Pick worldwide or one of SimilarWeb's ranked countries. |
includeRankChange | boolean | optional | Include rank movement and new-entry fields in topWebsites and trending results. |
3. Start an Actor run
Set APIFY_TOKEN in your environment. Python 3.10 or newer is sufficient; this recipe uses no third-party packages.
Execution may incur charges. Review current pricing on Apify. The request asks for a 120-second timeout and a charge limit; these settings are subject to Apify’s pricing and do not guarantee an all-inclusive spending cap.
import json
import os
import urllib.request
# Save the schema-derived example as input.json; review and edit it first.
with open("input.json", encoding="utf-8") as stream:
actor_input = json.load(stream)
token = os.environ["APIFY_TOKEN"]
request = urllib.request.Request(
"https://api.apify.com/v2/acts/CA9G7LcHX1KciQGeC/runs?timeout=120&maxTotalChargeUsd=0.50",
data=json.dumps(actor_input).encode("utf-8"),
headers={"Authorization": "Bearer " + token, "Content-Type": "application/json"},
method="POST",
)
# This starts a potentially billable run. Do not automatically retry this POST.
with urllib.request.urlopen(request, timeout=40) as response:
run = json.load(response)["data"]
print("Run ID:", run["id"])
print("Status:", run["status"])
# Inspect and download results in Apify Console once the run succeeds.
4. Inspect the actual results
Open the run in Apify Console and wait for a successful completion. Use the published output schema to locate results and the dataset schema to understand declared views. Missing or optional record fields must not be treated as guaranteed values.
Per-domain website traffic, rankings, audience, competitors and AI-chatbot referral data, plus similar-site, top-website and trending rows.
Questions before you run
Which inputs are required?
No top-level fields are marked required in the published schema. Conditional requirements can still apply; check the README.
What does this guide verify?
The fields, prefills, and schema links are rendered from the published build. This is a usage recipe, not a paid live extraction test. Source availability and collection results can vary.
What if the run request times out?
Check Apify Console before retrying. The first request may already have created a run. Do not automatically repeat a run-creation POST.
Generated from source build tMWJpULmMAGrijTIJ and its README and schemas. Source changes regenerate this guide; no third-party editorial claims are inferred.