Twitter (X) Comments Scraper
Collect public replies from Twitter post URLs with the source post, reply author, content, timestamps, media links, and engagement details.
Übersicht
Twitter (X) Comments Scraper turns known public post URLs into structured reply records that are ready to review, filter, and compare. Each record connects one reply to its source post and preserves the post and reply links, authors, text, publication times, media links, visible engagement counts, deletion indicator, and any collection message.
This dataset helps teams move beyond a post-level engagement total and inspect the conversation underneath it. Because each reply stays linked to the source post and the replying account, the results can support qualitative conversation review, visible-audience research, response-pattern analysis, and evidence gathering around a defined set of posts.
Data notes
Records come from publicly accessible Twitter conversations and reflect what the collector could see when the run took place. Each record represents one collected reply to one submitted source post, and the reply URL is used to remove duplicate records across retrieved result pages. Post and reply timestamps retain the source's displayed UTC offset. Like, retweet, reply, bookmark, and view counts are snapshots reported at collection time and can change afterward; they are preserved as reported text rather than recalculated values. Multiple source-post image addresses may be joined with vertical bars, while an empty reply-image value means no image was reported for that reply. Private, restricted, deleted, and sign-in-only content may not be available.
What the results look like
Each record is one collected public reply linked to its source post:
| Reply author name | Reply content | Reply timestamp | Reply URL | Reply likes | Reply views |
|---|---|---|---|---|---|
| ALT_uscis | @smutoro @Meta @instagram @facebook The COVID era was THE TRUMP ERA YOU MORON | Tue Aug 27 13:49:59 +0000 2024 | https://x.com/ALT_uscis/status/1828429756108296452 | 13 | 713 |
| ExampleResponder | A short public response to the source post. | Tue Aug 27 14:02:10 +0000 2024 | https://x.com/ExampleResponder/status/1828432800000000000 | 4 | 128 |
The output also includes “Source post URL,” “Source post ID,” “Post author name,” “Post author URL,” “Post timestamp,” “Post content,” “Post image URLs,” “Post likes,” “Post retweets,” “Post replies,” “Post bookmarks,” “Reply author URL,” “Reply image URL,” “Reply retweets,” “Nested replies,” “Deletion indicator,” and “Collection message.”
Use cases
- For conversation analysis, group records by “Source post URL” and review “Reply content” to identify recurring questions, objections, claims, and themes beneath each post.
- For visible-audience research, compare “Reply author name” and “Reply author URL,” then use “Reply URL” to inspect the original public context.
- For reply-engagement comparisons, evaluate “Reply likes,” “Reply retweets,” “Nested replies,” and “Reply views” together to identify which collected responses drew more visible interaction.
- For post-to-reply context review, compare “Post content” with “Reply content” and their respective timestamps to preserve the relationship between a statement and the responses it received.
Anwendungsbereich & Grenzen
Each run accepts 1 to 100,000 public Twitter post URLs and can request up to 100,000 replies per post; retrieval is capped at 10,000 returned records per run.
- Geeignet für
- Use it when you need reply-level records for one or more known public Twitter posts.
- Use it for conversation analysis, respondent discovery, reply engagement comparisons, or evidence collection around specific posts.
- Nicht verwenden für
- Do not use it to discover posts by keyword or hashtag because it starts from known post URLs.
- Do not use it for private, deleted, restricted, or sign-in-only conversations because only content visible to the collector is covered.
Fehlerbehandlung
Vom Entwickler deklariertes Fehler- und Wiederholungsverhalten. Wir empfehlen, es bei der Integration in Ihren System-Prompt aufzunehmen.
- 1If a run stops before completion, retry the same small input once; if it stops again, use fewer post URLs or request fewer replies.
- 2An empty result can mean the post has no visible replies, the URL is unavailable, or access was temporarily limited; verify the post URL and retry later.
Eingabe
Parameter, die zum Aufruf dieser App erforderlich sind, generiert aus dem input.schema in der manifest.json.
- Twitter post URLs
tweet_urlsErforderlicharray<string>Public Twitter or X post URLs whose replies should be collected. Enter 1 to 100,000 URLs per run.Anzahlbis zu 100000 EinträgeBeispiel["https://x.com/smutoro/status/1828297507484438722"] - Replies per post
reply_limitOptionalintegerMaximum number of replies to request for each post, from 1 to 100,000. When omitted, the collector decides the limit; set it explicitly when a predictable depth is important.Bereich1–100000
Ausgabe
Feldstruktur eines einzelnen Datensatzes, generiert aus dem output.schema in der manifest.json.
- Source post URL
tweet_urlstringDirect address of the source Twitter post.Beispielhttps://x.com/smutoro/status/1828297507484438722 - Source post ID
tweet_idstringIdentifier of the source Twitter post.Beispiel1828297507484438722 - Post author name
tweet_author_namestringDisplay name of the account that published the source post.BeispielStephen Mutoro - Post author URL
tweet_author_profile_urlstringDirect address of the source post author's profile.Beispielhttps://x.com/smutoro
Beispieldaten
Aus output.schema erzeugt. Felder ohne Beispielwert verwenden strukturelle Platzhalter.
{
"tweet_url": "https://x.com/smutoro/status/1828297507484438722",
"tweet_id": "1828297507484438722",
"tweet_author_name": "Stephen Mutoro",
"tweet_author_profile_url": "https://x.com/smutoro",
"tweet_posted_at_utc": "Tue Aug 27 05:04:28 +0000 2024",
"tweet_content": "The @Meta, @instagram and @facebook owner Mark Zuckerberg says he regrets working with the Biden-Harris administration to censure information online during the #Covid19 era https://t.co/G8nKVLDDPG",
"tweet_image_urls": "https://pbs.twimg.com/ext_tw_video_thumb/1828297475221774336/pu/img/dMCF64ISghcByCeH.jpg|https://pbs.twimg.com/media/GV9q30sWwAAU7cU.jpg|https://pbs.twimg.com/media/GV9q3xVXAAEzT4Y.jpg",
"tweet_likes": "212",
"tweet_retweets": "93",
"tweet_replies": "52",
"tweet_bookmarks": "89",
"comment_url": "https://x.com/ALT_uscis/status/1828429756108296452",
"comment_author_name": "ALT_uscis",
"comment_author_profile_url": "https://x.com/ALT_uscis",
"comment_timestamp": "Tue Aug 27 13:49:59 +0000 2024",
"comment_content": "@smutoro @Meta @instagram @facebook The COVID era was THE TRUMP ERA YOU MORON",
"comment_image_url": "",
"comment_likes": "13",
"comment_retweets": "0",
"comment_replies": "2",
"comment_views": "713",
"is_deleted": "False",
"error_message": ""
}Integration
Diese App kann über MCP, API, SDK oder Dateiexport integriert werden — alle Kanäle teilen sich dieselben Fähigkeiten und Preise. Jede Anfrage authentifiziert sich über den Authorization: Bearer-Header mit einem API Key (langlebig, in der Data Hub Konsole erstellt); MCP-Clients können sich zusätzlich per OAuth ohne Key anmelden. Weitere Optionen wie CLI und Skill sind in Vorbereitung. Diese App läuft asynchron und kann zwischendurch abgebrochen werden: Nach dem Abbruch stoppt der Lauf. Bereits gelieferte Datensätze bleiben erhalten und werden abgerechnet.
Über das MCP (Model Context Protocol) können Sie diese App direkt aus KI-Clients wie Claude und Cursor aufrufen. Wählen Sie Ihren Client und den Authentifizierungsmodus und kopieren Sie dann die Konfiguration unten.
Client-Konfiguration
Ersetzen Sie den Wert nach Bearer durch Ihren langlebigen API Key. Funktioniert in jedem Client, in CI und in Headless-Umgebungen.
{
"mcpServers": {
"octoparse_datahub": {
"type": "http",
"url": "https://mcp-v2.octoparse.com?pin=YiJacobJohnRaku/tweets-comments-scraper-by-search-result-url",
"headers": { "Authorization": "Bearer <YOUR_API_KEY>" }
}
}
}Lassen Sie die KI die Einrichtung übernehmen
Sie möchten Konfigurationen nicht von Hand bearbeiten? Kopieren Sie den Installations-Prompt und fügen Sie ihn in einen beliebigen KI-Client ein — er schließt die Einrichtung auf seine eigene Weise ab. (Der Prompt weist die KI an, Ihren API Key bei Ihnen zu erfragen, damit Zugangsdaten nie im Chatverlauf oder in geteilten Konfigurationen landen.)
detail.access.mcp.composeHint
Preise
Berechnet nach der Anzahl der erfolgreich zurückgegebenen Datensätze. Fehlgeschlagene Läufe werden nicht berechnet.
Mehrere Abrechnungsereignisse werden unabhängig voneinander kumuliert. Details siehe jeweilige Position. Fehlgeschlagene Läufe werden nicht berechnet.
Credits ansehenJetzt ausprobieren
Füllen Sie die Parameter aus und starten Sie — die Ergebnisse stammen aus einem echten Aufruf.