All Post Comments

Convenience API to get all comments from a Reddit post including nested replies. This will take a long time if there are a lot of comments.

GET
/v1/reddit/post/all-comments

🤖 Why Code When AI Can Do It For You?

Stop writing code like it's 1970! Let AI do the heavy lifting - click the sparkles to copy a perfectly formatted prompt for ChatGPT, Claude, or your favorite AI assistant.

curl "https://api.scrapecreators.com/v1/reddit/post/all-comments" \
  -H "x-api-key: "
[
  {
    "body": "Puppeteer/playwright can pull that info from network tab from devtools",
    "ups": 2,
    "author": "alex3321xxx",
    "url": "https://www.reddit.com/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xz43g/",
    "subreddit_id": "t5_318ly",
    "approved_at_utc": null,
    "author_is_blocked": false,
    "comment_type": null,
    "awarders": [],
    "mod_reason_by": null,
    "banned_by": null,
    "author_flair_type": "text",
    "total_awards_received": 0,
    "subreddit": "webscraping",
    "author_flair_template_id": null,
    "likes": null,
    "replies": "",
    "user_reports": [],
    "saved": false,
    "id": "m8xz43g",
    "banned_at_utc": null,
    "mod_reason_title": null,
    "gilded": 0,
    "archived": false,
    "collapsed_reason_code": null,
    "no_follow": true,
    "can_mod_post": false,
    "created_utc": 1737739604,
    "send_replies": true,
    "parent_id": "t3_1i8z28z",
    "score": 2,
    "author_fullname": "t2_9xj2549p",
    "approved_by": null,
    "mod_note": null,
    "all_awardings": [],
    "collapsed": false,
    "edited": false,
    "top_awarded_type": null,
    "author_flair_css_class": null,
    "name": "t1_m8xz43g",
    "is_submitter": false,
    "downs": 0,
    "author_flair_richtext": [],
    "author_patreon_flair": false,
    "body_html": "<div class="md"><p>Puppeteer/playwright can pull that info from network tab from devtools</p>
</div>",
    "removal_reason": null,
    "collapsed_reason": null,
    "distinguished": null,
    "associated_award": null,
    "stickied": false,
    "author_premium": false,
    "can_gild": false,
    "gildings": {},
    "unrepliable_reason": null,
    "author_flair_text_color": null,
    "score_hidden": false,
    "permalink": "/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xz43g/",
    "subreddit_type": "public",
    "locked": false,
    "report_reasons": null,
    "created": 1737739604,
    "author_flair_text": null,
    "treatment_tags": [],
    "link_id": "t3_1i8z28z",
    "subreddit_name_prefixed": "r/webscraping",
    "controversiality": 0,
    "depth": 0,
    "author_flair_background_color": null,
    "collapsed_because_crowd_control": null,
    "mod_reports": [],
    "num_reports": null
  },
  {
    "body": "Are you trying to record traffic ? If so, just use Charles proxy or proxyman and record a session to find what you need.",
    "ups": 1,
    "author": "casual_review_guy",
    "url": "https://www.reddit.com/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xka8c/",
    "subreddit_id": "t5_318ly",
    "approved_at_utc": null,
    "author_is_blocked": false,
    "comment_type": null,
    "awarders": [],
    "mod_reason_by": null,
    "banned_by": null,
    "author_flair_type": "text",
    "total_awards_received": 0,
    "subreddit": "webscraping",
    "author_flair_template_id": null,
    "likes": null,
    "replies": "",
    "user_reports": [],
    "saved": false,
    "id": "m8xka8c",
    "banned_at_utc": null,
    "mod_reason_title": null,
    "gilded": 0,
    "archived": false,
    "collapsed_reason_code": null,
    "no_follow": true,
    "can_mod_post": false,
    "created_utc": 1737735520,
    "send_replies": true,
    "parent_id": "t3_1i8z28z",
    "score": 1,
    "author_fullname": "t2_1f43pyoah7",
    "approved_by": null,
    "mod_note": null,
    "all_awardings": [],
    "collapsed": false,
    "edited": false,
    "top_awarded_type": null,
    "author_flair_css_class": null,
    "name": "t1_m8xka8c",
    "is_submitter": false,
    "downs": 0,
    "author_flair_richtext": [],
    "author_patreon_flair": false,
    "body_html": "<div class="md"><p>Are you trying to record traffic ? If so, just use Charles proxy or proxyman and record a session to find what you need.</p>
</div>",
    "removal_reason": null,
    "collapsed_reason": null,
    "distinguished": null,
    "associated_award": null,
    "stickied": false,
    "author_premium": false,
    "can_gild": false,
    "gildings": {},
    "unrepliable_reason": null,
    "author_flair_text_color": null,
    "score_hidden": false,
    "permalink": "/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xka8c/",
    "subreddit_type": "public",
    "locked": false,
    "report_reasons": null,
    "created": 1737735520,
    "author_flair_text": null,
    "treatment_tags": [],
    "link_id": "t3_1i8z28z",
    "subreddit_name_prefixed": "r/webscraping",
    "controversiality": 0,
    "depth": 0,
    "author_flair_background_color": null,
    "collapsed_because_crowd_control": null,
    "mod_reports": [],
    "num_reports": null
  },
  {
    "body": "I don't think people will be able to give you precise help, given how broadly you have phrased your question.

* Are we talking about GET or POST requests?  
* What makes API call inconsistent?
  * The URL structure?
  * The response format?

My money is on the URL structure. If it's the URL: From which point onward does the URL become unpredictable? What's common about different calls? What parameters make the URL unpredictable?  
  
If there's wonky parameters included in the URL that you cannot predict (e.g. some odd ID or hash), see if you can derive them from another XHR's response.

If the hash is generated through client side (potentially obfuscated) JavaScript, then best of luck to you.",
    "ups": 1,
    "author": "Zambucafy",
    "url": "https://www.reddit.com/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xlqot/",
    "subreddit_id": "t5_318ly",
    "approved_at_utc": null,
    "author_is_blocked": false,
    "comment_type": null,
    "awarders": [],
    "mod_reason_by": null,
    "banned_by": null,
    "author_flair_type": "text",
    "total_awards_received": 0,
    "subreddit": "webscraping",
    "author_flair_template_id": null,
    "likes": null,
    "replies": "",
    "user_reports": [],
    "saved": false,
    "id": "m8xlqot",
    "banned_at_utc": null,
    "mod_reason_title": null,
    "gilded": 0,
    "archived": false,
    "collapsed_reason_code": null,
    "no_follow": true,
    "can_mod_post": false,
    "created_utc": 1737735916,
    "send_replies": true,
    "parent_id": "t3_1i8z28z",
    "score": 1,
    "author_fullname": "t2_b5gxz",
    "approved_by": null,
    "mod_note": null,
    "all_awardings": [],
    "collapsed": false,
    "edited": false,
    "top_awarded_type": null,
    "author_flair_css_class": null,
    "name": "t1_m8xlqot",
    "is_submitter": false,
    "downs": 0,
    "author_flair_richtext": [],
    "author_patreon_flair": false,
    "body_html": "<div class="md"><p>I don't think people will be able to give you precise help, given how broadly you have phrased your question.</p>

<ul>
<li>Are we talking about GET or POST requests?<br/></li>
<li>What makes API call inconsistent?

<ul>
<li>The URL structure?</li>
<li>The response format?</li>
</ul></li>
</ul>

<p>My money is on the URL structure. If it's the URL: From which point onward does the URL become unpredictable? What's common about different calls? What parameters make the URL unpredictable?  </p>

<p>If there's wonky parameters included in the URL that you cannot predict (e.g. some odd ID or hash), see if you can derive them from another XHR's response.</p>

<p>If the hash is generated through client side (potentially obfuscated) JavaScript, then best of luck to you.</p>
</div>",
    "removal_reason": null,
    "collapsed_reason": null,
    "distinguished": null,
    "associated_award": null,
    "stickied": false,
    "author_premium": false,
    "can_gild": false,
    "gildings": {},
    "unrepliable_reason": null,
    "author_flair_text_color": null,
    "score_hidden": false,
    "permalink": "/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xlqot/",
    "subreddit_type": "public",
    "locked": false,
    "report_reasons": null,
    "created": 1737735916,
    "author_flair_text": null,
    "treatment_tags": [],
    "link_id": "t3_1i8z28z",
    "subreddit_name_prefixed": "r/webscraping",
    "controversiality": 0,
    "depth": 0,
    "author_flair_background_color": null,
    "collapsed_because_crowd_control": null,
    "mod_reports": [],
    "num_reports": null
  },
  {
    "body": "haha good luck with selenium, i know how to do it but i use a chrome extension to enter the network tab and get all the beautiful XHRs , hidden apis, cookies, everything.",
    "ups": 1,
    "author": "ZorroGlitchero",
    "url": "https://www.reddit.com/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xnkb2/",
    "subreddit_id": "t5_318ly",
    "approved_at_utc": null,
    "author_is_blocked": false,
    "comment_type": null,
    "awarders": [],
    "mod_reason_by": null,
    "banned_by": null,
    "author_flair_type": "text",
    "total_awards_received": 0,
    "subreddit": "webscraping",
    "author_flair_template_id": null,
    "likes": null,
    "replies": "",
    "user_reports": [],
    "saved": false,
    "id": "m8xnkb2",
    "banned_at_utc": null,
    "mod_reason_title": null,
    "gilded": 0,
    "archived": false,
    "collapsed_reason_code": null,
    "no_follow": true,
    "can_mod_post": false,
    "created_utc": 1737736414,
    "send_replies": true,
    "parent_id": "t3_1i8z28z",
    "score": 1,
    "author_fullname": "t2_4u2x6yo5",
    "approved_by": null,
    "mod_note": null,
    "all_awardings": [],
    "collapsed": false,
    "edited": false,
    "top_awarded_type": null,
    "author_flair_css_class": null,
    "name": "t1_m8xnkb2",
    "is_submitter": false,
    "downs": 0,
    "author_flair_richtext": [],
    "author_patreon_flair": false,
    "body_html": "<div class="md"><p>haha good luck with selenium, i know how to do it but i use a chrome extension to enter the network tab and get all the beautiful XHRs , hidden apis, cookies, everything.</p>
</div>",
    "removal_reason": null,
    "collapsed_reason": null,
    "distinguished": null,
    "associated_award": null,
    "stickied": false,
    "author_premium": false,
    "can_gild": false,
    "gildings": {},
    "unrepliable_reason": null,
    "author_flair_text_color": null,
    "score_hidden": false,
    "permalink": "/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xnkb2/",
    "subreddit_type": "public",
    "locked": false,
    "report_reasons": null,
    "created": 1737736414,
    "author_flair_text": null,
    "treatment_tags": [],
    "link_id": "t3_1i8z28z",
    "subreddit_name_prefixed": "r/webscraping",
    "controversiality": 0,
    "depth": 0,
    "author_flair_background_color": null,
    "collapsed_because_crowd_control": null,
    "mod_reports": [],
    "num_reports": null
  },
  {
    "body": "Have a look at seleniumwire.

I am pretty confident it will work for your needs.",
    "ups": 1,
    "author": "IceCreamMonomaniac",
    "url": "https://www.reddit.com/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xp420/",
    "subreddit_id": "t5_318ly",
    "approved_at_utc": null,
    "author_is_blocked": false,
    "comment_type": null,
    "awarders": [],
    "mod_reason_by": null,
    "banned_by": null,
    "author_flair_type": "text",
    "total_awards_received": 0,
    "subreddit": "webscraping",
    "author_flair_template_id": null,
    "likes": null,
    "replies": "",
    "user_reports": [],
    "saved": false,
    "id": "m8xp420",
    "banned_at_utc": null,
    "mod_reason_title": null,
    "gilded": 0,
    "archived": false,
    "collapsed_reason_code": null,
    "no_follow": true,
    "can_mod_post": false,
    "created_utc": 1737736840,
    "send_replies": true,
    "parent_id": "t3_1i8z28z",
    "score": 1,
    "author_fullname": "t2_63xw2txn",
    "approved_by": null,
    "mod_note": null,
    "all_awardings": [],
    "collapsed": false,
    "edited": false,
    "top_awarded_type": null,
    "author_flair_css_class": null,
    "name": "t1_m8xp420",
    "is_submitter": false,
    "downs": 0,
    "author_flair_richtext": [],
    "author_patreon_flair": false,
    "body_html": "<div class="md"><p>Have a look at seleniumwire.</p>

<p>I am pretty confident it will work for your needs.</p>
</div>",
    "removal_reason": null,
    "collapsed_reason": null,
    "distinguished": null,
    "associated_award": null,
    "stickied": false,
    "author_premium": false,
    "can_gild": false,
    "gildings": {},
    "unrepliable_reason": null,
    "author_flair_text_color": null,
    "score_hidden": false,
    "permalink": "/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xp420/",
    "subreddit_type": "public",
    "locked": false,
    "report_reasons": null,
    "created": 1737736840,
    "author_flair_text": null,
    "treatment_tags": [],
    "link_id": "t3_1i8z28z",
    "subreddit_name_prefixed": "r/webscraping",
    "controversiality": 0,
    "depth": 0,
    "author_flair_background_color": null,
    "collapsed_because_crowd_control": null,
    "mod_reports": [],
    "num_reports": null
  },
  {
    "body": "If URL is changing but its producing the consistent or at least expected data on the page, its possible that URL params are encoded. Few days back I was scraping a website where filters, offset, limit all were base64 encoded twice (once individual k,v pairs were encoded and then joined string was encoded). It was first time I encountered it but copy pasting URLs in chatgpt and claude helped me figure that out.",
    "ups": 1,
    "author": "__VenomSnake__",
    "url": "https://www.reddit.com/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xsw4l/",
    "subreddit_id": "t5_318ly",
    "approved_at_utc": null,
    "author_is_blocked": false,
    "comment_type": null,
    "awarders": [],
    "mod_reason_by": null,
    "banned_by": null,
    "author_flair_type": "text",
    "total_awards_received": 0,
    "subreddit": "webscraping",
    "author_flair_template_id": null,
    "likes": null,
    "replies": "",
    "user_reports": [],
    "saved": false,
    "id": "m8xsw4l",
    "banned_at_utc": null,
    "mod_reason_title": null,
    "gilded": 0,
    "archived": false,
    "collapsed_reason_code": null,
    "no_follow": true,
    "can_mod_post": false,
    "created_utc": 1737737878,
    "send_replies": true,
    "parent_id": "t3_1i8z28z",
    "score": 1,
    "author_fullname": "t2_v68mgts98",
    "approved_by": null,
    "mod_note": null,
    "all_awardings": [],
    "collapsed": false,
    "edited": false,
    "top_awarded_type": null,
    "author_flair_css_class": null,
    "name": "t1_m8xsw4l",
    "is_submitter": false,
    "downs": 0,
    "author_flair_richtext": [],
    "author_patreon_flair": false,
    "body_html": "<div class="md"><p>If URL is changing but its producing the consistent or at least expected data on the page, its possible that URL params are encoded. Few days back I was scraping a website where filters, offset, limit all were base64 encoded twice (once individual k,v pairs were encoded and then joined string was encoded). It was first time I encountered it but copy pasting URLs in chatgpt and claude helped me figure that out.</p>
</div>",
    "removal_reason": null,
    "collapsed_reason": null,
    "distinguished": null,
    "associated_award": null,
    "stickied": false,
    "author_premium": false,
    "can_gild": false,
    "gildings": {},
    "unrepliable_reason": null,
    "author_flair_text_color": null,
    "score_hidden": false,
    "permalink": "/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8xsw4l/",
    "subreddit_type": "public",
    "locked": false,
    "report_reasons": null,
    "created": 1737737878,
    "author_flair_text": null,
    "treatment_tags": [],
    "link_id": "t3_1i8z28z",
    "subreddit_name_prefixed": "r/webscraping",
    "controversiality": 0,
    "depth": 0,
    "author_flair_background_color": null,
    "collapsed_because_crowd_control": null,
    "mod_reports": [],
    "num_reports": null
  },
  {
    "body": "Use a proxy and then set up a service to query the files created by the proxy",
    "ups": 1,
    "author": "LoveThemMegaSeeds",
    "url": "https://www.reddit.com/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8y1pib/",
    "subreddit_id": "t5_318ly",
    "approved_at_utc": null,
    "author_is_blocked": false,
    "comment_type": null,
    "awarders": [],
    "mod_reason_by": null,
    "banned_by": null,
    "author_flair_type": "text",
    "total_awards_received": 0,
    "subreddit": "webscraping",
    "author_flair_template_id": null,
    "likes": null,
    "replies": "",
    "user_reports": [],
    "saved": false,
    "id": "m8y1pib",
    "banned_at_utc": null,
    "mod_reason_title": null,
    "gilded": 0,
    "archived": false,
    "collapsed_reason_code": null,
    "no_follow": true,
    "can_mod_post": false,
    "created_utc": 1737740326,
    "send_replies": true,
    "parent_id": "t3_1i8z28z",
    "score": 1,
    "author_fullname": "t2_s4v13pzrg",
    "approved_by": null,
    "mod_note": null,
    "all_awardings": [],
    "collapsed": false,
    "edited": false,
    "top_awarded_type": null,
    "author_flair_css_class": null,
    "name": "t1_m8y1pib",
    "is_submitter": false,
    "downs": 0,
    "author_flair_richtext": [],
    "author_patreon_flair": false,
    "body_html": "<div class="md"><p>Use a proxy and then set up a service to query the files created by the proxy</p>
</div>",
    "removal_reason": null,
    "collapsed_reason": null,
    "distinguished": null,
    "associated_award": null,
    "stickied": false,
    "author_premium": false,
    "can_gild": false,
    "gildings": {},
    "unrepliable_reason": null,
    "author_flair_text_color": null,
    "score_hidden": false,
    "permalink": "/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8y1pib/",
    "subreddit_type": "public",
    "locked": false,
    "report_reasons": null,
    "created": 1737740326,
    "author_flair_text": null,
    "treatment_tags": [],
    "link_id": "t3_1i8z28z",
    "subreddit_name_prefixed": "r/webscraping",
    "controversiality": 0,
    "depth": 0,
    "author_flair_background_color": null,
    "collapsed_because_crowd_control": null,
    "mod_reports": [],
    "num_reports": null
  },
  {
    "body": "You haven't included enough detail for people to give you proper advice",
    "ups": 1,
    "author": "matty_fu",
    "url": "https://www.reddit.com/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8zwahx/",
    "subreddit_id": "t5_318ly",
    "approved_at_utc": null,
    "author_is_blocked": false,
    "comment_type": null,
    "awarders": [],
    "mod_reason_by": null,
    "banned_by": null,
    "author_flair_type": "text",
    "total_awards_received": 0,
    "subreddit": "webscraping",
    "author_flair_template_id": null,
    "likes": null,
    "replies": "",
    "user_reports": [],
    "saved": false,
    "id": "m8zwahx",
    "banned_at_utc": null,
    "mod_reason_title": null,
    "gilded": 0,
    "archived": false,
    "collapsed_reason_code": null,
    "no_follow": true,
    "can_mod_post": false,
    "created_utc": 1737759262,
    "send_replies": true,
    "parent_id": "t3_1i8z28z",
    "score": 1,
    "author_fullname": "t2_vep5j",
    "approved_by": null,
    "mod_note": null,
    "all_awardings": [],
    "collapsed": false,
    "edited": false,
    "top_awarded_type": null,
    "author_flair_css_class": null,
    "name": "t1_m8zwahx",
    "is_submitter": false,
    "downs": 0,
    "author_flair_richtext": [],
    "author_patreon_flair": false,
    "body_html": "<div class="md"><p>You haven't included enough detail for people to give you proper advice</p>
</div>",
    "removal_reason": null,
    "collapsed_reason": null,
    "distinguished": null,
    "associated_award": null,
    "stickied": false,
    "author_premium": false,
    "can_gild": false,
    "gildings": {},
    "unrepliable_reason": null,
    "author_flair_text_color": null,
    "score_hidden": false,
    "permalink": "/r/webscraping/comments/1i8z28z/getting_data_from_network_tab/m8zwahx/",
    "subreddit_type": "public",
    "locked": false,
    "report_reasons": null,
    "created": 1737759262,
    "author_flair_text": null,
    "treatment_tags": [],
    "link_id": "t3_1i8z28z",
    "subreddit_name_prefixed": "r/webscraping",
    "controversiality": 0,
    "depth": 0,
    "author_flair_background_color": null,
    "collapsed_because_crowd_control": null,
    "mod_reports": [],
    "num_reports": null
  }
]

Headers

x-api-key
string
required

Your Scrape Creators API key

Query Parameters

url
string
required

Reddit post URL