ive been scrapping reddit and x for a few months and generating a daily summary using gumloop.anybody interested in helping me out with more data analysis?its getting pretty good, signaled xrp on the 10th, among others...started publishing it to substack. looking for feeback. not gay
>>59612422Why is Ethereum left out?Arbitrum is l2
>>59612430it’s not left out, this isn’t a personal opinion piece, pure data analysis based on user generated content this is literally the sentiment of here,
>>59612444Ok the arbitrum point still stands. What's your substack?
The terminology in this case likely stems from the content or phrasing used by users in the dataset I’m summarizing. It was probably referred to as an “Alt L1” in a popular thread, which led to its inclusion here without correction.I’m intentionally aiming to avoid introducing any personal bias into the summaries, so there may (and likely will) be some inaccuracies due to the nature of the original user-generated content. My goal is to reflect the conversations as they are, even if the terminology isn’t always precise.it’s scanx (substack) com
it's interesting, what tools do you use to scrape in case i want to dick around?gonna follow your substack for sentinement analysis
>>59612728I try and get whatever data I can using platform API’s (x and Reddit have decent APIs), feed that into a node js server / mongoDB. Then Gumloop ai comes in clutch for creating a programmatic web scraping flow and then output that to my mongoDB. Lastly, clean all the data, create metadata for gpt4o to Summerizehmu on x or substack if you need any help