New cool feature on bird.makeup this morning: pinned tweets!
They show as native pinned toots and they are not affected by the 100 top tweets limitation.
26.8.2023 14:54vincent: New cool feature onTo fix the crawling, I'm going to need to start using Twitter accounts to fetch new posts. This is getting complicated for the time I can put on this as a side project, so I'm going to rely on Nitter implementing this, then I'm going to use that. You can track progress here: https://github.com/zedeus/nitter/issues/983
There is another thing I can fix natively in bird.makeup though. I noticed pinned tweets are there in user lookups. I can forward this, and the top 100 limitation doesn't apply to that.
2/2
25.8.2023 12:26vincent: To fix the crawling,I'm getting a lot of question about what's currently working with bird.makeup, so here it is:
The system is mostly back online, but there are some major limitation when crawling new posts.
- To be forwarded, a post has to be in the top 100 of an account as measured by likes
- There are no retweets being forwarded right now
1/2
25.8.2023 12:22vincent: I'm getting a lot ofOne really useful thing Nitter could do is to log the id of new tweets (and their author) as it encounters them during normal operation. Bird.makeup could simply hook into that byproduct and it can already figure out the rest on its own.
I’ll sleep on it and if I still like it I’ll propose it to the nitter dev
24.8.2023 02:52vincent: One really useful thAnd no retweets, but I did notice I can get pinned tweets though
23.8.2023 23:51vincent: And no retweets, butAnd we are back*, baby!
* with the limitation on popular tweets for now
23.8.2023 23:48vincent: And we are back*, baCurrently setting up a mastodon instance and it looks like all requests have a 20 second delay added. It's driving me crazy!
Anyone knows what's up? My google-fu is giving me nothing
22.8.2023 19:51vincent: Currently setting upSo they are all green right now, and the fetching tweets part works from my computer and CI, but not from any of the servers... The approach of fetching tweets from the embeds doesn't seem to work....
FML, and back to the drawing board!
21.8.2023 23:14vincent: So they are all greeI will continue with something homegrown for users and individual tweets, but I'm thinking if I should add a dependency on nitter to fetch timelines 🤔
The lead dev has timelines working again already: https://github.com/zedeus/nitter/issues/983#issuecomment-1684070343
While having everything built-in is neat, strategies to crawl are getting more complicated and it's starting to take a lot of time to re-implement things in C#
18.8.2023 15:53vincent: I will continue withMore checkmarks are green today!
18.8.2023 15:23vincent: More checkmarks are