Commit graph

132 commits

Author SHA1 Message Date
nanos
885b84d598 ensure callbacks aren't blocked by robtos 2024-06-25 10:38:47 +01:00
nanos
1b4c135f8f respect robots.txt 2024-06-25 10:24:45 +01:00
nanos
1c7023819e try again 2024-06-25 09:03:59 +01:00
nanos
e6fd9c6b00 bug fix 2024-06-25 09:01:07 +01:00
nanos
120008ced0 shorten storage time 2024-06-25 08:50:27 +01:00
nanos
3278ce2f06 Rate limit fetching of context 2024-06-25 08:45:03 +01:00
nanos
f965b4f6fc stop rushing things ... 2024-06-24 17:19:27 +01:00
nanos
468e092e21 fix stupid bug 2024-06-24 17:18:02 +01:00
nanos
a23d6fe1fb Add Instance name to FediFetcher UA [fixes #122] 2024-06-24 17:13:23 +01:00
Andrew Kvalheim
1fed215977 Quiet urllib3 logs
As described at https://github.com/urllib3/urllib3/blob/1.26.18/docs/user-guide.rst#logging
2024-04-22 11:17:38 -07:00
Andrew Kvalheim
c528efb1be Add --log-level option 2024-04-21 12:01:57 -07:00
Jonas
bf0ed943ec
add sharkey as misskey-api-capable 2024-03-02 09:56:41 +00:00
Laura Hausmann
7be5dfb9b1
Add support for Iceshrimp 2023-10-21 23:41:05 +02:00
nanos
95b644d431 Define nodeLoc (fixes #82) 2023-09-07 08:43:10 +01:00
nanos
31f475dcdd fixes #79 2023-08-18 08:00:09 +01:00
Michael
a76b52642d
Merge pull request #71 from ToadKing/retry-cleanup
remove redundant code for retrying on HTTP 429
2023-08-14 15:49:14 +01:00
Yoann MALLEMANCHE
adc0d4ec4e
fix bug when failing to get user's posts 2023-08-06 17:54:34 +02:00
nanos
253c7c4f2b Revert "print current version on startup" (#70)
This reverts commit 213ef57abe.
2023-08-06 09:45:33 +01:00
Toad King
db2dcce2ff remove redundant code for retrying on HTTP 429 2023-08-05 11:44:48 -05:00
nanos
c90a7e42ab fix incorrect rate limit handling for mastodon 2023-08-03 15:21:59 +01:00
nanos
3294a44f76 cache host failures for a shorter time 2023-08-03 15:21:12 +01:00
nanos
174448a2b0 fix bug in writing file to disk 2023-08-03 10:54:14 +01:00
nanos
ae55c96506 improve caching to provide timeout 2023-08-03 10:53:17 +01:00
nanos
5a2b2c2311 Save seen_hosts on disk 2023-08-03 08:01:42 +01:00
Toad King
a7611c6e6f remove GoToSocial from Mastodon API support list
https://github.com/superseriousbusiness/gotosocial/issues/2038
2023-07-31 17:10:29 -05:00
Toad King
80ee1387f7 hook up host software lookup to user/post fetching
add depth fetching for misskey posts (works in firefish and foundkey)
2023-07-30 03:19:47 -05:00
Toad King
c92d4e1c2c start on server software detection 2023-07-26 01:14:06 -05:00
Toad King
c169b2ae30 add hacky support for misskey and calckey/firefish 2023-07-25 01:02:41 -05:00
nanos
213ef57abe print current version on startup (#58) 2023-07-03 08:46:20 +01:00
Timothy Quilling
47e8b485a5 fix: handle zero notifications 2023-07-02 23:54:29 -04:00
Timothy Quilling
6f7392cfaa feat: fetch root lemmy post 2023-06-30 01:36:56 -04:00
Timothy Quilling
0472fe6e0c fix: match pixelfed profile last 2023-06-30 01:34:30 -04:00
Timothy Quilling
8edfbc030c chore: access context items safely 2023-06-30 01:33:19 -04:00
Timothy Quilling
b04664f9d5 chore: deliminate regex with forward slash 2023-06-30 00:21:17 -04:00
Timothy Quilling
4751d96a1d chore: check none type 2023-06-30 00:18:39 -04:00
Timothy Quilling
4011883ef2 feat: lemmy-2 2023-06-30 00:16:59 -04:00
Timothy Quilling
e290f2c05f chore: use getters 2023-06-30 00:11:33 -04:00
Timothy Quilling
b7ef2be02e chore: refactor get_all_known_context_urls 2023-06-29 01:57:33 -04:00
Timothy Quilling
c1f0e8ac61 feat: lemmy 2023-06-29 00:20:12 -04:00
nanos
9edbee7285 Deal better with it, when someone provides a URL instead of a server name (#50, #45) 2023-06-15 08:00:05 +01:00
nanos
46a5be98df Fix bug in providing access token as config where it isn't being recognised as array 2023-06-14 09:51:56 +01:00
nanos
5a3db443cb Allow us to pass configuration options in a json file
Addresses #48
2023-06-09 21:55:09 +01:00
nanos
1fffddcb23 support for fetching context to favourites (#42) 2023-04-28 20:40:24 +01:00
nanos
8235cda859 support for multiple access tokens 2023-04-10 16:28:09 +01:00
nanos
d0cb212315 fix silly comment 🤦‍♂️ 2023-04-06 09:13:30 +01:00
nanos
bfbffc0773 Fix backfill options [#37] 2023-04-06 08:00:28 +01:00
nanos
b9d82dc073 Fixes missing arguments (#35) 2023-04-05 09:15:24 +01:00
Michael
886a0cecd2
Merge pull request #29 from arachnist/configurable-state-location
make the state location configurable
2023-04-05 07:49:35 +01:00
nanos
a3f2b23022 dont attempt to backfill reblogs, as we cannot 2023-04-04 17:00:35 +01:00
nanos
9f28ba2333 bug fixes 2023-04-03 08:57:31 +01:00
nanos
2b707e7807 some refactoring 2023-04-03 08:36:09 +01:00
Robert Gerus
73a296c310 make the state file configurable 2023-04-01 16:03:43 +02:00
nanos
56039cfdea only request context to a toot, if we know context exists 2023-04-01 08:44:12 +01:00
nanos
f51d19730b put a cap on mentions to backfill during any given executions 2023-03-31 17:23:12 +01:00
nanos
9ea4ba05fb allow us to choose whether to get context when backfilling 2023-03-31 17:22:35 +01:00
nanos
785499ab82 do make sure we also backfill users from reblogs 2023-03-31 10:23:47 +01:00
nanos
a357470328 also backfill post authors 2023-03-31 09:05:51 +01:00
nanos
5f438ee873 backfill any user mentioned in the home timeline 2023-03-31 09:05:43 +01:00
nanos
dc0d94a274 Add Context when adding posts 2023-03-31 09:05:29 +01:00
nanos
0c87cd6727 Allow us to parse Pixelfed URLs
fixes #30
2023-03-31 07:51:18 +01:00
nanos
9b7093e478 Allow us to backfill posts from users that are mentioned in notifications 2023-03-28 07:04:03 +01:00
nanos
3b9eecce08 Rename to FediFetcher 2023-03-27 07:02:59 +01:00
nanos
3491c6a7e2 don't attempt to send beacon if urls are empty string 2023-03-22 11:40:10 +00:00
nanos
afc981930c Implement option to get replies to bookmarks (#19) 2023-03-21 19:23:14 +00:00
nanos
c587e0907a finalise callbacks 2023-03-21 14:42:31 +00:00
nanos
38231cc4f6 fix how we deal with failure to get timeline toots 2023-03-21 14:22:19 +00:00
nanos
79b69e7fdc also add a callback for process start 2023-03-21 11:56:34 +00:00
nanos
586888c761 implement callback upon completion
This fixes #20
2023-03-21 10:27:43 +00:00
nanos
200d3a155d forgot to remove lock file 2023-03-21 08:40:22 +00:00
nanos
12bde97687 allow us to set lock-hours to 0 to prevent the action getting stuck (#18) 2023-03-21 08:28:29 +00:00
nanos
917ff8354d Document locking for #18 2023-03-21 08:26:48 +00:00
nanos
f8979ed578 fix default max-follow-requests 2023-03-21 08:18:23 +00:00
nanos
43c04cf05f Improve handling of lock (see #18) 2023-03-21 08:17:03 +00:00
nanos
27bfcc3841 Improved output 2023-03-21 07:55:52 +00:00
nanos
62989f4041 Use file based locking when running script locally
Fixes #18
2023-03-20 21:15:21 +00:00
nanos
5be011b8d9 Fix bug in getting follow requests 2023-03-20 21:15:21 +00:00
nanos
76f7c22d73 backfill follow requests' profiles (addresses #7) 2023-03-20 09:12:16 +00:00
Andrew Williams
429a16667c
Fix var naming conflict with argparse and date parser 2023-03-19 13:37:55 +00:00
Michael Thomas
a624f1ae58 Allow us to make the HTTP timeout configurable 2023-03-17 08:26:38 +00:00
Michael Thomas
837043bbe0 edits for readability 2023-03-16 08:50:28 +00:00
Michael Thomas
c31ce64ab7 update readme 2023-03-16 08:48:20 +00:00
Michael Thomas
90e6ac39b2 use the new find_posts, with get_context being used as fallback 2023-03-16 08:25:24 +00:00