Andrew Kvalheim
|
5ed751a8c6
|
Skip fetching context of private posts
Context fetching is performed without authentication, so it is only
possible for public and unlisted posts.
|
2024-07-01 18:21:57 -07:00 |
|
nanos
|
e85384a5a6
|
name collision (fixes #134)
|
2024-06-28 12:46:12 +01:00 |
|
nanos
|
6c1ec2f1c5
|
fix logs
|
2024-06-28 09:08:59 +01:00 |
|
nanos
|
3639878df0
|
Update version
|
2024-06-28 08:50:32 +01:00 |
|
nanos
|
42774c5195
|
documentation update
|
2024-06-28 08:47:21 +01:00 |
|
nanos
|
fd615cad15
|
Support for fetching lists
|
2024-06-28 08:22:34 +01:00 |
|
nanos
|
e7da9a1f61
|
Fix bug
|
2024-06-27 17:14:41 +01:00 |
|
Michael
|
e0faafb37a
|
Merge pull request #130 from nanos/cache-robots-on-disk
Cache robots.txt for 24 hours on disk to reduce load on servers
|
2024-06-27 16:46:01 +01:00 |
|
nanos
|
d2a14f687a
|
log what's happening
|
2024-06-27 09:18:06 +01:00 |
|
nanos
|
aa589670eb
|
Do not backfill users that have opted out of indexing
|
2024-06-27 09:16:59 +01:00 |
|
nanos
|
40b624aaff
|
update version
|
2024-06-27 07:56:50 +01:00 |
|
nanos
|
90988872b7
|
fix
|
2024-06-26 16:45:30 +01:00 |
|
nanos
|
7e8ca17640
|
Cache robots.txt for 24 hours on disk to reduce load on servers
|
2024-06-26 16:41:51 +01:00 |
|
nanos
|
3651d028a6
|
update version number
|
2024-06-25 16:36:01 +01:00 |
|
nanos
|
01a2719918
|
shorten http timeout for robots.txt fetch
|
2024-06-25 16:32:47 +01:00 |
|
nanos
|
7b9896b5c0
|
Cache robots.txt
|
2024-06-25 16:24:37 +01:00 |
|
nanos
|
dd468d5956
|
User FediFetcher as User Agent to fetch the robots.txt
|
2024-06-25 16:15:43 +01:00 |
|
nanos
|
e40d61d291
|
update version
|
2024-06-25 11:00:24 +01:00 |
|
nanos
|
ac2b648e05
|
change timeout periods to never allow more than once per minute
|
2024-06-25 10:54:00 +01:00 |
|
nanos
|
885b84d598
|
ensure callbacks aren't blocked by robtos
|
2024-06-25 10:38:47 +01:00 |
|
nanos
|
1b4c135f8f
|
respect robots.txt
|
2024-06-25 10:24:45 +01:00 |
|
nanos
|
1c7023819e
|
try again
|
2024-06-25 09:03:59 +01:00 |
|
nanos
|
e6fd9c6b00
|
bug fix
|
2024-06-25 09:01:07 +01:00 |
|
nanos
|
120008ced0
|
shorten storage time
|
2024-06-25 08:50:27 +01:00 |
|
nanos
|
3278ce2f06
|
Rate limit fetching of context
|
2024-06-25 08:45:03 +01:00 |
|
nanos
|
f965b4f6fc
|
stop rushing things ...
|
2024-06-24 17:19:27 +01:00 |
|
nanos
|
468e092e21
|
fix stupid bug
|
2024-06-24 17:18:02 +01:00 |
|
nanos
|
a23d6fe1fb
|
Add Instance name to FediFetcher UA [fixes #122]
|
2024-06-24 17:13:23 +01:00 |
|
Andrew Kvalheim
|
1fed215977
|
Quiet urllib3 logs
As described at https://github.com/urllib3/urllib3/blob/1.26.18/docs/user-guide.rst#logging
|
2024-04-22 11:17:38 -07:00 |
|
Andrew Kvalheim
|
c528efb1be
|
Add --log-level option
|
2024-04-21 12:01:57 -07:00 |
|
Jonas
|
bf0ed943ec
|
add sharkey as misskey-api-capable
|
2024-03-02 09:56:41 +00:00 |
|
Laura Hausmann
|
7be5dfb9b1
|
Add support for Iceshrimp
|
2023-10-21 23:41:05 +02:00 |
|
nanos
|
95b644d431
|
Define nodeLoc (fixes #82)
|
2023-09-07 08:43:10 +01:00 |
|
nanos
|
31f475dcdd
|
fixes #79
|
2023-08-18 08:00:09 +01:00 |
|
Michael
|
a76b52642d
|
Merge pull request #71 from ToadKing/retry-cleanup
remove redundant code for retrying on HTTP 429
|
2023-08-14 15:49:14 +01:00 |
|
Yoann MALLEMANCHE
|
adc0d4ec4e
|
fix bug when failing to get user's posts
|
2023-08-06 17:54:34 +02:00 |
|
nanos
|
253c7c4f2b
|
Revert "print current version on startup" (#70)
This reverts commit 213ef57abe.
|
2023-08-06 09:45:33 +01:00 |
|
Toad King
|
db2dcce2ff
|
remove redundant code for retrying on HTTP 429
|
2023-08-05 11:44:48 -05:00 |
|
nanos
|
c90a7e42ab
|
fix incorrect rate limit handling for mastodon
|
2023-08-03 15:21:59 +01:00 |
|
nanos
|
3294a44f76
|
cache host failures for a shorter time
|
2023-08-03 15:21:12 +01:00 |
|
nanos
|
174448a2b0
|
fix bug in writing file to disk
|
2023-08-03 10:54:14 +01:00 |
|
nanos
|
ae55c96506
|
improve caching to provide timeout
|
2023-08-03 10:53:17 +01:00 |
|
nanos
|
5a2b2c2311
|
Save seen_hosts on disk
|
2023-08-03 08:01:42 +01:00 |
|
Toad King
|
a7611c6e6f
|
remove GoToSocial from Mastodon API support list
https://github.com/superseriousbusiness/gotosocial/issues/2038
|
2023-07-31 17:10:29 -05:00 |
|
Toad King
|
80ee1387f7
|
hook up host software lookup to user/post fetching
add depth fetching for misskey posts (works in firefish and foundkey)
|
2023-07-30 03:19:47 -05:00 |
|
Toad King
|
c92d4e1c2c
|
start on server software detection
|
2023-07-26 01:14:06 -05:00 |
|
Toad King
|
c169b2ae30
|
add hacky support for misskey and calckey/firefish
|
2023-07-25 01:02:41 -05:00 |
|
nanos
|
213ef57abe
|
print current version on startup (#58)
|
2023-07-03 08:46:20 +01:00 |
|
Timothy Quilling
|
47e8b485a5
|
fix: handle zero notifications
|
2023-07-02 23:54:29 -04:00 |
|
Timothy Quilling
|
6f7392cfaa
|
feat: fetch root lemmy post
|
2023-06-30 01:36:56 -04:00 |
|