nanos
|
d2a14f687a
|
log what's happening
|
2024-06-27 09:18:06 +01:00 |
|
nanos
|
aa589670eb
|
Do not backfill users that have opted out of indexing
|
2024-06-27 09:16:59 +01:00 |
|
nanos
|
3651d028a6
|
update version number
|
2024-06-25 16:36:01 +01:00 |
|
nanos
|
01a2719918
|
shorten http timeout for robots.txt fetch
|
2024-06-25 16:32:47 +01:00 |
|
nanos
|
7b9896b5c0
|
Cache robots.txt
|
2024-06-25 16:24:37 +01:00 |
|
nanos
|
dd468d5956
|
User FediFetcher as User Agent to fetch the robots.txt
|
2024-06-25 16:15:43 +01:00 |
|
nanos
|
e40d61d291
|
update version
|
2024-06-25 11:00:24 +01:00 |
|
nanos
|
ac2b648e05
|
change timeout periods to never allow more than once per minute
|
2024-06-25 10:54:00 +01:00 |
|
nanos
|
885b84d598
|
ensure callbacks aren't blocked by robtos
|
2024-06-25 10:38:47 +01:00 |
|
nanos
|
1b4c135f8f
|
respect robots.txt
|
2024-06-25 10:24:45 +01:00 |
|
nanos
|
1c7023819e
|
try again
|
2024-06-25 09:03:59 +01:00 |
|
nanos
|
e6fd9c6b00
|
bug fix
|
2024-06-25 09:01:07 +01:00 |
|
nanos
|
120008ced0
|
shorten storage time
|
2024-06-25 08:50:27 +01:00 |
|
nanos
|
3278ce2f06
|
Rate limit fetching of context
|
2024-06-25 08:45:03 +01:00 |
|
nanos
|
f965b4f6fc
|
stop rushing things ...
|
2024-06-24 17:19:27 +01:00 |
|
nanos
|
468e092e21
|
fix stupid bug
|
2024-06-24 17:18:02 +01:00 |
|
nanos
|
a23d6fe1fb
|
Add Instance name to FediFetcher UA [fixes #122]
|
2024-06-24 17:13:23 +01:00 |
|
Andrew Kvalheim
|
1fed215977
|
Quiet urllib3 logs
As described at https://github.com/urllib3/urllib3/blob/1.26.18/docs/user-guide.rst#logging
|
2024-04-22 11:17:38 -07:00 |
|
Andrew Kvalheim
|
c528efb1be
|
Add --log-level option
|
2024-04-21 12:01:57 -07:00 |
|
Jonas
|
bf0ed943ec
|
add sharkey as misskey-api-capable
|
2024-03-02 09:56:41 +00:00 |
|
Laura Hausmann
|
7be5dfb9b1
|
Add support for Iceshrimp
|
2023-10-21 23:41:05 +02:00 |
|
nanos
|
95b644d431
|
Define nodeLoc (fixes #82)
|
2023-09-07 08:43:10 +01:00 |
|
nanos
|
31f475dcdd
|
fixes #79
|
2023-08-18 08:00:09 +01:00 |
|
Michael
|
a76b52642d
|
Merge pull request #71 from ToadKing/retry-cleanup
remove redundant code for retrying on HTTP 429
|
2023-08-14 15:49:14 +01:00 |
|
Yoann MALLEMANCHE
|
adc0d4ec4e
|
fix bug when failing to get user's posts
|
2023-08-06 17:54:34 +02:00 |
|
nanos
|
253c7c4f2b
|
Revert "print current version on startup" (#70)
This reverts commit 213ef57abe.
|
2023-08-06 09:45:33 +01:00 |
|
Toad King
|
db2dcce2ff
|
remove redundant code for retrying on HTTP 429
|
2023-08-05 11:44:48 -05:00 |
|
nanos
|
c90a7e42ab
|
fix incorrect rate limit handling for mastodon
|
2023-08-03 15:21:59 +01:00 |
|
nanos
|
3294a44f76
|
cache host failures for a shorter time
|
2023-08-03 15:21:12 +01:00 |
|
nanos
|
174448a2b0
|
fix bug in writing file to disk
|
2023-08-03 10:54:14 +01:00 |
|
nanos
|
ae55c96506
|
improve caching to provide timeout
|
2023-08-03 10:53:17 +01:00 |
|
nanos
|
5a2b2c2311
|
Save seen_hosts on disk
|
2023-08-03 08:01:42 +01:00 |
|
Toad King
|
a7611c6e6f
|
remove GoToSocial from Mastodon API support list
https://github.com/superseriousbusiness/gotosocial/issues/2038
|
2023-07-31 17:10:29 -05:00 |
|
Toad King
|
80ee1387f7
|
hook up host software lookup to user/post fetching
add depth fetching for misskey posts (works in firefish and foundkey)
|
2023-07-30 03:19:47 -05:00 |
|
Toad King
|
c92d4e1c2c
|
start on server software detection
|
2023-07-26 01:14:06 -05:00 |
|
Toad King
|
c169b2ae30
|
add hacky support for misskey and calckey/firefish
|
2023-07-25 01:02:41 -05:00 |
|
nanos
|
213ef57abe
|
print current version on startup (#58)
|
2023-07-03 08:46:20 +01:00 |
|
Timothy Quilling
|
47e8b485a5
|
fix: handle zero notifications
|
2023-07-02 23:54:29 -04:00 |
|
Timothy Quilling
|
6f7392cfaa
|
feat: fetch root lemmy post
|
2023-06-30 01:36:56 -04:00 |
|
Timothy Quilling
|
0472fe6e0c
|
fix: match pixelfed profile last
|
2023-06-30 01:34:30 -04:00 |
|
Timothy Quilling
|
8edfbc030c
|
chore: access context items safely
|
2023-06-30 01:33:19 -04:00 |
|
Timothy Quilling
|
b04664f9d5
|
chore: deliminate regex with forward slash
|
2023-06-30 00:21:17 -04:00 |
|
Timothy Quilling
|
4751d96a1d
|
chore: check none type
|
2023-06-30 00:18:39 -04:00 |
|
Timothy Quilling
|
4011883ef2
|
feat: lemmy-2
|
2023-06-30 00:16:59 -04:00 |
|
Timothy Quilling
|
e290f2c05f
|
chore: use getters
|
2023-06-30 00:11:33 -04:00 |
|
Timothy Quilling
|
b7ef2be02e
|
chore: refactor get_all_known_context_urls
|
2023-06-29 01:57:33 -04:00 |
|
Timothy Quilling
|
c1f0e8ac61
|
feat: lemmy
|
2023-06-29 00:20:12 -04:00 |
|
nanos
|
9edbee7285
|
Deal better with it, when someone provides a URL instead of a server name (#50, #45)
|
2023-06-15 08:00:05 +01:00 |
|
nanos
|
46a5be98df
|
Fix bug in providing access token as config where it isn't being recognised as array
|
2023-06-14 09:51:56 +01:00 |
|
nanos
|
5a3db443cb
|
Allow us to pass configuration options in a json file
Addresses #48
|
2023-06-09 21:55:09 +01:00 |
|