nanos-bot
|
043612f21a
|
[bot] Bump version to ain
|
2024-09-16 15:18:56 +00:00 |
|
nanos-bot
|
1aca617c72
|
[bot] Bump version to 7.1.11
|
2024-09-16 15:10:15 +00:00 |
|
nanos-bot
|
044c45d32a
|
[bot] Bump version to 7.1.10
|
2024-09-16 15:00:45 +00:00 |
|
Andrew Kvalheim
|
37e8d16fab
|
Correct spelling
|
2024-09-03 07:55:16 -07:00 |
|
Andrew Kvalheim
|
ac06103caf
|
Remove unused code
|
2024-09-03 07:55:16 -07:00 |
|
Andrew Kvalheim
|
d0d35988e7
|
Remove trailing whitespace
|
2024-09-03 07:55:13 -07:00 |
|
Michael
|
e9dab187dd
|
Update version number
|
2024-09-03 08:19:27 +01:00 |
|
Michael
|
fe6ce1af43
|
Merge pull request #161 from bentasker/instance_banlist
feat: add support for instance banlist
|
2024-09-02 17:07:21 +01:00 |
|
B Tasker
|
c9f6521a61
|
fix: strip whitespace if it's included in the list
|
2024-08-18 17:03:20 +01:00 |
|
B Tasker
|
3eb2589a8b
|
feat: enforce blocklist (and remove testing statements)
|
2024-08-18 16:58:11 +01:00 |
|
B Tasker
|
6e1830f87c
|
feat: implement new flag --instance-blocklist
This can also be set via env var `FF_INSTANCE_BLOCKLIST`
It should be a comma seperated list of domains
|
2024-08-18 16:47:56 +01:00 |
|
nanos
|
939e775c27
|
Try to use xxHash to hash robots cache file names
This should be faster and more efficient.
|
2024-08-15 08:00:00 +01:00 |
|
Michael
|
df22348eb1
|
Update version number
|
2024-08-15 07:33:23 +01:00 |
|
Ari Gato
|
d246f25bfc
|
Allow all settings to be set via env variables
|
2024-08-09 13:51:23 +02:00 |
|
Ari Gato
|
938d9d7d62
|
Get access token from environment variable
|
2024-08-04 12:25:38 +02:00 |
|
Michael
|
5bebab7168
|
Mark Iceshrimp.NET as supporting mastodon
|
2024-08-03 11:10:07 +01:00 |
|
nanos
|
2e99ce0199
|
Fix for missing entry in seen hosts
|
2024-07-02 10:29:08 +01:00 |
|
nanos
|
c5af476348
|
Rudimentary peertube support
|
2024-07-02 10:20:07 +01:00 |
|
nanos
|
0e2178cc5a
|
bug fix
|
2024-07-02 09:43:39 +01:00 |
|
Michael
|
5f290b5682
|
Merge pull request #140 from nanos/backfill-list
backfil mentioned users in list timelines
|
2024-07-02 07:58:46 +01:00 |
|
nanos
|
5b247aa22a
|
allow specification of a custom log format
|
2024-07-02 07:52:37 +01:00 |
|
nanos
|
f4873e7c8e
|
backfil mentioned users in list timelines
|
2024-07-02 07:34:15 +01:00 |
|
Michael
|
d863b58513
|
Merge pull request #139 from AndrewKvalheim/skip-private
Skip fetching context of private posts
|
2024-07-02 06:54:16 +01:00 |
|
Andrew Kvalheim
|
5ed751a8c6
|
Skip fetching context of private posts
Context fetching is performed without authentication, so it is only
possible for public and unlisted posts.
|
2024-07-01 18:21:57 -07:00 |
|
nanos
|
c58c5b5af0
|
use sha hashes to cache file names
|
2024-07-01 20:06:51 +01:00 |
|
nanos
|
e85384a5a6
|
name collision (fixes #134)
|
2024-06-28 12:46:12 +01:00 |
|
nanos
|
6c1ec2f1c5
|
fix logs
|
2024-06-28 09:08:59 +01:00 |
|
nanos
|
3639878df0
|
Update version
|
2024-06-28 08:50:32 +01:00 |
|
nanos
|
42774c5195
|
documentation update
|
2024-06-28 08:47:21 +01:00 |
|
nanos
|
fd615cad15
|
Support for fetching lists
|
2024-06-28 08:22:34 +01:00 |
|
nanos
|
e7da9a1f61
|
Fix bug
|
2024-06-27 17:14:41 +01:00 |
|
Michael
|
e0faafb37a
|
Merge pull request #130 from nanos/cache-robots-on-disk
Cache robots.txt for 24 hours on disk to reduce load on servers
|
2024-06-27 16:46:01 +01:00 |
|
nanos
|
d2a14f687a
|
log what's happening
|
2024-06-27 09:18:06 +01:00 |
|
nanos
|
aa589670eb
|
Do not backfill users that have opted out of indexing
|
2024-06-27 09:16:59 +01:00 |
|
nanos
|
40b624aaff
|
update version
|
2024-06-27 07:56:50 +01:00 |
|
nanos
|
90988872b7
|
fix
|
2024-06-26 16:45:30 +01:00 |
|
nanos
|
7e8ca17640
|
Cache robots.txt for 24 hours on disk to reduce load on servers
|
2024-06-26 16:41:51 +01:00 |
|
nanos
|
3651d028a6
|
update version number
|
2024-06-25 16:36:01 +01:00 |
|
nanos
|
01a2719918
|
shorten http timeout for robots.txt fetch
|
2024-06-25 16:32:47 +01:00 |
|
nanos
|
7b9896b5c0
|
Cache robots.txt
|
2024-06-25 16:24:37 +01:00 |
|
nanos
|
dd468d5956
|
User FediFetcher as User Agent to fetch the robots.txt
|
2024-06-25 16:15:43 +01:00 |
|
nanos
|
e40d61d291
|
update version
|
2024-06-25 11:00:24 +01:00 |
|
nanos
|
ac2b648e05
|
change timeout periods to never allow more than once per minute
|
2024-06-25 10:54:00 +01:00 |
|
nanos
|
885b84d598
|
ensure callbacks aren't blocked by robtos
|
2024-06-25 10:38:47 +01:00 |
|
nanos
|
1b4c135f8f
|
respect robots.txt
|
2024-06-25 10:24:45 +01:00 |
|
nanos
|
1c7023819e
|
try again
|
2024-06-25 09:03:59 +01:00 |
|
nanos
|
e6fd9c6b00
|
bug fix
|
2024-06-25 09:01:07 +01:00 |
|
nanos
|
120008ced0
|
shorten storage time
|
2024-06-25 08:50:27 +01:00 |
|
nanos
|
3278ce2f06
|
Rate limit fetching of context
|
2024-06-25 08:45:03 +01:00 |
|
nanos
|
f965b4f6fc
|
stop rushing things ...
|
2024-06-24 17:19:27 +01:00 |
|