Commit graph

  • 5ed751a8c6 Skip fetching context of private posts Andrew Kvalheim 2024-07-01 18:01:03 -0700
  • c58c5b5af0 use sha hashes to cache file names nanos 2024-07-01 20:06:51 +0100
  • e85384a5a6 name collision (fixes #134) nanos 2024-06-28 12:46:12 +0100
  • 6c1ec2f1c5 fix logs nanos 2024-06-28 09:08:59 +0100
  • 3639878df0 Update version nanos 2024-06-28 08:50:32 +0100
  • 80c8937a88 Improve docs nanos 2024-06-28 08:49:54 +0100
  • 5e6aa2bd66
    Merge pull request #133 from nanos/lists Michael 2024-06-28 08:47:42 +0100
  • 42774c5195 documentation update nanos 2024-06-28 08:47:21 +0100
  • fd615cad15 Support for fetching lists nanos 2024-06-28 08:22:34 +0100
  • e7da9a1f61 Fix bug nanos 2024-06-27 17:13:37 +0100
  • e0faafb37a
    Merge pull request #130 from nanos/cache-robots-on-disk Michael 2024-06-27 16:46:01 +0100
  • 009fbe54b4
    Merge pull request #131 from nanos/no-bot Michael 2024-06-27 09:18:20 +0100
  • d2a14f687a log what's happening nanos 2024-06-27 09:18:06 +0100
  • aa589670eb Do not backfill users that have opted out of indexing nanos 2024-06-27 09:06:03 +0100
  • 40b624aaff update version nanos 2024-06-27 07:56:50 +0100
  • 90988872b7 fix nanos 2024-06-26 16:45:30 +0100
  • 7e8ca17640 Cache robots.txt for 24 hours on disk to reduce load on servers nanos 2024-06-26 16:41:51 +0100
  • 3651d028a6 update version number nanos 2024-06-25 16:36:01 +0100
  • 01a2719918 shorten http timeout for robots.txt fetch nanos 2024-06-25 16:32:47 +0100
  • dec718db76
    Merge pull request #129 from nanos/cache-robots Michael 2024-06-25 16:25:26 +0100
  • 7b9896b5c0 Cache robots.txt nanos 2024-06-25 16:24:37 +0100
  • ac8044db83
    Merge pull request #128 from nanos/user-agent Michael 2024-06-25 16:16:49 +0100
  • dd468d5956 User FediFetcher as User Agent to fetch the robots.txt nanos 2024-06-25 16:15:43 +0100
  • e40d61d291 update version nanos 2024-06-25 11:00:24 +0100
  • ac2b648e05 change timeout periods to never allow more than once per minute nanos 2024-06-25 10:54:00 +0100
  • de656d1e0d
    Merge pull request #125 from nanos/robots Michael 2024-06-25 10:46:22 +0100
  • 885b84d598 ensure callbacks aren't blocked by robtos nanos 2024-06-25 10:38:47 +0100
  • 1b4c135f8f respect robots.txt nanos 2024-06-25 10:24:45 +0100
  • ed5f0ba3b4 update gitignore nanos 2024-06-25 10:01:37 +0100
  • 1c7023819e try again nanos 2024-06-25 09:03:59 +0100
  • e6fd9c6b00 bug fix nanos 2024-06-25 09:01:07 +0100
  • 721d2fc5bb
    Merge pull request #124 from nanos/rate-limits Michael 2024-06-25 08:53:16 +0100
  • 120008ced0 shorten storage time nanos 2024-06-25 08:50:27 +0100
  • 3278ce2f06 Rate limit fetching of context nanos 2024-06-25 08:45:03 +0100
  • f965b4f6fc stop rushing things ... nanos 2024-06-24 17:19:27 +0100
  • 468e092e21 fix stupid bug nanos 2024-06-24 17:18:02 +0100
  • a23d6fe1fb Add Instance name to FediFetcher UA [fixes #122] nanos 2024-06-24 17:13:23 +0100
  • 624801d0cb
    Merge pull request #120 from nanos/dependabot/pip/urllib3-1.26.19 Michael 2024-06-18 07:00:24 +0100
  • 9bc465c0bc
    Bump urllib3 from 1.26.18 to 1.26.19 dependabot[bot] 2024-06-18 01:38:27 +0000
  • df29cff634
    Merge pull request #116 from nanos/dependabot/pip/requests-2.32.0 Michael 2024-05-21 08:57:15 +0100
  • d10e60fa18
    --- updated-dependencies: - dependency-name: requests dependency-type: direct:production ... dependabot[bot] 2024-05-21 07:56:07 +0000
  • 1bb8c9d2b7
    Merge pull request #115 from AndrewKvalheim/log-level Michael 2024-04-22 19:37:24 +0100
  • 1fed215977 Quiet urllib3 logs Andrew Kvalheim 2024-04-22 11:15:25 -0700
  • fe47a8a0e5
    Merge pull request #114 from AndrewKvalheim/log-level Michael 2024-04-22 16:31:37 +0100
  • 4038d2dde5
    Merge pull request #110 from nanos/dependabot/pip/idna-3.7 Michael 2024-04-22 16:24:14 +0100
  • c528efb1be Add --log-level option Andrew Kvalheim 2024-04-21 11:24:00 -0700
  • f6ef16b933
    Bump idna from 3.4 to 3.7 dependabot[bot] 2024-04-12 02:06:56 +0000
  • 0dc65a60ef
    Merge pull request #105 from Tealk/main Michael 2024-03-15 08:40:37 +0000
  • cc260ddfa2 add to readme Tealk 2024-03-15 09:25:04 +0100
  • f9c2b37647 add .timer explanation Tealk 2024-03-15 09:23:00 +0100
  • 2f9e7feca4
    Merge pull request #108 from nanos/dependabot/pip/urllib3-1.26.18 Michael 2024-03-15 08:20:57 +0000
  • 3f6adf5927
    Bump urllib3 from 1.26.14 to 1.26.18 dependabot[bot] 2024-03-15 08:20:26 +0000
  • 1faa905269
    Merge pull request #107 from nanos/dependabot/pip/certifi-2023.7.22 Michael 2024-03-15 08:19:43 +0000
  • f28f789442
    Merge pull request #106 from nanos/dependabot/pip/requests-2.31.0 Michael 2024-03-15 08:19:28 +0000
  • eaa1056c25
    Bump certifi from 2022.12.7 to 2023.7.22 dependabot[bot] 2024-03-15 08:16:33 +0000
  • 56541263dc
    Bump requests from 2.28.2 to 2.31.0 dependabot[bot] 2024-03-15 08:16:32 +0000
  • b18333cdc4 add systemd guide Tealk 2024-03-15 08:58:22 +0100
  • 205b0731db
    Merge pull request #103 from likeazir/patch-1 Michael 2024-03-04 07:14:45 +0000
  • bf0ed943ec
    add sharkey as misskey-api-capable Jonas 2024-03-02 09:56:41 +0000
  • f5c1033fc9
    Merge pull request #102 from benyafai/main Michael 2024-02-28 17:07:35 +0000
  • ca302bb8db 🐳 docker-compose Ben Yafai 2024-02-28 17:05:09 +0000
  • 34d07a4fa1
    Merge pull request #95 from nanos/update-for-node-20 Michael 2024-02-02 07:25:44 +0000
  • e86863a8ae
    Update build-container.yaml Michael 2024-02-02 07:25:08 +0000
  • e4fca0d67e
    Merge pull request #94 from nanos/node-16-depracation Michael 2024-02-02 07:05:45 +0000
  • fe1c69f3ba
    Update get_context.yml Michael 2024-01-30 21:10:29 +0000
  • 0416cc159a
    Update get_context.yml Michael 2024-01-26 16:32:54 +0000
  • 52d3b8d9e9
    Update get_context.yml Michael 2024-01-26 16:31:22 +0000
  • 3d8ab95f11
    Update get_context.yml Michael 2024-01-26 15:52:45 +0000
  • a8dc809787
    Merge pull request #90 from himynameisjonas/patch-1 Michael 2023-12-18 10:19:11 +0000
  • 099ef7d37a
    Build docker image for arm64 as well Jonas Brusman 2023-12-16 16:07:36 +0100
  • f69eaed5a6
    Merge pull request #88 from zotanmew/main Michael 2023-10-24 13:23:15 +0100
  • 7be5dfb9b1
    Add support for Iceshrimp Laura Hausmann 2023-10-21 23:34:47 +0200
  • 95b644d431 Define nodeLoc (fixes #82) nanos 2023-09-07 08:43:10 +0100
  • bed11e83f1
    Merge pull request #80 from lhoBas/fix/k8s-cronjob Michael 2023-08-31 08:33:12 +0100
  • dafaf93d50
    examples/k8s-cronjob.yaml: fix job naming Bas 2023-08-18 10:49:22 +0200
  • 31f475dcdd fixes #79 nanos 2023-08-18 08:00:04 +0100
  • a76b52642d
    Merge pull request #71 from ToadKing/retry-cleanup Michael 2023-08-14 15:49:14 +0100
  • 0744caad6f
    Merge pull request #75 from YoannMa/fixLog Michael 2023-08-06 22:42:45 +0100
  • adc0d4ec4e
    fix bug when failing to get user's posts Yoann MALLEMANCHE 2023-08-06 17:54:34 +0200
  • 253c7c4f2b Revert "print current version on startup" (#70) nanos 2023-08-06 09:45:33 +0100
  • db2dcce2ff remove redundant code for retrying on HTTP 429 Toad King 2023-08-05 11:44:48 -0500
  • 712d88cf0d Update list of supported servers nanos 2023-08-05 09:29:49 +0100
  • ffa6617fff
    Merge pull request #66 from ToadKing/misskey Michael 2023-08-05 09:04:08 +0100
  • e207bb6435 document remember-hosts-for-days nanos 2023-08-03 15:23:23 +0100
  • c90a7e42ab fix incorrect rate limit handling for mastodon nanos 2023-08-03 15:21:59 +0100
  • 3294a44f76 cache host failures for a shorter time nanos 2023-08-03 15:21:12 +0100
  • 174448a2b0 fix bug in writing file to disk nanos 2023-08-03 10:54:14 +0100
  • ae55c96506 improve caching to provide timeout nanos 2023-08-03 10:53:17 +0100
  • 5a2b2c2311 Save seen_hosts on disk nanos 2023-08-03 07:51:46 +0100
  • 179bb65253 move note regarding access token further up nanos 2023-08-01 16:13:06 +0100
  • a7611c6e6f remove GoToSocial from Mastodon API support list Toad King 2023-07-31 17:10:29 -0500
  • 80ee1387f7 hook up host software lookup to user/post fetching Toad King 2023-07-29 22:30:25 -0500
  • c92d4e1c2c start on server software detection Toad King 2023-07-26 00:41:08 -0500
  • c169b2ae30 add hacky support for misskey and calckey/firefish Toad King 2023-07-25 01:02:41 -0500
  • 213ef57abe print current version on startup (#58) nanos 2023-07-03 08:43:34 +0100
  • 4dc41ee02c
    Merge pull request #61 from Teqed/fix/crash-on-zero-notifications Michael 2023-07-03 07:02:16 +0100
  • 47e8b485a5 fix: handle zero notifications Timothy Quilling 2023-07-02 23:51:46 -0400
  • 93d5b503af Update to indicate Lemmy support nanos 2023-07-01 20:47:25 +0100
  • f7d015004e
    Merge pull request #56 from Teqed/feat/lemmy Michael 2023-07-01 20:43:58 +0100
  • 6f7392cfaa feat: fetch root lemmy post Timothy Quilling 2023-06-30 01:36:56 -0400