Commit Graph

112 Commits

Author SHA1 Message Date
Syfaro
e47f2f7eac Try to fix some build errors. 2020-10-09 14:06:50 -04:00
Syfaro
9dcf6f4713 Initial commit. 2020-10-09 14:02:58 -04:00
Syfaro
9f70ae0aca Fix load_hashes. 2020-09-23 15:49:55 -04:00
Syfaro
2a2c3b88fc Somewhat untested changes for new e621 API. 2020-09-23 14:00:21 -04:00
Syfaro
c44b877f70 Save images. 2020-09-14 16:12:32 -04:00
Syfaro
04506fbd53 Get file hash, size. 2020-09-06 15:40:25 -04:00
Syfaro
b6b21c4ee6 Add Prometheus metrics. 2020-09-06 13:40:00 -04:00
Syfaro
124089b76f Update OpenTelemetry. 2020-07-22 23:04:42 -05:00
Syfaro
8972e2bede Update deps. 2020-07-17 14:01:58 -05:00
Syfaro
ec9baf0c8a Add API endpoint to check if known handle. 2020-05-14 01:34:44 -05:00
Syfaro
801d63f9d9 Change API rate limiting.
Instead of using a single rate limit bucket for searching by uploading
an image and sending a hash, use two separate buckets joined together.

Now when an image is uploaded, it consumes an image and a hash.
When just a hash is provided, it only consumes an image. This naming is
somewhat confusing, but was used for data backwards compatibility.
2020-05-14 00:58:32 -05:00
Syfaro
ee830688ff Update deps. 2020-04-06 20:27:49 -05:00
Syfaro
86c8037745 Update e621 JSON format. 2020-04-06 19:51:20 -05:00
Syfaro
95b0ec910b Updates. 2020-03-10 04:47:58 -05:00
Syfaro
eee2f7d65d Updates. 2020-03-01 19:39:05 -06:00
Syfaro
b6fdc37413 Update deps. 2020-02-19 18:23:36 -06:00
Syfaro
68b8b911d2 Include which hash caused a match in hashes. 2020-02-19 00:40:43 -06:00
Syfaro
904d3290e1 Initial attempt at an in-memory tree. 2020-02-15 23:50:09 -06:00
Syfaro
a68a46acf4 Trace incoming context. 2020-02-05 21:01:16 -06:00
Syfaro
61f87e5526 Use traceparent header to get tracing. 2020-02-05 20:31:06 -06:00
Syfaro
af213d4365 Trace using Jaeger. 2020-02-05 02:21:46 -06:00
Syfaro
80061dc051 Update deps, use sized bytes type for img_hash. 2020-01-29 14:56:36 -06:00
Syfaro
9c930d17b1 Workaround for BKtree. 2020-01-26 22:52:57 -06:00
Syfaro
ce52f145d9 Working unified index. 2020-01-25 01:25:43 -06:00
Syfaro
764f081338 Some mostly working stuff. 2020-01-24 23:27:40 -06:00
Syfaro
f1e13a70e1 Fix error in getting rows. 2020-01-24 02:52:37 -06:00
Syfaro
be5e1a9b97 Ability to stream responses for faster updates. 2020-01-24 00:29:13 -06:00
Syfaro
cad0016522 Twitter, add id_str field. 2020-01-23 16:21:02 -06:00
Syfaro
cfd05672dd Ability to search by hashes. 2020-01-21 19:04:28 -06:00
Syfaro
ceeef0b9e9 Fix schema name. 2020-01-21 14:50:47 -06:00
Syfaro
658a023334 Some improvements. 2020-01-21 03:08:15 -06:00
Syfaro
70b94f454b Log rejections. 2020-01-17 18:31:26 -06:00
Syfaro
b4b441139b Update deps, use stable Rust. 2020-01-17 17:21:30 -06:00
Syfaro
82dd1ef8b7 Initial commit. 2020-01-17 17:13:24 -06:00
Syfaro
880c5f385e Fix trying to load hashes before loop finished. 2020-01-14 02:19:42 -06:00
Syfaro
5dc771421c Load next posts to get hashes for in background. 2020-01-13 16:46:09 -06:00
Syfaro
af15b20f8e Update furaffinity-rs version. 2020-01-12 18:24:17 -06:00
Syfaro
057a91e498 Update furaffinity-rs version. 2020-01-12 18:23:47 -06:00
Syfaro
49f24e081c Print less. 2020-01-12 02:18:40 -06:00
Syfaro
8673515ed1 Various fixes. 2020-01-12 02:18:12 -06:00
Syfaro
1ce40026b3 Load hashes of more recent posts first. 2020-01-12 01:39:03 -06:00
Syfaro
a71d442f87 Incrementally load new posts. 2020-01-12 01:38:12 -06:00
Syfaro
647bcf9cfe Only get new items where no previous hash error. 2020-01-11 23:58:24 -06:00
Syfaro
f02a8db8c0 Tolerate and log hashing errors. 2020-01-11 23:56:37 -06:00
Syfaro
797fa4cb11 Fix minimum ID value. 2020-01-11 23:12:22 -06:00
Syfaro
f207d110a1 Initial commit. 2020-01-11 23:07:01 -06:00
Syfaro
ae545aed1f Insert file_id when possible. 2020-01-09 00:12:06 -06:00
Syfaro
e1133b21db Go back to bktree index. 2020-01-07 03:05:51 -06:00
Syfaro
478c9a6720 Only insert cube if hash is some. 2020-01-04 16:37:29 -06:00
Syfaro
10dc909114 Insert as cube. 2020-01-04 16:12:45 -06:00