Commit Graph

128 Commits

Author SHA1 Message Date
Syfaro
348352f23e Some updates for FurAffinity ingester. 2020-12-07 17:57:13 -06:00
Syfaro
3d7add5c1d Remove some unneeded files. 2020-12-07 17:49:34 -06:00
Syfaro
43e5c834a9 Add 'fuzzysearch-ingest-furaffinity/' from commit 'c44b877f70bf478e599110b10e17d152f89c8d61'
git-subtree-dir: fuzzysearch-ingest-furaffinity
git-subtree-mainline: 59da1e99a8
git-subtree-split: c44b877f70
2020-12-07 17:45:37 -06:00
Syfaro
59da1e99a8 Start unifying all FuzzySearch crates. 2020-12-07 17:41:32 -06:00
Syfaro
b1bc46d929 Add API endpoint to hash video input. 2020-12-07 17:20:57 -06:00
Syfaro
b1552d8ee1 Update Drone build deps. 2020-12-06 20:59:37 -06:00
Syfaro
9eb653ce6b Add methods to extract hashes from a GIF or video. 2020-12-06 20:02:01 -06:00
Syfaro
f6319e6d90 Update dependencies. 2020-12-06 18:49:29 -06:00
Syfaro
6baf256f09 Fix loading front page. 2020-10-14 11:33:29 -04:00
Syfaro
41a993d0b1 Handle corrupted images. 2020-10-09 19:10:44 -04:00
Syfaro
0b42564c5e Ignore submissions of other types. 2020-10-09 15:04:59 -04:00
Syfaro
c9a6706d5c Ignore JSON deserialization errors. 2020-10-09 14:58:28 -04:00
Syfaro
54d18020a9 Another possible fix... 2020-10-09 14:42:21 -04:00
Syfaro
f2ca3d1e33 Try a different fix. 2020-10-09 14:38:29 -04:00
Syfaro
f49eba0d15 Try fixing missing library. 2020-10-09 14:35:55 -04:00
Syfaro
eb5354d4fd Try to fix drone. 2020-10-09 14:17:27 -04:00
Syfaro
e47f2f7eac Try to fix some build errors. 2020-10-09 14:06:50 -04:00
Syfaro
9dcf6f4713 Initial commit. 2020-10-09 14:02:58 -04:00
Syfaro
9f70ae0aca Fix load_hashes. 2020-09-23 15:49:55 -04:00
Syfaro
2a2c3b88fc Somewhat untested changes for new e621 API. 2020-09-23 14:00:21 -04:00
Syfaro
c44b877f70 Save images. 2020-09-14 16:12:32 -04:00
Syfaro
04506fbd53 Get file hash, size. 2020-09-06 15:40:25 -04:00
Syfaro
b6b21c4ee6 Add Prometheus metrics. 2020-09-06 13:40:00 -04:00
Syfaro
124089b76f Update OpenTelemetry. 2020-07-22 23:04:42 -05:00
Syfaro
8972e2bede Update deps. 2020-07-17 14:01:58 -05:00
Syfaro
ec9baf0c8a Add API endpoint to check if known handle. 2020-05-14 01:34:44 -05:00
Syfaro
801d63f9d9 Change API rate limiting.
Instead of using a single rate limit bucket for searching by uploading
an image and sending a hash, use two separate buckets joined together.

Now when an image is uploaded, it consumes an image and a hash.
When just a hash is provided, it only consumes an image. This naming is
somewhat confusing, but was used for data backwards compatibility.
2020-05-14 00:58:32 -05:00
Syfaro
ee830688ff Update deps. 2020-04-06 20:27:49 -05:00
Syfaro
86c8037745 Update e621 JSON format. 2020-04-06 19:51:20 -05:00
Syfaro
95b0ec910b Updates. 2020-03-10 04:47:58 -05:00
Syfaro
eee2f7d65d Updates. 2020-03-01 19:39:05 -06:00
Syfaro
b6fdc37413 Update deps. 2020-02-19 18:23:36 -06:00
Syfaro
68b8b911d2 Include which hash caused a match in hashes. 2020-02-19 00:40:43 -06:00
Syfaro
904d3290e1 Initial attempt at an in-memory tree. 2020-02-15 23:50:09 -06:00
Syfaro
a68a46acf4 Trace incoming context. 2020-02-05 21:01:16 -06:00
Syfaro
61f87e5526 Use traceparent header to get tracing. 2020-02-05 20:31:06 -06:00
Syfaro
af213d4365 Trace using Jaeger. 2020-02-05 02:21:46 -06:00
Syfaro
80061dc051 Update deps, use sized bytes type for img_hash. 2020-01-29 14:56:36 -06:00
Syfaro
9c930d17b1 Workaround for BKtree. 2020-01-26 22:52:57 -06:00
Syfaro
ce52f145d9 Working unified index. 2020-01-25 01:25:43 -06:00
Syfaro
764f081338 Some mostly working stuff. 2020-01-24 23:27:40 -06:00
Syfaro
f1e13a70e1 Fix error in getting rows. 2020-01-24 02:52:37 -06:00
Syfaro
be5e1a9b97 Ability to stream responses for faster updates. 2020-01-24 00:29:13 -06:00
Syfaro
cad0016522 Twitter, add id_str field. 2020-01-23 16:21:02 -06:00
Syfaro
cfd05672dd Ability to search by hashes. 2020-01-21 19:04:28 -06:00
Syfaro
ceeef0b9e9 Fix schema name. 2020-01-21 14:50:47 -06:00
Syfaro
658a023334 Some improvements. 2020-01-21 03:08:15 -06:00
Syfaro
70b94f454b Log rejections. 2020-01-17 18:31:26 -06:00
Syfaro
b4b441139b Update deps, use stable Rust. 2020-01-17 17:21:30 -06:00
Syfaro
82dd1ef8b7 Initial commit. 2020-01-17 17:13:24 -06:00