Commit Graph

144 Commits

Author SHA1 Message Date
Syfaro
4ad577cee5 Update everything to Tokio v1. 2021-02-20 21:16:58 -05:00
Syfaro
8914227f23 Merge branch 'master' into unify 2021-02-20 18:05:04 -05:00
Syfaro
ed865ba512 Updates. 2021-02-20 17:36:48 -05:00
Syfaro
f592cc624d Add 'fuzzysearch-ingest-e621/' from commit 'd557d9bbaef52b8b86904ceade7ae04b7666b210'
git-subtree-dir: fuzzysearch-ingest-e621
git-subtree-mainline: e1160f54db
git-subtree-split: d557d9bbae
2021-02-20 16:46:45 -05:00
Syfaro
6fe6c8ee0d Fixes for content ratings. 2021-02-19 15:47:31 -05:00
Syfaro
274d545734 Include content rating. 2021-02-19 15:38:07 -05:00
Syfaro
c345c51a0f
Add Prometheus for request and process monitoring (#4)
* Add Prometheus metrics.

* Set default METRICS_HOST and EXPOSE in Dockerfile.
2021-02-17 17:41:55 -05:00
Syfaro
908cda8ce9
Use NOTIFY/LISTEN instead of polling for updates (#3)
* Use NOTIFY/LISTEN instead of polling for updates.

* Allow different distances for multiple hashes.
2021-02-17 16:30:05 -05:00
Syfaro
06a1c7b466 Minor formatting changes. 2021-02-17 12:28:58 -05:00
Syfaro
d557d9bbae Keep database updated. 2021-02-16 23:43:33 -05:00
Syfaro
0453a84511 Updates. 2021-02-16 13:22:29 -05:00
Syfaro
3ade5aeba9
Add ability to search by URL, rate limit headers (#2)
* Initial progress on searching by URL.

* Avoid rejections for error messages.

* Handle some more rejections.

* Fix build issues.

* Remove detailed error messages.

* Fix issue with built Docker image.

* Add rate limit headers to all responses.

* Remove unneeded dependency.

* Limit URLs to 10MB.
2021-01-21 21:21:16 -05:00
Syfaro
e1160f54db Update dependencies to allow building on stable. 2020-12-07 18:46:12 -06:00
Syfaro
dae97a074e Update test step. 2020-12-07 18:23:23 -06:00
Syfaro
415d030bd2 Update Weasyl ingester. 2020-12-07 18:17:38 -06:00
Syfaro
1fda51cb5d Add 'fuzzysearch-ingest-weasyl/' from commit '6baf256f09d44c7ac19dd1cdc956fbebae1ffedf'
git-subtree-dir: fuzzysearch-ingest-weasyl
git-subtree-mainline: 348352f23e
git-subtree-split: 6baf256f09
2020-12-07 18:07:57 -06:00
Syfaro
348352f23e Some updates for FurAffinity ingester. 2020-12-07 17:57:13 -06:00
Syfaro
3d7add5c1d Remove some unneeded files. 2020-12-07 17:49:34 -06:00
Syfaro
43e5c834a9 Add 'fuzzysearch-ingest-furaffinity/' from commit 'c44b877f70bf478e599110b10e17d152f89c8d61'
git-subtree-dir: fuzzysearch-ingest-furaffinity
git-subtree-mainline: 59da1e99a8
git-subtree-split: c44b877f70
2020-12-07 17:45:37 -06:00
Syfaro
59da1e99a8 Start unifying all FuzzySearch crates. 2020-12-07 17:41:32 -06:00
Syfaro
b1bc46d929 Add API endpoint to hash video input. 2020-12-07 17:20:57 -06:00
Syfaro
b1552d8ee1 Update Drone build deps. 2020-12-06 20:59:37 -06:00
Syfaro
9eb653ce6b Add methods to extract hashes from a GIF or video. 2020-12-06 20:02:01 -06:00
Syfaro
f6319e6d90 Update dependencies. 2020-12-06 18:49:29 -06:00
Syfaro
6baf256f09 Fix loading front page. 2020-10-14 11:33:29 -04:00
Syfaro
41a993d0b1 Handle corrupted images. 2020-10-09 19:10:44 -04:00
Syfaro
0b42564c5e Ignore submissions of other types. 2020-10-09 15:04:59 -04:00
Syfaro
c9a6706d5c Ignore JSON deserialization errors. 2020-10-09 14:58:28 -04:00
Syfaro
54d18020a9 Another possible fix... 2020-10-09 14:42:21 -04:00
Syfaro
f2ca3d1e33 Try a different fix. 2020-10-09 14:38:29 -04:00
Syfaro
f49eba0d15 Try fixing missing library. 2020-10-09 14:35:55 -04:00
Syfaro
eb5354d4fd Try to fix drone. 2020-10-09 14:17:27 -04:00
Syfaro
e47f2f7eac Try to fix some build errors. 2020-10-09 14:06:50 -04:00
Syfaro
9dcf6f4713 Initial commit. 2020-10-09 14:02:58 -04:00
Syfaro
9f70ae0aca Fix load_hashes. 2020-09-23 15:49:55 -04:00
Syfaro
2a2c3b88fc Somewhat untested changes for new e621 API. 2020-09-23 14:00:21 -04:00
Syfaro
c44b877f70 Save images. 2020-09-14 16:12:32 -04:00
Syfaro
04506fbd53 Get file hash, size. 2020-09-06 15:40:25 -04:00
Syfaro
b6b21c4ee6 Add Prometheus metrics. 2020-09-06 13:40:00 -04:00
Syfaro
124089b76f Update OpenTelemetry. 2020-07-22 23:04:42 -05:00
Syfaro
8972e2bede Update deps. 2020-07-17 14:01:58 -05:00
Syfaro
ec9baf0c8a Add API endpoint to check if known handle. 2020-05-14 01:34:44 -05:00
Syfaro
801d63f9d9 Change API rate limiting.
Instead of using a single rate limit bucket for searching by uploading
an image and sending a hash, use two separate buckets joined together.

Now when an image is uploaded, it consumes an image and a hash.
When just a hash is provided, it only consumes an image. This naming is
somewhat confusing, but was used for data backwards compatibility.
2020-05-14 00:58:32 -05:00
Syfaro
ee830688ff Update deps. 2020-04-06 20:27:49 -05:00
Syfaro
86c8037745 Update e621 JSON format. 2020-04-06 19:51:20 -05:00
Syfaro
95b0ec910b Updates. 2020-03-10 04:47:58 -05:00
Syfaro
eee2f7d65d Updates. 2020-03-01 19:39:05 -06:00
Syfaro
b6fdc37413 Update deps. 2020-02-19 18:23:36 -06:00
Syfaro
68b8b911d2 Include which hash caused a match in hashes. 2020-02-19 00:40:43 -06:00
Syfaro
904d3290e1 Initial attempt at an in-memory tree. 2020-02-15 23:50:09 -06:00