Syfaro
dbfee26a40
Add looking up FA submissions by site ID.
2021-03-20 02:25:01 -04:00
Syfaro
17a4d39a75
Improve FurAffinity ingester ( #5 )
...
* Improve FurAffinity retry logic, add timeout.
* Only build images when pushing to master.
* Use tracing instead of directly printing messages.
* Make case consistent on messages.
* Use tracing instead of panics directly.
* Record users online.
* Extract submission handling to new function.
2021-02-27 22:26:53 -05:00
Syfaro
0e0b7e0ecb
Fix typo in drone.yml file.
2021-02-21 01:59:33 -05:00
Syfaro
5f5a93c85b
Update package names and Dockerfiles.
2021-02-21 01:26:29 -05:00
Syfaro
e57d932042
Derive more for types.
2021-02-21 00:38:48 -05:00
Syfaro
08f1b6ad22
Update drone.yml to build images.
2021-02-21 00:30:38 -05:00
Syfaro
f94f6a35f4
Remove panic, monitor video hashing duration.
2021-02-21 00:30:28 -05:00
Syfaro
eded80fd78
Include sample data and images.
2021-02-20 23:40:03 -05:00
Syfaro
ce3793f9a3
Add complete database migrations.
2021-02-20 22:48:03 -05:00
Syfaro
4ad577cee5
Update everything to Tokio v1.
2021-02-20 21:16:58 -05:00
Syfaro
8914227f23
Merge branch 'master' into unify
2021-02-20 18:05:04 -05:00
Syfaro
ed865ba512
Updates.
2021-02-20 17:36:48 -05:00
Syfaro
f592cc624d
Add 'fuzzysearch-ingest-e621/' from commit 'd557d9bbaef52b8b86904ceade7ae04b7666b210'
...
git-subtree-dir: fuzzysearch-ingest-e621
git-subtree-mainline: e1160f54db
git-subtree-split: d557d9bbae
2021-02-20 16:46:45 -05:00
Syfaro
6fe6c8ee0d
Fixes for content ratings.
2021-02-19 15:47:31 -05:00
Syfaro
274d545734
Include content rating.
2021-02-19 15:38:07 -05:00
Syfaro
c345c51a0f
Add Prometheus for request and process monitoring ( #4 )
...
* Add Prometheus metrics.
* Set default METRICS_HOST and EXPOSE in Dockerfile.
2021-02-17 17:41:55 -05:00
Syfaro
908cda8ce9
Use NOTIFY/LISTEN instead of polling for updates ( #3 )
...
* Use NOTIFY/LISTEN instead of polling for updates.
* Allow different distances for multiple hashes.
2021-02-17 16:30:05 -05:00
Syfaro
06a1c7b466
Minor formatting changes.
2021-02-17 12:28:58 -05:00
Syfaro
d557d9bbae
Keep database updated.
2021-02-16 23:43:33 -05:00
Syfaro
0453a84511
Updates.
2021-02-16 13:22:29 -05:00
Syfaro
3ade5aeba9
Add ability to search by URL, rate limit headers ( #2 )
...
* Initial progress on searching by URL.
* Avoid rejections for error messages.
* Handle some more rejections.
* Fix build issues.
* Remove detailed error messages.
* Fix issue with built Docker image.
* Add rate limit headers to all responses.
* Remove unneeded dependency.
* Limit URLs to 10MB.
2021-01-21 21:21:16 -05:00
Syfaro
e1160f54db
Update dependencies to allow building on stable.
2020-12-07 18:46:12 -06:00
Syfaro
dae97a074e
Update test step.
2020-12-07 18:23:23 -06:00
Syfaro
415d030bd2
Update Weasyl ingester.
2020-12-07 18:17:38 -06:00
Syfaro
1fda51cb5d
Add 'fuzzysearch-ingest-weasyl/' from commit '6baf256f09d44c7ac19dd1cdc956fbebae1ffedf'
...
git-subtree-dir: fuzzysearch-ingest-weasyl
git-subtree-mainline: 348352f23e
git-subtree-split: 6baf256f09
2020-12-07 18:07:57 -06:00
Syfaro
348352f23e
Some updates for FurAffinity ingester.
2020-12-07 17:57:13 -06:00
Syfaro
3d7add5c1d
Remove some unneeded files.
2020-12-07 17:49:34 -06:00
Syfaro
43e5c834a9
Add 'fuzzysearch-ingest-furaffinity/' from commit 'c44b877f70bf478e599110b10e17d152f89c8d61'
...
git-subtree-dir: fuzzysearch-ingest-furaffinity
git-subtree-mainline: 59da1e99a8
git-subtree-split: c44b877f70
2020-12-07 17:45:37 -06:00
Syfaro
59da1e99a8
Start unifying all FuzzySearch crates.
2020-12-07 17:41:32 -06:00
Syfaro
b1bc46d929
Add API endpoint to hash video input.
2020-12-07 17:20:57 -06:00
Syfaro
b1552d8ee1
Update Drone build deps.
2020-12-06 20:59:37 -06:00
Syfaro
9eb653ce6b
Add methods to extract hashes from a GIF or video.
2020-12-06 20:02:01 -06:00
Syfaro
f6319e6d90
Update dependencies.
2020-12-06 18:49:29 -06:00
Syfaro
6baf256f09
Fix loading front page.
2020-10-14 11:33:29 -04:00
Syfaro
41a993d0b1
Handle corrupted images.
2020-10-09 19:10:44 -04:00
Syfaro
0b42564c5e
Ignore submissions of other types.
2020-10-09 15:04:59 -04:00
Syfaro
c9a6706d5c
Ignore JSON deserialization errors.
2020-10-09 14:58:28 -04:00
Syfaro
54d18020a9
Another possible fix...
2020-10-09 14:42:21 -04:00
Syfaro
f2ca3d1e33
Try a different fix.
2020-10-09 14:38:29 -04:00
Syfaro
f49eba0d15
Try fixing missing library.
2020-10-09 14:35:55 -04:00
Syfaro
eb5354d4fd
Try to fix drone.
2020-10-09 14:17:27 -04:00
Syfaro
e47f2f7eac
Try to fix some build errors.
2020-10-09 14:06:50 -04:00
Syfaro
9dcf6f4713
Initial commit.
2020-10-09 14:02:58 -04:00
Syfaro
9f70ae0aca
Fix load_hashes.
2020-09-23 15:49:55 -04:00
Syfaro
2a2c3b88fc
Somewhat untested changes for new e621 API.
2020-09-23 14:00:21 -04:00
Syfaro
c44b877f70
Save images.
2020-09-14 16:12:32 -04:00
Syfaro
04506fbd53
Get file hash, size.
2020-09-06 15:40:25 -04:00
Syfaro
b6b21c4ee6
Add Prometheus metrics.
2020-09-06 13:40:00 -04:00
Syfaro
124089b76f
Update OpenTelemetry.
2020-07-22 23:04:42 -05:00
Syfaro
8972e2bede
Update deps.
2020-07-17 14:01:58 -05:00