3be16a9277
new_scrape_algorithm_#5 ( #20 )
...
First implementation of the new algorithm that got proposed in issue #5
Reviewed-on: anthrove/e621-to-graph#20
Reviewed-by: Lennard Brinkhaus <lennard.brinkhaus@noreply.localhost>
Reviewed-by: daskadse <daskadse@noreply.localhost>
Co-authored-by: SoXX <soxx@fenpa.ws>
Co-committed-by: SoXX <soxx@fenpa.ws>
2023-11-15 20:28:44 +00:00
60b3502ee3
implement_new_e621_sdk_#17 ( #18 )
...
As mentioned in #17 , I implemented the new SDK. I removed the scheduler and executor code since they were no longer needed.
Reviewed-on: anthrove/e621-to-graph#18
Reviewed-by: Lennard Brinkhaus <lennard.brinkhaus@noreply.localhost>
Reviewed-by: daskadse <daskadse@noreply.localhost>
Co-authored-by: SoXX <soxx@fenpa.ws>
Co-committed-by: SoXX <soxx@fenpa.ws>
2023-11-08 13:01:27 +00:00
b6d0f4d63f
rework_logging_#12 ( #16 )
...
Better and more extensive logging with proper logging levels, also new env variables are created to control those.
Reviewed-on: anthrove/e621-to-graph#16
Reviewed-by: Lennard Brinkhaus <lennard.brinkhaus@noreply.localhost>
Co-authored-by: Fenpaws <soxx@fenpa.ws>
Co-committed-by: Fenpaws <soxx@fenpa.ws>
2023-07-26 13:27:18 +00:00
802764092e
refactor_folder_structure_#11 ( #14 )
...
As mentioned in Issue #11 , the folder structure got an overall as some file names
Co-authored-by: Fenpaws <soxx@fenpa.ws>
Reviewed-on: anthrove/e621-to-graph#14
Reviewed-by: Lennard Brinkhaus <lennard.brinkhaus@noreply.localhost>
Co-authored-by: SoXX <fenpaws@noreply.localhost>
Co-committed-by: SoXX <fenpaws@noreply.localhost>
2023-07-17 10:57:23 +00:00
31bd0cf639
api-call-system-#10 ( #13 )
...
Co-authored-by: Fenpaws <soxx@fenpa.ws>
Reviewed-on: anthrove/e621-to-graph#13
Reviewed-by: SoXX <fenpaws@noreply.localhost>
Co-authored-by: Lennard Brinkhaus <lennard.brinkhaus@noreply.localhost>
Co-committed-by: Lennard Brinkhaus <lennard.brinkhaus@noreply.localhost>
2023-07-17 08:10:13 +00:00
f4b73034b8
Merge pull request 'feat: create first version of a build-check gitea action workflow' ( #8 ) from feat/workflows into master
...
Reviewed-on: fenpaws/e621-to-graph#8
2023-06-24 21:35:33 +00:00
b71152e822
fix: use github repo for go image
2023-06-24 23:19:03 +02:00
8cfa2916ec
feat: create first version of a build-check gitea action workflow
2023-06-24 23:12:56 +02:00
2d9cc7e9fe
added variable for easier modifications
2023-06-22 12:30:05 +02:00
aa6f928ed2
revert 010397ef63
...
revert added variable for easier modifications
2023-06-22 10:29:26 +00:00
010397ef63
added variable for easier modifications
2023-06-22 12:28:37 +02:00
277236057e
fixed user issue
2023-06-22 12:27:22 +02:00
b75cacef82
set post limit to 320 posts per request
2023-06-22 12:18:25 +02:00
8cf25e2ac9
added dockerfile and compose config ( #1 )
...
Co-authored-by: Patrick Kauls <patrick@kauls.xyz>
Reviewed-on: fenpaws/e621-to-graph#1
2023-06-22 09:12:43 +00:00
David Janowski
9c98059972
changed env for DB to be more DB agnostic
2023-06-22 11:00:08 +02:00
David Janowski
83ba0f6464
changed env for DB to be more DB agnostic
2023-06-22 10:39:13 +02:00
David Janowski
4232e41d6b
improved documentation
2023-06-22 09:35:13 +02:00
David Janowski
6d7fd4395d
fixed issue #2
2023-06-22 09:04:52 +02:00
David Janowski
5630c281c1
update
2023-06-21 13:32:27 +02:00
David Janowski
9cfe7abcae
go mod tidy
2023-06-21 13:32:22 +02:00
David Janowski
0f964120bd
added simple build script
2023-06-21 13:30:39 +02:00
David Janowski
3df1ae5f59
removed dgraph
2023-06-21 13:30:28 +02:00
David Janowski
4a285e8c52
update to ignore .run folder
2023-06-21 13:30:04 +02:00
David Janowski
75eec7c0f5
using new logging provider
2023-06-21 13:29:29 +02:00
David Janowski
d9436c5843
using new logging provider
2023-06-21 13:29:23 +02:00
David Janowski
f95e9b0853
added DB Interface for later dgraph DB backend
2023-06-20 10:38:36 +02:00
David Janowski
ce9c081ae6
added rate limiting with brust
2023-06-17 21:18:01 +02:00
David Janowski
3a964f598f
generalized request
2023-06-17 20:51:04 +02:00
David Janowski
b49fdea71c
added queue, changed fav api endpoint for e621, fixed db query and added a check if fav already exists
2023-06-17 19:13:25 +02:00
David Janowski
e838b7b724
removed deprecated function
2023-05-30 14:06:34 +02:00
David Janowski
efc49e1a2c
set logger to info and removed deprecated functions
2023-05-30 14:04:39 +02:00
David Janowski
0e07b02346
added check function for user to post relationship
2023-05-30 14:04:13 +02:00
7d494d5f7a
add some debug stuff
2023-05-26 12:19:36 +02:00
David Janowski
8113adba53
logging and cleanup
2023-05-24 23:11:49 +02:00
David Janowski
690201433d
now using subroutines
2023-05-24 23:11:31 +02:00
David Janowski
15ee54553c
removed unused code & added log message
2023-05-24 23:11:20 +02:00
David Janowski
2b5fd4843a
added redis
2023-05-24 23:11:00 +02:00
David Janowski
10c0247f3c
added user api implementation
2023-05-24 16:05:27 +02:00
David Janowski
dc4cf3be42
added most types of relationships (HAS_SOURCE, HAS_TAG, IS_FAVORITE)
2023-05-22 22:10:05 +02:00
David Janowski
11dac75882
nwo able to upload the sources to the DB
2023-05-22 21:01:59 +02:00
David Janowski
409788d0b0
added support for e621 post and groundwork for sources
2023-05-22 19:53:30 +02:00
David Janowski
a7b97a0e35
Added another method making tags unique
2023-05-22 17:50:26 +02:00
David Janowski
08502160cc
moved neo4j integration
2023-05-22 16:01:20 +02:00
David Janowski
01fcb00191
experiments uploading of the tags to neo4j
2023-05-22 16:00:49 +02:00
David Janowski
1dd14b9c82
added first neo4j integration
2023-05-22 16:00:01 +02:00
David Janowski
7bf67372e9
fix: used required field for verification
2023-05-22 14:26:10 +02:00
David Janowski
e0a312bffc
inital commit
2023-05-22 13:08:08 +02:00
