Commit Graph

91 Commits (a764cc8f605df39034f8c848249abcc49be47382)

Author SHA1 Message Date
Kaias Blackwood a764cc8f60 Fixed README table formatting 2025-08-14 20:02:39 +00:00
Kaias Blackwood bf9f3b8e7a Merge https://github.com/neobooru/neo-scraper 2025-08-14 17:58:51 +00:00
Kaias Blackwood e1ffab613b Updated README for e6ai.net 2025-08-14 17:52:21 +00:00
Kaias Blackwood 7b3ac61156 Fixed image download link issue. Added support for e9ai domain. 2025-08-14 17:47:21 +00:00
neobooru 51be6dfdcd Fix + bump version 2025-04-12 01:03:38 +02:00
neobooru 4692fe757d Fix some things 2025-04-12 00:10:28 +02:00
Shae 832b3d286d feat: add more domains 2025-04-11 22:43:56 +02:00
Kaias Blackwood eeee42c389 Updated tag scraping to new e621 DOM 2025-04-11 22:39:35 +02:00
Kaias Blackwood c1f8399416 Updated tag scraping to new e621 DOM 2025-03-30 02:48:34 +00:00
neobooru ed9580ea58 Add basic bluesky support (image only) 2025-02-18 23:32:50 +01:00
neobooru ad2d1fe585 Fix tests and some small issues 2024-12-08 18:03:32 +01:00
neobooru cfbd9652ec Fix crash when yande.re post source has no link 2024-07-11 23:06:54 +02:00
neobooru 593c4cef0d yande.re hotlink protection workaround 2024-07-11 22:55:57 +02:00
neobooru 17c84b16db UploadMode tweaks + add Nozomi + add x.com as twitter domain 2024-06-25 23:37:35 +02:00
neobooru df9b1b2cfe Add uploadMode to engines 2024-06-14 16:55:20 +02:00
neobooru 5253297809 Update danbooru tag category scraper 2024-01-09 23:19:10 +01:00
neobooru 6cd6bb1745 Add sensitive -> sketchy conversion for gelbooru 2024-01-01 20:15:43 +01:00
neobooru 56c3e78afd Fix bug where exhentai full resolution picture would not be found 2023-12-01 23:00:38 +01:00
neobooru fa6baa75b7 Fix and update tests and use pnpm instead of yarn 2023-11-05 15:09:49 +01:00
neobooru 18e9b57e12 Add Philomena video resolution test 2023-07-22 14:35:56 +02:00
GlobalGit3 7a12310bb4 Update Philomena.ts
Fix resolution grabbing extra data, on video/animated images specifically.
This is only a visual issue and not a problem for importing.
2023-07-22 11:54:23 +00:00
neobooru b2937d3c94 Find PNG version of posts on konachan + test fixes 2023-07-05 13:58:23 +02:00
neobooru c149992fb2 Bump version to 0.7.0 2023-07-05 13:11:28 +02:00
neobooru da0593e432 Fix typescript definitions for test utilities 2023-07-05 13:07:29 +02:00
Neo c9daac63b0
Merge pull request #15 from GlobalGit3/master
Added Philomena Scraper
2023-07-05 11:06:07 +00:00
neobooru 5beea8cc69 Small fixes and add extra test 2023-07-05 13:04:41 +02:00
GlobalGit3 e208d69695 Updated Features & Added resolution.
Resolution now supported.
Feature list was updated to reflect both resolution and tag category being used now.
2023-07-03 16:43:39 -05:00
GlobalGit3 8d215729f3 Map and Arrays for prefixes
Categorize tags and remove prefixes using Maps and Arrays.
A quick write-up, but works for the time being to get an idea for what is wanted.

Due to the data-tag-category's 'origin' being used for more than artist's names, prefixes are used to categorize the artist tag. There are also other prefixes such as 'editor' that are the same as 'artist'. This should be no problem as all artists' tags start with the 'artist' or 'editor' prefix.

Suffixes only applies when removing a prefix, this will probably be changed later to apply without removing the prefix.
It was coded to give an idea of wanting to change tagNames from "oc:originalcharacter" to "originalcharacter_(oc)".
2023-07-02 01:49:40 -05:00
neobooru 580e308f8f Remove safety tags from list and add categories 2023-07-02 00:20:12 +02:00
GlobalGit3 4c0c790c0c Attempt to 'prettier' code
* Hopefully this is 'prettier'
2023-07-01 14:24:08 -05:00
GlobalGit3 3407ae2a8c Update Philomena.ts
* Removed useless check
2023-07-01 14:14:44 -05:00
GlobalGit3 b9ae6a1e8a
Update README.md
Used the wrong readme, oopsies.
2023-07-01 08:32:35 -05:00
GlobalGit3 e10baedddc
Update Philomena.test.ts
Fixed a small oversight. No worries with the old id.
2023-07-01 08:30:07 -05:00
GlobalGit3 8b89e7b527 Added Philomena
* Philomena support
2023-07-01 08:17:53 -05:00
neobooru 4254c5f5d8 Bump version to 0.6.0 2023-06-19 21:31:19 +02:00
neobooru 52c48526af tsconfig.json change which shouldn't break anything 2023-06-19 21:30:02 +02:00
neobooru b67d024274 Fix broken engines and update tests where needed 2023-06-19 21:22:23 +02:00
neobooru bf1e9d9e62 Add experimental e-hentai engine 2023-06-19 21:05:24 +02:00
neobooru f89ab0b949 Upgrade dependencies and maybe fix tests 2023-02-11 00:27:39 +01:00
neobooru 8c12ad4d49 Fix ES module crap
I hope
2023-01-15 16:42:30 +01:00
neobooru 1c9e0934d1 Fix zerochan issue 2022-10-22 13:30:13 +02:00
neobooru be6111e166 Map sensitive as sketchy on danbooru + small fix 2022-10-22 00:50:51 +02:00
neobooru de16edd143 Bump version 2022-08-12 01:31:16 +02:00
neobooru 535b358e7d Build fixes 2022-08-12 01:27:33 +02:00
neobooru 75f5c201b4 Add support for multiple source fields + add tests 2022-08-10 14:01:17 +02:00
neobooru 73ffee047e Set user who submitted the art as the artists on furaffinity 2022-08-10 14:00:27 +02:00
neobooru d127ec755b Fix broken tag names when logged into moebooru site 2022-08-09 18:08:18 +02:00
neobooru 3d602869ed Fix jest puppeteer config 2022-08-09 00:41:19 +02:00
neobooru a599710276 Add feature info to engines + project cleanup 2022-08-07 20:48:28 +02:00
neobooru 198da89bc4 Update Pixiv engine and tests 2022-08-07 15:24:04 +02:00