lucdev
82320560a1
Rate limiter: fix datetime parser ( fixes #5 )
2022-12-29 01:32:22 +00:00
Joel Beckmeyer
6523a28e11
fix some pleroma errors with async and 500 errors ( #4 )
...
* fix some pleroma errors with async and 500 errors
* add better recovery/handling of HTTP 500
* remove unnecessary else
2022-12-29 01:22:24 +00:00
io
766b60c09c
accept pleroma-style empty string CWs ( fix #3 )
2021-09-27 11:17:56 +00:00
io
94949289f0
normalize Pleroman posts without cws ( fix #3 )
2021-09-27 11:17:56 +00:00
io
4492f6685c
remove repeated call to extract_post_content ( #2 )
...
fortunately, extract_post_content returns the same thing when called repeatedly,
so this wasn't a big deal anyway
2021-09-27 11:17:56 +00:00
io
f3014f029b
update README
2021-09-27 11:17:56 +00:00
ioistired
3d393c7577
Merge pull request #2 from TinfoilSubmarine/create-posts-on-first-run
...
Commit on DB object creation to ensure table posts is created
2021-09-27 05:42:46 -05:00
io
7b2faec9ae
fix posting on masto without a reply_to_id
2021-09-21 16:56:04 +00:00
io
c301fd31c5
fix AttributeError in gen.py
2021-09-21 16:55:45 +00:00
io
ade608562e
fix old license header
2021-09-21 13:59:45 +00:00
io
2bea936cf2
fix fetching from masto instances
2021-09-21 13:58:20 +00:00
Joel Beckmeyer
6f0a389050
create table posts if it does not exist
2021-09-17 14:07:32 -04:00
io
da961a0e35
add TODO comment
2021-09-17 06:37:39 +00:00
io
788f8550c7
handle rate limits
2021-09-17 06:35:54 +00:00
io
b906abe2b1
add basic migration support
2021-09-17 06:35:35 +00:00
io
191214dbd6
save some memory by using account handles instead of objects
2021-08-19 10:40:57 +00:00
io
4e16eef4e1
add TODOs
2021-08-17 05:55:47 +00:00
io
5db218e362
forgot to sanitize mentions in output
2021-08-17 05:55:29 +00:00
io
97a2f5de00
a few changes
...
- better error reporting
- fix the program hanging at the end if any of the accounts failed to fetch
- remove trailing semicolon from user agent string
2021-08-13 09:40:20 +00:00
io
9b60540d07
move db_path default to load_config
2021-07-26 06:47:43 +00:00
io
d0965d437b
make third_party.utils.make_toot async
2021-07-26 06:29:20 +00:00
io
4e4619fbe0
markov.py: fix queries to reflect schema changes
2021-07-26 06:24:26 +00:00
io
dce92186f9
config.defaults.json: add db_path key
2021-07-26 06:17:28 +00:00
io
a3348602c1
fetch_posts: add KeyboardInterrupt handling
2021-07-26 06:17:01 +00:00
io
4ba3bb1662
fetch_posts.py: use argparse
2021-07-26 06:04:32 +00:00
io
b8e727cfd4
fetch_posts.py: remove unused import
2021-07-26 06:04:14 +00:00
io
5dcbd4ccfa
add generation_mode to config.defaults.json
2021-07-26 06:03:43 +00:00
io
8be760e8af
broaden .gitignore
2021-07-26 06:03:29 +00:00
io
6b97f6cbff
split requirements.txt into gpt2, markov, and base reqs
2021-07-26 05:45:45 +00:00
io
960061b92b
remove old app.json
2021-07-26 05:35:14 +00:00
io
a78c60ac6f
remove posts.db from git
2021-07-26 05:19:31 +00:00
io
330fdc2809
rewrite fetch_posts.py from scratch
...
now it should be properly async by fetching posts in a separate task and sending them across
a queue to a task that inserts to the DB
2021-07-26 04:59:04 +00:00
io
c22a493dff
license compliance stuff and other changes
...
relicense to AGPLv3
comply with the MPL's file copyleft
some other changes in the direction of supporting GPT-2 which were hard to untangle from the rest of the changes (sorry)
2021-07-26 04:52:44 +00:00
io
944e2fc3a5
use json5 instead lol
...
toml sucks add null when
2021-06-18 10:38:58 +00:00
io
79301382cd
fix AttributeError in Pleroma.reply()
2021-06-18 09:05:55 +00:00
io
b5b4349d7f
implement chud alarm
2021-06-16 04:58:24 +00:00
io
213bdf75c3
add asqlite to requirements
2021-06-16 04:34:59 +00:00
io
fcbbd7decf
fix requirements.txt
2021-06-16 04:30:56 +00:00
io
8c14e031e8
remove Dockerfile
2021-06-16 04:26:36 +00:00
io
a6aff9b4fa
update README
2021-06-16 04:26:29 +00:00
io
5f9959fff8
rename main.py to fetch_posts.py
2021-06-16 04:26:22 +00:00
io
b93ee8fa45
fix readme link
2021-06-16 04:23:47 +00:00
io
8c0041e8ad
update README
2021-06-16 04:17:57 +00:00
io
36a416da7a
fix Pleroma.reply() not tagging
2021-06-16 04:14:18 +00:00
io
e273a28aae
update README
2021-06-16 03:50:27 +00:00
io
01a39db9d6
rewrite reply.py too
2021-06-16 03:49:34 +00:00
io
5d1c3397b6
rewrite for anyio+aiohttp
2021-06-16 01:59:57 +00:00
io
93095f62f3
relicense
2021-06-16 01:29:53 +00:00
io
16a39c8493
update README
2021-06-14 21:43:16 +00:00
io
04178b37d7
fix scraping posts
...
saves the cursors provided in the first page to the db so that we can reuse it next time we fetch,
instead of assuming the format of the cursor URL manually using min_id
2021-06-14 21:39:17 +00:00
