17 commits

Author	SHA1	Message	Date
io	94949289f0	normalize Pleroman posts without cws (fix #3)	2021-09-27 11:17:56 +00:00
io	4492f6685c	remove repeated call to extract_post_content (#2) ... fortunately, extract_post_content returns the same thing when called repeatedly, so this wasn't a big deal anyway	2021-09-27 11:17:56 +00:00
ioistired	3d393c7577	Merge pull request #2 from TinfoilSubmarine/create-posts-on-first-run ... Commit on DB object creation to ensure table posts is created	2021-09-27 05:42:46 -05:00
io	2bea936cf2	fix fetching from masto instances	2021-09-21 13:58:20 +00:00
Joel Beckmeyer	6f0a389050	create table posts if it does not exist	2021-09-17 14:07:32 -04:00
io	da961a0e35	add TODO comment	2021-09-17 06:37:39 +00:00
io	788f8550c7	handle rate limits	2021-09-17 06:35:54 +00:00
io	b906abe2b1	add basic migration support	2021-09-17 06:35:35 +00:00
io	191214dbd6	save some memory by using account handles instead of objects	2021-08-19 10:40:57 +00:00
io	97a2f5de00	a few changes ... - better error reporting - fix the program hanging at the end if any of the accounts failed to fetch - remove trailing semicolon from user agent string	2021-08-13 09:40:20 +00:00
io	9b60540d07	move db_path default to load_config	2021-07-26 06:47:43 +00:00
io	a3348602c1	fetch_posts: add KeyboardInterrupt handling	2021-07-26 06:17:01 +00:00
io	4ba3bb1662	fetch_posts.py: use argparse	2021-07-26 06:04:32 +00:00
io	b8e727cfd4	fetch_posts.py: remove unused import	2021-07-26 06:04:14 +00:00
io	330fdc2809	rewrite fetch_posts.py from scratch ... now it should be properly async by fetching posts in a separate task and sending them across a queue to a task that inserts to the DB	2021-07-26 04:59:04 +00:00
io	944e2fc3a5	use json5 instead lol ... toml sucks add null when	2021-06-18 10:38:58 +00:00
io	5f9959fff8	rename main.py to fetch_posts.py	2021-06-16 04:26:22 +00:00

Renamed from main.py (Browse further)