84 Commits (e859d6f259cfe4aa61c2e68a18db95d34d460b81)

Author	SHA1	Message	Date
takayamaki	3eedad2737	change sidekiq queueing to bulk push (#3536)	8 years ago
Matt Jankowski	ec34ec63b1	Specs for cleanup workers (#3235) ... * Add spec files for feed and media cleanup workers * Add coverage for feed and media cleanup schedulers * Clean up feed and media cleanup workers	8 years ago
Eugen Rochko	ef900789bc	Replace mastodon:media:clear and mastodon:feeds:clear rake tasks with (#3180) ... sidekiq-scheduler jobs Resolves #2495	8 years ago
Matt Jankowski	d2e0edd721	Add spec coverage for regeneration worker (#3143)	8 years ago
Matt Jankowski	db4119f971	Specs for precompute feed service (#3142) ... * Add spec for precompute feed service * Refactor PrecomputeFeedService * spec wip	8 years ago
Matt Jankowski	8ec8410651	After remote follow worker specs (#3098) ... * Add specs for the after remote follow workers * Refactor the after remote follow workers	8 years ago
Eugen Rochko	657496b5a9	Do not cancel PuSH subscriptions after encountering "permanent" error… (#3046) ... * Do not cancel PuSH subscriptions after encountering "permanent" error response After talking with MMN about it, turns out some servers/php setups do return 4xx errors while rebooting, so this anti-feature that was meant to take load off of the hub is doing more harm than good in terms of breaking subscriptions * Update delivery_worker.rb	8 years ago
Matt Jankowski	0d70fe2659	Spec coverage and refactor for pubsub/delivery worker (#3021) ... * Framework for delivery worker spec * Refactor of pubsub delivery worker	8 years ago
Matt Jankowski	08949cca41	Pubsub confirmation worker spec (#2974) ... * Add specs for valid challenge response from pubsub confirmation worker * Refactor the pubsub confirmation worker	8 years ago
Matt Jankowski	cc9a6a710f	Spec feed insert worker (#2965) ... * Spec for feed insert worker when missing records * more specs! * Refactor feed insert worker	8 years ago
Matt Jankowski	d142544159	Spec coverage and refactor of digest mailer worker (#2961)	8 years ago
Eugen Rochko	3a38322a54	Add spec for Pubsubhubbub::DistributionWorker. PuSH-deliver public items (#2954) ... to all subscribers. IDN-normalize callback URLs for subscriptions on insert.	8 years ago
haoyayoi	2fba94b36e	add content-type in pubsubhubhub request header (#2943) ... * add content-type in pubsubhubhub request header * fix type	8 years ago
Eugen Rochko	b8e166894b	Fix Scheduler::SubscriptionsScheduler (#2834) ... * Fix Scheduler::SubscriptionsScheduler, add worker test for it * Change production log level of Sidekiq to "warn" instead of "info"	8 years ago
Eugen Rochko	81584779cb	More robust PuSH subscription refreshes (#2799) ... * Fix #2473 - Use sidekiq scheduler to refresh PuSH subscriptions instead of cron Fix an issue where / in domain would raise exception in TagManager#normalize_domain PuSH subscriptions refresh done in a round-robin way to avoid hammering a single server's hub in sequence. Correct handling of failures/retries through Sidekiq (see also #2613). Optimize Account#with_followers scope. Also, since subscriptions are now delegated to Sidekiq jobs, an uncaught exception will not stop the entire refreshing operation halfway through Fix #2702 - Correct user agent header on outgoing http requests * Add test for SubscribeService * Extract #expiring_accounts into method * Make mastodon:push:refresh no-op * Queues are now defined in sidekiq.yml * Queues are now in sidekiq.yml	8 years ago
Eugen	17c591ffba	Punycode URI normalization (#2370) ... * Fix #2119 - Whenever about to send a HTTP request, normalize the URI * Add test for IDN request in FetchLinkCardService * Perform IDN normalization on domains before they are stored in the DB	8 years ago
Eugen	501514960a	Followers-only post federation (#2111) ... * Make private toots get PuSHed to subscription URLs that belong to domains where you have approved followers * Authorized followers controller, stub for bulk action * Soft block in the background * Add simple test for new controller * Rename Settings::FollowersController to Settings::FollowerDomainsController, paginate results, rename "private" post setting to "followers-only", fix pagination style, improve post privacy preferences style, improve warning style * Extract compose form warnings into own container, show warning when posting to followers-only with unlocked account	8 years ago
Matt Jankowski	c44a700252	Quick best practice cleanup of views/helpers (#1546) ... * Remove trailing whitespace * Use query methods instead of explicit .blank? checks	8 years ago
Matt Jankowski	7f0a865b05	Allow import/export of mutes list (#1541) ... * Allow export of mutes list * Allow importing of mutes list * Refactor to use Settings::Exports::BaseController and DRY up exports code	8 years ago
Matt Jankowski	89e8e110c8	Imports controller errors (#1553) ... * Add spec for settings/imports controller * Add failing spec for settings/imports#create * Fix broken imports * Refactor ImportWorker	8 years ago
Jantso Porali	e30bbb1cb0	Fix for Import issue from URL (#1416)	8 years ago
Eugen	982fef811e	Fix #1141, fix #1126 - Avatar/profile info fetching (#1215) ... * Fix #1141, fix #1126 - Work through UpdateRemoteProfileService for both <feed> and <entry> top-level tags * Improve code quality, remove line unrelated to fix	8 years ago
Eugen	6d6a429af8	Rewrite Atom generation from stream entries to use Ox instead of Nokogiri (#1124) ... * Rewrite Atom generation from stream entries to use Ox instead of Nokogiri::Builder StreamEntry is now limited to only statuses, which allows some optimization. Removed extra queries on AccountsController#show. AtomSerializer instead of AtomBuilderHelper used in AccountsController#show, StreamEntriesController#show, StreamEntryRenderer and PubSubHubbub::DistributionWorker PubSubHubbub::DistributionWorker moves n+1 DomainBlock query to PubSubHubbub::DeliveryWorker instead. All Salmon slaps that aren't based on StreamEntry still use AtomBuilderHelper and Nokogiri * All Salmon slaps now use Ox instead of Nokogiri. No touch from status on account	8 years ago
blackle	540d6efe88	Catch more errors in process_follows so it doesn't fail	8 years ago
Eugen Rochko	5442083b3c	Split SalmonWorker into smaller parts, move profile updating into another job	8 years ago
Eugen Rochko	5b95be1c42	Replace calls to FeedManager#inline_render and #broadcast	8 years ago
Eugen	c9ebd5d19f	Fix wrong variable used in publish channel	8 years ago
Eugen	1b8c244dff	Add proper message to PushUpdateWorker, use redis directly	8 years ago
Eugen	3d8b80e1cc	Merge branch 'master' into broadcast-to-worker	8 years ago
Eugen Rochko	220bc48e8e	Only render public payload once in FanOutOnWrite	8 years ago
Kurtis Rainbolt-Greene	22dcadedb4	We're going to want these nice helper methods, lets share them with a parent class that matches Rails 5 practices (application level abstraction)	8 years ago
Kurtis Rainbolt-Greene	9638894233	Moving in the inline render	8 years ago
Kurtis Rainbolt-Greene	220051b8b2	I don't actually think we need that.	8 years ago
Kurtis Rainbolt-Greene	0069c01285	Moving the queue_at into the worker	8 years ago
Kurtis Rainbolt-Greene	96ef933820	Replacing the broadcast method with the one defined in the feed manager	8 years ago
Kurtis Rainbolt-Greene	1e96ce378e	By pushing this into a worker we can reduce the amount of time the feed manager using workers eat up a connection	8 years ago
Eugen Rochko	bda37489ac	Remove PuSH subscriptions when delivery is answered with a 4xx error	8 years ago
Eugen Rochko	6fd865c000	Spawn FeedInsertWorker to deliver status into personal feed	8 years ago
Eugen Rochko	82aaedec46	Reduce number of items in feeds, optimize regeneration worker slightly, ... make regeneration worker unique, (only schedule/execute once at a time)	8 years ago
Eugen Rochko	b21f7c28f6	Move OStatus processing back into default queue	8 years ago
Eugen Rochko	b510a56c0c	Only call regeneration worker after first login after a 14 day break	8 years ago
Eugen Rochko	f722bd2387	Separate background jobs into different queues. ATTENTION: new queue "pull" ... must be added to the Sidekiq invokation in your systemd file The pull queue will handle link crawling, thread resolving, and OStatus processing. Such tasks are more likely to hang for a longer time (due to network requests) so it is more sensible to not make the "in-house" tasks wait for them.	8 years ago
Eugen Rochko	b7c1b12367	Make default admin UI page reports. Add admin UI for creating a domain block	8 years ago
Eugen Rochko	e8875c6046	Import feature for following/blocking lists (addresses #62, #177, #201, #454)	8 years ago
Eugen Rochko	6b81d10030	Add digest e-mails	8 years ago
Eugen Rochko	40a4053732	Disable PuSH for blocked domains	8 years ago
Eugen Rochko	720ff55262	Adding more unit tests. Fixing Salmon slaps XML	8 years ago
Eugen Rochko	db814543c0	Take out private toot distribution out of PuSH again	8 years ago
Eugen Rochko	446aad4ce2	Make PuSH only distribute to subscriptions that match follower domains ... Allow PuSH to distribute private toots with that condition	8 years ago
Eugen Rochko	00b5731ecb	After FollowService, re-fetch remote account asynchronously, do nothing ... if account lock info was up to date, otherwise re-do the FollowService with now updated information	8 years ago